May 20 14:06:25.894491 ip-10-0-142-164 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 20 14:06:25.894504 ip-10-0-142-164 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 20 14:06:25.894514 ip-10-0-142-164 systemd[1]: kubelet.service: Failed with result 'resources'. May 20 14:06:25.894794 ip-10-0-142-164 systemd[1]: Failed to start Kubernetes Kubelet. May 20 14:06:37.078722 ip-10-0-142-164 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 20 14:06:37.078740 ip-10-0-142-164 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 9615b9a354934abe8a12cb04e88401c8 -- May 20 14:09:00.132062 ip-10-0-142-164 systemd[1]: Starting Kubernetes Kubelet... May 20 14:09:00.610537 ip-10-0-142-164 kubenswrapper[2551]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 20 14:09:00.610537 ip-10-0-142-164 kubenswrapper[2551]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 20 14:09:00.610537 ip-10-0-142-164 kubenswrapper[2551]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 20 14:09:00.610537 ip-10-0-142-164 kubenswrapper[2551]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 20 14:09:00.610537 ip-10-0-142-164 kubenswrapper[2551]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 20 14:09:00.612091 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.612005 2551 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 20 14:09:00.615463 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615446 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 20 14:09:00.615463 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615464 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 20 14:09:00.615531 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615468 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability May 20 14:09:00.615531 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615471 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 20 14:09:00.615531 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615476 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 20 14:09:00.615531 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615479 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 20 14:09:00.615531 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615483 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 20 14:09:00.615531 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615486 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 20 14:09:00.615531 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615488 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 20 14:09:00.615531 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615491 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 20 14:09:00.615531 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615494 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 20 14:09:00.615531 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615496 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 20 14:09:00.615531 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615499 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 20 14:09:00.615531 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615502 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 20 14:09:00.615531 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615505 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 20 14:09:00.615531 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615507 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 20 14:09:00.615531 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615510 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 20 14:09:00.615531 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615513 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 20 14:09:00.615531 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615515 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 20 14:09:00.615531 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615518 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 20 14:09:00.615531 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615521 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 20 14:09:00.615531 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615524 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 20 14:09:00.616021 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615526 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 20 14:09:00.616021 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615529 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 20 14:09:00.616021 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615532 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 20 14:09:00.616021 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615535 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 20 14:09:00.616021 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615539 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 20 14:09:00.616021 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615542 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 20 14:09:00.616021 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615545 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 20 14:09:00.616021 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615547 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 20 14:09:00.616021 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615556 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 20 14:09:00.616021 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615559 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 20 14:09:00.616021 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615563 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 20 14:09:00.616021 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615565 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 20 14:09:00.616021 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615568 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 20 14:09:00.616021 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615571 2551 feature_gate.go:328] unrecognized feature gate: DualReplica May 20 14:09:00.616021 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615573 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores May 20 14:09:00.616021 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615576 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 20 14:09:00.616021 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615578 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 20 14:09:00.616021 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615581 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages May 20 14:09:00.616021 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615583 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 20 14:09:00.616021 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615586 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 20 14:09:00.616624 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615588 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 20 14:09:00.616624 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615591 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 20 14:09:00.616624 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615593 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 20 14:09:00.616624 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615595 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 20 14:09:00.616624 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615598 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 20 14:09:00.616624 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615601 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 20 14:09:00.616624 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615603 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 20 14:09:00.616624 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615606 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 20 14:09:00.616624 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615608 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 20 14:09:00.616624 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615612 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 20 14:09:00.616624 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615616 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 20 14:09:00.616624 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615618 2551 feature_gate.go:328] unrecognized feature gate: NewOLM May 20 14:09:00.616624 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615621 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 20 14:09:00.616624 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615624 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 20 14:09:00.616624 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615626 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 20 14:09:00.616624 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615628 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 20 14:09:00.616624 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615631 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 20 14:09:00.616624 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615633 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 20 14:09:00.616624 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615636 2551 feature_gate.go:328] unrecognized feature gate: Example May 20 14:09:00.616624 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615639 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 20 14:09:00.617352 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615641 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 20 14:09:00.617352 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615650 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 20 14:09:00.617352 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615652 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 20 14:09:00.617352 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615655 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 20 14:09:00.617352 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615657 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 20 14:09:00.617352 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615660 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 20 14:09:00.617352 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615662 2551 feature_gate.go:328] unrecognized feature gate: Example2 May 20 14:09:00.617352 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615665 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 20 14:09:00.617352 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615667 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 20 14:09:00.617352 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615669 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 20 14:09:00.617352 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615672 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 20 14:09:00.617352 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615674 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 20 14:09:00.617352 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615677 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 20 14:09:00.617352 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615679 2551 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 20 14:09:00.617352 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615682 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 20 14:09:00.617352 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615686 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 20 14:09:00.617352 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615689 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 20 14:09:00.617352 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615693 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 20 14:09:00.617352 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615696 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 20 14:09:00.617828 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615698 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 20 14:09:00.617828 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615701 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 20 14:09:00.617828 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615703 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 20 14:09:00.617828 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615706 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 20 14:09:00.617828 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.615709 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 20 14:09:00.617828 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.616185 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 20 14:09:00.617828 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.616190 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 20 14:09:00.617828 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.616193 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 20 14:09:00.617828 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.616195 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 20 14:09:00.617828 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.616199 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 20 14:09:00.617828 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.616201 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 20 14:09:00.617828 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.616204 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 20 14:09:00.617828 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.616207 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 20 14:09:00.617828 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.616209 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 20 14:09:00.617828 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.616266 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 20 14:09:00.617828 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.616321 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 20 14:09:00.617828 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.616325 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 20 14:09:00.617828 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.616328 2551 feature_gate.go:328] unrecognized feature gate: DualReplica May 20 14:09:00.617828 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.616331 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 20 14:09:00.617828 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.616334 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 20 14:09:00.618396 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.616337 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 20 14:09:00.618396 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617294 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 20 14:09:00.618396 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617304 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 20 14:09:00.618396 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617309 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 20 14:09:00.618396 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617313 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 20 14:09:00.618396 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617318 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 20 14:09:00.618396 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617323 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 20 14:09:00.618396 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617327 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 20 14:09:00.618396 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617338 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 20 14:09:00.618396 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617342 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 20 14:09:00.618396 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617346 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 20 14:09:00.618396 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617357 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 20 14:09:00.618396 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617409 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 20 14:09:00.618396 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617538 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 20 14:09:00.618396 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617544 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 20 14:09:00.618396 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617549 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 20 14:09:00.618396 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617552 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 20 14:09:00.618396 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617555 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 20 14:09:00.618396 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617558 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 20 14:09:00.618886 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617561 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 20 14:09:00.618886 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617564 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 20 14:09:00.618886 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617566 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 20 14:09:00.618886 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617569 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 20 14:09:00.618886 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617574 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 20 14:09:00.618886 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617579 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 20 14:09:00.618886 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617582 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 20 14:09:00.618886 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617585 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 20 14:09:00.618886 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617589 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 20 14:09:00.618886 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617595 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 20 14:09:00.618886 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617600 2551 feature_gate.go:328] unrecognized feature gate: NewOLM May 20 14:09:00.618886 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617603 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 20 14:09:00.618886 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617606 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 20 14:09:00.618886 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617608 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 20 14:09:00.618886 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617611 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 20 14:09:00.618886 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617614 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability May 20 14:09:00.618886 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617617 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 20 14:09:00.618886 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617619 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 20 14:09:00.618886 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617622 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 20 14:09:00.618886 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617625 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 20 14:09:00.619368 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617628 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 20 14:09:00.619368 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617630 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 20 14:09:00.619368 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617633 2551 feature_gate.go:328] unrecognized feature gate: Example May 20 14:09:00.619368 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617636 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 20 14:09:00.619368 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617638 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 20 14:09:00.619368 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617641 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages May 20 14:09:00.619368 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617644 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 20 14:09:00.619368 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617647 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 20 14:09:00.619368 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617650 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 20 14:09:00.619368 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617654 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 20 14:09:00.619368 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617658 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 20 14:09:00.619368 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617661 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 20 14:09:00.619368 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617664 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 20 14:09:00.619368 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617667 2551 feature_gate.go:328] unrecognized feature gate: Example2 May 20 14:09:00.619368 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617670 2551 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 20 14:09:00.619368 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617672 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 20 14:09:00.619368 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617675 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 20 14:09:00.619368 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617678 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 20 14:09:00.619368 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617681 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 20 14:09:00.619368 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617684 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 20 14:09:00.619868 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617687 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 20 14:09:00.619868 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617690 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 20 14:09:00.619868 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617692 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 20 14:09:00.619868 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617695 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 20 14:09:00.619868 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617698 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 20 14:09:00.619868 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617700 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 20 14:09:00.619868 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617703 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 20 14:09:00.619868 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617706 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 20 14:09:00.619868 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617709 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 20 14:09:00.619868 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617711 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 20 14:09:00.619868 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617716 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores May 20 14:09:00.619868 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.617718 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 20 14:09:00.619868 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617808 2551 flags.go:64] FLAG: --address="0.0.0.0" May 20 14:09:00.619868 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617817 2551 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 20 14:09:00.619868 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617828 2551 flags.go:64] FLAG: --anonymous-auth="true" May 20 14:09:00.619868 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617833 2551 flags.go:64] FLAG: --application-metrics-count-limit="100" May 20 14:09:00.619868 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617837 2551 flags.go:64] FLAG: --authentication-token-webhook="false" May 20 14:09:00.619868 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617841 2551 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 20 14:09:00.619868 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617846 2551 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 20 14:09:00.619868 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617853 2551 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 20 14:09:00.619868 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617856 2551 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 20 14:09:00.620380 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617859 2551 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 20 14:09:00.620380 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617863 2551 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 20 14:09:00.620380 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617866 2551 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 20 14:09:00.620380 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617870 2551 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 20 14:09:00.620380 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617873 2551 flags.go:64] FLAG: --cgroup-root="" May 20 14:09:00.620380 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617876 2551 flags.go:64] FLAG: --cgroups-per-qos="true" May 20 14:09:00.620380 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617879 2551 flags.go:64] FLAG: --client-ca-file="" May 20 14:09:00.620380 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617881 2551 flags.go:64] FLAG: --cloud-config="" May 20 14:09:00.620380 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617884 2551 flags.go:64] FLAG: --cloud-provider="external" May 20 14:09:00.620380 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617888 2551 flags.go:64] FLAG: --cluster-dns="[]" May 20 14:09:00.620380 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617892 2551 flags.go:64] FLAG: --cluster-domain="" May 20 14:09:00.620380 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617895 2551 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 20 14:09:00.620380 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617898 2551 flags.go:64] FLAG: --config-dir="" May 20 14:09:00.620380 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617901 2551 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 20 14:09:00.620380 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617905 2551 flags.go:64] FLAG: --container-log-max-files="5" May 20 14:09:00.620380 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617909 2551 flags.go:64] FLAG: --container-log-max-size="10Mi" May 20 14:09:00.620380 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617912 2551 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 20 14:09:00.620380 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617915 2551 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 20 14:09:00.620380 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617918 2551 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 20 14:09:00.620380 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617921 2551 flags.go:64] FLAG: --contention-profiling="false" May 20 14:09:00.620380 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617924 2551 flags.go:64] FLAG: --cpu-cfs-quota="true" May 20 14:09:00.620380 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617927 2551 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 20 14:09:00.620380 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617930 2551 flags.go:64] FLAG: --cpu-manager-policy="none" May 20 14:09:00.620380 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617933 2551 flags.go:64] FLAG: --cpu-manager-policy-options="" May 20 14:09:00.620380 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617938 2551 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 20 14:09:00.621035 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617941 2551 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 20 14:09:00.621035 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617944 2551 flags.go:64] FLAG: --enable-debugging-handlers="true" May 20 14:09:00.621035 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617947 2551 flags.go:64] FLAG: --enable-load-reader="false" May 20 14:09:00.621035 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617950 2551 flags.go:64] FLAG: --enable-server="true" May 20 14:09:00.621035 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617953 2551 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 20 14:09:00.621035 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617958 2551 flags.go:64] FLAG: --event-burst="100" May 20 14:09:00.621035 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617961 2551 flags.go:64] FLAG: --event-qps="50" May 20 14:09:00.621035 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617964 2551 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 20 14:09:00.621035 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617967 2551 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 20 14:09:00.621035 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617970 2551 flags.go:64] FLAG: --eviction-hard="" May 20 14:09:00.621035 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617974 2551 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 20 14:09:00.621035 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617977 2551 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 20 14:09:00.621035 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617980 2551 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 20 14:09:00.621035 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617983 2551 flags.go:64] FLAG: --eviction-soft="" May 20 14:09:00.621035 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617986 2551 flags.go:64] FLAG: --eviction-soft-grace-period="" May 20 14:09:00.621035 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617989 2551 flags.go:64] FLAG: --exit-on-lock-contention="false" May 20 14:09:00.621035 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617992 2551 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 20 14:09:00.621035 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617995 2551 flags.go:64] FLAG: --experimental-mounter-path="" May 20 14:09:00.621035 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.617998 2551 flags.go:64] FLAG: --fail-cgroupv1="false" May 20 14:09:00.621035 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618001 2551 flags.go:64] FLAG: --fail-swap-on="true" May 20 14:09:00.621035 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618003 2551 flags.go:64] FLAG: --feature-gates="" May 20 14:09:00.621035 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618007 2551 flags.go:64] FLAG: --file-check-frequency="20s" May 20 14:09:00.621035 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618010 2551 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 20 14:09:00.621035 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618013 2551 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 20 14:09:00.621035 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618016 2551 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 20 14:09:00.621637 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618019 2551 flags.go:64] FLAG: --healthz-port="10248" May 20 14:09:00.621637 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618022 2551 flags.go:64] FLAG: --help="false" May 20 14:09:00.621637 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618025 2551 flags.go:64] FLAG: --hostname-override="ip-10-0-142-164.ec2.internal" May 20 14:09:00.621637 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618029 2551 flags.go:64] FLAG: --housekeeping-interval="10s" May 20 14:09:00.621637 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618032 2551 flags.go:64] FLAG: --http-check-frequency="20s" May 20 14:09:00.621637 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618035 2551 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 20 14:09:00.621637 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618038 2551 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 20 14:09:00.621637 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618042 2551 flags.go:64] FLAG: --image-gc-high-threshold="85" May 20 14:09:00.621637 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618046 2551 flags.go:64] FLAG: --image-gc-low-threshold="80" May 20 14:09:00.621637 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618049 2551 flags.go:64] FLAG: --image-service-endpoint="" May 20 14:09:00.621637 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618053 2551 flags.go:64] FLAG: --kernel-memcg-notification="false" May 20 14:09:00.621637 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618056 2551 flags.go:64] FLAG: --kube-api-burst="100" May 20 14:09:00.621637 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618059 2551 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 20 14:09:00.621637 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618062 2551 flags.go:64] FLAG: --kube-api-qps="50" May 20 14:09:00.621637 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618065 2551 flags.go:64] FLAG: --kube-reserved="" May 20 14:09:00.621637 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618068 2551 flags.go:64] FLAG: --kube-reserved-cgroup="" May 20 14:09:00.621637 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618071 2551 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 20 14:09:00.621637 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618074 2551 flags.go:64] FLAG: --kubelet-cgroups="" May 20 14:09:00.621637 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618078 2551 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 20 14:09:00.621637 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618081 2551 flags.go:64] FLAG: --lock-file="" May 20 14:09:00.621637 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618084 2551 flags.go:64] FLAG: --log-cadvisor-usage="false" May 20 14:09:00.621637 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618086 2551 flags.go:64] FLAG: --log-flush-frequency="5s" May 20 14:09:00.621637 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618089 2551 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 20 14:09:00.621637 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618099 2551 flags.go:64] FLAG: --log-json-split-stream="false" May 20 14:09:00.622223 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618102 2551 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 20 14:09:00.622223 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618105 2551 flags.go:64] FLAG: --log-text-split-stream="false" May 20 14:09:00.622223 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618108 2551 flags.go:64] FLAG: --logging-format="text" May 20 14:09:00.622223 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618111 2551 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 20 14:09:00.622223 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618115 2551 flags.go:64] FLAG: --make-iptables-util-chains="true" May 20 14:09:00.622223 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618118 2551 flags.go:64] FLAG: --manifest-url="" May 20 14:09:00.622223 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618121 2551 flags.go:64] FLAG: --manifest-url-header="" May 20 14:09:00.622223 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618125 2551 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 20 14:09:00.622223 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618128 2551 flags.go:64] FLAG: --max-open-files="1000000" May 20 14:09:00.622223 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618132 2551 flags.go:64] FLAG: --max-pods="110" May 20 14:09:00.622223 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618135 2551 flags.go:64] FLAG: --maximum-dead-containers="-1" May 20 14:09:00.622223 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618138 2551 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 20 14:09:00.622223 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618141 2551 flags.go:64] FLAG: --memory-manager-policy="None" May 20 14:09:00.622223 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618144 2551 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 20 14:09:00.622223 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618147 2551 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 20 14:09:00.622223 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618150 2551 flags.go:64] FLAG: --node-ip="0.0.0.0" May 20 14:09:00.622223 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618153 2551 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 20 14:09:00.622223 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618162 2551 flags.go:64] FLAG: --node-status-max-images="50" May 20 14:09:00.622223 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618165 2551 flags.go:64] FLAG: --node-status-update-frequency="10s" May 20 14:09:00.622223 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618169 2551 flags.go:64] FLAG: --oom-score-adj="-999" May 20 14:09:00.622223 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618172 2551 flags.go:64] FLAG: --pod-cidr="" May 20 14:09:00.622223 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618175 2551 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 20 14:09:00.622223 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618181 2551 flags.go:64] FLAG: --pod-manifest-path="" May 20 14:09:00.622837 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618184 2551 flags.go:64] FLAG: --pod-max-pids="-1" May 20 14:09:00.622837 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618187 2551 flags.go:64] FLAG: --pods-per-core="0" May 20 14:09:00.622837 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618190 2551 flags.go:64] FLAG: --port="10250" May 20 14:09:00.622837 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618193 2551 flags.go:64] FLAG: --protect-kernel-defaults="false" May 20 14:09:00.622837 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618196 2551 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06fece968ef6570af" May 20 14:09:00.622837 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618199 2551 flags.go:64] FLAG: --qos-reserved="" May 20 14:09:00.622837 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618202 2551 flags.go:64] FLAG: --read-only-port="10255" May 20 14:09:00.622837 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618205 2551 flags.go:64] FLAG: --register-node="true" May 20 14:09:00.622837 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618208 2551 flags.go:64] FLAG: --register-schedulable="true" May 20 14:09:00.622837 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618211 2551 flags.go:64] FLAG: --register-with-taints="" May 20 14:09:00.622837 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618215 2551 flags.go:64] FLAG: --registry-burst="10" May 20 14:09:00.622837 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618218 2551 flags.go:64] FLAG: --registry-qps="5" May 20 14:09:00.622837 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618221 2551 flags.go:64] FLAG: --reserved-cpus="" May 20 14:09:00.622837 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618223 2551 flags.go:64] FLAG: --reserved-memory="" May 20 14:09:00.622837 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618227 2551 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 20 14:09:00.622837 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618230 2551 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 20 14:09:00.622837 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618233 2551 flags.go:64] FLAG: --rotate-certificates="false" May 20 14:09:00.622837 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618236 2551 flags.go:64] FLAG: --rotate-server-certificates="false" May 20 14:09:00.622837 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618239 2551 flags.go:64] FLAG: --runonce="false" May 20 14:09:00.622837 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618242 2551 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 20 14:09:00.622837 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618246 2551 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 20 14:09:00.622837 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618250 2551 flags.go:64] FLAG: --seccomp-default="false" May 20 14:09:00.622837 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618253 2551 flags.go:64] FLAG: --serialize-image-pulls="true" May 20 14:09:00.622837 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618256 2551 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 20 14:09:00.622837 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618259 2551 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 20 14:09:00.622837 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618262 2551 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 20 14:09:00.623465 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618265 2551 flags.go:64] FLAG: --storage-driver-password="root" May 20 14:09:00.623465 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618268 2551 flags.go:64] FLAG: --storage-driver-secure="false" May 20 14:09:00.623465 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618271 2551 flags.go:64] FLAG: --storage-driver-table="stats" May 20 14:09:00.623465 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618274 2551 flags.go:64] FLAG: --storage-driver-user="root" May 20 14:09:00.623465 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618277 2551 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 20 14:09:00.623465 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618280 2551 flags.go:64] FLAG: --sync-frequency="1m0s" May 20 14:09:00.623465 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618283 2551 flags.go:64] FLAG: --system-cgroups="" May 20 14:09:00.623465 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618286 2551 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 20 14:09:00.623465 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618292 2551 flags.go:64] FLAG: --system-reserved-cgroup="" May 20 14:09:00.623465 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618294 2551 flags.go:64] FLAG: --tls-cert-file="" May 20 14:09:00.623465 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618297 2551 flags.go:64] FLAG: --tls-cipher-suites="[]" May 20 14:09:00.623465 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618303 2551 flags.go:64] FLAG: --tls-min-version="" May 20 14:09:00.623465 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618306 2551 flags.go:64] FLAG: --tls-private-key-file="" May 20 14:09:00.623465 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618309 2551 flags.go:64] FLAG: --topology-manager-policy="none" May 20 14:09:00.623465 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618312 2551 flags.go:64] FLAG: --topology-manager-policy-options="" May 20 14:09:00.623465 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618315 2551 flags.go:64] FLAG: --topology-manager-scope="container" May 20 14:09:00.623465 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618318 2551 flags.go:64] FLAG: --v="2" May 20 14:09:00.623465 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618326 2551 flags.go:64] FLAG: --version="false" May 20 14:09:00.623465 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618331 2551 flags.go:64] FLAG: --vmodule="" May 20 14:09:00.623465 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618335 2551 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 20 14:09:00.623465 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.618338 2551 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 20 14:09:00.623465 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618431 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 20 14:09:00.623465 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618434 2551 feature_gate.go:328] unrecognized feature gate: NewOLM May 20 14:09:00.623465 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618437 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 20 14:09:00.624075 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618440 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 20 14:09:00.624075 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618443 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 20 14:09:00.624075 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618446 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 20 14:09:00.624075 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618449 2551 feature_gate.go:328] unrecognized feature gate: Example2 May 20 14:09:00.624075 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618452 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 20 14:09:00.624075 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618454 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 20 14:09:00.624075 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618457 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 20 14:09:00.624075 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618460 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 20 14:09:00.624075 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618463 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 20 14:09:00.624075 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618466 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 20 14:09:00.624075 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618469 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 20 14:09:00.624075 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618472 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 20 14:09:00.624075 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618475 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 20 14:09:00.624075 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618477 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 20 14:09:00.624075 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618480 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 20 14:09:00.624075 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618483 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 20 14:09:00.624075 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618485 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 20 14:09:00.624075 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618488 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 20 14:09:00.624075 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618490 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 20 14:09:00.624075 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618493 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 20 14:09:00.624574 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618495 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 20 14:09:00.624574 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618498 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 20 14:09:00.624574 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618500 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 20 14:09:00.624574 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618503 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability May 20 14:09:00.624574 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618507 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 20 14:09:00.624574 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618510 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 20 14:09:00.624574 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618514 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 20 14:09:00.624574 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618517 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 20 14:09:00.624574 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618520 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 20 14:09:00.624574 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618523 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 20 14:09:00.624574 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618525 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 20 14:09:00.624574 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618528 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 20 14:09:00.624574 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618531 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages May 20 14:09:00.624574 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618533 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 20 14:09:00.624574 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618536 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 20 14:09:00.624574 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618539 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 20 14:09:00.624574 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618542 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 20 14:09:00.624574 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618545 2551 feature_gate.go:328] unrecognized feature gate: DualReplica May 20 14:09:00.624574 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618547 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 20 14:09:00.624574 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618550 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 20 14:09:00.625066 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618553 2551 feature_gate.go:328] unrecognized feature gate: Example May 20 14:09:00.625066 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618556 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 20 14:09:00.625066 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618558 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 20 14:09:00.625066 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618561 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 20 14:09:00.625066 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618564 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 20 14:09:00.625066 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618567 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 20 14:09:00.625066 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618569 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 20 14:09:00.625066 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618572 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 20 14:09:00.625066 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618574 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 20 14:09:00.625066 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618577 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 20 14:09:00.625066 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618579 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 20 14:09:00.625066 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618582 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 20 14:09:00.625066 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618585 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 20 14:09:00.625066 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618587 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores May 20 14:09:00.625066 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618590 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 20 14:09:00.625066 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618593 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 20 14:09:00.625066 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618595 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 20 14:09:00.625066 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618598 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 20 14:09:00.625066 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618600 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 20 14:09:00.625066 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618603 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 20 14:09:00.625557 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618606 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 20 14:09:00.625557 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618608 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 20 14:09:00.625557 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618611 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 20 14:09:00.625557 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618613 2551 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 20 14:09:00.625557 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618616 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 20 14:09:00.625557 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618623 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 20 14:09:00.625557 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618628 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 20 14:09:00.625557 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618632 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 20 14:09:00.625557 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618635 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 20 14:09:00.625557 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618638 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 20 14:09:00.625557 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618640 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 20 14:09:00.625557 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618643 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 20 14:09:00.625557 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618646 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 20 14:09:00.625557 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618649 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 20 14:09:00.625557 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618651 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 20 14:09:00.625557 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618653 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 20 14:09:00.625557 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618657 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 20 14:09:00.625557 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618660 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 20 14:09:00.625557 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618662 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 20 14:09:00.626033 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618665 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 20 14:09:00.626033 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618667 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 20 14:09:00.626033 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618670 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 20 14:09:00.626033 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.618673 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 20 14:09:00.626033 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.619453 2551 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 20 14:09:00.626569 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.626451 2551 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 20 14:09:00.626602 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.626571 2551 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 20 14:09:00.626635 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626621 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 20 14:09:00.626635 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626627 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 20 14:09:00.626635 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626632 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 20 14:09:00.626635 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626635 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 20 14:09:00.626736 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626639 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 20 14:09:00.626736 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626642 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 20 14:09:00.626736 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626645 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 20 14:09:00.626736 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626648 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 20 14:09:00.626736 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626651 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 20 14:09:00.626736 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626654 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 20 14:09:00.626736 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626658 2551 feature_gate.go:328] unrecognized feature gate: NewOLM May 20 14:09:00.626736 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626660 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 20 14:09:00.626736 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626663 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages May 20 14:09:00.626736 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626666 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 20 14:09:00.626736 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626669 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 20 14:09:00.626736 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626671 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 20 14:09:00.626736 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626674 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores May 20 14:09:00.626736 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626677 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 20 14:09:00.626736 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626679 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 20 14:09:00.626736 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626682 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 20 14:09:00.626736 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626684 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 20 14:09:00.626736 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626687 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 20 14:09:00.626736 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626691 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 20 14:09:00.626736 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626695 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 20 14:09:00.627231 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626698 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability May 20 14:09:00.627231 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626701 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 20 14:09:00.627231 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626704 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 20 14:09:00.627231 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626706 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 20 14:09:00.627231 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626709 2551 feature_gate.go:328] unrecognized feature gate: DualReplica May 20 14:09:00.627231 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626711 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 20 14:09:00.627231 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626714 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 20 14:09:00.627231 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626717 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 20 14:09:00.627231 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626720 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 20 14:09:00.627231 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626723 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 20 14:09:00.627231 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626725 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 20 14:09:00.627231 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626728 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 20 14:09:00.627231 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626731 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 20 14:09:00.627231 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626735 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 20 14:09:00.627231 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626738 2551 feature_gate.go:328] unrecognized feature gate: Example2 May 20 14:09:00.627231 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626741 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 20 14:09:00.627231 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626744 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 20 14:09:00.627231 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626747 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 20 14:09:00.627231 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626750 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 20 14:09:00.627231 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626752 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 20 14:09:00.627748 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626755 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 20 14:09:00.627748 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626757 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 20 14:09:00.627748 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626760 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 20 14:09:00.627748 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626764 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 20 14:09:00.627748 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626768 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 20 14:09:00.627748 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626771 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 20 14:09:00.627748 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626774 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 20 14:09:00.627748 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626777 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 20 14:09:00.627748 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626779 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 20 14:09:00.627748 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626795 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 20 14:09:00.627748 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626799 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 20 14:09:00.627748 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626803 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 20 14:09:00.627748 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626806 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 20 14:09:00.627748 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626811 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 20 14:09:00.627748 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626814 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 20 14:09:00.627748 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626817 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 20 14:09:00.627748 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626820 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 20 14:09:00.627748 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626822 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 20 14:09:00.627748 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626825 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 20 14:09:00.628244 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626828 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 20 14:09:00.628244 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626832 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 20 14:09:00.628244 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626835 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 20 14:09:00.628244 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626838 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 20 14:09:00.628244 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626840 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 20 14:09:00.628244 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626844 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 20 14:09:00.628244 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626846 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 20 14:09:00.628244 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626850 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 20 14:09:00.628244 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626853 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 20 14:09:00.628244 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626855 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 20 14:09:00.628244 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626858 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 20 14:09:00.628244 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626860 2551 feature_gate.go:328] unrecognized feature gate: Example May 20 14:09:00.628244 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626863 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 20 14:09:00.628244 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626866 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 20 14:09:00.628244 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626869 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 20 14:09:00.628244 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626871 2551 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 20 14:09:00.628244 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626874 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 20 14:09:00.628244 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626877 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 20 14:09:00.628244 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626880 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 20 14:09:00.628704 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626882 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 20 14:09:00.628704 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626885 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 20 14:09:00.628704 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626887 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 20 14:09:00.628704 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.626890 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 20 14:09:00.628704 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.626895 2551 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 20 14:09:00.628704 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627031 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 20 14:09:00.628704 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627036 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 20 14:09:00.628704 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627039 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 20 14:09:00.628704 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627042 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 20 14:09:00.628704 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627045 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 20 14:09:00.628704 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627048 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 20 14:09:00.628704 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627050 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 20 14:09:00.628704 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627053 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 20 14:09:00.628704 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627055 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 20 14:09:00.628704 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627058 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 20 14:09:00.628704 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627061 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 20 14:09:00.629098 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627064 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 20 14:09:00.629098 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627067 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 20 14:09:00.629098 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627071 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 20 14:09:00.629098 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627076 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores May 20 14:09:00.629098 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627079 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 20 14:09:00.629098 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627082 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 20 14:09:00.629098 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627086 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 20 14:09:00.629098 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627089 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 20 14:09:00.629098 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627092 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 20 14:09:00.629098 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627095 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 20 14:09:00.629098 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627098 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 20 14:09:00.629098 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627101 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 20 14:09:00.629098 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627104 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 20 14:09:00.629098 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627106 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 20 14:09:00.629098 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627109 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 20 14:09:00.629098 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627112 2551 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 20 14:09:00.629098 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627114 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 20 14:09:00.629098 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627117 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 20 14:09:00.629098 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627120 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability May 20 14:09:00.629599 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627122 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 20 14:09:00.629599 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627125 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 20 14:09:00.629599 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627127 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 20 14:09:00.629599 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627130 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 20 14:09:00.629599 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627132 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 20 14:09:00.629599 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627135 2551 feature_gate.go:328] unrecognized feature gate: NewOLM May 20 14:09:00.629599 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627137 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 20 14:09:00.629599 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627140 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 20 14:09:00.629599 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627142 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 20 14:09:00.629599 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627144 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 20 14:09:00.629599 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627147 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 20 14:09:00.629599 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627149 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 20 14:09:00.629599 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627152 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 20 14:09:00.629599 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627155 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 20 14:09:00.629599 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627158 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 20 14:09:00.629599 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627161 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 20 14:09:00.629599 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627164 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 20 14:09:00.629599 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627167 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 20 14:09:00.629599 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627169 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 20 14:09:00.629599 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627172 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 20 14:09:00.630107 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627174 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 20 14:09:00.630107 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627177 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 20 14:09:00.630107 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627180 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 20 14:09:00.630107 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627182 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 20 14:09:00.630107 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627185 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 20 14:09:00.630107 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627188 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 20 14:09:00.630107 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627192 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 20 14:09:00.630107 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627195 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 20 14:09:00.630107 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627197 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 20 14:09:00.630107 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627200 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 20 14:09:00.630107 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627202 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 20 14:09:00.630107 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627205 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 20 14:09:00.630107 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627207 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 20 14:09:00.630107 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627210 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 20 14:09:00.630107 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627213 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages May 20 14:09:00.630107 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627215 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 20 14:09:00.630107 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627218 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 20 14:09:00.630107 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627220 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 20 14:09:00.630107 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627223 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 20 14:09:00.630561 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627225 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 20 14:09:00.630561 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627228 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 20 14:09:00.630561 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627230 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 20 14:09:00.630561 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627233 2551 feature_gate.go:328] unrecognized feature gate: DualReplica May 20 14:09:00.630561 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627236 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 20 14:09:00.630561 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627239 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 20 14:09:00.630561 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627241 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 20 14:09:00.630561 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627245 2551 feature_gate.go:328] unrecognized feature gate: Example May 20 14:09:00.630561 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627248 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 20 14:09:00.630561 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627251 2551 feature_gate.go:328] unrecognized feature gate: Example2 May 20 14:09:00.630561 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627253 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 20 14:09:00.630561 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627256 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 20 14:09:00.630561 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627258 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 20 14:09:00.630561 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627261 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 20 14:09:00.630561 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627263 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 20 14:09:00.630561 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627266 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 20 14:09:00.630561 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:00.627269 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 20 14:09:00.630998 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.627273 2551 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 20 14:09:00.630998 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.628118 2551 server.go:962] "Client rotation is on, will bootstrap in background" May 20 14:09:00.631581 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.631567 2551 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 20 14:09:00.634203 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.634192 2551 server.go:1019] "Starting client certificate rotation" May 20 14:09:00.634305 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.634292 2551 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 20 14:09:00.634339 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.634330 2551 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 20 14:09:00.662293 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.662269 2551 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 20 14:09:00.663392 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.663374 2551 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 20 14:09:00.679815 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.679776 2551 log.go:25] "Validated CRI v1 runtime API" May 20 14:09:00.684886 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.684872 2551 log.go:25] "Validated CRI v1 image API" May 20 14:09:00.686271 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.686246 2551 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 20 14:09:00.690404 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.690382 2551 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 20 14:09:00.694513 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.694488 2551 fs.go:135] Filesystem UUIDs: map[4af5ce4c-a5cc-4121-93c8-85c88ec3d43f:/dev/nvme0n1p3 5e18e8e8-63e8-483a-9ee4-e2e55222a7af:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] May 20 14:09:00.694589 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.694513 2551 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 20 14:09:00.698863 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.698729 2551 manager.go:217] Machine: {Timestamp:2026-05-20 14:09:00.698235012 +0000 UTC m=+0.438532917 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099585 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25cf27b9886b3dbc877f67d9dace46 SystemUUID:ec25cf27-b988-6b3d-bc87-7f67d9dace46 BootID:9615b9a3-5493-4abe-8a12-cb04e88401c8 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4c:af:51:f0:9b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4c:af:51:f0:9b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a2:3c:82:de:a1:a9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 20 14:09:00.699714 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.699701 2551 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 20 14:09:00.699892 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.699875 2551 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 20 14:09:00.701750 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.701724 2551 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 20 14:09:00.701948 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.701752 2551 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-164.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 20 14:09:00.702026 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.701964 2551 topology_manager.go:138] "Creating topology manager with none policy" May 20 14:09:00.702026 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.701978 2551 container_manager_linux.go:306] "Creating device plugin manager" May 20 14:09:00.702026 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.701988 2551 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 20 14:09:00.702026 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.702007 2551 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 20 14:09:00.703182 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.703169 2551 state_mem.go:36] "Initialized new in-memory state store" May 20 14:09:00.703308 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.703297 2551 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 20 14:09:00.705849 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.705839 2551 kubelet.go:491] "Attempting to sync node with API server" May 20 14:09:00.705907 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.705857 2551 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 20 14:09:00.705907 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.705873 2551 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 20 14:09:00.705907 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.705887 2551 kubelet.go:397] "Adding apiserver pod source" May 20 14:09:00.705907 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.705899 2551 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 20 14:09:00.707037 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.707024 2551 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 20 14:09:00.707102 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.707045 2551 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 20 14:09:00.711059 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.711042 2551 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 20 14:09:00.713269 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.713252 2551 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 20 14:09:00.714189 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.714175 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 20 14:09:00.714268 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.714243 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 20 14:09:00.714268 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.714255 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 20 14:09:00.714268 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.714263 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 20 14:09:00.714352 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.714275 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 20 14:09:00.714352 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.714286 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 20 14:09:00.714352 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.714294 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 20 14:09:00.714352 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.714301 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 20 14:09:00.714352 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.714310 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 20 14:09:00.714352 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.714315 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 20 14:09:00.714352 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.714338 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 20 14:09:00.716317 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.716301 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 20 14:09:00.717583 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.717553 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 20 14:09:00.717683 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.717590 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 20 14:09:00.721052 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.721034 2551 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-164.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 20 14:09:00.721660 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.721647 2551 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 20 14:09:00.721746 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.721709 2551 server.go:1295] "Started kubelet" May 20 14:09:00.721807 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:00.721734 2551 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 20 14:09:00.722452 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:00.721734 2551 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-164.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 20 14:09:00.722538 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.722502 2551 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 20 14:09:00.722640 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.722459 2551 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 20 14:09:00.722640 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.722590 2551 server_v1.go:47] "podresources" method="list" useActivePods=true May 20 14:09:00.723405 ip-10-0-142-164 systemd[1]: Started Kubernetes Kubelet. May 20 14:09:00.723894 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.723621 2551 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 20 14:09:00.725843 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.725829 2551 server.go:317] "Adding debug handlers to kubelet server" May 20 14:09:00.728965 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:00.728017 2551 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-164.ec2.internal.18b14b51637d8248 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-164.ec2.internal,UID:ip-10-0-142-164.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-164.ec2.internal,},FirstTimestamp:2026-05-20 14:09:00.721660488 +0000 UTC m=+0.461958398,LastTimestamp:2026-05-20 14:09:00.721660488 +0000 UTC m=+0.461958398,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-164.ec2.internal,}" May 20 14:09:00.730102 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.730086 2551 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 20 14:09:00.730102 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.730096 2551 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 20 14:09:00.730225 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.730157 2551 volume_manager.go:295] "The desired_state_of_world populator starts" May 20 14:09:00.730225 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.730166 2551 volume_manager.go:297] "Starting Kubelet Volume Manager" May 20 14:09:00.730307 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.730246 2551 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 20 14:09:00.730374 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.730360 2551 reconstruct.go:97] "Volume reconstruction finished" May 20 14:09:00.730474 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.730463 2551 reconciler.go:26] "Reconciler: start to sync state" May 20 14:09:00.730853 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:00.730830 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-164.ec2.internal\" not found" May 20 14:09:00.733127 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.733111 2551 factory.go:55] Registering systemd factory May 20 14:09:00.733203 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.733145 2551 factory.go:223] Registration of the systemd container factory successfully May 20 14:09:00.733914 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.733895 2551 factory.go:153] Registering CRI-O factory May 20 14:09:00.733914 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.733917 2551 factory.go:223] Registration of the crio container factory successfully May 20 14:09:00.734048 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.733972 2551 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 20 14:09:00.734048 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.733989 2551 factory.go:103] Registering Raw factory May 20 14:09:00.734048 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.734004 2551 manager.go:1196] Started watching for new ooms in manager May 20 14:09:00.734419 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.734404 2551 manager.go:319] Starting recovery of all containers May 20 14:09:00.735522 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:00.735500 2551 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 20 14:09:00.735663 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.735646 2551 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wjhdf" May 20 14:09:00.742384 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:00.742362 2551 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-164.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 20 14:09:00.742502 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:00.742474 2551 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 20 14:09:00.743714 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.743685 2551 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wjhdf" May 20 14:09:00.745130 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.745107 2551 manager.go:324] Recovery completed May 20 14:09:00.749874 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.749860 2551 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 14:09:00.751685 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.751670 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-164.ec2.internal" event="NodeHasSufficientMemory" May 20 14:09:00.751770 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.751702 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-164.ec2.internal" event="NodeHasNoDiskPressure" May 20 14:09:00.751770 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.751717 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-164.ec2.internal" event="NodeHasSufficientPID" May 20 14:09:00.752336 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.752323 2551 cpu_manager.go:222] "Starting CPU manager" policy="none" May 20 14:09:00.752336 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.752336 2551 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 20 14:09:00.752450 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.752353 2551 state_mem.go:36] "Initialized new in-memory state store" May 20 14:09:00.754179 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.754165 2551 policy_none.go:49] "None policy: Start" May 20 14:09:00.754251 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.754184 2551 memory_manager.go:186] "Starting memorymanager" policy="None" May 20 14:09:00.754251 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.754197 2551 state_mem.go:35] "Initializing new in-memory state store" May 20 14:09:00.783374 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.783357 2551 manager.go:341] "Starting Device Plugin manager" May 20 14:09:00.783482 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:00.783421 2551 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 20 14:09:00.783482 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.783436 2551 server.go:85] "Starting device plugin registration server" May 20 14:09:00.783689 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.783675 2551 eviction_manager.go:189] "Eviction manager: starting control loop" May 20 14:09:00.783753 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.783692 2551 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 20 14:09:00.783822 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.783796 2551 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 20 14:09:00.783892 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.783882 2551 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 20 14:09:00.783892 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.783892 2551 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 20 14:09:00.784664 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:00.784643 2551 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 20 14:09:00.784733 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:00.784689 2551 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-164.ec2.internal\" not found" May 20 14:09:00.862075 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.861998 2551 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 20 14:09:00.863960 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.863149 2551 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 20 14:09:00.863960 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.863169 2551 status_manager.go:230] "Starting to sync pod status with apiserver" May 20 14:09:00.863960 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.863190 2551 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 20 14:09:00.863960 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.863197 2551 kubelet.go:2451] "Starting kubelet main sync loop" May 20 14:09:00.863960 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:00.863269 2551 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 20 14:09:00.866231 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.866214 2551 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 20 14:09:00.884170 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.884152 2551 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 14:09:00.885030 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.885015 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-164.ec2.internal" event="NodeHasSufficientMemory" May 20 14:09:00.885107 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.885043 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-164.ec2.internal" event="NodeHasNoDiskPressure" May 20 14:09:00.885107 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.885058 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-164.ec2.internal" event="NodeHasSufficientPID" May 20 14:09:00.885107 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.885086 2551 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-164.ec2.internal" May 20 14:09:00.895265 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.895243 2551 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-164.ec2.internal" May 20 14:09:00.895265 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:00.895266 2551 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-164.ec2.internal\": node \"ip-10-0-142-164.ec2.internal\" not found" May 20 14:09:00.911538 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:00.911517 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-164.ec2.internal\" not found" May 20 14:09:00.964022 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.963987 2551 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-164.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-164.ec2.internal"] May 20 14:09:00.964139 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.964063 2551 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 14:09:00.965983 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.965967 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-164.ec2.internal" event="NodeHasSufficientMemory" May 20 14:09:00.966075 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.965999 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-164.ec2.internal" event="NodeHasNoDiskPressure" May 20 14:09:00.966075 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.966012 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-164.ec2.internal" event="NodeHasSufficientPID" May 20 14:09:00.968127 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.968111 2551 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 14:09:00.968252 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.968236 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-164.ec2.internal" May 20 14:09:00.968298 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.968268 2551 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 14:09:00.969110 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.969089 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-164.ec2.internal" event="NodeHasSufficientMemory" May 20 14:09:00.969110 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.969100 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-164.ec2.internal" event="NodeHasSufficientMemory" May 20 14:09:00.969244 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.969119 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-164.ec2.internal" event="NodeHasNoDiskPressure" May 20 14:09:00.969244 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.969122 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-164.ec2.internal" event="NodeHasNoDiskPressure" May 20 14:09:00.969244 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.969139 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-164.ec2.internal" event="NodeHasSufficientPID" May 20 14:09:00.969244 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.969142 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-164.ec2.internal" event="NodeHasSufficientPID" May 20 14:09:00.971158 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.971142 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-164.ec2.internal" May 20 14:09:00.971238 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.971170 2551 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 14:09:00.971858 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.971842 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-164.ec2.internal" event="NodeHasSufficientMemory" May 20 14:09:00.971952 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.971869 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-164.ec2.internal" event="NodeHasNoDiskPressure" May 20 14:09:00.971952 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:00.971882 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-164.ec2.internal" event="NodeHasSufficientPID" May 20 14:09:00.991380 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:00.991361 2551 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-164.ec2.internal\" not found" node="ip-10-0-142-164.ec2.internal" May 20 14:09:00.995536 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:00.995521 2551 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-164.ec2.internal\" not found" node="ip-10-0-142-164.ec2.internal" May 20 14:09:01.012390 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:01.012370 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-164.ec2.internal\" not found" May 20 14:09:01.031685 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:01.031665 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fe2859cafc41e5d23c2ec64bcc15789b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-164.ec2.internal\" (UID: \"fe2859cafc41e5d23c2ec64bcc15789b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-164.ec2.internal" May 20 14:09:01.031754 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:01.031690 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe2859cafc41e5d23c2ec64bcc15789b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-164.ec2.internal\" (UID: \"fe2859cafc41e5d23c2ec64bcc15789b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-164.ec2.internal" May 20 14:09:01.031754 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:01.031706 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9f433c144673f44ac68220eba4eaa3a1-config\") pod \"kube-apiserver-proxy-ip-10-0-142-164.ec2.internal\" (UID: \"9f433c144673f44ac68220eba4eaa3a1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-164.ec2.internal" May 20 14:09:01.113331 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:01.113252 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-164.ec2.internal\" not found" May 20 14:09:01.131988 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:01.131962 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fe2859cafc41e5d23c2ec64bcc15789b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-164.ec2.internal\" (UID: \"fe2859cafc41e5d23c2ec64bcc15789b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-164.ec2.internal" May 20 14:09:01.132108 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:01.131991 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe2859cafc41e5d23c2ec64bcc15789b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-164.ec2.internal\" (UID: \"fe2859cafc41e5d23c2ec64bcc15789b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-164.ec2.internal" May 20 14:09:01.132108 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:01.132007 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9f433c144673f44ac68220eba4eaa3a1-config\") pod \"kube-apiserver-proxy-ip-10-0-142-164.ec2.internal\" (UID: \"9f433c144673f44ac68220eba4eaa3a1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-164.ec2.internal" May 20 14:09:01.132108 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:01.132034 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9f433c144673f44ac68220eba4eaa3a1-config\") pod \"kube-apiserver-proxy-ip-10-0-142-164.ec2.internal\" (UID: \"9f433c144673f44ac68220eba4eaa3a1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-164.ec2.internal" May 20 14:09:01.132108 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:01.132068 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe2859cafc41e5d23c2ec64bcc15789b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-164.ec2.internal\" (UID: \"fe2859cafc41e5d23c2ec64bcc15789b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-164.ec2.internal" May 20 14:09:01.132108 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:01.132064 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fe2859cafc41e5d23c2ec64bcc15789b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-164.ec2.internal\" (UID: \"fe2859cafc41e5d23c2ec64bcc15789b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-164.ec2.internal" May 20 14:09:01.214408 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:01.214373 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-164.ec2.internal\" not found" May 20 14:09:01.293867 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:01.293835 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-164.ec2.internal" May 20 14:09:01.297540 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:01.297520 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-164.ec2.internal" May 20 14:09:01.315119 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:01.315096 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-164.ec2.internal\" not found" May 20 14:09:01.415659 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:01.415569 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-164.ec2.internal\" not found" May 20 14:09:01.516058 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:01.516022 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-164.ec2.internal\" not found" May 20 14:09:01.616535 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:01.616496 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-164.ec2.internal\" not found" May 20 14:09:01.633833 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:01.633808 2551 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 20 14:09:01.633953 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:01.633938 2551 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 20 14:09:01.662322 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:01.662295 2551 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 20 14:09:01.668580 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:01.668539 2551 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 20 14:09:01.712858 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:01.712833 2551 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 20 14:09:01.730752 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:01.730723 2551 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 20 14:09:01.730900 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:01.730756 2551 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-164.ec2.internal" May 20 14:09:01.744419 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:01.744388 2551 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 20 14:09:01.746506 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:01.746482 2551 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-19 14:04:00 +0000 UTC" deadline="2028-01-05 15:09:38.172541458 +0000 UTC" May 20 14:09:01.746584 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:01.746507 2551 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14281h0m36.426038525s" May 20 14:09:01.747263 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:01.747247 2551 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 20 14:09:01.748464 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:01.748451 2551 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-164.ec2.internal" May 20 14:09:01.758325 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:01.758308 2551 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 20 14:09:01.773317 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:01.773293 2551 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2g2cc" May 20 14:09:01.786109 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:01.786082 2551 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2g2cc" May 20 14:09:01.943252 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:01.943087 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f433c144673f44ac68220eba4eaa3a1.slice/crio-23d62f3119ebb1a86c5310d9680a64e460a79d6566481a4a312c0b8f640e7a88 WatchSource:0}: Error finding container 23d62f3119ebb1a86c5310d9680a64e460a79d6566481a4a312c0b8f640e7a88: Status 404 returned error can't find the container with id 23d62f3119ebb1a86c5310d9680a64e460a79d6566481a4a312c0b8f640e7a88 May 20 14:09:01.943478 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:01.943456 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe2859cafc41e5d23c2ec64bcc15789b.slice/crio-18a0a018916a5efe3542afebc421644c8a72799d61723505c91640a53e0934d1 WatchSource:0}: Error finding container 18a0a018916a5efe3542afebc421644c8a72799d61723505c91640a53e0934d1: Status 404 returned error can't find the container with id 18a0a018916a5efe3542afebc421644c8a72799d61723505c91640a53e0934d1 May 20 14:09:01.949368 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:01.949353 2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 20 14:09:02.707308 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.707276 2551 apiserver.go:52] "Watching apiserver" May 20 14:09:02.714958 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.714850 2551 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 20 14:09:02.715296 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.715271 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-69szq","openshift-multus/network-metrics-daemon-m2p6p","openshift-network-operator/iptables-alerter-9lkk5","openshift-image-registry/node-ca-zklgl","openshift-multus/multus-qqv5s","openshift-network-diagnostics/network-check-target-647bg","openshift-ovn-kubernetes/ovnkube-node-ggb6b","kube-system/konnectivity-agent-wl72b","kube-system/kube-apiserver-proxy-ip-10-0-142-164.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhgtf","openshift-cluster-node-tuning-operator/tuned-dswp2","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-164.ec2.internal"] May 20 14:09:02.717898 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.717871 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-69szq" May 20 14:09:02.720491 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.720217 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2p6p" May 20 14:09:02.720491 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:02.720290 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2p6p" podUID="ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb" May 20 14:09:02.720948 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.720677 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 20 14:09:02.720948 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.720733 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 20 14:09:02.720948 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.720812 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gfldp\"" May 20 14:09:02.720948 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.720858 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 20 14:09:02.721198 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.721141 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 20 14:09:02.721477 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.721345 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 20 14:09:02.724857 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.724834 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.727058 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.727036 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wl72b" May 20 14:09:02.727507 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.727168 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhgtf" May 20 14:09:02.727827 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.727744 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 20 14:09:02.728150 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.727975 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wxfgv\"" May 20 14:09:02.728150 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.728082 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 20 14:09:02.728452 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.728399 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 20 14:09:02.728671 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.728650 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 20 14:09:02.728671 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.728668 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 20 14:09:02.728832 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.728775 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 20 14:09:02.729197 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.729152 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 20 14:09:02.729778 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.729758 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 20 14:09:02.729778 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.729774 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 20 14:09:02.729951 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.729865 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 20 14:09:02.730084 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.730032 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 20 14:09:02.730422 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.730390 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nknjr\"" May 20 14:09:02.730609 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.730595 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-tgdp2\"" May 20 14:09:02.732642 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.732360 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9lkk5" May 20 14:09:02.732642 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.732482 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dswp2" May 20 14:09:02.735279 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.735050 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wc4nq\"" May 20 14:09:02.738910 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.738511 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 20 14:09:02.738910 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.738521 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 20 14:09:02.738910 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.738677 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 20 14:09:02.738910 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.738745 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-flnc6\"" May 20 14:09:02.739807 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.739167 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 20 14:09:02.739807 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.739340 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 20 14:09:02.739807 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.739354 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zklgl" May 20 14:09:02.740212 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.740189 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mn8f\" (UniqueName: \"kubernetes.io/projected/30438ca2-f3c2-42e8-9664-2f91f826bc45-kube-api-access-6mn8f\") pod \"tuned-dswp2\" (UID: \"30438ca2-f3c2-42e8-9664-2f91f826bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-dswp2" May 20 14:09:02.740302 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.740239 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7681b0e8-c9eb-405d-a05f-93b077b403ba-etc-selinux\") pod \"aws-ebs-csi-driver-node-vhgtf\" (UID: \"7681b0e8-c9eb-405d-a05f-93b077b403ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhgtf" May 20 14:09:02.740302 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.740275 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b8a30337-47c1-4c73-ad43-87551f5adf02-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-69szq\" (UID: \"b8a30337-47c1-4c73-ad43-87551f5adf02\") " pod="openshift-multus/multus-additional-cni-plugins-69szq" May 20 14:09:02.740433 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.740303 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/30438ca2-f3c2-42e8-9664-2f91f826bc45-etc-modprobe-d\") pod \"tuned-dswp2\" (UID: \"30438ca2-f3c2-42e8-9664-2f91f826bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-dswp2" May 20 14:09:02.740433 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.740363 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-log-socket\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.740433 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.740395 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-host-run-ovn-kubernetes\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.740433 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.740420 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30438ca2-f3c2-42e8-9664-2f91f826bc45-etc-kubernetes\") pod \"tuned-dswp2\" (UID: \"30438ca2-f3c2-42e8-9664-2f91f826bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-dswp2" May 20 14:09:02.740710 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.740445 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/30438ca2-f3c2-42e8-9664-2f91f826bc45-host\") pod \"tuned-dswp2\" (UID: \"30438ca2-f3c2-42e8-9664-2f91f826bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-dswp2" May 20 14:09:02.740710 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.740489 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b8a30337-47c1-4c73-ad43-87551f5adf02-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-69szq\" (UID: \"b8a30337-47c1-4c73-ad43-87551f5adf02\") " pod="openshift-multus/multus-additional-cni-plugins-69szq" May 20 14:09:02.740710 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.740525 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-systemd-units\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.740710 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.740548 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-host-slash\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.740710 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.740570 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7681b0e8-c9eb-405d-a05f-93b077b403ba-socket-dir\") pod \"aws-ebs-csi-driver-node-vhgtf\" (UID: \"7681b0e8-c9eb-405d-a05f-93b077b403ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhgtf" May 20 14:09:02.740710 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.740595 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b8a30337-47c1-4c73-ad43-87551f5adf02-os-release\") pod \"multus-additional-cni-plugins-69szq\" (UID: \"b8a30337-47c1-4c73-ad43-87551f5adf02\") " pod="openshift-multus/multus-additional-cni-plugins-69szq" May 20 14:09:02.740710 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.740619 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-etc-openvswitch\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.740710 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.740641 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/30438ca2-f3c2-42e8-9664-2f91f826bc45-etc-systemd\") pod \"tuned-dswp2\" (UID: \"30438ca2-f3c2-42e8-9664-2f91f826bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-dswp2" May 20 14:09:02.740710 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.740663 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30438ca2-f3c2-42e8-9664-2f91f826bc45-tmp\") pod \"tuned-dswp2\" (UID: \"30438ca2-f3c2-42e8-9664-2f91f826bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-dswp2" May 20 14:09:02.740710 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.740704 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7019fc5d-a470-4b78-9296-bd5d3bfffe65-host-slash\") pod \"iptables-alerter-9lkk5\" (UID: \"7019fc5d-a470-4b78-9296-bd5d3bfffe65\") " pod="openshift-network-operator/iptables-alerter-9lkk5" May 20 14:09:02.741497 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.740729 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-host-cni-netd\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.741497 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.740750 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/30438ca2-f3c2-42e8-9664-2f91f826bc45-etc-sysconfig\") pod \"tuned-dswp2\" (UID: \"30438ca2-f3c2-42e8-9664-2f91f826bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-dswp2" May 20 14:09:02.741497 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.740771 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30438ca2-f3c2-42e8-9664-2f91f826bc45-var-lib-kubelet\") pod \"tuned-dswp2\" (UID: \"30438ca2-f3c2-42e8-9664-2f91f826bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-dswp2" May 20 14:09:02.741497 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.740808 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/30438ca2-f3c2-42e8-9664-2f91f826bc45-run\") pod \"tuned-dswp2\" (UID: \"30438ca2-f3c2-42e8-9664-2f91f826bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-dswp2" May 20 14:09:02.741497 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.740829 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7681b0e8-c9eb-405d-a05f-93b077b403ba-registration-dir\") pod \"aws-ebs-csi-driver-node-vhgtf\" (UID: \"7681b0e8-c9eb-405d-a05f-93b077b403ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhgtf" May 20 14:09:02.741497 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.740852 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvgb8\" (UniqueName: \"kubernetes.io/projected/b8a30337-47c1-4c73-ad43-87551f5adf02-kube-api-access-zvgb8\") pod \"multus-additional-cni-plugins-69szq\" (UID: \"b8a30337-47c1-4c73-ad43-87551f5adf02\") " pod="openshift-multus/multus-additional-cni-plugins-69szq" May 20 14:09:02.741497 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.740874 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-host-kubelet\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.741497 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.740893 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-run-ovn\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.741497 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.740919 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-host-cni-bin\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.741497 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.740944 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/03ff3c4e-874c-46d1-bc2f-a86677878e83-agent-certs\") pod \"konnectivity-agent-wl72b\" (UID: \"03ff3c4e-874c-46d1-bc2f-a86677878e83\") " pod="kube-system/konnectivity-agent-wl72b" May 20 14:09:02.741497 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.740965 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7681b0e8-c9eb-405d-a05f-93b077b403ba-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vhgtf\" (UID: \"7681b0e8-c9eb-405d-a05f-93b077b403ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhgtf" May 20 14:09:02.741497 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.740987 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-var-lib-openvswitch\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.741497 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.741010 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-ovnkube-script-lib\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.741497 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.741033 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-ovn-node-metrics-cert\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.741497 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.741054 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/03ff3c4e-874c-46d1-bc2f-a86677878e83-konnectivity-ca\") pod \"konnectivity-agent-wl72b\" (UID: \"03ff3c4e-874c-46d1-bc2f-a86677878e83\") " pod="kube-system/konnectivity-agent-wl72b" May 20 14:09:02.741497 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.741078 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8a30337-47c1-4c73-ad43-87551f5adf02-system-cni-dir\") pod \"multus-additional-cni-plugins-69szq\" (UID: \"b8a30337-47c1-4c73-ad43-87551f5adf02\") " pod="openshift-multus/multus-additional-cni-plugins-69szq" May 20 14:09:02.742485 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.741102 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b8a30337-47c1-4c73-ad43-87551f5adf02-cnibin\") pod \"multus-additional-cni-plugins-69szq\" (UID: \"b8a30337-47c1-4c73-ad43-87551f5adf02\") " pod="openshift-multus/multus-additional-cni-plugins-69szq" May 20 14:09:02.742485 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.741126 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b8a30337-47c1-4c73-ad43-87551f5adf02-tuning-conf-dir\") pod \"multus-additional-cni-plugins-69szq\" (UID: \"b8a30337-47c1-4c73-ad43-87551f5adf02\") " pod="openshift-multus/multus-additional-cni-plugins-69szq" May 20 14:09:02.742485 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.741171 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/30438ca2-f3c2-42e8-9664-2f91f826bc45-etc-sysctl-conf\") pod \"tuned-dswp2\" (UID: \"30438ca2-f3c2-42e8-9664-2f91f826bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-dswp2" May 20 14:09:02.742485 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.741206 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-host-run-netns\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.742485 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.741240 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7681b0e8-c9eb-405d-a05f-93b077b403ba-sys-fs\") pod \"aws-ebs-csi-driver-node-vhgtf\" (UID: \"7681b0e8-c9eb-405d-a05f-93b077b403ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhgtf" May 20 14:09:02.742485 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.741271 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb-metrics-certs\") pod \"network-metrics-daemon-m2p6p\" (UID: \"ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb\") " pod="openshift-multus/network-metrics-daemon-m2p6p" May 20 14:09:02.742485 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.741304 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.742485 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.741340 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrk8t\" (UniqueName: \"kubernetes.io/projected/ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb-kube-api-access-nrk8t\") pod \"network-metrics-daemon-m2p6p\" (UID: \"ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb\") " pod="openshift-multus/network-metrics-daemon-m2p6p" May 20 14:09:02.742485 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.741366 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-run-openvswitch\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.742485 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.741389 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30438ca2-f3c2-42e8-9664-2f91f826bc45-sys\") pod \"tuned-dswp2\" (UID: \"30438ca2-f3c2-42e8-9664-2f91f826bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-dswp2" May 20 14:09:02.742485 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.741417 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwknf\" (UniqueName: \"kubernetes.io/projected/7019fc5d-a470-4b78-9296-bd5d3bfffe65-kube-api-access-wwknf\") pod \"iptables-alerter-9lkk5\" (UID: \"7019fc5d-a470-4b78-9296-bd5d3bfffe65\") " pod="openshift-network-operator/iptables-alerter-9lkk5" May 20 14:09:02.742485 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.741441 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xh88w\" (UniqueName: \"kubernetes.io/projected/7681b0e8-c9eb-405d-a05f-93b077b403ba-kube-api-access-xh88w\") pod \"aws-ebs-csi-driver-node-vhgtf\" (UID: \"7681b0e8-c9eb-405d-a05f-93b077b403ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhgtf" May 20 14:09:02.742485 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.741466 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b8a30337-47c1-4c73-ad43-87551f5adf02-cni-binary-copy\") pod \"multus-additional-cni-plugins-69szq\" (UID: \"b8a30337-47c1-4c73-ad43-87551f5adf02\") " pod="openshift-multus/multus-additional-cni-plugins-69szq" May 20 14:09:02.742485 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.741489 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-env-overrides\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.742485 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.741519 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/30438ca2-f3c2-42e8-9664-2f91f826bc45-etc-sysctl-d\") pod \"tuned-dswp2\" (UID: \"30438ca2-f3c2-42e8-9664-2f91f826bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-dswp2" May 20 14:09:02.742485 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.741542 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/30438ca2-f3c2-42e8-9664-2f91f826bc45-lib-modules\") pod \"tuned-dswp2\" (UID: \"30438ca2-f3c2-42e8-9664-2f91f826bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-dswp2" May 20 14:09:02.743493 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.741564 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/30438ca2-f3c2-42e8-9664-2f91f826bc45-etc-tuned\") pod \"tuned-dswp2\" (UID: \"30438ca2-f3c2-42e8-9664-2f91f826bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-dswp2" May 20 14:09:02.743493 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.741602 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-run-systemd\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.743493 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.741642 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7681b0e8-c9eb-405d-a05f-93b077b403ba-device-dir\") pod \"aws-ebs-csi-driver-node-vhgtf\" (UID: \"7681b0e8-c9eb-405d-a05f-93b077b403ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhgtf" May 20 14:09:02.743493 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.741674 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7019fc5d-a470-4b78-9296-bd5d3bfffe65-iptables-alerter-script\") pod \"iptables-alerter-9lkk5\" (UID: \"7019fc5d-a470-4b78-9296-bd5d3bfffe65\") " pod="openshift-network-operator/iptables-alerter-9lkk5" May 20 14:09:02.743493 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.741701 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-node-log\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.743493 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.741721 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-ovnkube-config\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.743493 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.741747 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp9zg\" (UniqueName: \"kubernetes.io/projected/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-kube-api-access-zp9zg\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.743493 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.742124 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 20 14:09:02.743493 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.742359 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-c67bz\"" May 20 14:09:02.743493 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.742535 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 20 14:09:02.743493 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.742665 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 20 14:09:02.744960 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.744623 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-647bg" May 20 14:09:02.744960 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:02.744689 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-647bg" podUID="5052d255-8507-424c-aa56-2e94ec6d060f" May 20 14:09:02.744960 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.744717 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qqv5s" May 20 14:09:02.747621 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.747369 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 20 14:09:02.747621 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.747399 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jctbt\"" May 20 14:09:02.786779 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.786745 2551 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-19 14:04:01 +0000 UTC" deadline="2027-12-27 13:29:37.942689159 +0000 UTC" May 20 14:09:02.786779 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.786777 2551 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14063h20m35.155915657s" May 20 14:09:02.830965 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.830937 2551 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 20 14:09:02.842004 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.841976 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-host-slash\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.842152 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.842013 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/efac700d-53e9-4404-83e9-c97b81f73d7b-cni-binary-copy\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:02.842152 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.842036 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/efac700d-53e9-4404-83e9-c97b81f73d7b-hostroot\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:02.842152 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.842068 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7681b0e8-c9eb-405d-a05f-93b077b403ba-socket-dir\") pod \"aws-ebs-csi-driver-node-vhgtf\" (UID: \"7681b0e8-c9eb-405d-a05f-93b077b403ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhgtf" May 20 14:09:02.842152 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.842086 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-host-slash\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.842152 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.842091 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b8a30337-47c1-4c73-ad43-87551f5adf02-os-release\") pod \"multus-additional-cni-plugins-69szq\" (UID: \"b8a30337-47c1-4c73-ad43-87551f5adf02\") " pod="openshift-multus/multus-additional-cni-plugins-69szq" May 20 14:09:02.842152 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.842138 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-etc-openvswitch\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.842448 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.842146 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b8a30337-47c1-4c73-ad43-87551f5adf02-os-release\") pod \"multus-additional-cni-plugins-69szq\" (UID: \"b8a30337-47c1-4c73-ad43-87551f5adf02\") " pod="openshift-multus/multus-additional-cni-plugins-69szq" May 20 14:09:02.842448 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.842168 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/30438ca2-f3c2-42e8-9664-2f91f826bc45-etc-systemd\") pod \"tuned-dswp2\" (UID: \"30438ca2-f3c2-42e8-9664-2f91f826bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-dswp2" May 20 14:09:02.842448 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.842188 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30438ca2-f3c2-42e8-9664-2f91f826bc45-tmp\") pod \"tuned-dswp2\" (UID: \"30438ca2-f3c2-42e8-9664-2f91f826bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-dswp2" May 20 14:09:02.842448 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.842206 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-etc-openvswitch\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.842448 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.842212 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7019fc5d-a470-4b78-9296-bd5d3bfffe65-host-slash\") pod \"iptables-alerter-9lkk5\" (UID: \"7019fc5d-a470-4b78-9296-bd5d3bfffe65\") " pod="openshift-network-operator/iptables-alerter-9lkk5" May 20 14:09:02.842448 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.842242 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-host-cni-netd\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.842448 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.842247 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7019fc5d-a470-4b78-9296-bd5d3bfffe65-host-slash\") pod \"iptables-alerter-9lkk5\" (UID: \"7019fc5d-a470-4b78-9296-bd5d3bfffe65\") " pod="openshift-network-operator/iptables-alerter-9lkk5" May 20 14:09:02.842448 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.842251 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7681b0e8-c9eb-405d-a05f-93b077b403ba-socket-dir\") pod \"aws-ebs-csi-driver-node-vhgtf\" (UID: \"7681b0e8-c9eb-405d-a05f-93b077b403ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhgtf" May 20 14:09:02.842448 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.842262 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/30438ca2-f3c2-42e8-9664-2f91f826bc45-etc-systemd\") pod \"tuned-dswp2\" (UID: \"30438ca2-f3c2-42e8-9664-2f91f826bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-dswp2" May 20 14:09:02.842448 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.842286 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-host-cni-netd\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.842448 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.842268 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/30438ca2-f3c2-42e8-9664-2f91f826bc45-etc-sysconfig\") pod \"tuned-dswp2\" (UID: \"30438ca2-f3c2-42e8-9664-2f91f826bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-dswp2" May 20 14:09:02.842448 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.842309 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/30438ca2-f3c2-42e8-9664-2f91f826bc45-etc-sysconfig\") pod \"tuned-dswp2\" (UID: \"30438ca2-f3c2-42e8-9664-2f91f826bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-dswp2" May 20 14:09:02.842448 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.842320 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30438ca2-f3c2-42e8-9664-2f91f826bc45-var-lib-kubelet\") pod \"tuned-dswp2\" (UID: \"30438ca2-f3c2-42e8-9664-2f91f826bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-dswp2" May 20 14:09:02.842448 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.842347 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/efac700d-53e9-4404-83e9-c97b81f73d7b-etc-kubernetes\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:02.842448 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.842372 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/30438ca2-f3c2-42e8-9664-2f91f826bc45-run\") pod \"tuned-dswp2\" (UID: \"30438ca2-f3c2-42e8-9664-2f91f826bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-dswp2" May 20 14:09:02.842448 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.842397 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7681b0e8-c9eb-405d-a05f-93b077b403ba-registration-dir\") pod \"aws-ebs-csi-driver-node-vhgtf\" (UID: \"7681b0e8-c9eb-405d-a05f-93b077b403ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhgtf" May 20 14:09:02.842448 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.842407 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30438ca2-f3c2-42e8-9664-2f91f826bc45-var-lib-kubelet\") pod \"tuned-dswp2\" (UID: \"30438ca2-f3c2-42e8-9664-2f91f826bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-dswp2" May 20 14:09:02.842448 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.842444 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/30438ca2-f3c2-42e8-9664-2f91f826bc45-run\") pod \"tuned-dswp2\" (UID: \"30438ca2-f3c2-42e8-9664-2f91f826bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-dswp2" May 20 14:09:02.843286 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.842453 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7681b0e8-c9eb-405d-a05f-93b077b403ba-registration-dir\") pod \"aws-ebs-csi-driver-node-vhgtf\" (UID: \"7681b0e8-c9eb-405d-a05f-93b077b403ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhgtf" May 20 14:09:02.843286 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.842477 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zvgb8\" (UniqueName: \"kubernetes.io/projected/b8a30337-47c1-4c73-ad43-87551f5adf02-kube-api-access-zvgb8\") pod \"multus-additional-cni-plugins-69szq\" (UID: \"b8a30337-47c1-4c73-ad43-87551f5adf02\") " pod="openshift-multus/multus-additional-cni-plugins-69szq" May 20 14:09:02.843286 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.842506 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-host-kubelet\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.843286 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.842530 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-run-ovn\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.843286 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.842551 2551 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 20 14:09:02.843286 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.842557 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-host-kubelet\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.843286 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.842555 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-host-cni-bin\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.843286 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.842597 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-host-cni-bin\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.843286 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.842606 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-run-ovn\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.843286 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.842618 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/03ff3c4e-874c-46d1-bc2f-a86677878e83-agent-certs\") pod \"konnectivity-agent-wl72b\" (UID: \"03ff3c4e-874c-46d1-bc2f-a86677878e83\") " pod="kube-system/konnectivity-agent-wl72b" May 20 14:09:02.843286 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.842636 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7681b0e8-c9eb-405d-a05f-93b077b403ba-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vhgtf\" (UID: \"7681b0e8-c9eb-405d-a05f-93b077b403ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhgtf" May 20 14:09:02.843286 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.842660 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-var-lib-openvswitch\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.843286 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.842685 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-ovnkube-script-lib\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.843286 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.842711 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/efac700d-53e9-4404-83e9-c97b81f73d7b-os-release\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:02.843286 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.842724 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7681b0e8-c9eb-405d-a05f-93b077b403ba-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vhgtf\" (UID: \"7681b0e8-c9eb-405d-a05f-93b077b403ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhgtf" May 20 14:09:02.843286 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.842751 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-ovn-node-metrics-cert\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.843286 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.842777 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/03ff3c4e-874c-46d1-bc2f-a86677878e83-konnectivity-ca\") pod \"konnectivity-agent-wl72b\" (UID: \"03ff3c4e-874c-46d1-bc2f-a86677878e83\") " pod="kube-system/konnectivity-agent-wl72b" May 20 14:09:02.844107 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.842817 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8a30337-47c1-4c73-ad43-87551f5adf02-system-cni-dir\") pod \"multus-additional-cni-plugins-69szq\" (UID: \"b8a30337-47c1-4c73-ad43-87551f5adf02\") " pod="openshift-multus/multus-additional-cni-plugins-69szq" May 20 14:09:02.844107 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.842820 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-var-lib-openvswitch\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.844107 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.842870 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b8a30337-47c1-4c73-ad43-87551f5adf02-cnibin\") pod \"multus-additional-cni-plugins-69szq\" (UID: \"b8a30337-47c1-4c73-ad43-87551f5adf02\") " pod="openshift-multus/multus-additional-cni-plugins-69szq" May 20 14:09:02.844107 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.842900 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b8a30337-47c1-4c73-ad43-87551f5adf02-tuning-conf-dir\") pod \"multus-additional-cni-plugins-69szq\" (UID: \"b8a30337-47c1-4c73-ad43-87551f5adf02\") " pod="openshift-multus/multus-additional-cni-plugins-69szq" May 20 14:09:02.844107 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.842923 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/30438ca2-f3c2-42e8-9664-2f91f826bc45-etc-sysctl-conf\") pod \"tuned-dswp2\" (UID: \"30438ca2-f3c2-42e8-9664-2f91f826bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-dswp2" May 20 14:09:02.844107 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.842946 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/efac700d-53e9-4404-83e9-c97b81f73d7b-cnibin\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:02.844107 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.842967 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6scgv\" (UniqueName: \"kubernetes.io/projected/5052d255-8507-424c-aa56-2e94ec6d060f-kube-api-access-6scgv\") pod \"network-check-target-647bg\" (UID: \"5052d255-8507-424c-aa56-2e94ec6d060f\") " pod="openshift-network-diagnostics/network-check-target-647bg" May 20 14:09:02.844107 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.843004 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-host-run-netns\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.844107 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.843025 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7681b0e8-c9eb-405d-a05f-93b077b403ba-sys-fs\") pod \"aws-ebs-csi-driver-node-vhgtf\" (UID: \"7681b0e8-c9eb-405d-a05f-93b077b403ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhgtf" May 20 14:09:02.844107 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.843049 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb-metrics-certs\") pod \"network-metrics-daemon-m2p6p\" (UID: \"ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb\") " pod="openshift-multus/network-metrics-daemon-m2p6p" May 20 14:09:02.844107 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.843072 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.844107 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.843099 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/efac700d-53e9-4404-83e9-c97b81f73d7b-host-var-lib-kubelet\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:02.844107 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.843125 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/efac700d-53e9-4404-83e9-c97b81f73d7b-host-run-multus-certs\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:02.844107 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.843153 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nrk8t\" (UniqueName: \"kubernetes.io/projected/ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb-kube-api-access-nrk8t\") pod \"network-metrics-daemon-m2p6p\" (UID: \"ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb\") " pod="openshift-multus/network-metrics-daemon-m2p6p" May 20 14:09:02.844107 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.843180 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-run-openvswitch\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.844107 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.843188 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b8a30337-47c1-4c73-ad43-87551f5adf02-cnibin\") pod \"multus-additional-cni-plugins-69szq\" (UID: \"b8a30337-47c1-4c73-ad43-87551f5adf02\") " pod="openshift-multus/multus-additional-cni-plugins-69szq" May 20 14:09:02.844107 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.843202 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30438ca2-f3c2-42e8-9664-2f91f826bc45-sys\") pod \"tuned-dswp2\" (UID: \"30438ca2-f3c2-42e8-9664-2f91f826bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-dswp2" May 20 14:09:02.844875 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.842872 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8a30337-47c1-4c73-ad43-87551f5adf02-system-cni-dir\") pod \"multus-additional-cni-plugins-69szq\" (UID: \"b8a30337-47c1-4c73-ad43-87551f5adf02\") " pod="openshift-multus/multus-additional-cni-plugins-69szq" May 20 14:09:02.844875 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.843242 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a2289b16-7fb4-4409-bfc9-5805b74161dc-host\") pod \"node-ca-zklgl\" (UID: \"a2289b16-7fb4-4409-bfc9-5805b74161dc\") " pod="openshift-image-registry/node-ca-zklgl" May 20 14:09:02.844875 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.843264 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a2289b16-7fb4-4409-bfc9-5805b74161dc-serviceca\") pod \"node-ca-zklgl\" (UID: \"a2289b16-7fb4-4409-bfc9-5805b74161dc\") " pod="openshift-image-registry/node-ca-zklgl" May 20 14:09:02.844875 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.843288 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/efac700d-53e9-4404-83e9-c97b81f73d7b-multus-socket-dir-parent\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:02.844875 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.843312 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/efac700d-53e9-4404-83e9-c97b81f73d7b-host-run-k8s-cni-cncf-io\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:02.844875 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.843337 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wwknf\" (UniqueName: \"kubernetes.io/projected/7019fc5d-a470-4b78-9296-bd5d3bfffe65-kube-api-access-wwknf\") pod \"iptables-alerter-9lkk5\" (UID: \"7019fc5d-a470-4b78-9296-bd5d3bfffe65\") " pod="openshift-network-operator/iptables-alerter-9lkk5" May 20 14:09:02.844875 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.843360 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xh88w\" (UniqueName: \"kubernetes.io/projected/7681b0e8-c9eb-405d-a05f-93b077b403ba-kube-api-access-xh88w\") pod \"aws-ebs-csi-driver-node-vhgtf\" (UID: \"7681b0e8-c9eb-405d-a05f-93b077b403ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhgtf" May 20 14:09:02.844875 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.843382 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b8a30337-47c1-4c73-ad43-87551f5adf02-cni-binary-copy\") pod \"multus-additional-cni-plugins-69szq\" (UID: \"b8a30337-47c1-4c73-ad43-87551f5adf02\") " pod="openshift-multus/multus-additional-cni-plugins-69szq" May 20 14:09:02.844875 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.843402 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-env-overrides\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.844875 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.843421 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/30438ca2-f3c2-42e8-9664-2f91f826bc45-etc-sysctl-d\") pod \"tuned-dswp2\" (UID: \"30438ca2-f3c2-42e8-9664-2f91f826bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-dswp2" May 20 14:09:02.844875 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.843430 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-ovnkube-script-lib\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.844875 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.843443 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/30438ca2-f3c2-42e8-9664-2f91f826bc45-lib-modules\") pod \"tuned-dswp2\" (UID: \"30438ca2-f3c2-42e8-9664-2f91f826bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-dswp2" May 20 14:09:02.844875 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.843466 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/30438ca2-f3c2-42e8-9664-2f91f826bc45-etc-tuned\") pod \"tuned-dswp2\" (UID: \"30438ca2-f3c2-42e8-9664-2f91f826bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-dswp2" May 20 14:09:02.844875 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.843476 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/30438ca2-f3c2-42e8-9664-2f91f826bc45-etc-sysctl-conf\") pod \"tuned-dswp2\" (UID: \"30438ca2-f3c2-42e8-9664-2f91f826bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-dswp2" May 20 14:09:02.844875 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.843492 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/efac700d-53e9-4404-83e9-c97b81f73d7b-multus-cni-dir\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:02.844875 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.843359 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b8a30337-47c1-4c73-ad43-87551f5adf02-tuning-conf-dir\") pod \"multus-additional-cni-plugins-69szq\" (UID: \"b8a30337-47c1-4c73-ad43-87551f5adf02\") " pod="openshift-multus/multus-additional-cni-plugins-69szq" May 20 14:09:02.844875 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.843826 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-run-systemd\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.845597 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.843966 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-env-overrides\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.845597 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.844012 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-host-run-netns\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.845597 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:02.844070 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 14:09:02.845597 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.844097 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/03ff3c4e-874c-46d1-bc2f-a86677878e83-konnectivity-ca\") pod \"konnectivity-agent-wl72b\" (UID: \"03ff3c4e-874c-46d1-bc2f-a86677878e83\") " pod="kube-system/konnectivity-agent-wl72b" May 20 14:09:02.845597 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:02.844120 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb-metrics-certs podName:ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb nodeName:}" failed. No retries permitted until 2026-05-20 14:09:03.344102541 +0000 UTC m=+3.084400434 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb-metrics-certs") pod "network-metrics-daemon-m2p6p" (UID: "ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 14:09:02.845597 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.844155 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.845597 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.844202 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7681b0e8-c9eb-405d-a05f-93b077b403ba-sys-fs\") pod \"aws-ebs-csi-driver-node-vhgtf\" (UID: \"7681b0e8-c9eb-405d-a05f-93b077b403ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhgtf" May 20 14:09:02.845597 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.844254 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30438ca2-f3c2-42e8-9664-2f91f826bc45-sys\") pod \"tuned-dswp2\" (UID: \"30438ca2-f3c2-42e8-9664-2f91f826bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-dswp2" May 20 14:09:02.845597 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.844279 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b8a30337-47c1-4c73-ad43-87551f5adf02-cni-binary-copy\") pod \"multus-additional-cni-plugins-69szq\" (UID: \"b8a30337-47c1-4c73-ad43-87551f5adf02\") " pod="openshift-multus/multus-additional-cni-plugins-69szq" May 20 14:09:02.845597 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.844295 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-run-openvswitch\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.845597 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.844342 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7681b0e8-c9eb-405d-a05f-93b077b403ba-device-dir\") pod \"aws-ebs-csi-driver-node-vhgtf\" (UID: \"7681b0e8-c9eb-405d-a05f-93b077b403ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhgtf" May 20 14:09:02.845597 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.844356 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/30438ca2-f3c2-42e8-9664-2f91f826bc45-lib-modules\") pod \"tuned-dswp2\" (UID: \"30438ca2-f3c2-42e8-9664-2f91f826bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-dswp2" May 20 14:09:02.845597 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.844371 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/30438ca2-f3c2-42e8-9664-2f91f826bc45-etc-sysctl-d\") pod \"tuned-dswp2\" (UID: \"30438ca2-f3c2-42e8-9664-2f91f826bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-dswp2" May 20 14:09:02.845597 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.844371 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7019fc5d-a470-4b78-9296-bd5d3bfffe65-iptables-alerter-script\") pod \"iptables-alerter-9lkk5\" (UID: \"7019fc5d-a470-4b78-9296-bd5d3bfffe65\") " pod="openshift-network-operator/iptables-alerter-9lkk5" May 20 14:09:02.845597 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.844514 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-node-log\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.845597 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.844544 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-ovnkube-config\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.845597 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.844575 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7681b0e8-c9eb-405d-a05f-93b077b403ba-device-dir\") pod \"aws-ebs-csi-driver-node-vhgtf\" (UID: \"7681b0e8-c9eb-405d-a05f-93b077b403ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhgtf" May 20 14:09:02.846366 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.844591 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zp9zg\" (UniqueName: \"kubernetes.io/projected/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-kube-api-access-zp9zg\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.846366 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.844649 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6mn8f\" (UniqueName: \"kubernetes.io/projected/30438ca2-f3c2-42e8-9664-2f91f826bc45-kube-api-access-6mn8f\") pod \"tuned-dswp2\" (UID: \"30438ca2-f3c2-42e8-9664-2f91f826bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-dswp2" May 20 14:09:02.846366 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.844675 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-node-log\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.846366 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.844678 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b655d\" (UniqueName: \"kubernetes.io/projected/a2289b16-7fb4-4409-bfc9-5805b74161dc-kube-api-access-b655d\") pod \"node-ca-zklgl\" (UID: \"a2289b16-7fb4-4409-bfc9-5805b74161dc\") " pod="openshift-image-registry/node-ca-zklgl" May 20 14:09:02.846366 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.844723 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7681b0e8-c9eb-405d-a05f-93b077b403ba-etc-selinux\") pod \"aws-ebs-csi-driver-node-vhgtf\" (UID: \"7681b0e8-c9eb-405d-a05f-93b077b403ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhgtf" May 20 14:09:02.846366 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.844771 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b8a30337-47c1-4c73-ad43-87551f5adf02-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-69szq\" (UID: \"b8a30337-47c1-4c73-ad43-87551f5adf02\") " pod="openshift-multus/multus-additional-cni-plugins-69szq" May 20 14:09:02.846366 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.844816 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/30438ca2-f3c2-42e8-9664-2f91f826bc45-etc-modprobe-d\") pod \"tuned-dswp2\" (UID: \"30438ca2-f3c2-42e8-9664-2f91f826bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-dswp2" May 20 14:09:02.846366 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.844847 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/efac700d-53e9-4404-83e9-c97b81f73d7b-multus-conf-dir\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:02.846366 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.844873 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrhrw\" (UniqueName: \"kubernetes.io/projected/efac700d-53e9-4404-83e9-c97b81f73d7b-kube-api-access-jrhrw\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:02.846366 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.844899 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/efac700d-53e9-4404-83e9-c97b81f73d7b-host-var-lib-cni-bin\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:02.846366 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.844972 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-log-socket\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.846366 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.845001 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/efac700d-53e9-4404-83e9-c97b81f73d7b-host-run-netns\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:02.846366 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.845026 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/efac700d-53e9-4404-83e9-c97b81f73d7b-host-var-lib-cni-multus\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:02.846366 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.845051 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/efac700d-53e9-4404-83e9-c97b81f73d7b-multus-daemon-config\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:02.846366 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.845078 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-host-run-ovn-kubernetes\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.846366 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.845084 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7019fc5d-a470-4b78-9296-bd5d3bfffe65-iptables-alerter-script\") pod \"iptables-alerter-9lkk5\" (UID: \"7019fc5d-a470-4b78-9296-bd5d3bfffe65\") " pod="openshift-network-operator/iptables-alerter-9lkk5" May 20 14:09:02.846366 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.845105 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30438ca2-f3c2-42e8-9664-2f91f826bc45-etc-kubernetes\") pod \"tuned-dswp2\" (UID: \"30438ca2-f3c2-42e8-9664-2f91f826bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-dswp2" May 20 14:09:02.846888 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.845130 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/30438ca2-f3c2-42e8-9664-2f91f826bc45-host\") pod \"tuned-dswp2\" (UID: \"30438ca2-f3c2-42e8-9664-2f91f826bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-dswp2" May 20 14:09:02.846888 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.845175 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-ovnkube-config\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.846888 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.845257 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/efac700d-53e9-4404-83e9-c97b81f73d7b-system-cni-dir\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:02.846888 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.845273 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/30438ca2-f3c2-42e8-9664-2f91f826bc45-host\") pod \"tuned-dswp2\" (UID: \"30438ca2-f3c2-42e8-9664-2f91f826bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-dswp2" May 20 14:09:02.846888 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.845289 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b8a30337-47c1-4c73-ad43-87551f5adf02-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-69szq\" (UID: \"b8a30337-47c1-4c73-ad43-87551f5adf02\") " pod="openshift-multus/multus-additional-cni-plugins-69szq" May 20 14:09:02.846888 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.845308 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-run-systemd\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.846888 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.845319 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-systemd-units\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.846888 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.845376 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30438ca2-f3c2-42e8-9664-2f91f826bc45-etc-kubernetes\") pod \"tuned-dswp2\" (UID: \"30438ca2-f3c2-42e8-9664-2f91f826bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-dswp2" May 20 14:09:02.846888 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.845276 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7681b0e8-c9eb-405d-a05f-93b077b403ba-etc-selinux\") pod \"aws-ebs-csi-driver-node-vhgtf\" (UID: \"7681b0e8-c9eb-405d-a05f-93b077b403ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhgtf" May 20 14:09:02.846888 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.845881 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b8a30337-47c1-4c73-ad43-87551f5adf02-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-69szq\" (UID: \"b8a30337-47c1-4c73-ad43-87551f5adf02\") " pod="openshift-multus/multus-additional-cni-plugins-69szq" May 20 14:09:02.846888 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.845974 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30438ca2-f3c2-42e8-9664-2f91f826bc45-tmp\") pod \"tuned-dswp2\" (UID: \"30438ca2-f3c2-42e8-9664-2f91f826bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-dswp2" May 20 14:09:02.846888 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.846055 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-systemd-units\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.846888 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.846156 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/30438ca2-f3c2-42e8-9664-2f91f826bc45-etc-modprobe-d\") pod \"tuned-dswp2\" (UID: \"30438ca2-f3c2-42e8-9664-2f91f826bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-dswp2" May 20 14:09:02.846888 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.846153 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-host-run-ovn-kubernetes\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.846888 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.846216 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-log-socket\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.846888 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.846228 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/03ff3c4e-874c-46d1-bc2f-a86677878e83-agent-certs\") pod \"konnectivity-agent-wl72b\" (UID: \"03ff3c4e-874c-46d1-bc2f-a86677878e83\") " pod="kube-system/konnectivity-agent-wl72b" May 20 14:09:02.846888 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.846825 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b8a30337-47c1-4c73-ad43-87551f5adf02-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-69szq\" (UID: \"b8a30337-47c1-4c73-ad43-87551f5adf02\") " pod="openshift-multus/multus-additional-cni-plugins-69szq" May 20 14:09:02.847412 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.847377 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/30438ca2-f3c2-42e8-9664-2f91f826bc45-etc-tuned\") pod \"tuned-dswp2\" (UID: \"30438ca2-f3c2-42e8-9664-2f91f826bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-dswp2" May 20 14:09:02.847525 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.847474 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-ovn-node-metrics-cert\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.851285 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.851264 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xh88w\" (UniqueName: \"kubernetes.io/projected/7681b0e8-c9eb-405d-a05f-93b077b403ba-kube-api-access-xh88w\") pod \"aws-ebs-csi-driver-node-vhgtf\" (UID: \"7681b0e8-c9eb-405d-a05f-93b077b403ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhgtf" May 20 14:09:02.851639 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.851596 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrk8t\" (UniqueName: \"kubernetes.io/projected/ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb-kube-api-access-nrk8t\") pod \"network-metrics-daemon-m2p6p\" (UID: \"ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb\") " pod="openshift-multus/network-metrics-daemon-m2p6p" May 20 14:09:02.852060 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.852043 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvgb8\" (UniqueName: \"kubernetes.io/projected/b8a30337-47c1-4c73-ad43-87551f5adf02-kube-api-access-zvgb8\") pod \"multus-additional-cni-plugins-69szq\" (UID: \"b8a30337-47c1-4c73-ad43-87551f5adf02\") " pod="openshift-multus/multus-additional-cni-plugins-69szq" May 20 14:09:02.858843 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.858821 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwknf\" (UniqueName: \"kubernetes.io/projected/7019fc5d-a470-4b78-9296-bd5d3bfffe65-kube-api-access-wwknf\") pod \"iptables-alerter-9lkk5\" (UID: \"7019fc5d-a470-4b78-9296-bd5d3bfffe65\") " pod="openshift-network-operator/iptables-alerter-9lkk5" May 20 14:09:02.860718 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.860702 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mn8f\" (UniqueName: \"kubernetes.io/projected/30438ca2-f3c2-42e8-9664-2f91f826bc45-kube-api-access-6mn8f\") pod \"tuned-dswp2\" (UID: \"30438ca2-f3c2-42e8-9664-2f91f826bc45\") " pod="openshift-cluster-node-tuning-operator/tuned-dswp2" May 20 14:09:02.864400 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.864377 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp9zg\" (UniqueName: \"kubernetes.io/projected/75f22758-90d8-4dd5-ab8e-74e8ec2badc1-kube-api-access-zp9zg\") pod \"ovnkube-node-ggb6b\" (UID: \"75f22758-90d8-4dd5-ab8e-74e8ec2badc1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:02.867236 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.867194 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-164.ec2.internal" event={"ID":"9f433c144673f44ac68220eba4eaa3a1","Type":"ContainerStarted","Data":"23d62f3119ebb1a86c5310d9680a64e460a79d6566481a4a312c0b8f640e7a88"} May 20 14:09:02.868248 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.868227 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-164.ec2.internal" event={"ID":"fe2859cafc41e5d23c2ec64bcc15789b","Type":"ContainerStarted","Data":"18a0a018916a5efe3542afebc421644c8a72799d61723505c91640a53e0934d1"} May 20 14:09:02.946182 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.946148 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/efac700d-53e9-4404-83e9-c97b81f73d7b-system-cni-dir\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:02.946326 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.946192 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/efac700d-53e9-4404-83e9-c97b81f73d7b-cni-binary-copy\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:02.946326 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.946211 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/efac700d-53e9-4404-83e9-c97b81f73d7b-hostroot\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:02.946326 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.946231 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/efac700d-53e9-4404-83e9-c97b81f73d7b-etc-kubernetes\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:02.946326 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.946255 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/efac700d-53e9-4404-83e9-c97b81f73d7b-os-release\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:02.946326 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.946273 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/efac700d-53e9-4404-83e9-c97b81f73d7b-system-cni-dir\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:02.946561 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.946336 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/efac700d-53e9-4404-83e9-c97b81f73d7b-hostroot\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:02.946561 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.946344 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/efac700d-53e9-4404-83e9-c97b81f73d7b-etc-kubernetes\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:02.946561 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.946370 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/efac700d-53e9-4404-83e9-c97b81f73d7b-os-release\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:02.946561 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.946421 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/efac700d-53e9-4404-83e9-c97b81f73d7b-cnibin\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:02.946561 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.946450 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6scgv\" (UniqueName: \"kubernetes.io/projected/5052d255-8507-424c-aa56-2e94ec6d060f-kube-api-access-6scgv\") pod \"network-check-target-647bg\" (UID: \"5052d255-8507-424c-aa56-2e94ec6d060f\") " pod="openshift-network-diagnostics/network-check-target-647bg" May 20 14:09:02.946561 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.946457 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/efac700d-53e9-4404-83e9-c97b81f73d7b-cnibin\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:02.946561 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.946484 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/efac700d-53e9-4404-83e9-c97b81f73d7b-host-var-lib-kubelet\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:02.946561 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.946510 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/efac700d-53e9-4404-83e9-c97b81f73d7b-host-run-multus-certs\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:02.946561 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.946528 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a2289b16-7fb4-4409-bfc9-5805b74161dc-host\") pod \"node-ca-zklgl\" (UID: \"a2289b16-7fb4-4409-bfc9-5805b74161dc\") " pod="openshift-image-registry/node-ca-zklgl" May 20 14:09:02.946561 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.946549 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a2289b16-7fb4-4409-bfc9-5805b74161dc-serviceca\") pod \"node-ca-zklgl\" (UID: \"a2289b16-7fb4-4409-bfc9-5805b74161dc\") " pod="openshift-image-registry/node-ca-zklgl" May 20 14:09:02.946943 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.946573 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/efac700d-53e9-4404-83e9-c97b81f73d7b-multus-socket-dir-parent\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:02.946943 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.946596 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/efac700d-53e9-4404-83e9-c97b81f73d7b-host-run-k8s-cni-cncf-io\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:02.946943 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.946615 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/efac700d-53e9-4404-83e9-c97b81f73d7b-multus-cni-dir\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:02.946943 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.946645 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b655d\" (UniqueName: \"kubernetes.io/projected/a2289b16-7fb4-4409-bfc9-5805b74161dc-kube-api-access-b655d\") pod \"node-ca-zklgl\" (UID: \"a2289b16-7fb4-4409-bfc9-5805b74161dc\") " pod="openshift-image-registry/node-ca-zklgl" May 20 14:09:02.946943 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.946671 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/efac700d-53e9-4404-83e9-c97b81f73d7b-multus-conf-dir\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:02.946943 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.946696 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jrhrw\" (UniqueName: \"kubernetes.io/projected/efac700d-53e9-4404-83e9-c97b81f73d7b-kube-api-access-jrhrw\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:02.946943 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.946720 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/efac700d-53e9-4404-83e9-c97b81f73d7b-host-var-lib-cni-bin\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:02.946943 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.946745 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/efac700d-53e9-4404-83e9-c97b81f73d7b-host-run-netns\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:02.946943 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.946760 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/efac700d-53e9-4404-83e9-c97b81f73d7b-host-var-lib-cni-multus\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:02.946943 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.946775 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/efac700d-53e9-4404-83e9-c97b81f73d7b-multus-daemon-config\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:02.946943 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.946813 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/efac700d-53e9-4404-83e9-c97b81f73d7b-cni-binary-copy\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:02.946943 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.946844 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/efac700d-53e9-4404-83e9-c97b81f73d7b-multus-cni-dir\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:02.946943 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.946886 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/efac700d-53e9-4404-83e9-c97b81f73d7b-host-var-lib-kubelet\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:02.946943 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.946920 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/efac700d-53e9-4404-83e9-c97b81f73d7b-host-run-multus-certs\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:02.947458 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.946956 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a2289b16-7fb4-4409-bfc9-5805b74161dc-host\") pod \"node-ca-zklgl\" (UID: \"a2289b16-7fb4-4409-bfc9-5805b74161dc\") " pod="openshift-image-registry/node-ca-zklgl" May 20 14:09:02.947458 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.947205 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/efac700d-53e9-4404-83e9-c97b81f73d7b-host-run-netns\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:02.947458 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.947229 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/efac700d-53e9-4404-83e9-c97b81f73d7b-multus-conf-dir\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:02.947458 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.947240 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/efac700d-53e9-4404-83e9-c97b81f73d7b-host-var-lib-cni-multus\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:02.947458 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.947234 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/efac700d-53e9-4404-83e9-c97b81f73d7b-host-var-lib-cni-bin\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:02.947458 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.947265 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/efac700d-53e9-4404-83e9-c97b81f73d7b-multus-socket-dir-parent\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:02.947458 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.947273 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/efac700d-53e9-4404-83e9-c97b81f73d7b-host-run-k8s-cni-cncf-io\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:02.947458 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.947369 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a2289b16-7fb4-4409-bfc9-5805b74161dc-serviceca\") pod \"node-ca-zklgl\" (UID: \"a2289b16-7fb4-4409-bfc9-5805b74161dc\") " pod="openshift-image-registry/node-ca-zklgl" May 20 14:09:02.947869 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.947852 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/efac700d-53e9-4404-83e9-c97b81f73d7b-multus-daemon-config\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:02.952624 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:02.952603 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 14:09:02.952624 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:02.952625 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 14:09:02.952804 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:02.952637 2551 projected.go:194] Error preparing data for projected volume kube-api-access-6scgv for pod openshift-network-diagnostics/network-check-target-647bg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 14:09:02.952804 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:02.952708 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5052d255-8507-424c-aa56-2e94ec6d060f-kube-api-access-6scgv podName:5052d255-8507-424c-aa56-2e94ec6d060f nodeName:}" failed. No retries permitted until 2026-05-20 14:09:03.452691653 +0000 UTC m=+3.192989563 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6scgv" (UniqueName: "kubernetes.io/projected/5052d255-8507-424c-aa56-2e94ec6d060f-kube-api-access-6scgv") pod "network-check-target-647bg" (UID: "5052d255-8507-424c-aa56-2e94ec6d060f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 14:09:02.954825 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.954803 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b655d\" (UniqueName: \"kubernetes.io/projected/a2289b16-7fb4-4409-bfc9-5805b74161dc-kube-api-access-b655d\") pod \"node-ca-zklgl\" (UID: \"a2289b16-7fb4-4409-bfc9-5805b74161dc\") " pod="openshift-image-registry/node-ca-zklgl" May 20 14:09:02.955071 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:02.955052 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrhrw\" (UniqueName: \"kubernetes.io/projected/efac700d-53e9-4404-83e9-c97b81f73d7b-kube-api-access-jrhrw\") pod \"multus-qqv5s\" (UID: \"efac700d-53e9-4404-83e9-c97b81f73d7b\") " pod="openshift-multus/multus-qqv5s" May 20 14:09:03.034671 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:03.034583 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-69szq" May 20 14:09:03.043331 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:03.043306 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:03.052047 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:03.052024 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wl72b" May 20 14:09:03.057657 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:03.057635 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhgtf" May 20 14:09:03.067199 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:03.067177 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9lkk5" May 20 14:09:03.075742 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:03.075725 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dswp2" May 20 14:09:03.089316 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:03.089290 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zklgl" May 20 14:09:03.095906 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:03.095889 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qqv5s" May 20 14:09:03.215801 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:03.215761 2551 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 20 14:09:03.349684 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:03.349650 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb-metrics-certs\") pod \"network-metrics-daemon-m2p6p\" (UID: \"ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb\") " pod="openshift-multus/network-metrics-daemon-m2p6p" May 20 14:09:03.349867 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:03.349769 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 14:09:03.349867 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:03.349846 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb-metrics-certs podName:ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb nodeName:}" failed. No retries permitted until 2026-05-20 14:09:04.34983161 +0000 UTC m=+4.090129502 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb-metrics-certs") pod "network-metrics-daemon-m2p6p" (UID: "ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 14:09:03.550466 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:03.550436 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6scgv\" (UniqueName: \"kubernetes.io/projected/5052d255-8507-424c-aa56-2e94ec6d060f-kube-api-access-6scgv\") pod \"network-check-target-647bg\" (UID: \"5052d255-8507-424c-aa56-2e94ec6d060f\") " pod="openshift-network-diagnostics/network-check-target-647bg" May 20 14:09:03.550632 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:03.550607 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 14:09:03.550632 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:03.550630 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 14:09:03.550743 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:03.550644 2551 projected.go:194] Error preparing data for projected volume kube-api-access-6scgv for pod openshift-network-diagnostics/network-check-target-647bg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 14:09:03.550743 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:03.550708 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5052d255-8507-424c-aa56-2e94ec6d060f-kube-api-access-6scgv podName:5052d255-8507-424c-aa56-2e94ec6d060f nodeName:}" failed. No retries permitted until 2026-05-20 14:09:04.550689988 +0000 UTC m=+4.290987895 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6scgv" (UniqueName: "kubernetes.io/projected/5052d255-8507-424c-aa56-2e94ec6d060f-kube-api-access-6scgv") pod "network-check-target-647bg" (UID: "5052d255-8507-424c-aa56-2e94ec6d060f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 14:09:03.627853 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:03.627742 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8a30337_47c1_4c73_ad43_87551f5adf02.slice/crio-ff5f49640b5eb1d1a91a761e9bdf7e4c556cb0fe4aed839caa05ad25ae6e5ddd WatchSource:0}: Error finding container ff5f49640b5eb1d1a91a761e9bdf7e4c556cb0fe4aed839caa05ad25ae6e5ddd: Status 404 returned error can't find the container with id ff5f49640b5eb1d1a91a761e9bdf7e4c556cb0fe4aed839caa05ad25ae6e5ddd May 20 14:09:03.628843 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:03.628813 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7019fc5d_a470_4b78_9296_bd5d3bfffe65.slice/crio-5e0841d11ae5d80fff7f1b547a5d189396829bf2d4e4a40aaa1c5ac2a069f8b0 WatchSource:0}: Error finding container 5e0841d11ae5d80fff7f1b547a5d189396829bf2d4e4a40aaa1c5ac2a069f8b0: Status 404 returned error can't find the container with id 5e0841d11ae5d80fff7f1b547a5d189396829bf2d4e4a40aaa1c5ac2a069f8b0 May 20 14:09:03.632472 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:03.632389 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2289b16_7fb4_4409_bfc9_5805b74161dc.slice/crio-6f96785aca0110f2470712824c8dc773983f9ce38291ed2f95378cc4a2f42014 WatchSource:0}: Error finding container 6f96785aca0110f2470712824c8dc773983f9ce38291ed2f95378cc4a2f42014: Status 404 returned error can't find the container with id 6f96785aca0110f2470712824c8dc773983f9ce38291ed2f95378cc4a2f42014 May 20 14:09:03.633226 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:03.633196 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75f22758_90d8_4dd5_ab8e_74e8ec2badc1.slice/crio-26280dba4088516728683564538af31692ac8ac3b4c82abb63455ba46d44e21c WatchSource:0}: Error finding container 26280dba4088516728683564538af31692ac8ac3b4c82abb63455ba46d44e21c: Status 404 returned error can't find the container with id 26280dba4088516728683564538af31692ac8ac3b4c82abb63455ba46d44e21c May 20 14:09:03.634022 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:03.634002 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7681b0e8_c9eb_405d_a05f_93b077b403ba.slice/crio-d42553b1e45400e60221601737febd9a8abbbe7a3d5190fe89bc1fd743e2f4ff WatchSource:0}: Error finding container d42553b1e45400e60221601737febd9a8abbbe7a3d5190fe89bc1fd743e2f4ff: Status 404 returned error can't find the container with id d42553b1e45400e60221601737febd9a8abbbe7a3d5190fe89bc1fd743e2f4ff May 20 14:09:03.635410 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:03.635339 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03ff3c4e_874c_46d1_bc2f_a86677878e83.slice/crio-572df4092a31871c454c33f6a318e874b767e60a2ce01cdc24066c8c343dcf8f WatchSource:0}: Error finding container 572df4092a31871c454c33f6a318e874b767e60a2ce01cdc24066c8c343dcf8f: Status 404 returned error can't find the container with id 572df4092a31871c454c33f6a318e874b767e60a2ce01cdc24066c8c343dcf8f May 20 14:09:03.636210 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:03.636188 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30438ca2_f3c2_42e8_9664_2f91f826bc45.slice/crio-4038ae6cd19eb58b3421e93bdd3d673d76aa3071b66f06521dcc9002f268de59 WatchSource:0}: Error finding container 4038ae6cd19eb58b3421e93bdd3d673d76aa3071b66f06521dcc9002f268de59: Status 404 returned error can't find the container with id 4038ae6cd19eb58b3421e93bdd3d673d76aa3071b66f06521dcc9002f268de59 May 20 14:09:03.638331 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:03.638091 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefac700d_53e9_4404_83e9_c97b81f73d7b.slice/crio-a9b5397dc05e7251d734b9a11d32b7f2f3381c21a6cc1ced379ae05f56948a73 WatchSource:0}: Error finding container a9b5397dc05e7251d734b9a11d32b7f2f3381c21a6cc1ced379ae05f56948a73: Status 404 returned error can't find the container with id a9b5397dc05e7251d734b9a11d32b7f2f3381c21a6cc1ced379ae05f56948a73 May 20 14:09:03.787970 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:03.787923 2551 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-19 14:04:01 +0000 UTC" deadline="2028-02-24 19:25:00.712221326 +0000 UTC" May 20 14:09:03.787970 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:03.787964 2551 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15485h15m56.924259288s" May 20 14:09:03.871359 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:03.871326 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" event={"ID":"75f22758-90d8-4dd5-ab8e-74e8ec2badc1","Type":"ContainerStarted","Data":"26280dba4088516728683564538af31692ac8ac3b4c82abb63455ba46d44e21c"} May 20 14:09:03.872305 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:03.872280 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9lkk5" event={"ID":"7019fc5d-a470-4b78-9296-bd5d3bfffe65","Type":"ContainerStarted","Data":"5e0841d11ae5d80fff7f1b547a5d189396829bf2d4e4a40aaa1c5ac2a069f8b0"} May 20 14:09:03.873251 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:03.873228 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-69szq" event={"ID":"b8a30337-47c1-4c73-ad43-87551f5adf02","Type":"ContainerStarted","Data":"ff5f49640b5eb1d1a91a761e9bdf7e4c556cb0fe4aed839caa05ad25ae6e5ddd"} May 20 14:09:03.874636 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:03.874617 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-164.ec2.internal" event={"ID":"9f433c144673f44ac68220eba4eaa3a1","Type":"ContainerStarted","Data":"2af4e08084a4958f7e015b3ec7aa36ae195c3178d2e0ac18379b94df7b2db90d"} May 20 14:09:03.875555 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:03.875537 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qqv5s" event={"ID":"efac700d-53e9-4404-83e9-c97b81f73d7b","Type":"ContainerStarted","Data":"a9b5397dc05e7251d734b9a11d32b7f2f3381c21a6cc1ced379ae05f56948a73"} May 20 14:09:03.876404 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:03.876386 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dswp2" event={"ID":"30438ca2-f3c2-42e8-9664-2f91f826bc45","Type":"ContainerStarted","Data":"4038ae6cd19eb58b3421e93bdd3d673d76aa3071b66f06521dcc9002f268de59"} May 20 14:09:03.877186 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:03.877166 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhgtf" event={"ID":"7681b0e8-c9eb-405d-a05f-93b077b403ba","Type":"ContainerStarted","Data":"d42553b1e45400e60221601737febd9a8abbbe7a3d5190fe89bc1fd743e2f4ff"} May 20 14:09:03.877948 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:03.877919 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zklgl" event={"ID":"a2289b16-7fb4-4409-bfc9-5805b74161dc","Type":"ContainerStarted","Data":"6f96785aca0110f2470712824c8dc773983f9ce38291ed2f95378cc4a2f42014"} May 20 14:09:03.878758 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:03.878741 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wl72b" event={"ID":"03ff3c4e-874c-46d1-bc2f-a86677878e83","Type":"ContainerStarted","Data":"572df4092a31871c454c33f6a318e874b767e60a2ce01cdc24066c8c343dcf8f"} May 20 14:09:03.887504 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:03.887459 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-164.ec2.internal" podStartSLOduration=2.887449512 podStartE2EDuration="2.887449512s" podCreationTimestamp="2026-05-20 14:09:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 14:09:03.887370947 +0000 UTC m=+3.627668863" watchObservedRunningTime="2026-05-20 14:09:03.887449512 +0000 UTC m=+3.627747426" May 20 14:09:04.232310 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:04.232226 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-v2ngr"] May 20 14:09:04.236629 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:04.236479 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2ngr" May 20 14:09:04.236629 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:04.236568 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2ngr" podUID="d3e67e53-49ad-4cb8-81dd-583176e309a3" May 20 14:09:04.256703 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:04.256668 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d3e67e53-49ad-4cb8-81dd-583176e309a3-dbus\") pod \"global-pull-secret-syncer-v2ngr\" (UID: \"d3e67e53-49ad-4cb8-81dd-583176e309a3\") " pod="kube-system/global-pull-secret-syncer-v2ngr" May 20 14:09:04.256886 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:04.256766 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d3e67e53-49ad-4cb8-81dd-583176e309a3-kubelet-config\") pod \"global-pull-secret-syncer-v2ngr\" (UID: \"d3e67e53-49ad-4cb8-81dd-583176e309a3\") " pod="kube-system/global-pull-secret-syncer-v2ngr" May 20 14:09:04.256886 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:04.256829 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3e67e53-49ad-4cb8-81dd-583176e309a3-original-pull-secret\") pod \"global-pull-secret-syncer-v2ngr\" (UID: \"d3e67e53-49ad-4cb8-81dd-583176e309a3\") " pod="kube-system/global-pull-secret-syncer-v2ngr" May 20 14:09:04.357434 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:04.357393 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d3e67e53-49ad-4cb8-81dd-583176e309a3-kubelet-config\") pod \"global-pull-secret-syncer-v2ngr\" (UID: \"d3e67e53-49ad-4cb8-81dd-583176e309a3\") " pod="kube-system/global-pull-secret-syncer-v2ngr" May 20 14:09:04.357623 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:04.357451 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb-metrics-certs\") pod \"network-metrics-daemon-m2p6p\" (UID: \"ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb\") " pod="openshift-multus/network-metrics-daemon-m2p6p" May 20 14:09:04.357623 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:04.357479 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3e67e53-49ad-4cb8-81dd-583176e309a3-original-pull-secret\") pod \"global-pull-secret-syncer-v2ngr\" (UID: \"d3e67e53-49ad-4cb8-81dd-583176e309a3\") " pod="kube-system/global-pull-secret-syncer-v2ngr" May 20 14:09:04.357623 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:04.357524 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d3e67e53-49ad-4cb8-81dd-583176e309a3-dbus\") pod \"global-pull-secret-syncer-v2ngr\" (UID: \"d3e67e53-49ad-4cb8-81dd-583176e309a3\") " pod="kube-system/global-pull-secret-syncer-v2ngr" May 20 14:09:04.357807 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:04.357632 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d3e67e53-49ad-4cb8-81dd-583176e309a3-dbus\") pod \"global-pull-secret-syncer-v2ngr\" (UID: \"d3e67e53-49ad-4cb8-81dd-583176e309a3\") " pod="kube-system/global-pull-secret-syncer-v2ngr" May 20 14:09:04.357807 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:04.357687 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d3e67e53-49ad-4cb8-81dd-583176e309a3-kubelet-config\") pod \"global-pull-secret-syncer-v2ngr\" (UID: \"d3e67e53-49ad-4cb8-81dd-583176e309a3\") " pod="kube-system/global-pull-secret-syncer-v2ngr" May 20 14:09:04.357807 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:04.357796 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 14:09:04.357964 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:04.357854 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb-metrics-certs podName:ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb nodeName:}" failed. No retries permitted until 2026-05-20 14:09:06.357836408 +0000 UTC m=+6.098134309 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb-metrics-certs") pod "network-metrics-daemon-m2p6p" (UID: "ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 14:09:04.358277 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:04.358255 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 20 14:09:04.358354 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:04.358306 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3e67e53-49ad-4cb8-81dd-583176e309a3-original-pull-secret podName:d3e67e53-49ad-4cb8-81dd-583176e309a3 nodeName:}" failed. No retries permitted until 2026-05-20 14:09:04.85829166 +0000 UTC m=+4.598589556 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3e67e53-49ad-4cb8-81dd-583176e309a3-original-pull-secret") pod "global-pull-secret-syncer-v2ngr" (UID: "d3e67e53-49ad-4cb8-81dd-583176e309a3") : object "kube-system"/"original-pull-secret" not registered May 20 14:09:04.559397 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:04.559358 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6scgv\" (UniqueName: \"kubernetes.io/projected/5052d255-8507-424c-aa56-2e94ec6d060f-kube-api-access-6scgv\") pod \"network-check-target-647bg\" (UID: \"5052d255-8507-424c-aa56-2e94ec6d060f\") " pod="openshift-network-diagnostics/network-check-target-647bg" May 20 14:09:04.559597 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:04.559578 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 14:09:04.559657 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:04.559604 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 14:09:04.559657 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:04.559617 2551 projected.go:194] Error preparing data for projected volume kube-api-access-6scgv for pod openshift-network-diagnostics/network-check-target-647bg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 14:09:04.559765 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:04.559677 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5052d255-8507-424c-aa56-2e94ec6d060f-kube-api-access-6scgv podName:5052d255-8507-424c-aa56-2e94ec6d060f nodeName:}" failed. No retries permitted until 2026-05-20 14:09:06.559658752 +0000 UTC m=+6.299956660 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6scgv" (UniqueName: "kubernetes.io/projected/5052d255-8507-424c-aa56-2e94ec6d060f-kube-api-access-6scgv") pod "network-check-target-647bg" (UID: "5052d255-8507-424c-aa56-2e94ec6d060f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 14:09:04.862644 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:04.862004 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3e67e53-49ad-4cb8-81dd-583176e309a3-original-pull-secret\") pod \"global-pull-secret-syncer-v2ngr\" (UID: \"d3e67e53-49ad-4cb8-81dd-583176e309a3\") " pod="kube-system/global-pull-secret-syncer-v2ngr" May 20 14:09:04.862644 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:04.862185 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 20 14:09:04.862644 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:04.862253 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3e67e53-49ad-4cb8-81dd-583176e309a3-original-pull-secret podName:d3e67e53-49ad-4cb8-81dd-583176e309a3 nodeName:}" failed. No retries permitted until 2026-05-20 14:09:05.862234748 +0000 UTC m=+5.602532658 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3e67e53-49ad-4cb8-81dd-583176e309a3-original-pull-secret") pod "global-pull-secret-syncer-v2ngr" (UID: "d3e67e53-49ad-4cb8-81dd-583176e309a3") : object "kube-system"/"original-pull-secret" not registered May 20 14:09:04.865815 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:04.865774 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2p6p" May 20 14:09:04.865997 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:04.865950 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2p6p" podUID="ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb" May 20 14:09:04.866085 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:04.866076 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-647bg" May 20 14:09:04.866197 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:04.866151 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-647bg" podUID="5052d255-8507-424c-aa56-2e94ec6d060f" May 20 14:09:04.894820 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:04.893846 2551 generic.go:358] "Generic (PLEG): container finished" podID="fe2859cafc41e5d23c2ec64bcc15789b" containerID="41a2c93dea6fce2e0194444be19211fe9330b8b304c7ea949f7b874308a7b32c" exitCode=0 May 20 14:09:04.894820 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:04.893960 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-164.ec2.internal" event={"ID":"fe2859cafc41e5d23c2ec64bcc15789b","Type":"ContainerDied","Data":"41a2c93dea6fce2e0194444be19211fe9330b8b304c7ea949f7b874308a7b32c"} May 20 14:09:05.864593 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:05.864105 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2ngr" May 20 14:09:05.864593 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:05.864230 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2ngr" podUID="d3e67e53-49ad-4cb8-81dd-583176e309a3" May 20 14:09:05.869387 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:05.869358 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3e67e53-49ad-4cb8-81dd-583176e309a3-original-pull-secret\") pod \"global-pull-secret-syncer-v2ngr\" (UID: \"d3e67e53-49ad-4cb8-81dd-583176e309a3\") " pod="kube-system/global-pull-secret-syncer-v2ngr" May 20 14:09:05.869534 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:05.869516 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 20 14:09:05.869597 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:05.869577 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3e67e53-49ad-4cb8-81dd-583176e309a3-original-pull-secret podName:d3e67e53-49ad-4cb8-81dd-583176e309a3 nodeName:}" failed. No retries permitted until 2026-05-20 14:09:07.869558098 +0000 UTC m=+7.609855994 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3e67e53-49ad-4cb8-81dd-583176e309a3-original-pull-secret") pod "global-pull-secret-syncer-v2ngr" (UID: "d3e67e53-49ad-4cb8-81dd-583176e309a3") : object "kube-system"/"original-pull-secret" not registered May 20 14:09:05.903040 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:05.903004 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-164.ec2.internal" event={"ID":"fe2859cafc41e5d23c2ec64bcc15789b","Type":"ContainerStarted","Data":"c4621cbf3636839d79d4abc9e320410a36568e3fc9307e3c0fc3b9f792807d26"} May 20 14:09:05.924035 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:05.923985 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-164.ec2.internal" podStartSLOduration=4.923966121 podStartE2EDuration="4.923966121s" podCreationTimestamp="2026-05-20 14:09:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 14:09:05.923511628 +0000 UTC m=+5.663809546" watchObservedRunningTime="2026-05-20 14:09:05.923966121 +0000 UTC m=+5.664264037" May 20 14:09:06.372890 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:06.372848 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb-metrics-certs\") pod \"network-metrics-daemon-m2p6p\" (UID: \"ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb\") " pod="openshift-multus/network-metrics-daemon-m2p6p" May 20 14:09:06.373061 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:06.373046 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 14:09:06.373122 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:06.373116 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb-metrics-certs podName:ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb nodeName:}" failed. No retries permitted until 2026-05-20 14:09:10.373098026 +0000 UTC m=+10.113395923 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb-metrics-certs") pod "network-metrics-daemon-m2p6p" (UID: "ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 14:09:06.574493 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:06.574452 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6scgv\" (UniqueName: \"kubernetes.io/projected/5052d255-8507-424c-aa56-2e94ec6d060f-kube-api-access-6scgv\") pod \"network-check-target-647bg\" (UID: \"5052d255-8507-424c-aa56-2e94ec6d060f\") " pod="openshift-network-diagnostics/network-check-target-647bg" May 20 14:09:06.574665 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:06.574649 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 14:09:06.574703 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:06.574674 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 14:09:06.574703 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:06.574688 2551 projected.go:194] Error preparing data for projected volume kube-api-access-6scgv for pod openshift-network-diagnostics/network-check-target-647bg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 14:09:06.574762 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:06.574746 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5052d255-8507-424c-aa56-2e94ec6d060f-kube-api-access-6scgv podName:5052d255-8507-424c-aa56-2e94ec6d060f nodeName:}" failed. No retries permitted until 2026-05-20 14:09:10.574729296 +0000 UTC m=+10.315027197 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6scgv" (UniqueName: "kubernetes.io/projected/5052d255-8507-424c-aa56-2e94ec6d060f-kube-api-access-6scgv") pod "network-check-target-647bg" (UID: "5052d255-8507-424c-aa56-2e94ec6d060f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 14:09:06.864190 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:06.864147 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-647bg" May 20 14:09:06.864367 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:06.864280 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-647bg" podUID="5052d255-8507-424c-aa56-2e94ec6d060f" May 20 14:09:06.864799 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:06.864509 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2p6p" May 20 14:09:06.864799 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:06.864709 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2p6p" podUID="ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb" May 20 14:09:07.864550 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:07.864499 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2ngr" May 20 14:09:07.864721 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:07.864653 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2ngr" podUID="d3e67e53-49ad-4cb8-81dd-583176e309a3" May 20 14:09:07.886555 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:07.886523 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3e67e53-49ad-4cb8-81dd-583176e309a3-original-pull-secret\") pod \"global-pull-secret-syncer-v2ngr\" (UID: \"d3e67e53-49ad-4cb8-81dd-583176e309a3\") " pod="kube-system/global-pull-secret-syncer-v2ngr" May 20 14:09:07.886996 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:07.886660 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 20 14:09:07.886996 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:07.886718 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3e67e53-49ad-4cb8-81dd-583176e309a3-original-pull-secret podName:d3e67e53-49ad-4cb8-81dd-583176e309a3 nodeName:}" failed. No retries permitted until 2026-05-20 14:09:11.886700564 +0000 UTC m=+11.626998472 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3e67e53-49ad-4cb8-81dd-583176e309a3-original-pull-secret") pod "global-pull-secret-syncer-v2ngr" (UID: "d3e67e53-49ad-4cb8-81dd-583176e309a3") : object "kube-system"/"original-pull-secret" not registered May 20 14:09:08.864571 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:08.863926 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-647bg" May 20 14:09:08.864571 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:08.864056 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-647bg" podUID="5052d255-8507-424c-aa56-2e94ec6d060f" May 20 14:09:08.864571 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:08.864426 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2p6p" May 20 14:09:08.864571 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:08.864528 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2p6p" podUID="ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb" May 20 14:09:09.863572 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:09.863543 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2ngr" May 20 14:09:09.864036 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:09.863663 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2ngr" podUID="d3e67e53-49ad-4cb8-81dd-583176e309a3" May 20 14:09:10.405982 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:10.405464 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb-metrics-certs\") pod \"network-metrics-daemon-m2p6p\" (UID: \"ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb\") " pod="openshift-multus/network-metrics-daemon-m2p6p" May 20 14:09:10.405982 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:10.405643 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 14:09:10.405982 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:10.405707 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb-metrics-certs podName:ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb nodeName:}" failed. No retries permitted until 2026-05-20 14:09:18.405688762 +0000 UTC m=+18.145986668 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb-metrics-certs") pod "network-metrics-daemon-m2p6p" (UID: "ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 14:09:10.607425 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:10.607379 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6scgv\" (UniqueName: \"kubernetes.io/projected/5052d255-8507-424c-aa56-2e94ec6d060f-kube-api-access-6scgv\") pod \"network-check-target-647bg\" (UID: \"5052d255-8507-424c-aa56-2e94ec6d060f\") " pod="openshift-network-diagnostics/network-check-target-647bg" May 20 14:09:10.608106 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:10.607599 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 14:09:10.608106 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:10.607633 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 14:09:10.608106 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:10.607647 2551 projected.go:194] Error preparing data for projected volume kube-api-access-6scgv for pod openshift-network-diagnostics/network-check-target-647bg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 14:09:10.608106 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:10.607715 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5052d255-8507-424c-aa56-2e94ec6d060f-kube-api-access-6scgv podName:5052d255-8507-424c-aa56-2e94ec6d060f nodeName:}" failed. No retries permitted until 2026-05-20 14:09:18.607693905 +0000 UTC m=+18.347991818 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6scgv" (UniqueName: "kubernetes.io/projected/5052d255-8507-424c-aa56-2e94ec6d060f-kube-api-access-6scgv") pod "network-check-target-647bg" (UID: "5052d255-8507-424c-aa56-2e94ec6d060f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 14:09:10.865046 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:10.864938 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-647bg" May 20 14:09:10.865046 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:10.864972 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2p6p" May 20 14:09:10.865606 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:10.865052 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-647bg" podUID="5052d255-8507-424c-aa56-2e94ec6d060f" May 20 14:09:10.865606 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:10.865144 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2p6p" podUID="ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb" May 20 14:09:11.864024 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:11.863988 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2ngr" May 20 14:09:11.864221 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:11.864133 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2ngr" podUID="d3e67e53-49ad-4cb8-81dd-583176e309a3" May 20 14:09:11.921229 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:11.921184 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3e67e53-49ad-4cb8-81dd-583176e309a3-original-pull-secret\") pod \"global-pull-secret-syncer-v2ngr\" (UID: \"d3e67e53-49ad-4cb8-81dd-583176e309a3\") " pod="kube-system/global-pull-secret-syncer-v2ngr" May 20 14:09:11.921704 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:11.921341 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 20 14:09:11.921704 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:11.921403 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3e67e53-49ad-4cb8-81dd-583176e309a3-original-pull-secret podName:d3e67e53-49ad-4cb8-81dd-583176e309a3 nodeName:}" failed. No retries permitted until 2026-05-20 14:09:19.921386586 +0000 UTC m=+19.661684497 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3e67e53-49ad-4cb8-81dd-583176e309a3-original-pull-secret") pod "global-pull-secret-syncer-v2ngr" (UID: "d3e67e53-49ad-4cb8-81dd-583176e309a3") : object "kube-system"/"original-pull-secret" not registered May 20 14:09:12.863646 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:12.863605 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2p6p" May 20 14:09:12.863839 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:12.863607 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-647bg" May 20 14:09:12.863839 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:12.863748 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2p6p" podUID="ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb" May 20 14:09:12.863952 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:12.863862 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-647bg" podUID="5052d255-8507-424c-aa56-2e94ec6d060f" May 20 14:09:13.863854 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:13.863756 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2ngr" May 20 14:09:13.864267 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:13.863886 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2ngr" podUID="d3e67e53-49ad-4cb8-81dd-583176e309a3" May 20 14:09:14.864112 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:14.863888 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-647bg" May 20 14:09:14.864524 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:14.863954 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2p6p" May 20 14:09:14.864524 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:14.864229 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-647bg" podUID="5052d255-8507-424c-aa56-2e94ec6d060f" May 20 14:09:14.864524 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:14.864306 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2p6p" podUID="ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb" May 20 14:09:15.864128 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:15.864092 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2ngr" May 20 14:09:15.864573 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:15.864216 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2ngr" podUID="d3e67e53-49ad-4cb8-81dd-583176e309a3" May 20 14:09:16.864266 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:16.864228 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2p6p" May 20 14:09:16.864708 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:16.864240 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-647bg" May 20 14:09:16.864708 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:16.864354 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2p6p" podUID="ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb" May 20 14:09:16.864708 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:16.864395 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-647bg" podUID="5052d255-8507-424c-aa56-2e94ec6d060f" May 20 14:09:17.864275 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:17.864239 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2ngr" May 20 14:09:17.864695 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:17.864359 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2ngr" podUID="d3e67e53-49ad-4cb8-81dd-583176e309a3" May 20 14:09:18.009952 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:18.009920 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-pjwj8"] May 20 14:09:18.044780 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:18.044748 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pjwj8" May 20 14:09:18.047429 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:18.047404 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 20 14:09:18.047569 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:18.047524 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-fnbpt\"" May 20 14:09:18.048473 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:18.048453 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 20 14:09:18.164411 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:18.164327 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/357ba598-e6a1-4cf4-9824-9206db075905-hosts-file\") pod \"node-resolver-pjwj8\" (UID: \"357ba598-e6a1-4cf4-9824-9206db075905\") " pod="openshift-dns/node-resolver-pjwj8" May 20 14:09:18.164411 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:18.164373 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/357ba598-e6a1-4cf4-9824-9206db075905-tmp-dir\") pod \"node-resolver-pjwj8\" (UID: \"357ba598-e6a1-4cf4-9824-9206db075905\") " pod="openshift-dns/node-resolver-pjwj8" May 20 14:09:18.164411 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:18.164403 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zb4gb\" (UniqueName: \"kubernetes.io/projected/357ba598-e6a1-4cf4-9824-9206db075905-kube-api-access-zb4gb\") pod \"node-resolver-pjwj8\" (UID: \"357ba598-e6a1-4cf4-9824-9206db075905\") " pod="openshift-dns/node-resolver-pjwj8" May 20 14:09:18.264734 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:18.264698 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/357ba598-e6a1-4cf4-9824-9206db075905-tmp-dir\") pod \"node-resolver-pjwj8\" (UID: \"357ba598-e6a1-4cf4-9824-9206db075905\") " pod="openshift-dns/node-resolver-pjwj8" May 20 14:09:18.264734 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:18.264744 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zb4gb\" (UniqueName: \"kubernetes.io/projected/357ba598-e6a1-4cf4-9824-9206db075905-kube-api-access-zb4gb\") pod \"node-resolver-pjwj8\" (UID: \"357ba598-e6a1-4cf4-9824-9206db075905\") " pod="openshift-dns/node-resolver-pjwj8" May 20 14:09:18.265075 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:18.264826 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/357ba598-e6a1-4cf4-9824-9206db075905-hosts-file\") pod \"node-resolver-pjwj8\" (UID: \"357ba598-e6a1-4cf4-9824-9206db075905\") " pod="openshift-dns/node-resolver-pjwj8" May 20 14:09:18.265075 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:18.264904 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/357ba598-e6a1-4cf4-9824-9206db075905-hosts-file\") pod \"node-resolver-pjwj8\" (UID: \"357ba598-e6a1-4cf4-9824-9206db075905\") " pod="openshift-dns/node-resolver-pjwj8" May 20 14:09:18.265194 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:18.265071 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/357ba598-e6a1-4cf4-9824-9206db075905-tmp-dir\") pod \"node-resolver-pjwj8\" (UID: \"357ba598-e6a1-4cf4-9824-9206db075905\") " pod="openshift-dns/node-resolver-pjwj8" May 20 14:09:18.274437 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:18.274408 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb4gb\" (UniqueName: \"kubernetes.io/projected/357ba598-e6a1-4cf4-9824-9206db075905-kube-api-access-zb4gb\") pod \"node-resolver-pjwj8\" (UID: \"357ba598-e6a1-4cf4-9824-9206db075905\") " pod="openshift-dns/node-resolver-pjwj8" May 20 14:09:18.354429 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:18.354384 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pjwj8" May 20 14:09:18.466155 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:18.466065 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb-metrics-certs\") pod \"network-metrics-daemon-m2p6p\" (UID: \"ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb\") " pod="openshift-multus/network-metrics-daemon-m2p6p" May 20 14:09:18.466325 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:18.466223 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 14:09:18.466325 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:18.466306 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb-metrics-certs podName:ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb nodeName:}" failed. No retries permitted until 2026-05-20 14:09:34.466282165 +0000 UTC m=+34.206580074 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb-metrics-certs") pod "network-metrics-daemon-m2p6p" (UID: "ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 14:09:18.667051 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:18.667010 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6scgv\" (UniqueName: \"kubernetes.io/projected/5052d255-8507-424c-aa56-2e94ec6d060f-kube-api-access-6scgv\") pod \"network-check-target-647bg\" (UID: \"5052d255-8507-424c-aa56-2e94ec6d060f\") " pod="openshift-network-diagnostics/network-check-target-647bg" May 20 14:09:18.667239 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:18.667176 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 14:09:18.667239 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:18.667196 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 14:09:18.667239 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:18.667206 2551 projected.go:194] Error preparing data for projected volume kube-api-access-6scgv for pod openshift-network-diagnostics/network-check-target-647bg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 14:09:18.667401 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:18.667264 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5052d255-8507-424c-aa56-2e94ec6d060f-kube-api-access-6scgv podName:5052d255-8507-424c-aa56-2e94ec6d060f nodeName:}" failed. No retries permitted until 2026-05-20 14:09:34.66724455 +0000 UTC m=+34.407542443 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6scgv" (UniqueName: "kubernetes.io/projected/5052d255-8507-424c-aa56-2e94ec6d060f-kube-api-access-6scgv") pod "network-check-target-647bg" (UID: "5052d255-8507-424c-aa56-2e94ec6d060f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 14:09:18.863546 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:18.863501 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-647bg" May 20 14:09:18.863726 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:18.863501 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2p6p" May 20 14:09:18.863726 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:18.863618 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-647bg" podUID="5052d255-8507-424c-aa56-2e94ec6d060f" May 20 14:09:18.863726 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:18.863690 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2p6p" podUID="ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb" May 20 14:09:19.864239 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:19.864194 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2ngr" May 20 14:09:19.864692 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:19.864332 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2ngr" podUID="d3e67e53-49ad-4cb8-81dd-583176e309a3" May 20 14:09:19.979624 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:19.979588 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3e67e53-49ad-4cb8-81dd-583176e309a3-original-pull-secret\") pod \"global-pull-secret-syncer-v2ngr\" (UID: \"d3e67e53-49ad-4cb8-81dd-583176e309a3\") " pod="kube-system/global-pull-secret-syncer-v2ngr" May 20 14:09:19.979835 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:19.979713 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 20 14:09:19.979835 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:19.979775 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3e67e53-49ad-4cb8-81dd-583176e309a3-original-pull-secret podName:d3e67e53-49ad-4cb8-81dd-583176e309a3 nodeName:}" failed. No retries permitted until 2026-05-20 14:09:35.979760349 +0000 UTC m=+35.720058246 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3e67e53-49ad-4cb8-81dd-583176e309a3-original-pull-secret") pod "global-pull-secret-syncer-v2ngr" (UID: "d3e67e53-49ad-4cb8-81dd-583176e309a3") : object "kube-system"/"original-pull-secret" not registered May 20 14:09:20.864676 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:20.864641 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2p6p" May 20 14:09:20.865129 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:20.864775 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2p6p" podUID="ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb" May 20 14:09:20.865129 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:20.864832 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-647bg" May 20 14:09:20.865129 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:20.864939 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-647bg" podUID="5052d255-8507-424c-aa56-2e94ec6d060f" May 20 14:09:21.778905 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:21.778880 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod357ba598_e6a1_4cf4_9824_9206db075905.slice/crio-1e8af036653848a6079d41a5f37a991c1b499b327f5d470adae41332d77db280 WatchSource:0}: Error finding container 1e8af036653848a6079d41a5f37a991c1b499b327f5d470adae41332d77db280: Status 404 returned error can't find the container with id 1e8af036653848a6079d41a5f37a991c1b499b327f5d470adae41332d77db280 May 20 14:09:21.863627 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:21.863592 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2ngr" May 20 14:09:21.863741 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:21.863722 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2ngr" podUID="d3e67e53-49ad-4cb8-81dd-583176e309a3" May 20 14:09:21.937021 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:21.936985 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pjwj8" event={"ID":"357ba598-e6a1-4cf4-9824-9206db075905","Type":"ContainerStarted","Data":"1e8af036653848a6079d41a5f37a991c1b499b327f5d470adae41332d77db280"} May 20 14:09:21.943409 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:21.942877 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qqv5s" event={"ID":"efac700d-53e9-4404-83e9-c97b81f73d7b","Type":"ContainerStarted","Data":"2d5a722cec8a0e8957a94c51a42624284a303fed4076d50d6f4ea0da6fcc7489"} May 20 14:09:21.970255 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:21.970004 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-qqv5s" podStartSLOduration=2.8366579290000002 podStartE2EDuration="20.969987658s" podCreationTimestamp="2026-05-20 14:09:01 +0000 UTC" firstStartedPulling="2026-05-20 14:09:03.642006168 +0000 UTC m=+3.382304064" lastFinishedPulling="2026-05-20 14:09:21.775335893 +0000 UTC m=+21.515633793" observedRunningTime="2026-05-20 14:09:21.967873499 +0000 UTC m=+21.708171414" watchObservedRunningTime="2026-05-20 14:09:21.969987658 +0000 UTC m=+21.710285574" May 20 14:09:21.997057 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:21.996805 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dswp2" podStartSLOduration=3.859530715 podStartE2EDuration="21.996766136s" podCreationTimestamp="2026-05-20 14:09:00 +0000 UTC" firstStartedPulling="2026-05-20 14:09:03.638358808 +0000 UTC m=+3.378656715" lastFinishedPulling="2026-05-20 14:09:21.77559424 +0000 UTC m=+21.515892136" observedRunningTime="2026-05-20 14:09:21.996147382 +0000 UTC m=+21.736445298" watchObservedRunningTime="2026-05-20 14:09:21.996766136 +0000 UTC m=+21.737064052" May 20 14:09:22.864309 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:22.864275 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-647bg" May 20 14:09:22.864481 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:22.864275 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2p6p" May 20 14:09:22.864481 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:22.864394 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-647bg" podUID="5052d255-8507-424c-aa56-2e94ec6d060f" May 20 14:09:22.864481 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:22.864446 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2p6p" podUID="ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb" May 20 14:09:22.949204 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:22.949171 2551 generic.go:358] "Generic (PLEG): container finished" podID="b8a30337-47c1-4c73-ad43-87551f5adf02" containerID="62551d64117e8f1712208d93e20ce9d34fec0b8018ca985b8cd4b868e262b016" exitCode=0 May 20 14:09:22.949639 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:22.949253 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-69szq" event={"ID":"b8a30337-47c1-4c73-ad43-87551f5adf02","Type":"ContainerDied","Data":"62551d64117e8f1712208d93e20ce9d34fec0b8018ca985b8cd4b868e262b016"} May 20 14:09:22.950638 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:22.950490 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pjwj8" event={"ID":"357ba598-e6a1-4cf4-9824-9206db075905","Type":"ContainerStarted","Data":"4e7f3557de23644f0540cbc82032e547a7f45d91c38d92213ebeb04ed63ed2ce"} May 20 14:09:22.951648 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:22.951627 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dswp2" event={"ID":"30438ca2-f3c2-42e8-9664-2f91f826bc45","Type":"ContainerStarted","Data":"a075e5d0a9bf9cf9b16cbcc8d68a2f542c606809cc47105c6faa555332e3052c"} May 20 14:09:22.952835 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:22.952812 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhgtf" event={"ID":"7681b0e8-c9eb-405d-a05f-93b077b403ba","Type":"ContainerStarted","Data":"b68a761893769d3a0bb3adbc1d6ed3bfedfca88ddc2b4dd16fb09ab248139b3a"} May 20 14:09:22.954042 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:22.954020 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zklgl" event={"ID":"a2289b16-7fb4-4409-bfc9-5805b74161dc","Type":"ContainerStarted","Data":"267183fa41993f9989d8a253aaf3e4bca3e1635d2eee5b0516b0c2decddcd754"} May 20 14:09:22.955185 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:22.955165 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wl72b" event={"ID":"03ff3c4e-874c-46d1-bc2f-a86677878e83","Type":"ContainerStarted","Data":"b4cc33879df71c24e33575aa8228eea28a9af02929ca78965e71abc483737912"} May 20 14:09:22.957884 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:22.957866 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" event={"ID":"75f22758-90d8-4dd5-ab8e-74e8ec2badc1","Type":"ContainerStarted","Data":"dcac38e614bc1cd2acb31cc2b1ba449d94aa04f2df34c13cab81c958cd271bf4"} May 20 14:09:22.957965 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:22.957890 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" event={"ID":"75f22758-90d8-4dd5-ab8e-74e8ec2badc1","Type":"ContainerStarted","Data":"dfebc3b85901715eb4581ef5dc8cc4187689d53fc3f9ae8f1276e57f25089d11"} May 20 14:09:22.957965 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:22.957900 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" event={"ID":"75f22758-90d8-4dd5-ab8e-74e8ec2badc1","Type":"ContainerStarted","Data":"3baed23dc2a7e50d877ed41c0d1010e9230a65f13f936516d6ead30faf6f5ee2"} May 20 14:09:22.957965 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:22.957910 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" event={"ID":"75f22758-90d8-4dd5-ab8e-74e8ec2badc1","Type":"ContainerStarted","Data":"8d8a7fc8da78a27e599a5b8f7e20187908e6001efdde50ebcd9ce146e0194a80"} May 20 14:09:22.957965 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:22.957918 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" event={"ID":"75f22758-90d8-4dd5-ab8e-74e8ec2badc1","Type":"ContainerStarted","Data":"fb4ff71b5a814db38a020a1d828e84768bf779328d2c6d88d911eb4467fea269"} May 20 14:09:22.957965 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:22.957927 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" event={"ID":"75f22758-90d8-4dd5-ab8e-74e8ec2badc1","Type":"ContainerStarted","Data":"6ec91e023b7809458e085f43134f4c3b3a3b02f4e371806b5944f55096b0eb4f"} May 20 14:09:22.986487 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:22.986435 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-pjwj8" podStartSLOduration=5.986423517 podStartE2EDuration="5.986423517s" podCreationTimestamp="2026-05-20 14:09:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 14:09:22.98581557 +0000 UTC m=+22.726113485" watchObservedRunningTime="2026-05-20 14:09:22.986423517 +0000 UTC m=+22.726721433" May 20 14:09:23.001653 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:23.001604 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-wl72b" podStartSLOduration=4.868648579 podStartE2EDuration="23.00159076s" podCreationTimestamp="2026-05-20 14:09:00 +0000 UTC" firstStartedPulling="2026-05-20 14:09:03.638570625 +0000 UTC m=+3.378868521" lastFinishedPulling="2026-05-20 14:09:21.771512802 +0000 UTC m=+21.511810702" observedRunningTime="2026-05-20 14:09:23.001184599 +0000 UTC m=+22.741482509" watchObservedRunningTime="2026-05-20 14:09:23.00159076 +0000 UTC m=+22.741888674" May 20 14:09:23.017650 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:23.017605 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zklgl" podStartSLOduration=8.726030464 podStartE2EDuration="22.017591264s" podCreationTimestamp="2026-05-20 14:09:01 +0000 UTC" firstStartedPulling="2026-05-20 14:09:03.634113004 +0000 UTC m=+3.374410915" lastFinishedPulling="2026-05-20 14:09:16.92567382 +0000 UTC m=+16.665971715" observedRunningTime="2026-05-20 14:09:23.017110273 +0000 UTC m=+22.757408202" watchObservedRunningTime="2026-05-20 14:09:23.017591264 +0000 UTC m=+22.757889193" May 20 14:09:23.165221 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:23.165186 2551 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 20 14:09:23.796805 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:23.796599 2551 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-20T14:09:23.16520924Z","UUID":"aff51bc0-7f04-4b90-a923-711349d16842","Handler":null,"Name":"","Endpoint":""} May 20 14:09:23.799282 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:23.799260 2551 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 20 14:09:23.799412 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:23.799290 2551 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 20 14:09:23.863665 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:23.863634 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2ngr" May 20 14:09:23.863887 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:23.863766 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2ngr" podUID="d3e67e53-49ad-4cb8-81dd-583176e309a3" May 20 14:09:23.961362 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:23.961324 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9lkk5" event={"ID":"7019fc5d-a470-4b78-9296-bd5d3bfffe65","Type":"ContainerStarted","Data":"832fd312b3d81ec60d1cefd95e314601ec32a8521f9a38c0c0ee5ec323760c47"} May 20 14:09:23.963342 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:23.963311 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhgtf" event={"ID":"7681b0e8-c9eb-405d-a05f-93b077b403ba","Type":"ContainerStarted","Data":"8c632fa7e298425831cf2303fd4f4c56921a3dff085567465d2080d8adb0e1cc"} May 20 14:09:23.978874 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:23.978213 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9lkk5" podStartSLOduration=4.8689471730000005 podStartE2EDuration="22.978196093s" podCreationTimestamp="2026-05-20 14:09:01 +0000 UTC" firstStartedPulling="2026-05-20 14:09:03.630829997 +0000 UTC m=+3.371127890" lastFinishedPulling="2026-05-20 14:09:21.740078903 +0000 UTC m=+21.480376810" observedRunningTime="2026-05-20 14:09:23.97817354 +0000 UTC m=+23.718471460" watchObservedRunningTime="2026-05-20 14:09:23.978196093 +0000 UTC m=+23.718494010" May 20 14:09:24.863839 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:24.863801 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2p6p" May 20 14:09:24.863839 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:24.863805 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-647bg" May 20 14:09:24.864078 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:24.863980 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-647bg" podUID="5052d255-8507-424c-aa56-2e94ec6d060f" May 20 14:09:24.864078 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:24.864014 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2p6p" podUID="ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb" May 20 14:09:24.967194 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:24.967158 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhgtf" event={"ID":"7681b0e8-c9eb-405d-a05f-93b077b403ba","Type":"ContainerStarted","Data":"5e0615429e8af78c6f33683c1cc1b26867bfe92434412ac38a060d5cab9a6d5f"} May 20 14:09:24.970466 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:24.970436 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" event={"ID":"75f22758-90d8-4dd5-ab8e-74e8ec2badc1","Type":"ContainerStarted","Data":"d62747103d07e29783b0df4e9f0f77586ef65c437d7352f18ba72b6488cd1935"} May 20 14:09:24.989104 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:24.989057 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhgtf" podStartSLOduration=4.125132443 podStartE2EDuration="24.989043309s" podCreationTimestamp="2026-05-20 14:09:00 +0000 UTC" firstStartedPulling="2026-05-20 14:09:03.637006541 +0000 UTC m=+3.377304442" lastFinishedPulling="2026-05-20 14:09:24.500917404 +0000 UTC m=+24.241215308" observedRunningTime="2026-05-20 14:09:24.987995691 +0000 UTC m=+24.728293605" watchObservedRunningTime="2026-05-20 14:09:24.989043309 +0000 UTC m=+24.729341223" May 20 14:09:25.864366 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:25.864333 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2ngr" May 20 14:09:25.864549 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:25.864453 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2ngr" podUID="d3e67e53-49ad-4cb8-81dd-583176e309a3" May 20 14:09:26.575311 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:26.575272 2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-wl72b" May 20 14:09:26.576248 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:26.576226 2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-wl72b" May 20 14:09:26.863912 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:26.863836 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2p6p" May 20 14:09:26.864051 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:26.863836 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-647bg" May 20 14:09:26.864051 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:26.863988 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2p6p" podUID="ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb" May 20 14:09:26.864051 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:26.864010 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-647bg" podUID="5052d255-8507-424c-aa56-2e94ec6d060f" May 20 14:09:26.979186 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:26.978806 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" event={"ID":"75f22758-90d8-4dd5-ab8e-74e8ec2badc1","Type":"ContainerStarted","Data":"95dc2168dc69de2f2f38199bf701beb6089eea3e130b2c48572b698c51feee94"} May 20 14:09:26.979186 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:26.979107 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-wl72b" May 20 14:09:26.979398 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:26.979227 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:26.979398 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:26.979252 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:26.979398 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:26.979265 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:26.980276 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:26.979963 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wl72b" May 20 14:09:26.995667 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:26.995497 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:26.995667 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:26.995561 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:09:27.007676 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:27.007593 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" podStartSLOduration=8.797868323 podStartE2EDuration="27.007579846s" podCreationTimestamp="2026-05-20 14:09:00 +0000 UTC" firstStartedPulling="2026-05-20 14:09:03.635895257 +0000 UTC m=+3.376193153" lastFinishedPulling="2026-05-20 14:09:21.845606768 +0000 UTC m=+21.585904676" observedRunningTime="2026-05-20 14:09:27.005887981 +0000 UTC m=+26.746185896" watchObservedRunningTime="2026-05-20 14:09:27.007579846 +0000 UTC m=+26.747877761" May 20 14:09:27.864093 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:27.864058 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2ngr" May 20 14:09:27.864495 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:27.864159 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2ngr" podUID="d3e67e53-49ad-4cb8-81dd-583176e309a3" May 20 14:09:27.981839 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:27.981800 2551 generic.go:358] "Generic (PLEG): container finished" podID="b8a30337-47c1-4c73-ad43-87551f5adf02" containerID="5af50994c675f23801f057276934ef9680268f4d9ee802b1d9b1eec897640c65" exitCode=0 May 20 14:09:27.982120 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:27.981879 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-69szq" event={"ID":"b8a30337-47c1-4c73-ad43-87551f5adf02","Type":"ContainerDied","Data":"5af50994c675f23801f057276934ef9680268f4d9ee802b1d9b1eec897640c65"} May 20 14:09:28.864284 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:28.864117 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-647bg" May 20 14:09:28.864807 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:28.864349 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-647bg" podUID="5052d255-8507-424c-aa56-2e94ec6d060f" May 20 14:09:28.864807 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:28.864181 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2p6p" May 20 14:09:28.864807 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:28.864427 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2p6p" podUID="ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb" May 20 14:09:28.905943 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:28.905909 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-v2ngr"] May 20 14:09:28.906084 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:28.906000 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2ngr" May 20 14:09:28.906129 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:28.906092 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2ngr" podUID="d3e67e53-49ad-4cb8-81dd-583176e309a3" May 20 14:09:28.909516 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:28.909487 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-647bg"] May 20 14:09:28.910172 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:28.910152 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-m2p6p"] May 20 14:09:28.983902 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:28.983876 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2p6p" May 20 14:09:28.984009 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:28.983878 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-647bg" May 20 14:09:28.984118 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:28.984090 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2p6p" podUID="ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb" May 20 14:09:28.984183 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:28.984137 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-647bg" podUID="5052d255-8507-424c-aa56-2e94ec6d060f" May 20 14:09:29.690389 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:29.690279 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pjwj8_357ba598-e6a1-4cf4-9824-9206db075905/dns-node-resolver/0.log" May 20 14:09:29.986895 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:29.986818 2551 generic.go:358] "Generic (PLEG): container finished" podID="b8a30337-47c1-4c73-ad43-87551f5adf02" containerID="e79e011b26496196942eb19118ddcb3e160bb6f9f2d4a7c859721780c231ce61" exitCode=0 May 20 14:09:29.986895 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:29.986874 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-69szq" event={"ID":"b8a30337-47c1-4c73-ad43-87551f5adf02","Type":"ContainerDied","Data":"e79e011b26496196942eb19118ddcb3e160bb6f9f2d4a7c859721780c231ce61"} May 20 14:09:30.471597 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:30.471561 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zklgl_a2289b16-7fb4-4409-bfc9-5805b74161dc/node-ca/0.log" May 20 14:09:30.864714 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:30.864684 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-647bg" May 20 14:09:30.864881 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:30.864781 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-647bg" podUID="5052d255-8507-424c-aa56-2e94ec6d060f" May 20 14:09:30.864881 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:30.864835 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2p6p" May 20 14:09:30.864998 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:30.864939 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2p6p" podUID="ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb" May 20 14:09:30.864998 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:30.864959 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2ngr" May 20 14:09:30.865106 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:30.865041 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2ngr" podUID="d3e67e53-49ad-4cb8-81dd-583176e309a3" May 20 14:09:31.993231 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:31.993182 2551 generic.go:358] "Generic (PLEG): container finished" podID="b8a30337-47c1-4c73-ad43-87551f5adf02" containerID="1094f2f3f2ae13ea6eef35aacf279b40bdcf09512c62e7e22cfa7387f612fa05" exitCode=0 May 20 14:09:31.993672 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:31.993238 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-69szq" event={"ID":"b8a30337-47c1-4c73-ad43-87551f5adf02","Type":"ContainerDied","Data":"1094f2f3f2ae13ea6eef35aacf279b40bdcf09512c62e7e22cfa7387f612fa05"} May 20 14:09:32.867476 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:32.867266 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-647bg" May 20 14:09:32.867654 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:32.867296 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2ngr" May 20 14:09:32.867654 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:32.867560 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-647bg" podUID="5052d255-8507-424c-aa56-2e94ec6d060f" May 20 14:09:32.867654 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:32.867325 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2p6p" May 20 14:09:32.867654 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:32.867638 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2ngr" podUID="d3e67e53-49ad-4cb8-81dd-583176e309a3" May 20 14:09:32.867836 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:32.867725 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2p6p" podUID="ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb" May 20 14:09:34.495037 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:34.494999 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb-metrics-certs\") pod \"network-metrics-daemon-m2p6p\" (UID: \"ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb\") " pod="openshift-multus/network-metrics-daemon-m2p6p" May 20 14:09:34.495575 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:34.495135 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 14:09:34.495575 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:34.495195 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb-metrics-certs podName:ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb nodeName:}" failed. No retries permitted until 2026-05-20 14:10:06.495178169 +0000 UTC m=+66.235476067 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb-metrics-certs") pod "network-metrics-daemon-m2p6p" (UID: "ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 14:09:34.696641 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:34.696606 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6scgv\" (UniqueName: \"kubernetes.io/projected/5052d255-8507-424c-aa56-2e94ec6d060f-kube-api-access-6scgv\") pod \"network-check-target-647bg\" (UID: \"5052d255-8507-424c-aa56-2e94ec6d060f\") " pod="openshift-network-diagnostics/network-check-target-647bg" May 20 14:09:34.696847 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:34.696814 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 14:09:34.696847 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:34.696838 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 14:09:34.696975 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:34.696851 2551 projected.go:194] Error preparing data for projected volume kube-api-access-6scgv for pod openshift-network-diagnostics/network-check-target-647bg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 14:09:34.696975 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:34.696918 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5052d255-8507-424c-aa56-2e94ec6d060f-kube-api-access-6scgv podName:5052d255-8507-424c-aa56-2e94ec6d060f nodeName:}" failed. No retries permitted until 2026-05-20 14:10:06.696900392 +0000 UTC m=+66.437198286 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6scgv" (UniqueName: "kubernetes.io/projected/5052d255-8507-424c-aa56-2e94ec6d060f-kube-api-access-6scgv") pod "network-check-target-647bg" (UID: "5052d255-8507-424c-aa56-2e94ec6d060f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 14:09:34.867325 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:34.867297 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2ngr" May 20 14:09:34.867521 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:34.867297 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-647bg" May 20 14:09:34.867521 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:34.867412 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2ngr" podUID="d3e67e53-49ad-4cb8-81dd-583176e309a3" May 20 14:09:34.867521 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:34.867297 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2p6p" May 20 14:09:34.867521 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:34.867476 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-647bg" podUID="5052d255-8507-424c-aa56-2e94ec6d060f" May 20 14:09:34.867729 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:34.867582 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2p6p" podUID="ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb" May 20 14:09:36.006712 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:36.006677 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3e67e53-49ad-4cb8-81dd-583176e309a3-original-pull-secret\") pod \"global-pull-secret-syncer-v2ngr\" (UID: \"d3e67e53-49ad-4cb8-81dd-583176e309a3\") " pod="kube-system/global-pull-secret-syncer-v2ngr" May 20 14:09:36.007196 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:36.006832 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 20 14:09:36.007196 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:36.006904 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3e67e53-49ad-4cb8-81dd-583176e309a3-original-pull-secret podName:d3e67e53-49ad-4cb8-81dd-583176e309a3 nodeName:}" failed. No retries permitted until 2026-05-20 14:10:08.006884846 +0000 UTC m=+67.747182745 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3e67e53-49ad-4cb8-81dd-583176e309a3-original-pull-secret") pod "global-pull-secret-syncer-v2ngr" (UID: "d3e67e53-49ad-4cb8-81dd-583176e309a3") : object "kube-system"/"original-pull-secret" not registered May 20 14:09:36.867029 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:36.866998 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-647bg" May 20 14:09:36.867029 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:36.867022 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2ngr" May 20 14:09:36.867263 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:36.866998 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2p6p" May 20 14:09:36.867263 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:36.867113 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-647bg" podUID="5052d255-8507-424c-aa56-2e94ec6d060f" May 20 14:09:36.867263 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:36.867218 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2p6p" podUID="ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb" May 20 14:09:36.867399 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:36.867297 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2ngr" podUID="d3e67e53-49ad-4cb8-81dd-583176e309a3" May 20 14:09:38.006446 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:38.006410 2551 generic.go:358] "Generic (PLEG): container finished" podID="b8a30337-47c1-4c73-ad43-87551f5adf02" containerID="930e4fbc1414667a7844d3be3a1625d8a8adc702ba5e6d973dd5b30b309c87e1" exitCode=0 May 20 14:09:38.006899 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:38.006460 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-69szq" event={"ID":"b8a30337-47c1-4c73-ad43-87551f5adf02","Type":"ContainerDied","Data":"930e4fbc1414667a7844d3be3a1625d8a8adc702ba5e6d973dd5b30b309c87e1"} May 20 14:09:38.863762 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:38.863722 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-647bg" May 20 14:09:38.863762 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:38.863749 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2ngr" May 20 14:09:38.864006 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:38.863844 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2p6p" May 20 14:09:38.864006 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:38.863855 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-647bg" podUID="5052d255-8507-424c-aa56-2e94ec6d060f" May 20 14:09:38.864006 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:38.863909 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2ngr" podUID="d3e67e53-49ad-4cb8-81dd-583176e309a3" May 20 14:09:38.864006 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:38.863996 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2p6p" podUID="ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb" May 20 14:09:39.011178 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:39.011144 2551 generic.go:358] "Generic (PLEG): container finished" podID="b8a30337-47c1-4c73-ad43-87551f5adf02" containerID="f7baaaebcbb3d11cb7d0161f4e2d860bc91639de74f9d3080250c5688f4ea321" exitCode=0 May 20 14:09:39.011544 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:39.011198 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-69szq" event={"ID":"b8a30337-47c1-4c73-ad43-87551f5adf02","Type":"ContainerDied","Data":"f7baaaebcbb3d11cb7d0161f4e2d860bc91639de74f9d3080250c5688f4ea321"} May 20 14:09:40.016282 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:40.016246 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-69szq" event={"ID":"b8a30337-47c1-4c73-ad43-87551f5adf02","Type":"ContainerStarted","Data":"47464aaf4b56449f2371ffd11580e865ff1460c1418d09f01c9d5535bc18a955"} May 20 14:09:40.042903 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:40.042855 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-69szq" podStartSLOduration=6.136743016 podStartE2EDuration="40.042841454s" podCreationTimestamp="2026-05-20 14:09:00 +0000 UTC" firstStartedPulling="2026-05-20 14:09:03.630812897 +0000 UTC m=+3.371110802" lastFinishedPulling="2026-05-20 14:09:37.536911345 +0000 UTC m=+37.277209240" observedRunningTime="2026-05-20 14:09:40.042507961 +0000 UTC m=+39.782805887" watchObservedRunningTime="2026-05-20 14:09:40.042841454 +0000 UTC m=+39.783139369" May 20 14:09:40.864110 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:40.864077 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-647bg" May 20 14:09:40.864274 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:40.864157 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-647bg" podUID="5052d255-8507-424c-aa56-2e94ec6d060f" May 20 14:09:40.864274 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:40.864240 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2p6p" May 20 14:09:40.864357 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:40.864331 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2p6p" podUID="ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb" May 20 14:09:40.864438 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:40.864420 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2ngr" May 20 14:09:40.864534 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:40.864518 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2ngr" podUID="d3e67e53-49ad-4cb8-81dd-583176e309a3" May 20 14:09:42.864097 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:42.864065 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-647bg" May 20 14:09:42.864571 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:42.864118 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2ngr" May 20 14:09:42.864571 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:42.864133 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2p6p" May 20 14:09:42.864571 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:42.864201 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2ngr" podUID="d3e67e53-49ad-4cb8-81dd-583176e309a3" May 20 14:09:42.864571 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:42.864299 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2p6p" podUID="ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb" May 20 14:09:42.864571 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:42.864396 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-647bg" podUID="5052d255-8507-424c-aa56-2e94ec6d060f" May 20 14:09:44.863410 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:44.863374 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2ngr" May 20 14:09:44.863815 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:44.863374 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-647bg" May 20 14:09:44.863815 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:44.863482 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2ngr" podUID="d3e67e53-49ad-4cb8-81dd-583176e309a3" May 20 14:09:44.863815 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:44.863385 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2p6p" May 20 14:09:44.863815 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:44.863555 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-647bg" podUID="5052d255-8507-424c-aa56-2e94ec6d060f" May 20 14:09:44.863815 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:44.863652 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2p6p" podUID="ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb" May 20 14:09:46.863457 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:46.863415 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-647bg" May 20 14:09:46.863457 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:46.863449 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2ngr" May 20 14:09:46.864078 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:46.863512 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-647bg" podUID="5052d255-8507-424c-aa56-2e94ec6d060f" May 20 14:09:46.864078 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:46.863550 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2p6p" May 20 14:09:46.864078 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:46.863629 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2p6p" podUID="ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb" May 20 14:09:46.864078 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:46.863726 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2ngr" podUID="d3e67e53-49ad-4cb8-81dd-583176e309a3" May 20 14:09:48.863530 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:48.863499 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2p6p" May 20 14:09:48.864028 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:48.863603 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-647bg" May 20 14:09:48.864028 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:48.863604 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2p6p" podUID="ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb" May 20 14:09:48.864028 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:48.863615 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2ngr" May 20 14:09:48.864028 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:48.863687 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-647bg" podUID="5052d255-8507-424c-aa56-2e94ec6d060f" May 20 14:09:48.864028 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:48.863749 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2ngr" podUID="d3e67e53-49ad-4cb8-81dd-583176e309a3" May 20 14:09:50.864549 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:50.864515 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2ngr" May 20 14:09:50.864922 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:50.864593 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2ngr" podUID="d3e67e53-49ad-4cb8-81dd-583176e309a3" May 20 14:09:50.864922 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:50.864681 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2p6p" May 20 14:09:50.864922 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:50.864805 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-647bg" May 20 14:09:50.864922 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:50.864813 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2p6p" podUID="ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb" May 20 14:09:50.864922 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:50.864852 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-647bg" podUID="5052d255-8507-424c-aa56-2e94ec6d060f" May 20 14:09:52.863766 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:52.863730 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-647bg" May 20 14:09:52.864237 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:52.863779 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2p6p" May 20 14:09:52.864237 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:52.863879 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2ngr" May 20 14:09:52.864237 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:52.863881 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2p6p" podUID="ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb" May 20 14:09:52.864237 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:52.863953 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-647bg" podUID="5052d255-8507-424c-aa56-2e94ec6d060f" May 20 14:09:52.864237 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:09:52.864056 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v2ngr" podUID="d3e67e53-49ad-4cb8-81dd-583176e309a3" May 20 14:09:54.529326 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.529249 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-164.ec2.internal" event="NodeReady" May 20 14:09:54.529670 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.529381 2551 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 20 14:09:54.574006 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.573974 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tk4mc"] May 20 14:09:54.576635 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.576609 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tk4mc" May 20 14:09:54.577229 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.577210 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8r442"] May 20 14:09:54.578485 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.578471 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8r442" May 20 14:09:54.579268 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.579251 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-p2cj4\"" May 20 14:09:54.579458 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.579442 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 20 14:09:54.579509 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.579477 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 20 14:09:54.580995 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.580979 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 20 14:09:54.581725 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.581710 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6xs8z\"" May 20 14:09:54.581940 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.581923 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 20 14:09:54.582005 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.581924 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 20 14:09:54.586193 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.586170 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tk4mc"] May 20 14:09:54.589695 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.589671 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8r442"] May 20 14:09:54.601831 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.601809 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mzs7q"] May 20 14:09:54.603457 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.603441 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mzs7q" May 20 14:09:54.606189 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.606165 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 20 14:09:54.606288 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.606211 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lggfn\"" May 20 14:09:54.606288 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.606228 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 20 14:09:54.606396 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.606228 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 20 14:09:54.606396 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.606216 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 20 14:09:54.617122 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.617075 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mzs7q"] May 20 14:09:54.641587 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.641557 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ndl2\" (UniqueName: \"kubernetes.io/projected/475bb6aa-70af-41d2-a009-d11abbbc4484-kube-api-access-9ndl2\") pod \"insights-runtime-extractor-mzs7q\" (UID: \"475bb6aa-70af-41d2-a009-d11abbbc4484\") " pod="openshift-insights/insights-runtime-extractor-mzs7q" May 20 14:09:54.641587 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.641588 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/475bb6aa-70af-41d2-a009-d11abbbc4484-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mzs7q\" (UID: \"475bb6aa-70af-41d2-a009-d11abbbc4484\") " pod="openshift-insights/insights-runtime-extractor-mzs7q" May 20 14:09:54.641761 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.641607 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2a54ec7c-1906-444e-b76c-340571083dec-config-volume\") pod \"dns-default-tk4mc\" (UID: \"2a54ec7c-1906-444e-b76c-340571083dec\") " pod="openshift-dns/dns-default-tk4mc" May 20 14:09:54.641761 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.641672 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/12fd684e-4a9e-43eb-b15f-93074c235ffa-cert\") pod \"ingress-canary-8r442\" (UID: \"12fd684e-4a9e-43eb-b15f-93074c235ffa\") " pod="openshift-ingress-canary/ingress-canary-8r442" May 20 14:09:54.641761 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.641722 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a54ec7c-1906-444e-b76c-340571083dec-tmp-dir\") pod \"dns-default-tk4mc\" (UID: \"2a54ec7c-1906-444e-b76c-340571083dec\") " pod="openshift-dns/dns-default-tk4mc" May 20 14:09:54.641761 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.641758 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jvmd\" (UniqueName: \"kubernetes.io/projected/12fd684e-4a9e-43eb-b15f-93074c235ffa-kube-api-access-2jvmd\") pod \"ingress-canary-8r442\" (UID: \"12fd684e-4a9e-43eb-b15f-93074c235ffa\") " pod="openshift-ingress-canary/ingress-canary-8r442" May 20 14:09:54.641903 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.641775 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a54ec7c-1906-444e-b76c-340571083dec-metrics-tls\") pod \"dns-default-tk4mc\" (UID: \"2a54ec7c-1906-444e-b76c-340571083dec\") " pod="openshift-dns/dns-default-tk4mc" May 20 14:09:54.641903 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.641808 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/475bb6aa-70af-41d2-a009-d11abbbc4484-data-volume\") pod \"insights-runtime-extractor-mzs7q\" (UID: \"475bb6aa-70af-41d2-a009-d11abbbc4484\") " pod="openshift-insights/insights-runtime-extractor-mzs7q" May 20 14:09:54.641903 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.641827 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/475bb6aa-70af-41d2-a009-d11abbbc4484-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mzs7q\" (UID: \"475bb6aa-70af-41d2-a009-d11abbbc4484\") " pod="openshift-insights/insights-runtime-extractor-mzs7q" May 20 14:09:54.641903 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.641856 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/475bb6aa-70af-41d2-a009-d11abbbc4484-crio-socket\") pod \"insights-runtime-extractor-mzs7q\" (UID: \"475bb6aa-70af-41d2-a009-d11abbbc4484\") " pod="openshift-insights/insights-runtime-extractor-mzs7q" May 20 14:09:54.641903 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.641884 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9hd7\" (UniqueName: \"kubernetes.io/projected/2a54ec7c-1906-444e-b76c-340571083dec-kube-api-access-n9hd7\") pod \"dns-default-tk4mc\" (UID: \"2a54ec7c-1906-444e-b76c-340571083dec\") " pod="openshift-dns/dns-default-tk4mc" May 20 14:09:54.743172 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.743138 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2jvmd\" (UniqueName: \"kubernetes.io/projected/12fd684e-4a9e-43eb-b15f-93074c235ffa-kube-api-access-2jvmd\") pod \"ingress-canary-8r442\" (UID: \"12fd684e-4a9e-43eb-b15f-93074c235ffa\") " pod="openshift-ingress-canary/ingress-canary-8r442" May 20 14:09:54.743172 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.743174 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a54ec7c-1906-444e-b76c-340571083dec-metrics-tls\") pod \"dns-default-tk4mc\" (UID: \"2a54ec7c-1906-444e-b76c-340571083dec\") " pod="openshift-dns/dns-default-tk4mc" May 20 14:09:54.743412 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.743197 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/475bb6aa-70af-41d2-a009-d11abbbc4484-data-volume\") pod \"insights-runtime-extractor-mzs7q\" (UID: \"475bb6aa-70af-41d2-a009-d11abbbc4484\") " pod="openshift-insights/insights-runtime-extractor-mzs7q" May 20 14:09:54.743412 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.743216 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/475bb6aa-70af-41d2-a009-d11abbbc4484-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mzs7q\" (UID: \"475bb6aa-70af-41d2-a009-d11abbbc4484\") " pod="openshift-insights/insights-runtime-extractor-mzs7q" May 20 14:09:54.743412 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.743343 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/475bb6aa-70af-41d2-a009-d11abbbc4484-crio-socket\") pod \"insights-runtime-extractor-mzs7q\" (UID: \"475bb6aa-70af-41d2-a009-d11abbbc4484\") " pod="openshift-insights/insights-runtime-extractor-mzs7q" May 20 14:09:54.743412 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.743383 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n9hd7\" (UniqueName: \"kubernetes.io/projected/2a54ec7c-1906-444e-b76c-340571083dec-kube-api-access-n9hd7\") pod \"dns-default-tk4mc\" (UID: \"2a54ec7c-1906-444e-b76c-340571083dec\") " pod="openshift-dns/dns-default-tk4mc" May 20 14:09:54.743611 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.743415 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9ndl2\" (UniqueName: \"kubernetes.io/projected/475bb6aa-70af-41d2-a009-d11abbbc4484-kube-api-access-9ndl2\") pod \"insights-runtime-extractor-mzs7q\" (UID: \"475bb6aa-70af-41d2-a009-d11abbbc4484\") " pod="openshift-insights/insights-runtime-extractor-mzs7q" May 20 14:09:54.743611 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.743448 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/475bb6aa-70af-41d2-a009-d11abbbc4484-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mzs7q\" (UID: \"475bb6aa-70af-41d2-a009-d11abbbc4484\") " pod="openshift-insights/insights-runtime-extractor-mzs7q" May 20 14:09:54.743611 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.743474 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2a54ec7c-1906-444e-b76c-340571083dec-config-volume\") pod \"dns-default-tk4mc\" (UID: \"2a54ec7c-1906-444e-b76c-340571083dec\") " pod="openshift-dns/dns-default-tk4mc" May 20 14:09:54.743611 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.743527 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/12fd684e-4a9e-43eb-b15f-93074c235ffa-cert\") pod \"ingress-canary-8r442\" (UID: \"12fd684e-4a9e-43eb-b15f-93074c235ffa\") " pod="openshift-ingress-canary/ingress-canary-8r442" May 20 14:09:54.743611 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.743557 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/475bb6aa-70af-41d2-a009-d11abbbc4484-crio-socket\") pod \"insights-runtime-extractor-mzs7q\" (UID: \"475bb6aa-70af-41d2-a009-d11abbbc4484\") " pod="openshift-insights/insights-runtime-extractor-mzs7q" May 20 14:09:54.743611 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.743580 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a54ec7c-1906-444e-b76c-340571083dec-tmp-dir\") pod \"dns-default-tk4mc\" (UID: \"2a54ec7c-1906-444e-b76c-340571083dec\") " pod="openshift-dns/dns-default-tk4mc" May 20 14:09:54.743611 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.743580 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/475bb6aa-70af-41d2-a009-d11abbbc4484-data-volume\") pod \"insights-runtime-extractor-mzs7q\" (UID: \"475bb6aa-70af-41d2-a009-d11abbbc4484\") " pod="openshift-insights/insights-runtime-extractor-mzs7q" May 20 14:09:54.743968 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.743955 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a54ec7c-1906-444e-b76c-340571083dec-tmp-dir\") pod \"dns-default-tk4mc\" (UID: \"2a54ec7c-1906-444e-b76c-340571083dec\") " pod="openshift-dns/dns-default-tk4mc" May 20 14:09:54.744158 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.744138 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/475bb6aa-70af-41d2-a009-d11abbbc4484-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mzs7q\" (UID: \"475bb6aa-70af-41d2-a009-d11abbbc4484\") " pod="openshift-insights/insights-runtime-extractor-mzs7q" May 20 14:09:54.744226 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.744158 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2a54ec7c-1906-444e-b76c-340571083dec-config-volume\") pod \"dns-default-tk4mc\" (UID: \"2a54ec7c-1906-444e-b76c-340571083dec\") " pod="openshift-dns/dns-default-tk4mc" May 20 14:09:54.747169 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.747143 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a54ec7c-1906-444e-b76c-340571083dec-metrics-tls\") pod \"dns-default-tk4mc\" (UID: \"2a54ec7c-1906-444e-b76c-340571083dec\") " pod="openshift-dns/dns-default-tk4mc" May 20 14:09:54.747278 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.747147 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/475bb6aa-70af-41d2-a009-d11abbbc4484-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mzs7q\" (UID: \"475bb6aa-70af-41d2-a009-d11abbbc4484\") " pod="openshift-insights/insights-runtime-extractor-mzs7q" May 20 14:09:54.747336 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.747294 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/12fd684e-4a9e-43eb-b15f-93074c235ffa-cert\") pod \"ingress-canary-8r442\" (UID: \"12fd684e-4a9e-43eb-b15f-93074c235ffa\") " pod="openshift-ingress-canary/ingress-canary-8r442" May 20 14:09:54.753917 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.753896 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jvmd\" (UniqueName: \"kubernetes.io/projected/12fd684e-4a9e-43eb-b15f-93074c235ffa-kube-api-access-2jvmd\") pod \"ingress-canary-8r442\" (UID: \"12fd684e-4a9e-43eb-b15f-93074c235ffa\") " pod="openshift-ingress-canary/ingress-canary-8r442" May 20 14:09:54.754621 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.754598 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ndl2\" (UniqueName: \"kubernetes.io/projected/475bb6aa-70af-41d2-a009-d11abbbc4484-kube-api-access-9ndl2\") pod \"insights-runtime-extractor-mzs7q\" (UID: \"475bb6aa-70af-41d2-a009-d11abbbc4484\") " pod="openshift-insights/insights-runtime-extractor-mzs7q" May 20 14:09:54.754870 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.754854 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9hd7\" (UniqueName: \"kubernetes.io/projected/2a54ec7c-1906-444e-b76c-340571083dec-kube-api-access-n9hd7\") pod \"dns-default-tk4mc\" (UID: \"2a54ec7c-1906-444e-b76c-340571083dec\") " pod="openshift-dns/dns-default-tk4mc" May 20 14:09:54.864019 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.863980 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-647bg" May 20 14:09:54.864191 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.863981 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2ngr" May 20 14:09:54.864248 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.863980 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2p6p" May 20 14:09:54.866776 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.866753 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 20 14:09:54.866949 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.866930 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 20 14:09:54.867010 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.867001 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 20 14:09:54.867106 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.867090 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-k9rks\"" May 20 14:09:54.867170 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.867145 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jdd5g\"" May 20 14:09:54.868881 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.868863 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 20 14:09:54.887553 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.887535 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tk4mc" May 20 14:09:54.894420 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.894399 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8r442" May 20 14:09:54.912094 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.912063 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mzs7q" May 20 14:09:54.975666 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.973288 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-4cwpv"] May 20 14:09:54.979007 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.977388 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-4cwpv" May 20 14:09:54.996027 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.995999 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-4cwpv"] May 20 14:09:54.998094 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.997741 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-bzvx7\"" May 20 14:09:54.998094 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.997829 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 20 14:09:54.998357 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:54.998340 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 20 14:09:55.046198 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:55.046167 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwx8v\" (UniqueName: \"kubernetes.io/projected/a6ec7480-6297-463d-82b8-2388d6e6f914-kube-api-access-fwx8v\") pod \"downloads-57bd96b888-4cwpv\" (UID: \"a6ec7480-6297-463d-82b8-2388d6e6f914\") " pod="openshift-console/downloads-57bd96b888-4cwpv" May 20 14:09:55.066448 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:55.066413 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8r442"] May 20 14:09:55.071132 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:55.071105 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12fd684e_4a9e_43eb_b15f_93074c235ffa.slice/crio-4f5209f1ebdcef84689fdbc75d1c7e13b02155a5172b71c308d1f43d70637fc8 WatchSource:0}: Error finding container 4f5209f1ebdcef84689fdbc75d1c7e13b02155a5172b71c308d1f43d70637fc8: Status 404 returned error can't find the container with id 4f5209f1ebdcef84689fdbc75d1c7e13b02155a5172b71c308d1f43d70637fc8 May 20 14:09:55.080106 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:55.080081 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tk4mc"] May 20 14:09:55.082849 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:55.082828 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a54ec7c_1906_444e_b76c_340571083dec.slice/crio-4eeb43d2a39b633e7e6da04d9d1adc7549330dd8227f0ad46719feab5a993672 WatchSource:0}: Error finding container 4eeb43d2a39b633e7e6da04d9d1adc7549330dd8227f0ad46719feab5a993672: Status 404 returned error can't find the container with id 4eeb43d2a39b633e7e6da04d9d1adc7549330dd8227f0ad46719feab5a993672 May 20 14:09:55.095762 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:55.095741 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mzs7q"] May 20 14:09:55.098225 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:55.098201 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod475bb6aa_70af_41d2_a009_d11abbbc4484.slice/crio-c13decddfc3e4c5299cc23f1b39b78c39b777280c2b304f57701298ee2348585 WatchSource:0}: Error finding container c13decddfc3e4c5299cc23f1b39b78c39b777280c2b304f57701298ee2348585: Status 404 returned error can't find the container with id c13decddfc3e4c5299cc23f1b39b78c39b777280c2b304f57701298ee2348585 May 20 14:09:55.147262 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:55.147234 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fwx8v\" (UniqueName: \"kubernetes.io/projected/a6ec7480-6297-463d-82b8-2388d6e6f914-kube-api-access-fwx8v\") pod \"downloads-57bd96b888-4cwpv\" (UID: \"a6ec7480-6297-463d-82b8-2388d6e6f914\") " pod="openshift-console/downloads-57bd96b888-4cwpv" May 20 14:09:55.155061 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:55.155041 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwx8v\" (UniqueName: \"kubernetes.io/projected/a6ec7480-6297-463d-82b8-2388d6e6f914-kube-api-access-fwx8v\") pod \"downloads-57bd96b888-4cwpv\" (UID: \"a6ec7480-6297-463d-82b8-2388d6e6f914\") " pod="openshift-console/downloads-57bd96b888-4cwpv" May 20 14:09:55.294565 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:55.294525 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-4cwpv" May 20 14:09:55.432905 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:55.432829 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-4cwpv"] May 20 14:09:55.435608 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:09:55.435574 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6ec7480_6297_463d_82b8_2388d6e6f914.slice/crio-e9d000b9ca9c247d6dbb6a009fbd0150c84322a2e3616bc320f1adb23907a9ee WatchSource:0}: Error finding container e9d000b9ca9c247d6dbb6a009fbd0150c84322a2e3616bc320f1adb23907a9ee: Status 404 returned error can't find the container with id e9d000b9ca9c247d6dbb6a009fbd0150c84322a2e3616bc320f1adb23907a9ee May 20 14:09:56.046364 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:56.046324 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mzs7q" event={"ID":"475bb6aa-70af-41d2-a009-d11abbbc4484","Type":"ContainerStarted","Data":"a733d5464884a9140adc81908806a3111e0e12b4f0b172b16efdab2f6b0dded9"} May 20 14:09:56.046838 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:56.046371 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mzs7q" event={"ID":"475bb6aa-70af-41d2-a009-d11abbbc4484","Type":"ContainerStarted","Data":"6910b9d98d824c199c2d5a059dec8309a134937135e0a1acbc77a9c1e5331884"} May 20 14:09:56.046838 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:56.046389 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mzs7q" event={"ID":"475bb6aa-70af-41d2-a009-d11abbbc4484","Type":"ContainerStarted","Data":"c13decddfc3e4c5299cc23f1b39b78c39b777280c2b304f57701298ee2348585"} May 20 14:09:56.047836 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:56.047779 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8r442" event={"ID":"12fd684e-4a9e-43eb-b15f-93074c235ffa","Type":"ContainerStarted","Data":"4f5209f1ebdcef84689fdbc75d1c7e13b02155a5172b71c308d1f43d70637fc8"} May 20 14:09:56.049105 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:56.049079 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tk4mc" event={"ID":"2a54ec7c-1906-444e-b76c-340571083dec","Type":"ContainerStarted","Data":"4eeb43d2a39b633e7e6da04d9d1adc7549330dd8227f0ad46719feab5a993672"} May 20 14:09:56.050389 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:56.050333 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-4cwpv" event={"ID":"a6ec7480-6297-463d-82b8-2388d6e6f914","Type":"ContainerStarted","Data":"e9d000b9ca9c247d6dbb6a009fbd0150c84322a2e3616bc320f1adb23907a9ee"} May 20 14:09:58.058735 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:58.058695 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mzs7q" event={"ID":"475bb6aa-70af-41d2-a009-d11abbbc4484","Type":"ContainerStarted","Data":"27256a5b4ef5b4aad61a72a56b3d8e64af710f158757e337ae46477b8c166cc0"} May 20 14:09:58.060050 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:58.060015 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8r442" event={"ID":"12fd684e-4a9e-43eb-b15f-93074c235ffa","Type":"ContainerStarted","Data":"3c60120762cfc92378814d4b65c5380ffcdc6921b2cb6ca28df52dc4e9a68ab9"} May 20 14:09:58.061605 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:58.061567 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tk4mc" event={"ID":"2a54ec7c-1906-444e-b76c-340571083dec","Type":"ContainerStarted","Data":"18d6f865b4465eea40e22ec5c6edac74fa12538ac9f2472f98e3d0837d20b892"} May 20 14:09:58.061605 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:58.061598 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tk4mc" event={"ID":"2a54ec7c-1906-444e-b76c-340571083dec","Type":"ContainerStarted","Data":"0cec8d511d776f3e7958619250261eaf50b5cd70ffb87ae5fb8086abb58b255f"} May 20 14:09:58.061743 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:58.061735 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tk4mc" May 20 14:09:58.088391 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:58.088333 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mzs7q" podStartSLOduration=1.464344402 podStartE2EDuration="4.088316465s" podCreationTimestamp="2026-05-20 14:09:54 +0000 UTC" firstStartedPulling="2026-05-20 14:09:55.162222119 +0000 UTC m=+54.902520011" lastFinishedPulling="2026-05-20 14:09:57.786194165 +0000 UTC m=+57.526492074" observedRunningTime="2026-05-20 14:09:58.08774576 +0000 UTC m=+57.828043675" watchObservedRunningTime="2026-05-20 14:09:58.088316465 +0000 UTC m=+57.828614385" May 20 14:09:58.112038 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:58.111990 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-tk4mc" podStartSLOduration=2.107627549 podStartE2EDuration="4.111976091s" podCreationTimestamp="2026-05-20 14:09:54 +0000 UTC" firstStartedPulling="2026-05-20 14:09:55.084533423 +0000 UTC m=+54.824831316" lastFinishedPulling="2026-05-20 14:09:57.088881962 +0000 UTC m=+56.829179858" observedRunningTime="2026-05-20 14:09:58.110675782 +0000 UTC m=+57.850973698" watchObservedRunningTime="2026-05-20 14:09:58.111976091 +0000 UTC m=+57.852274007" May 20 14:09:58.137621 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:58.137577 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8r442" podStartSLOduration=2.117720478 podStartE2EDuration="4.137563543s" podCreationTimestamp="2026-05-20 14:09:54 +0000 UTC" firstStartedPulling="2026-05-20 14:09:55.072483681 +0000 UTC m=+54.812781577" lastFinishedPulling="2026-05-20 14:09:57.092326734 +0000 UTC m=+56.832624642" observedRunningTime="2026-05-20 14:09:58.136903953 +0000 UTC m=+57.877201859" watchObservedRunningTime="2026-05-20 14:09:58.137563543 +0000 UTC m=+57.877861455" May 20 14:09:58.996641 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:09:58.996611 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ggb6b" May 20 14:10:00.802155 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:00.802122 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-scnxp"] May 20 14:10:00.804757 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:00.804733 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-scnxp" May 20 14:10:00.808510 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:00.808486 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 20 14:10:00.808796 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:00.808755 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" May 20 14:10:00.808918 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:00.808775 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 20 14:10:00.808918 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:00.808835 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" May 20 14:10:00.809158 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:00.809140 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 20 14:10:00.809262 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:00.809186 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-2tgbh\"" May 20 14:10:00.815642 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:00.815603 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-scnxp"] May 20 14:10:00.895080 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:00.895047 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1a9e3e14-2909-41fd-95bd-ca60e50b4a8d-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-scnxp\" (UID: \"1a9e3e14-2909-41fd-95bd-ca60e50b4a8d\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-scnxp" May 20 14:10:00.895080 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:00.895086 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a9e3e14-2909-41fd-95bd-ca60e50b4a8d-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-scnxp\" (UID: \"1a9e3e14-2909-41fd-95bd-ca60e50b4a8d\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-scnxp" May 20 14:10:00.895275 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:00.895102 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntmzn\" (UniqueName: \"kubernetes.io/projected/1a9e3e14-2909-41fd-95bd-ca60e50b4a8d-kube-api-access-ntmzn\") pod \"prometheus-operator-7779bbdd78-scnxp\" (UID: \"1a9e3e14-2909-41fd-95bd-ca60e50b4a8d\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-scnxp" May 20 14:10:00.895275 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:00.895134 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1a9e3e14-2909-41fd-95bd-ca60e50b4a8d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-scnxp\" (UID: \"1a9e3e14-2909-41fd-95bd-ca60e50b4a8d\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-scnxp" May 20 14:10:00.996514 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:00.996475 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1a9e3e14-2909-41fd-95bd-ca60e50b4a8d-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-scnxp\" (UID: \"1a9e3e14-2909-41fd-95bd-ca60e50b4a8d\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-scnxp" May 20 14:10:00.996703 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:00.996539 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a9e3e14-2909-41fd-95bd-ca60e50b4a8d-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-scnxp\" (UID: \"1a9e3e14-2909-41fd-95bd-ca60e50b4a8d\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-scnxp" May 20 14:10:00.996703 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:00.996590 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ntmzn\" (UniqueName: \"kubernetes.io/projected/1a9e3e14-2909-41fd-95bd-ca60e50b4a8d-kube-api-access-ntmzn\") pod \"prometheus-operator-7779bbdd78-scnxp\" (UID: \"1a9e3e14-2909-41fd-95bd-ca60e50b4a8d\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-scnxp" May 20 14:10:00.996703 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:10:00.996611 2551 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found May 20 14:10:00.996703 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:00.996641 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1a9e3e14-2909-41fd-95bd-ca60e50b4a8d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-scnxp\" (UID: \"1a9e3e14-2909-41fd-95bd-ca60e50b4a8d\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-scnxp" May 20 14:10:00.996703 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:10:00.996689 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a9e3e14-2909-41fd-95bd-ca60e50b4a8d-prometheus-operator-tls podName:1a9e3e14-2909-41fd-95bd-ca60e50b4a8d nodeName:}" failed. No retries permitted until 2026-05-20 14:10:01.496668878 +0000 UTC m=+61.236966783 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/1a9e3e14-2909-41fd-95bd-ca60e50b4a8d-prometheus-operator-tls") pod "prometheus-operator-7779bbdd78-scnxp" (UID: "1a9e3e14-2909-41fd-95bd-ca60e50b4a8d") : secret "prometheus-operator-tls" not found May 20 14:10:00.997364 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:00.997343 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a9e3e14-2909-41fd-95bd-ca60e50b4a8d-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-scnxp\" (UID: \"1a9e3e14-2909-41fd-95bd-ca60e50b4a8d\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-scnxp" May 20 14:10:00.999567 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:00.999547 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1a9e3e14-2909-41fd-95bd-ca60e50b4a8d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-scnxp\" (UID: \"1a9e3e14-2909-41fd-95bd-ca60e50b4a8d\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-scnxp" May 20 14:10:01.006723 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:01.006701 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntmzn\" (UniqueName: \"kubernetes.io/projected/1a9e3e14-2909-41fd-95bd-ca60e50b4a8d-kube-api-access-ntmzn\") pod \"prometheus-operator-7779bbdd78-scnxp\" (UID: \"1a9e3e14-2909-41fd-95bd-ca60e50b4a8d\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-scnxp" May 20 14:10:01.500411 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:01.500375 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1a9e3e14-2909-41fd-95bd-ca60e50b4a8d-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-scnxp\" (UID: \"1a9e3e14-2909-41fd-95bd-ca60e50b4a8d\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-scnxp" May 20 14:10:01.503400 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:01.503375 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1a9e3e14-2909-41fd-95bd-ca60e50b4a8d-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-scnxp\" (UID: \"1a9e3e14-2909-41fd-95bd-ca60e50b4a8d\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-scnxp" May 20 14:10:01.719104 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:01.719068 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-scnxp" May 20 14:10:01.876940 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:01.876905 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-scnxp"] May 20 14:10:01.883127 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:10:01.883087 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a9e3e14_2909_41fd_95bd_ca60e50b4a8d.slice/crio-5a54a5542600dd2627e2b2c135534668de8069333c267b0420b16decd820fe75 WatchSource:0}: Error finding container 5a54a5542600dd2627e2b2c135534668de8069333c267b0420b16decd820fe75: Status 404 returned error can't find the container with id 5a54a5542600dd2627e2b2c135534668de8069333c267b0420b16decd820fe75 May 20 14:10:02.073334 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:02.073298 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-scnxp" event={"ID":"1a9e3e14-2909-41fd-95bd-ca60e50b4a8d","Type":"ContainerStarted","Data":"5a54a5542600dd2627e2b2c135534668de8069333c267b0420b16decd820fe75"} May 20 14:10:03.711616 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:03.711580 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5ff9fbfbdb-v5hgn"] May 20 14:10:03.714773 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:03.714751 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ff9fbfbdb-v5hgn" May 20 14:10:03.719633 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:03.719605 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 20 14:10:03.719761 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:03.719661 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 20 14:10:03.720007 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:03.719989 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 20 14:10:03.720118 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:03.720016 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 20 14:10:03.720118 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:03.720061 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-n6zx9\"" May 20 14:10:03.720239 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:03.720132 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 20 14:10:03.728866 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:03.728842 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5ff9fbfbdb-v5hgn"] May 20 14:10:03.820543 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:03.820511 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/176900a6-e9f3-43ec-a17e-75e93646d940-console-config\") pod \"console-5ff9fbfbdb-v5hgn\" (UID: \"176900a6-e9f3-43ec-a17e-75e93646d940\") " pod="openshift-console/console-5ff9fbfbdb-v5hgn" May 20 14:10:03.820745 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:03.820553 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/176900a6-e9f3-43ec-a17e-75e93646d940-console-oauth-config\") pod \"console-5ff9fbfbdb-v5hgn\" (UID: \"176900a6-e9f3-43ec-a17e-75e93646d940\") " pod="openshift-console/console-5ff9fbfbdb-v5hgn" May 20 14:10:03.820745 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:03.820612 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/176900a6-e9f3-43ec-a17e-75e93646d940-service-ca\") pod \"console-5ff9fbfbdb-v5hgn\" (UID: \"176900a6-e9f3-43ec-a17e-75e93646d940\") " pod="openshift-console/console-5ff9fbfbdb-v5hgn" May 20 14:10:03.820745 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:03.820658 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/176900a6-e9f3-43ec-a17e-75e93646d940-console-serving-cert\") pod \"console-5ff9fbfbdb-v5hgn\" (UID: \"176900a6-e9f3-43ec-a17e-75e93646d940\") " pod="openshift-console/console-5ff9fbfbdb-v5hgn" May 20 14:10:03.820745 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:03.820727 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kv4kt\" (UniqueName: \"kubernetes.io/projected/176900a6-e9f3-43ec-a17e-75e93646d940-kube-api-access-kv4kt\") pod \"console-5ff9fbfbdb-v5hgn\" (UID: \"176900a6-e9f3-43ec-a17e-75e93646d940\") " pod="openshift-console/console-5ff9fbfbdb-v5hgn" May 20 14:10:03.820956 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:03.820768 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/176900a6-e9f3-43ec-a17e-75e93646d940-oauth-serving-cert\") pod \"console-5ff9fbfbdb-v5hgn\" (UID: \"176900a6-e9f3-43ec-a17e-75e93646d940\") " pod="openshift-console/console-5ff9fbfbdb-v5hgn" May 20 14:10:03.921501 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:03.921458 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/176900a6-e9f3-43ec-a17e-75e93646d940-console-oauth-config\") pod \"console-5ff9fbfbdb-v5hgn\" (UID: \"176900a6-e9f3-43ec-a17e-75e93646d940\") " pod="openshift-console/console-5ff9fbfbdb-v5hgn" May 20 14:10:03.921686 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:03.921521 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/176900a6-e9f3-43ec-a17e-75e93646d940-service-ca\") pod \"console-5ff9fbfbdb-v5hgn\" (UID: \"176900a6-e9f3-43ec-a17e-75e93646d940\") " pod="openshift-console/console-5ff9fbfbdb-v5hgn" May 20 14:10:03.921686 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:03.921567 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/176900a6-e9f3-43ec-a17e-75e93646d940-console-serving-cert\") pod \"console-5ff9fbfbdb-v5hgn\" (UID: \"176900a6-e9f3-43ec-a17e-75e93646d940\") " pod="openshift-console/console-5ff9fbfbdb-v5hgn" May 20 14:10:03.921820 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:03.921745 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kv4kt\" (UniqueName: \"kubernetes.io/projected/176900a6-e9f3-43ec-a17e-75e93646d940-kube-api-access-kv4kt\") pod \"console-5ff9fbfbdb-v5hgn\" (UID: \"176900a6-e9f3-43ec-a17e-75e93646d940\") " pod="openshift-console/console-5ff9fbfbdb-v5hgn" May 20 14:10:03.921820 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:03.921805 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/176900a6-e9f3-43ec-a17e-75e93646d940-oauth-serving-cert\") pod \"console-5ff9fbfbdb-v5hgn\" (UID: \"176900a6-e9f3-43ec-a17e-75e93646d940\") " pod="openshift-console/console-5ff9fbfbdb-v5hgn" May 20 14:10:03.921896 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:03.921847 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/176900a6-e9f3-43ec-a17e-75e93646d940-console-config\") pod \"console-5ff9fbfbdb-v5hgn\" (UID: \"176900a6-e9f3-43ec-a17e-75e93646d940\") " pod="openshift-console/console-5ff9fbfbdb-v5hgn" May 20 14:10:03.922421 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:03.922393 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/176900a6-e9f3-43ec-a17e-75e93646d940-service-ca\") pod \"console-5ff9fbfbdb-v5hgn\" (UID: \"176900a6-e9f3-43ec-a17e-75e93646d940\") " pod="openshift-console/console-5ff9fbfbdb-v5hgn" May 20 14:10:03.922551 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:03.922466 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/176900a6-e9f3-43ec-a17e-75e93646d940-console-config\") pod \"console-5ff9fbfbdb-v5hgn\" (UID: \"176900a6-e9f3-43ec-a17e-75e93646d940\") " pod="openshift-console/console-5ff9fbfbdb-v5hgn" May 20 14:10:03.922551 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:03.922514 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/176900a6-e9f3-43ec-a17e-75e93646d940-oauth-serving-cert\") pod \"console-5ff9fbfbdb-v5hgn\" (UID: \"176900a6-e9f3-43ec-a17e-75e93646d940\") " pod="openshift-console/console-5ff9fbfbdb-v5hgn" May 20 14:10:03.924342 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:03.924319 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/176900a6-e9f3-43ec-a17e-75e93646d940-console-serving-cert\") pod \"console-5ff9fbfbdb-v5hgn\" (UID: \"176900a6-e9f3-43ec-a17e-75e93646d940\") " pod="openshift-console/console-5ff9fbfbdb-v5hgn" May 20 14:10:03.924452 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:03.924432 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/176900a6-e9f3-43ec-a17e-75e93646d940-console-oauth-config\") pod \"console-5ff9fbfbdb-v5hgn\" (UID: \"176900a6-e9f3-43ec-a17e-75e93646d940\") " pod="openshift-console/console-5ff9fbfbdb-v5hgn" May 20 14:10:03.932977 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:03.932950 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kv4kt\" (UniqueName: \"kubernetes.io/projected/176900a6-e9f3-43ec-a17e-75e93646d940-kube-api-access-kv4kt\") pod \"console-5ff9fbfbdb-v5hgn\" (UID: \"176900a6-e9f3-43ec-a17e-75e93646d940\") " pod="openshift-console/console-5ff9fbfbdb-v5hgn" May 20 14:10:04.025665 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:04.025630 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ff9fbfbdb-v5hgn" May 20 14:10:04.081248 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:04.081213 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-scnxp" event={"ID":"1a9e3e14-2909-41fd-95bd-ca60e50b4a8d","Type":"ContainerStarted","Data":"ce30f382eb6aa6bc6bae958e555ea3d5f35b520f0ce960155d653272d5db4d74"} May 20 14:10:04.081398 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:04.081257 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-scnxp" event={"ID":"1a9e3e14-2909-41fd-95bd-ca60e50b4a8d","Type":"ContainerStarted","Data":"3a8f0574a244003cbbeafaaa8b0a66949a372f1ccf572ff42a181cbb52e4384a"} May 20 14:10:04.127199 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:04.126598 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-scnxp" podStartSLOduration=2.496699689 podStartE2EDuration="4.1265814s" podCreationTimestamp="2026-05-20 14:10:00 +0000 UTC" firstStartedPulling="2026-05-20 14:10:01.885070722 +0000 UTC m=+61.625368619" lastFinishedPulling="2026-05-20 14:10:03.514952423 +0000 UTC m=+63.255250330" observedRunningTime="2026-05-20 14:10:04.12363532 +0000 UTC m=+63.863933260" watchObservedRunningTime="2026-05-20 14:10:04.1265814 +0000 UTC m=+63.866879316" May 20 14:10:04.190678 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:04.190653 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5ff9fbfbdb-v5hgn"] May 20 14:10:04.192835 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:10:04.192802 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod176900a6_e9f3_43ec_a17e_75e93646d940.slice/crio-889aff6fb7ef53106fc63ac67ad8dd91bf0160df688ef309e11dcaba6d65fcc6 WatchSource:0}: Error finding container 889aff6fb7ef53106fc63ac67ad8dd91bf0160df688ef309e11dcaba6d65fcc6: Status 404 returned error can't find the container with id 889aff6fb7ef53106fc63ac67ad8dd91bf0160df688ef309e11dcaba6d65fcc6 May 20 14:10:05.093101 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:05.093060 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ff9fbfbdb-v5hgn" event={"ID":"176900a6-e9f3-43ec-a17e-75e93646d940","Type":"ContainerStarted","Data":"889aff6fb7ef53106fc63ac67ad8dd91bf0160df688ef309e11dcaba6d65fcc6"} May 20 14:10:06.331200 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.331119 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-xr2xr"] May 20 14:10:06.341682 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.341656 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xr2xr" May 20 14:10:06.350526 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.350501 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" May 20 14:10:06.350526 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.350517 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" May 20 14:10:06.355447 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.355423 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" May 20 14:10:06.355571 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.355527 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-vqgtc\"" May 20 14:10:06.357680 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.357659 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cfxkz"] May 20 14:10:06.368064 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.368010 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-xr2xr"] May 20 14:10:06.368201 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.368168 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cfxkz" May 20 14:10:06.371285 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.371100 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 20 14:10:06.371671 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.371565 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 20 14:10:06.371813 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.371772 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8vm5m\"" May 20 14:10:06.371912 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.371820 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 20 14:10:06.447359 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.447322 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f4c50283-8dd2-43b8-baaf-312629ac8a44-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-xr2xr\" (UID: \"f4c50283-8dd2-43b8-baaf-312629ac8a44\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xr2xr" May 20 14:10:06.447532 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.447375 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/10fe0991-123c-4342-a808-8d1a47454f56-root\") pod \"node-exporter-cfxkz\" (UID: \"10fe0991-123c-4342-a808-8d1a47454f56\") " pod="openshift-monitoring/node-exporter-cfxkz" May 20 14:10:06.447532 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.447394 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10fe0991-123c-4342-a808-8d1a47454f56-metrics-client-ca\") pod \"node-exporter-cfxkz\" (UID: \"10fe0991-123c-4342-a808-8d1a47454f56\") " pod="openshift-monitoring/node-exporter-cfxkz" May 20 14:10:06.447532 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.447426 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/10fe0991-123c-4342-a808-8d1a47454f56-sys\") pod \"node-exporter-cfxkz\" (UID: \"10fe0991-123c-4342-a808-8d1a47454f56\") " pod="openshift-monitoring/node-exporter-cfxkz" May 20 14:10:06.447532 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.447456 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f4c50283-8dd2-43b8-baaf-312629ac8a44-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-xr2xr\" (UID: \"f4c50283-8dd2-43b8-baaf-312629ac8a44\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xr2xr" May 20 14:10:06.447764 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.447540 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f4c50283-8dd2-43b8-baaf-312629ac8a44-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-xr2xr\" (UID: \"f4c50283-8dd2-43b8-baaf-312629ac8a44\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xr2xr" May 20 14:10:06.447764 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.447592 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/10fe0991-123c-4342-a808-8d1a47454f56-node-exporter-textfile\") pod \"node-exporter-cfxkz\" (UID: \"10fe0991-123c-4342-a808-8d1a47454f56\") " pod="openshift-monitoring/node-exporter-cfxkz" May 20 14:10:06.447764 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.447637 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/10fe0991-123c-4342-a808-8d1a47454f56-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cfxkz\" (UID: \"10fe0991-123c-4342-a808-8d1a47454f56\") " pod="openshift-monitoring/node-exporter-cfxkz" May 20 14:10:06.447764 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.447669 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/10fe0991-123c-4342-a808-8d1a47454f56-node-exporter-accelerators-collector-config\") pod \"node-exporter-cfxkz\" (UID: \"10fe0991-123c-4342-a808-8d1a47454f56\") " pod="openshift-monitoring/node-exporter-cfxkz" May 20 14:10:06.447764 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.447695 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhc65\" (UniqueName: \"kubernetes.io/projected/f4c50283-8dd2-43b8-baaf-312629ac8a44-kube-api-access-fhc65\") pod \"kube-state-metrics-54fd6bc5c4-xr2xr\" (UID: \"f4c50283-8dd2-43b8-baaf-312629ac8a44\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xr2xr" May 20 14:10:06.447764 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.447712 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkjp4\" (UniqueName: \"kubernetes.io/projected/10fe0991-123c-4342-a808-8d1a47454f56-kube-api-access-gkjp4\") pod \"node-exporter-cfxkz\" (UID: \"10fe0991-123c-4342-a808-8d1a47454f56\") " pod="openshift-monitoring/node-exporter-cfxkz" May 20 14:10:06.447764 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.447730 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/10fe0991-123c-4342-a808-8d1a47454f56-node-exporter-wtmp\") pod \"node-exporter-cfxkz\" (UID: \"10fe0991-123c-4342-a808-8d1a47454f56\") " pod="openshift-monitoring/node-exporter-cfxkz" May 20 14:10:06.448070 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.447812 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f4c50283-8dd2-43b8-baaf-312629ac8a44-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-xr2xr\" (UID: \"f4c50283-8dd2-43b8-baaf-312629ac8a44\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xr2xr" May 20 14:10:06.448070 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.447858 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f4c50283-8dd2-43b8-baaf-312629ac8a44-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-xr2xr\" (UID: \"f4c50283-8dd2-43b8-baaf-312629ac8a44\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xr2xr" May 20 14:10:06.448070 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.447925 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/10fe0991-123c-4342-a808-8d1a47454f56-node-exporter-tls\") pod \"node-exporter-cfxkz\" (UID: \"10fe0991-123c-4342-a808-8d1a47454f56\") " pod="openshift-monitoring/node-exporter-cfxkz" May 20 14:10:06.548746 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.548687 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/10fe0991-123c-4342-a808-8d1a47454f56-node-exporter-tls\") pod \"node-exporter-cfxkz\" (UID: \"10fe0991-123c-4342-a808-8d1a47454f56\") " pod="openshift-monitoring/node-exporter-cfxkz" May 20 14:10:06.548932 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.548757 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f4c50283-8dd2-43b8-baaf-312629ac8a44-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-xr2xr\" (UID: \"f4c50283-8dd2-43b8-baaf-312629ac8a44\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xr2xr" May 20 14:10:06.548932 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.548805 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb-metrics-certs\") pod \"network-metrics-daemon-m2p6p\" (UID: \"ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb\") " pod="openshift-multus/network-metrics-daemon-m2p6p" May 20 14:10:06.548932 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.548830 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/10fe0991-123c-4342-a808-8d1a47454f56-root\") pod \"node-exporter-cfxkz\" (UID: \"10fe0991-123c-4342-a808-8d1a47454f56\") " pod="openshift-monitoring/node-exporter-cfxkz" May 20 14:10:06.548932 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.548854 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10fe0991-123c-4342-a808-8d1a47454f56-metrics-client-ca\") pod \"node-exporter-cfxkz\" (UID: \"10fe0991-123c-4342-a808-8d1a47454f56\") " pod="openshift-monitoring/node-exporter-cfxkz" May 20 14:10:06.548932 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:10:06.548857 2551 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found May 20 14:10:06.548932 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.548892 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/10fe0991-123c-4342-a808-8d1a47454f56-sys\") pod \"node-exporter-cfxkz\" (UID: \"10fe0991-123c-4342-a808-8d1a47454f56\") " pod="openshift-monitoring/node-exporter-cfxkz" May 20 14:10:06.548932 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:10:06.548922 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10fe0991-123c-4342-a808-8d1a47454f56-node-exporter-tls podName:10fe0991-123c-4342-a808-8d1a47454f56 nodeName:}" failed. No retries permitted until 2026-05-20 14:10:07.048902501 +0000 UTC m=+66.789200417 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/10fe0991-123c-4342-a808-8d1a47454f56-node-exporter-tls") pod "node-exporter-cfxkz" (UID: "10fe0991-123c-4342-a808-8d1a47454f56") : secret "node-exporter-tls" not found May 20 14:10:06.549213 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.548946 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/10fe0991-123c-4342-a808-8d1a47454f56-root\") pod \"node-exporter-cfxkz\" (UID: \"10fe0991-123c-4342-a808-8d1a47454f56\") " pod="openshift-monitoring/node-exporter-cfxkz" May 20 14:10:06.549213 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.548987 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/10fe0991-123c-4342-a808-8d1a47454f56-sys\") pod \"node-exporter-cfxkz\" (UID: \"10fe0991-123c-4342-a808-8d1a47454f56\") " pod="openshift-monitoring/node-exporter-cfxkz" May 20 14:10:06.549213 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.549018 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f4c50283-8dd2-43b8-baaf-312629ac8a44-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-xr2xr\" (UID: \"f4c50283-8dd2-43b8-baaf-312629ac8a44\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xr2xr" May 20 14:10:06.549213 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.549055 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f4c50283-8dd2-43b8-baaf-312629ac8a44-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-xr2xr\" (UID: \"f4c50283-8dd2-43b8-baaf-312629ac8a44\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xr2xr" May 20 14:10:06.549213 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.549088 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/10fe0991-123c-4342-a808-8d1a47454f56-node-exporter-textfile\") pod \"node-exporter-cfxkz\" (UID: \"10fe0991-123c-4342-a808-8d1a47454f56\") " pod="openshift-monitoring/node-exporter-cfxkz" May 20 14:10:06.549213 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.549162 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/10fe0991-123c-4342-a808-8d1a47454f56-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cfxkz\" (UID: \"10fe0991-123c-4342-a808-8d1a47454f56\") " pod="openshift-monitoring/node-exporter-cfxkz" May 20 14:10:06.549486 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.549218 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/10fe0991-123c-4342-a808-8d1a47454f56-node-exporter-accelerators-collector-config\") pod \"node-exporter-cfxkz\" (UID: \"10fe0991-123c-4342-a808-8d1a47454f56\") " pod="openshift-monitoring/node-exporter-cfxkz" May 20 14:10:06.549486 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.549255 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fhc65\" (UniqueName: \"kubernetes.io/projected/f4c50283-8dd2-43b8-baaf-312629ac8a44-kube-api-access-fhc65\") pod \"kube-state-metrics-54fd6bc5c4-xr2xr\" (UID: \"f4c50283-8dd2-43b8-baaf-312629ac8a44\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xr2xr" May 20 14:10:06.549486 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.549285 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gkjp4\" (UniqueName: \"kubernetes.io/projected/10fe0991-123c-4342-a808-8d1a47454f56-kube-api-access-gkjp4\") pod \"node-exporter-cfxkz\" (UID: \"10fe0991-123c-4342-a808-8d1a47454f56\") " pod="openshift-monitoring/node-exporter-cfxkz" May 20 14:10:06.549486 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.549316 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/10fe0991-123c-4342-a808-8d1a47454f56-node-exporter-wtmp\") pod \"node-exporter-cfxkz\" (UID: \"10fe0991-123c-4342-a808-8d1a47454f56\") " pod="openshift-monitoring/node-exporter-cfxkz" May 20 14:10:06.549486 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.549347 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f4c50283-8dd2-43b8-baaf-312629ac8a44-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-xr2xr\" (UID: \"f4c50283-8dd2-43b8-baaf-312629ac8a44\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xr2xr" May 20 14:10:06.549486 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.549374 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f4c50283-8dd2-43b8-baaf-312629ac8a44-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-xr2xr\" (UID: \"f4c50283-8dd2-43b8-baaf-312629ac8a44\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xr2xr" May 20 14:10:06.549486 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.549465 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/10fe0991-123c-4342-a808-8d1a47454f56-node-exporter-wtmp\") pod \"node-exporter-cfxkz\" (UID: \"10fe0991-123c-4342-a808-8d1a47454f56\") " pod="openshift-monitoring/node-exporter-cfxkz" May 20 14:10:06.549981 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.549936 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f4c50283-8dd2-43b8-baaf-312629ac8a44-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-xr2xr\" (UID: \"f4c50283-8dd2-43b8-baaf-312629ac8a44\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xr2xr" May 20 14:10:06.550240 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.550207 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f4c50283-8dd2-43b8-baaf-312629ac8a44-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-xr2xr\" (UID: \"f4c50283-8dd2-43b8-baaf-312629ac8a44\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xr2xr" May 20 14:10:06.551767 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.551747 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f4c50283-8dd2-43b8-baaf-312629ac8a44-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-xr2xr\" (UID: \"f4c50283-8dd2-43b8-baaf-312629ac8a44\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xr2xr" May 20 14:10:06.552100 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.552076 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f4c50283-8dd2-43b8-baaf-312629ac8a44-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-xr2xr\" (UID: \"f4c50283-8dd2-43b8-baaf-312629ac8a44\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xr2xr" May 20 14:10:06.552100 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.552090 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 20 14:10:06.557209 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.557176 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/10fe0991-123c-4342-a808-8d1a47454f56-node-exporter-textfile\") pod \"node-exporter-cfxkz\" (UID: \"10fe0991-123c-4342-a808-8d1a47454f56\") " pod="openshift-monitoring/node-exporter-cfxkz" May 20 14:10:06.557443 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.557422 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10fe0991-123c-4342-a808-8d1a47454f56-metrics-client-ca\") pod \"node-exporter-cfxkz\" (UID: \"10fe0991-123c-4342-a808-8d1a47454f56\") " pod="openshift-monitoring/node-exporter-cfxkz" May 20 14:10:06.557517 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.557477 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/10fe0991-123c-4342-a808-8d1a47454f56-node-exporter-accelerators-collector-config\") pod \"node-exporter-cfxkz\" (UID: \"10fe0991-123c-4342-a808-8d1a47454f56\") " pod="openshift-monitoring/node-exporter-cfxkz" May 20 14:10:06.559067 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.558991 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f4c50283-8dd2-43b8-baaf-312629ac8a44-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-xr2xr\" (UID: \"f4c50283-8dd2-43b8-baaf-312629ac8a44\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xr2xr" May 20 14:10:06.559509 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.559467 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/10fe0991-123c-4342-a808-8d1a47454f56-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cfxkz\" (UID: \"10fe0991-123c-4342-a808-8d1a47454f56\") " pod="openshift-monitoring/node-exporter-cfxkz" May 20 14:10:06.560954 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.560923 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhc65\" (UniqueName: \"kubernetes.io/projected/f4c50283-8dd2-43b8-baaf-312629ac8a44-kube-api-access-fhc65\") pod \"kube-state-metrics-54fd6bc5c4-xr2xr\" (UID: \"f4c50283-8dd2-43b8-baaf-312629ac8a44\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xr2xr" May 20 14:10:06.561048 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.560965 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkjp4\" (UniqueName: \"kubernetes.io/projected/10fe0991-123c-4342-a808-8d1a47454f56-kube-api-access-gkjp4\") pod \"node-exporter-cfxkz\" (UID: \"10fe0991-123c-4342-a808-8d1a47454f56\") " pod="openshift-monitoring/node-exporter-cfxkz" May 20 14:10:06.561494 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.561477 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb-metrics-certs\") pod \"network-metrics-daemon-m2p6p\" (UID: \"ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb\") " pod="openshift-multus/network-metrics-daemon-m2p6p" May 20 14:10:06.586637 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.586529 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jdd5g\"" May 20 14:10:06.594697 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.594668 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2p6p" May 20 14:10:06.653396 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.653364 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xr2xr" May 20 14:10:06.751430 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.751392 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6scgv\" (UniqueName: \"kubernetes.io/projected/5052d255-8507-424c-aa56-2e94ec6d060f-kube-api-access-6scgv\") pod \"network-check-target-647bg\" (UID: \"5052d255-8507-424c-aa56-2e94ec6d060f\") " pod="openshift-network-diagnostics/network-check-target-647bg" May 20 14:10:06.754279 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.754253 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 20 14:10:06.765128 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.765100 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 20 14:10:06.776059 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.776030 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6scgv\" (UniqueName: \"kubernetes.io/projected/5052d255-8507-424c-aa56-2e94ec6d060f-kube-api-access-6scgv\") pod \"network-check-target-647bg\" (UID: \"5052d255-8507-424c-aa56-2e94ec6d060f\") " pod="openshift-network-diagnostics/network-check-target-647bg" May 20 14:10:06.878002 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.877926 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-k9rks\"" May 20 14:10:06.884426 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:06.884398 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-647bg" May 20 14:10:07.054910 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:07.054872 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/10fe0991-123c-4342-a808-8d1a47454f56-node-exporter-tls\") pod \"node-exporter-cfxkz\" (UID: \"10fe0991-123c-4342-a808-8d1a47454f56\") " pod="openshift-monitoring/node-exporter-cfxkz" May 20 14:10:07.057734 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:07.057708 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/10fe0991-123c-4342-a808-8d1a47454f56-node-exporter-tls\") pod \"node-exporter-cfxkz\" (UID: \"10fe0991-123c-4342-a808-8d1a47454f56\") " pod="openshift-monitoring/node-exporter-cfxkz" May 20 14:10:07.279053 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:07.278969 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cfxkz" May 20 14:10:08.063208 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:08.063167 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3e67e53-49ad-4cb8-81dd-583176e309a3-original-pull-secret\") pod \"global-pull-secret-syncer-v2ngr\" (UID: \"d3e67e53-49ad-4cb8-81dd-583176e309a3\") " pod="kube-system/global-pull-secret-syncer-v2ngr" May 20 14:10:08.065882 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:08.065843 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 20 14:10:08.069133 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:08.069109 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tk4mc" May 20 14:10:08.075868 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:08.075840 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3e67e53-49ad-4cb8-81dd-583176e309a3-original-pull-secret\") pod \"global-pull-secret-syncer-v2ngr\" (UID: \"d3e67e53-49ad-4cb8-81dd-583176e309a3\") " pod="kube-system/global-pull-secret-syncer-v2ngr" May 20 14:10:08.079629 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:08.079597 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v2ngr" May 20 14:10:09.355509 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:09.355454 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-97b8c9d98-bg22m"] May 20 14:10:09.384583 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:09.384556 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-97b8c9d98-bg22m"] May 20 14:10:09.384741 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:09.384703 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-97b8c9d98-bg22m" May 20 14:10:09.387298 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:09.387272 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" May 20 14:10:09.387431 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:09.387331 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" May 20 14:10:09.387431 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:09.387353 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-l5gxb\"" May 20 14:10:09.387550 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:09.387440 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" May 20 14:10:09.387550 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:09.387446 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" May 20 14:10:09.387973 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:09.387954 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-f1213efsqhka7\"" May 20 14:10:09.388060 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:09.387979 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" May 20 14:10:09.477689 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:09.477649 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xdvr\" (UniqueName: \"kubernetes.io/projected/dbde0e4c-106c-47ed-98ad-5c2f072e5b94-kube-api-access-4xdvr\") pod \"thanos-querier-97b8c9d98-bg22m\" (UID: \"dbde0e4c-106c-47ed-98ad-5c2f072e5b94\") " pod="openshift-monitoring/thanos-querier-97b8c9d98-bg22m" May 20 14:10:09.477877 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:09.477698 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/dbde0e4c-106c-47ed-98ad-5c2f072e5b94-secret-thanos-querier-tls\") pod \"thanos-querier-97b8c9d98-bg22m\" (UID: \"dbde0e4c-106c-47ed-98ad-5c2f072e5b94\") " pod="openshift-monitoring/thanos-querier-97b8c9d98-bg22m" May 20 14:10:09.477877 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:09.477780 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dbde0e4c-106c-47ed-98ad-5c2f072e5b94-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-97b8c9d98-bg22m\" (UID: \"dbde0e4c-106c-47ed-98ad-5c2f072e5b94\") " pod="openshift-monitoring/thanos-querier-97b8c9d98-bg22m" May 20 14:10:09.477877 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:09.477837 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/dbde0e4c-106c-47ed-98ad-5c2f072e5b94-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-97b8c9d98-bg22m\" (UID: \"dbde0e4c-106c-47ed-98ad-5c2f072e5b94\") " pod="openshift-monitoring/thanos-querier-97b8c9d98-bg22m" May 20 14:10:09.478033 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:09.477881 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dbde0e4c-106c-47ed-98ad-5c2f072e5b94-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-97b8c9d98-bg22m\" (UID: \"dbde0e4c-106c-47ed-98ad-5c2f072e5b94\") " pod="openshift-monitoring/thanos-querier-97b8c9d98-bg22m" May 20 14:10:09.478033 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:09.477933 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbde0e4c-106c-47ed-98ad-5c2f072e5b94-metrics-client-ca\") pod \"thanos-querier-97b8c9d98-bg22m\" (UID: \"dbde0e4c-106c-47ed-98ad-5c2f072e5b94\") " pod="openshift-monitoring/thanos-querier-97b8c9d98-bg22m" May 20 14:10:09.478033 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:09.477995 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/dbde0e4c-106c-47ed-98ad-5c2f072e5b94-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-97b8c9d98-bg22m\" (UID: \"dbde0e4c-106c-47ed-98ad-5c2f072e5b94\") " pod="openshift-monitoring/thanos-querier-97b8c9d98-bg22m" May 20 14:10:09.478033 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:09.478021 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dbde0e4c-106c-47ed-98ad-5c2f072e5b94-secret-grpc-tls\") pod \"thanos-querier-97b8c9d98-bg22m\" (UID: \"dbde0e4c-106c-47ed-98ad-5c2f072e5b94\") " pod="openshift-monitoring/thanos-querier-97b8c9d98-bg22m" May 20 14:10:09.578976 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:09.578937 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/dbde0e4c-106c-47ed-98ad-5c2f072e5b94-secret-thanos-querier-tls\") pod \"thanos-querier-97b8c9d98-bg22m\" (UID: \"dbde0e4c-106c-47ed-98ad-5c2f072e5b94\") " pod="openshift-monitoring/thanos-querier-97b8c9d98-bg22m" May 20 14:10:09.579155 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:09.579004 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dbde0e4c-106c-47ed-98ad-5c2f072e5b94-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-97b8c9d98-bg22m\" (UID: \"dbde0e4c-106c-47ed-98ad-5c2f072e5b94\") " pod="openshift-monitoring/thanos-querier-97b8c9d98-bg22m" May 20 14:10:09.579155 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:09.579044 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/dbde0e4c-106c-47ed-98ad-5c2f072e5b94-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-97b8c9d98-bg22m\" (UID: \"dbde0e4c-106c-47ed-98ad-5c2f072e5b94\") " pod="openshift-monitoring/thanos-querier-97b8c9d98-bg22m" May 20 14:10:09.579271 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:09.579197 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dbde0e4c-106c-47ed-98ad-5c2f072e5b94-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-97b8c9d98-bg22m\" (UID: \"dbde0e4c-106c-47ed-98ad-5c2f072e5b94\") " pod="openshift-monitoring/thanos-querier-97b8c9d98-bg22m" May 20 14:10:09.579271 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:09.579247 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbde0e4c-106c-47ed-98ad-5c2f072e5b94-metrics-client-ca\") pod \"thanos-querier-97b8c9d98-bg22m\" (UID: \"dbde0e4c-106c-47ed-98ad-5c2f072e5b94\") " pod="openshift-monitoring/thanos-querier-97b8c9d98-bg22m" May 20 14:10:09.579370 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:09.579317 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/dbde0e4c-106c-47ed-98ad-5c2f072e5b94-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-97b8c9d98-bg22m\" (UID: \"dbde0e4c-106c-47ed-98ad-5c2f072e5b94\") " pod="openshift-monitoring/thanos-querier-97b8c9d98-bg22m" May 20 14:10:09.579370 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:09.579346 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dbde0e4c-106c-47ed-98ad-5c2f072e5b94-secret-grpc-tls\") pod \"thanos-querier-97b8c9d98-bg22m\" (UID: \"dbde0e4c-106c-47ed-98ad-5c2f072e5b94\") " pod="openshift-monitoring/thanos-querier-97b8c9d98-bg22m" May 20 14:10:09.579470 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:09.579387 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4xdvr\" (UniqueName: \"kubernetes.io/projected/dbde0e4c-106c-47ed-98ad-5c2f072e5b94-kube-api-access-4xdvr\") pod \"thanos-querier-97b8c9d98-bg22m\" (UID: \"dbde0e4c-106c-47ed-98ad-5c2f072e5b94\") " pod="openshift-monitoring/thanos-querier-97b8c9d98-bg22m" May 20 14:10:09.580128 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:09.580096 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbde0e4c-106c-47ed-98ad-5c2f072e5b94-metrics-client-ca\") pod \"thanos-querier-97b8c9d98-bg22m\" (UID: \"dbde0e4c-106c-47ed-98ad-5c2f072e5b94\") " pod="openshift-monitoring/thanos-querier-97b8c9d98-bg22m" May 20 14:10:09.582079 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:09.582033 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/dbde0e4c-106c-47ed-98ad-5c2f072e5b94-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-97b8c9d98-bg22m\" (UID: \"dbde0e4c-106c-47ed-98ad-5c2f072e5b94\") " pod="openshift-monitoring/thanos-querier-97b8c9d98-bg22m" May 20 14:10:09.582182 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:09.582115 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dbde0e4c-106c-47ed-98ad-5c2f072e5b94-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-97b8c9d98-bg22m\" (UID: \"dbde0e4c-106c-47ed-98ad-5c2f072e5b94\") " pod="openshift-monitoring/thanos-querier-97b8c9d98-bg22m" May 20 14:10:09.582182 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:09.582132 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/dbde0e4c-106c-47ed-98ad-5c2f072e5b94-secret-thanos-querier-tls\") pod \"thanos-querier-97b8c9d98-bg22m\" (UID: \"dbde0e4c-106c-47ed-98ad-5c2f072e5b94\") " pod="openshift-monitoring/thanos-querier-97b8c9d98-bg22m" May 20 14:10:09.582295 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:09.582261 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dbde0e4c-106c-47ed-98ad-5c2f072e5b94-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-97b8c9d98-bg22m\" (UID: \"dbde0e4c-106c-47ed-98ad-5c2f072e5b94\") " pod="openshift-monitoring/thanos-querier-97b8c9d98-bg22m" May 20 14:10:09.583046 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:09.583012 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/dbde0e4c-106c-47ed-98ad-5c2f072e5b94-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-97b8c9d98-bg22m\" (UID: \"dbde0e4c-106c-47ed-98ad-5c2f072e5b94\") " pod="openshift-monitoring/thanos-querier-97b8c9d98-bg22m" May 20 14:10:09.583499 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:09.583477 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dbde0e4c-106c-47ed-98ad-5c2f072e5b94-secret-grpc-tls\") pod \"thanos-querier-97b8c9d98-bg22m\" (UID: \"dbde0e4c-106c-47ed-98ad-5c2f072e5b94\") " pod="openshift-monitoring/thanos-querier-97b8c9d98-bg22m" May 20 14:10:09.591586 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:09.591563 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xdvr\" (UniqueName: \"kubernetes.io/projected/dbde0e4c-106c-47ed-98ad-5c2f072e5b94-kube-api-access-4xdvr\") pod \"thanos-querier-97b8c9d98-bg22m\" (UID: \"dbde0e4c-106c-47ed-98ad-5c2f072e5b94\") " pod="openshift-monitoring/thanos-querier-97b8c9d98-bg22m" May 20 14:10:09.696181 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:09.696087 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-97b8c9d98-bg22m" May 20 14:10:12.534268 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.534182 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 20 14:10:12.540112 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.540079 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.550769 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.546293 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 20 14:10:12.550769 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.546899 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 20 14:10:12.550769 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.546999 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 20 14:10:12.550769 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.547617 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 20 14:10:12.550769 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.547749 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8q038bhhs24ag\"" May 20 14:10:12.550769 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.548151 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 20 14:10:12.550769 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.550054 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 20 14:10:12.550769 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.550163 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 20 14:10:12.550769 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.550358 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 20 14:10:12.550769 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.550473 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 20 14:10:12.551737 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.551571 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 20 14:10:12.551906 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.551889 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 20 14:10:12.553178 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.552956 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-trvjc\"" May 20 14:10:12.553178 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.553078 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 20 14:10:12.557388 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.557362 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 20 14:10:12.573705 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.573664 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 20 14:10:12.605256 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.605203 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.605256 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.605256 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xmxf\" (UniqueName: \"kubernetes.io/projected/061768ac-a4b2-4763-a9e6-643906183c48-kube-api-access-8xmxf\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.605478 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.605296 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/061768ac-a4b2-4763-a9e6-643906183c48-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.605478 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.605324 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/061768ac-a4b2-4763-a9e6-643906183c48-config-out\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.605478 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.605392 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/061768ac-a4b2-4763-a9e6-643906183c48-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.605478 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.605432 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/061768ac-a4b2-4763-a9e6-643906183c48-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.605677 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.605491 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.605677 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.605513 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/061768ac-a4b2-4763-a9e6-643906183c48-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.605677 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.605539 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/061768ac-a4b2-4763-a9e6-643906183c48-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.605677 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.605558 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-config\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.605677 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.605576 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/061768ac-a4b2-4763-a9e6-643906183c48-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.605677 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.605600 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.605677 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.605631 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.605677 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.605660 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/061768ac-a4b2-4763-a9e6-643906183c48-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.606087 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.605690 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.606087 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.605719 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.606087 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.605743 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-web-config\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.606087 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.605770 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.707325 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.707222 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.708705 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.707299 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8xmxf\" (UniqueName: \"kubernetes.io/projected/061768ac-a4b2-4763-a9e6-643906183c48-kube-api-access-8xmxf\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.708705 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.708029 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/061768ac-a4b2-4763-a9e6-643906183c48-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.708705 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.708058 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/061768ac-a4b2-4763-a9e6-643906183c48-config-out\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.708705 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.708085 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/061768ac-a4b2-4763-a9e6-643906183c48-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.708705 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.708113 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/061768ac-a4b2-4763-a9e6-643906183c48-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.708705 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.708145 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.708705 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.708168 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/061768ac-a4b2-4763-a9e6-643906183c48-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.708705 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.708196 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/061768ac-a4b2-4763-a9e6-643906183c48-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.708705 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.708223 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-config\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.708705 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.708249 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/061768ac-a4b2-4763-a9e6-643906183c48-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.708705 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.708272 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.708705 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.708308 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.708705 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.708336 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/061768ac-a4b2-4763-a9e6-643906183c48-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.708705 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.708367 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.708705 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.708395 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.708705 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.708421 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-web-config\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.708705 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.708450 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.709777 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.709747 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/061768ac-a4b2-4763-a9e6-643906183c48-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.714692 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.712029 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.714692 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.712170 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.714692 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.712307 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/061768ac-a4b2-4763-a9e6-643906183c48-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.714692 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.712967 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/061768ac-a4b2-4763-a9e6-643906183c48-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.714692 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.712987 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-config\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.714692 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.713078 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/061768ac-a4b2-4763-a9e6-643906183c48-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.714692 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.713261 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/061768ac-a4b2-4763-a9e6-643906183c48-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.714692 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.713772 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/061768ac-a4b2-4763-a9e6-643906183c48-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.714692 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.714588 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.714692 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.714644 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/061768ac-a4b2-4763-a9e6-643906183c48-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.715273 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.715090 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.716090 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.716045 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.716598 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.716573 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.717465 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.717419 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-web-config\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.717465 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.717427 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.718063 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.718019 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xmxf\" (UniqueName: \"kubernetes.io/projected/061768ac-a4b2-4763-a9e6-643906183c48-kube-api-access-8xmxf\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.718563 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.718506 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/061768ac-a4b2-4763-a9e6-643906183c48-config-out\") pod \"prometheus-k8s-0\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.856602 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:12.856566 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:12.923665 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:10:12.923629 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10fe0991_123c_4342_a808_8d1a47454f56.slice/crio-efe679dad14eebbc8f20cc2c4601697a09a67a0126366a2dd4a0bf5558688ba5 WatchSource:0}: Error finding container efe679dad14eebbc8f20cc2c4601697a09a67a0126366a2dd4a0bf5558688ba5: Status 404 returned error can't find the container with id efe679dad14eebbc8f20cc2c4601697a09a67a0126366a2dd4a0bf5558688ba5 May 20 14:10:13.120642 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:13.119612 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ff9fbfbdb-v5hgn" event={"ID":"176900a6-e9f3-43ec-a17e-75e93646d940","Type":"ContainerStarted","Data":"54aa32b4954a477756b8f207da0b9645186b471a92124c0e945a645312f4d565"} May 20 14:10:13.122612 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:13.122582 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cfxkz" event={"ID":"10fe0991-123c-4342-a808-8d1a47454f56","Type":"ContainerStarted","Data":"efe679dad14eebbc8f20cc2c4601697a09a67a0126366a2dd4a0bf5558688ba5"} May 20 14:10:13.136189 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:13.136158 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-xr2xr"] May 20 14:10:13.139247 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:13.139225 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-m2p6p"] May 20 14:10:13.139575 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:10:13.139543 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4c50283_8dd2_43b8_baaf_312629ac8a44.slice/crio-ff3131cee685b56a878501ec5956951d0f5647014e20e5d84cf01616774b6951 WatchSource:0}: Error finding container ff3131cee685b56a878501ec5956951d0f5647014e20e5d84cf01616774b6951: Status 404 returned error can't find the container with id ff3131cee685b56a878501ec5956951d0f5647014e20e5d84cf01616774b6951 May 20 14:10:13.141655 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:10:13.141628 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca1c032d_7d4d_4aba_9cdc_4d4e2eec8adb.slice/crio-76219e065e637848dde1ebdda04c6a61be7f0360eb3af1a0f4df5b470162c197 WatchSource:0}: Error finding container 76219e065e637848dde1ebdda04c6a61be7f0360eb3af1a0f4df5b470162c197: Status 404 returned error can't find the container with id 76219e065e637848dde1ebdda04c6a61be7f0360eb3af1a0f4df5b470162c197 May 20 14:10:13.143727 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:13.143677 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5ff9fbfbdb-v5hgn" podStartSLOduration=1.41598099 podStartE2EDuration="10.143659165s" podCreationTimestamp="2026-05-20 14:10:03 +0000 UTC" firstStartedPulling="2026-05-20 14:10:04.195007253 +0000 UTC m=+63.935305159" lastFinishedPulling="2026-05-20 14:10:12.922685436 +0000 UTC m=+72.662983334" observedRunningTime="2026-05-20 14:10:13.143577365 +0000 UTC m=+72.883875294" watchObservedRunningTime="2026-05-20 14:10:13.143659165 +0000 UTC m=+72.883957082" May 20 14:10:13.393198 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:13.393143 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-647bg"] May 20 14:10:13.393636 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:13.393601 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-v2ngr"] May 20 14:10:13.396640 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:10:13.396551 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5052d255_8507_424c_aa56_2e94ec6d060f.slice/crio-bc1fd08fc2b701c53357522c20c12bdb829867abdc7ac88a105d0f1358c6e015 WatchSource:0}: Error finding container bc1fd08fc2b701c53357522c20c12bdb829867abdc7ac88a105d0f1358c6e015: Status 404 returned error can't find the container with id bc1fd08fc2b701c53357522c20c12bdb829867abdc7ac88a105d0f1358c6e015 May 20 14:10:13.396857 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:10:13.396824 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3e67e53_49ad_4cb8_81dd_583176e309a3.slice/crio-e5514b76729ac2de62a0e9f703bdb84fde5cfb77c39bc2bacb820cd302f41a5d WatchSource:0}: Error finding container e5514b76729ac2de62a0e9f703bdb84fde5cfb77c39bc2bacb820cd302f41a5d: Status 404 returned error can't find the container with id e5514b76729ac2de62a0e9f703bdb84fde5cfb77c39bc2bacb820cd302f41a5d May 20 14:10:13.401877 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:13.401859 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-97b8c9d98-bg22m"] May 20 14:10:13.405348 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:10:13.405320 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbde0e4c_106c_47ed_98ad_5c2f072e5b94.slice/crio-64cf9e6bb6286cf7ce35e36aa5e84665d87b6e5c093c6e4a7076fc4dfefb3e1a WatchSource:0}: Error finding container 64cf9e6bb6286cf7ce35e36aa5e84665d87b6e5c093c6e4a7076fc4dfefb3e1a: Status 404 returned error can't find the container with id 64cf9e6bb6286cf7ce35e36aa5e84665d87b6e5c093c6e4a7076fc4dfefb3e1a May 20 14:10:13.426123 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:13.426092 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 20 14:10:13.443359 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:10:13.442988 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod061768ac_a4b2_4763_a9e6_643906183c48.slice/crio-8ba202ff5096838b7c237b365a230c5eb35fbc7ba1a103a7fde4b9bcc956d517 WatchSource:0}: Error finding container 8ba202ff5096838b7c237b365a230c5eb35fbc7ba1a103a7fde4b9bcc956d517: Status 404 returned error can't find the container with id 8ba202ff5096838b7c237b365a230c5eb35fbc7ba1a103a7fde4b9bcc956d517 May 20 14:10:14.027524 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:14.026170 2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5ff9fbfbdb-v5hgn" May 20 14:10:14.027524 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:14.026273 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5ff9fbfbdb-v5hgn" May 20 14:10:14.034291 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:14.034076 2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5ff9fbfbdb-v5hgn" May 20 14:10:14.133459 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:14.133379 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-97b8c9d98-bg22m" event={"ID":"dbde0e4c-106c-47ed-98ad-5c2f072e5b94","Type":"ContainerStarted","Data":"64cf9e6bb6286cf7ce35e36aa5e84665d87b6e5c093c6e4a7076fc4dfefb3e1a"} May 20 14:10:14.135574 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:14.135505 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"061768ac-a4b2-4763-a9e6-643906183c48","Type":"ContainerStarted","Data":"8ba202ff5096838b7c237b365a230c5eb35fbc7ba1a103a7fde4b9bcc956d517"} May 20 14:10:14.138708 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:14.138639 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xr2xr" event={"ID":"f4c50283-8dd2-43b8-baaf-312629ac8a44","Type":"ContainerStarted","Data":"ff3131cee685b56a878501ec5956951d0f5647014e20e5d84cf01616774b6951"} May 20 14:10:14.146287 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:14.146238 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-v2ngr" event={"ID":"d3e67e53-49ad-4cb8-81dd-583176e309a3","Type":"ContainerStarted","Data":"e5514b76729ac2de62a0e9f703bdb84fde5cfb77c39bc2bacb820cd302f41a5d"} May 20 14:10:14.149416 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:14.149360 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-m2p6p" event={"ID":"ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb","Type":"ContainerStarted","Data":"76219e065e637848dde1ebdda04c6a61be7f0360eb3af1a0f4df5b470162c197"} May 20 14:10:14.159230 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:14.156630 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-4cwpv" event={"ID":"a6ec7480-6297-463d-82b8-2388d6e6f914","Type":"ContainerStarted","Data":"510741b997efc6accc78fd6f0012ea6a686032ad72a3940cfb2fb2a4e2e467d3"} May 20 14:10:14.159504 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:14.159419 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-4cwpv" May 20 14:10:14.166419 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:14.166132 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-4cwpv" May 20 14:10:14.170874 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:14.170835 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-647bg" event={"ID":"5052d255-8507-424c-aa56-2e94ec6d060f","Type":"ContainerStarted","Data":"bc1fd08fc2b701c53357522c20c12bdb829867abdc7ac88a105d0f1358c6e015"} May 20 14:10:14.178404 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:14.178356 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-4cwpv" podStartSLOduration=2.651164542 podStartE2EDuration="20.178340446s" podCreationTimestamp="2026-05-20 14:09:54 +0000 UTC" firstStartedPulling="2026-05-20 14:09:55.438122432 +0000 UTC m=+55.178420380" lastFinishedPulling="2026-05-20 14:10:12.965298389 +0000 UTC m=+72.705596284" observedRunningTime="2026-05-20 14:10:14.178225403 +0000 UTC m=+73.918523330" watchObservedRunningTime="2026-05-20 14:10:14.178340446 +0000 UTC m=+73.918638362" May 20 14:10:14.178613 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:14.178589 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5ff9fbfbdb-v5hgn" May 20 14:10:22.205255 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:22.205222 2551 generic.go:358] "Generic (PLEG): container finished" podID="061768ac-a4b2-4763-a9e6-643906183c48" containerID="4b129cf1a89ca12789a8a0f83b4bc896bc0a5bbb7e8d3603b1a386fbc2d3e4bf" exitCode=0 May 20 14:10:22.205630 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:22.205307 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"061768ac-a4b2-4763-a9e6-643906183c48","Type":"ContainerDied","Data":"4b129cf1a89ca12789a8a0f83b4bc896bc0a5bbb7e8d3603b1a386fbc2d3e4bf"} May 20 14:10:22.206807 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:22.206764 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xr2xr" event={"ID":"f4c50283-8dd2-43b8-baaf-312629ac8a44","Type":"ContainerStarted","Data":"76400047efd3c33252593c6778b29bc121aa2d756822e326df56804e4a064ddb"} May 20 14:10:22.207987 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:22.207964 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-m2p6p" event={"ID":"ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb","Type":"ContainerStarted","Data":"a3357fba44dac3a0ef1ba14430a661f66a533892173734a65da45305c1f6c5f5"} May 20 14:10:22.209234 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:22.209207 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-647bg" event={"ID":"5052d255-8507-424c-aa56-2e94ec6d060f","Type":"ContainerStarted","Data":"e5ec6e233381c1fd57ed223ce146df853ab37951e15a6d2c038a0e0d1685bb39"} May 20 14:10:22.209343 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:22.209329 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-647bg" May 20 14:10:22.210687 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:22.210664 2551 generic.go:358] "Generic (PLEG): container finished" podID="10fe0991-123c-4342-a808-8d1a47454f56" containerID="5e48a660080842155926d514b16a376016c956696d63761d67dcd6fd0a6d333d" exitCode=0 May 20 14:10:22.210811 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:22.210739 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cfxkz" event={"ID":"10fe0991-123c-4342-a808-8d1a47454f56","Type":"ContainerDied","Data":"5e48a660080842155926d514b16a376016c956696d63761d67dcd6fd0a6d333d"} May 20 14:10:22.213171 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:22.213147 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-97b8c9d98-bg22m" event={"ID":"dbde0e4c-106c-47ed-98ad-5c2f072e5b94","Type":"ContainerStarted","Data":"aad5ea5c70c22cc21b28798e900f38ac6239891866776ec371eb6c8109b3fdf2"} May 20 14:10:22.278040 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:22.276673 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-647bg" podStartSLOduration=72.910243162 podStartE2EDuration="1m21.276653845s" podCreationTimestamp="2026-05-20 14:09:01 +0000 UTC" firstStartedPulling="2026-05-20 14:10:13.399268398 +0000 UTC m=+73.139566292" lastFinishedPulling="2026-05-20 14:10:21.765679073 +0000 UTC m=+81.505976975" observedRunningTime="2026-05-20 14:10:22.274718459 +0000 UTC m=+82.015016375" watchObservedRunningTime="2026-05-20 14:10:22.276653845 +0000 UTC m=+82.016951760" May 20 14:10:22.360034 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:22.359906 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5ff9fbfbdb-v5hgn"] May 20 14:10:23.220360 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:23.220314 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xr2xr" event={"ID":"f4c50283-8dd2-43b8-baaf-312629ac8a44","Type":"ContainerStarted","Data":"458d680b0e6a26509d87e93aa7b5f9bcba35f14f6fd935d5c0ef867ffa8d79b7"} May 20 14:10:23.220942 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:23.220370 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xr2xr" event={"ID":"f4c50283-8dd2-43b8-baaf-312629ac8a44","Type":"ContainerStarted","Data":"9093a4e060e7d2a451064f1410201315c9e957dfffb504e29602806ff1dc7c47"} May 20 14:10:23.223225 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:23.222719 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-v2ngr" event={"ID":"d3e67e53-49ad-4cb8-81dd-583176e309a3","Type":"ContainerStarted","Data":"d79f2636f7e7dc3495cadfe95e334fa3eb761d806cd0ac7cef041fe42c05f5e9"} May 20 14:10:23.225848 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:23.225819 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-m2p6p" event={"ID":"ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb","Type":"ContainerStarted","Data":"c056c84399eebb3bab9e2a58105a560c8793946f019c89c22febd22a91ea0894"} May 20 14:10:23.228098 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:23.228075 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cfxkz" event={"ID":"10fe0991-123c-4342-a808-8d1a47454f56","Type":"ContainerStarted","Data":"17558cc03a11d6aa473ce9f2ec7c6432afb266eac5911124d56a79b57c2b2779"} May 20 14:10:23.228217 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:23.228105 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cfxkz" event={"ID":"10fe0991-123c-4342-a808-8d1a47454f56","Type":"ContainerStarted","Data":"3fd245793189ff487aa6faa28200ae0c8675dd2000e33c29f341e30df23d2825"} May 20 14:10:23.230423 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:23.230400 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-97b8c9d98-bg22m" event={"ID":"dbde0e4c-106c-47ed-98ad-5c2f072e5b94","Type":"ContainerStarted","Data":"a6b54494f9cb344fe36777bcce43157fac589a79ec514fcc9d139dcf122b552c"} May 20 14:10:23.230579 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:23.230427 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-97b8c9d98-bg22m" event={"ID":"dbde0e4c-106c-47ed-98ad-5c2f072e5b94","Type":"ContainerStarted","Data":"aee60a4ec81b86c0027f22f2f961b584ad07e195b110fbf49dcf32ac52efe3c8"} May 20 14:10:23.242683 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:23.242636 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xr2xr" podStartSLOduration=8.618838551 podStartE2EDuration="17.242618972s" podCreationTimestamp="2026-05-20 14:10:06 +0000 UTC" firstStartedPulling="2026-05-20 14:10:13.141839868 +0000 UTC m=+72.882137762" lastFinishedPulling="2026-05-20 14:10:21.765620274 +0000 UTC m=+81.505918183" observedRunningTime="2026-05-20 14:10:23.240731796 +0000 UTC m=+82.981029713" watchObservedRunningTime="2026-05-20 14:10:23.242618972 +0000 UTC m=+82.982916889" May 20 14:10:23.267585 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:23.267530 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cfxkz" podStartSLOduration=8.808342286 podStartE2EDuration="17.267515796s" podCreationTimestamp="2026-05-20 14:10:06 +0000 UTC" firstStartedPulling="2026-05-20 14:10:12.926016297 +0000 UTC m=+72.666314190" lastFinishedPulling="2026-05-20 14:10:21.385189796 +0000 UTC m=+81.125487700" observedRunningTime="2026-05-20 14:10:23.266559601 +0000 UTC m=+83.006857518" watchObservedRunningTime="2026-05-20 14:10:23.267515796 +0000 UTC m=+83.007813713" May 20 14:10:23.294495 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:23.294434 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-m2p6p" podStartSLOduration=74.672694787 podStartE2EDuration="1m23.294416217s" podCreationTimestamp="2026-05-20 14:09:00 +0000 UTC" firstStartedPulling="2026-05-20 14:10:13.143859802 +0000 UTC m=+72.884157708" lastFinishedPulling="2026-05-20 14:10:21.765581233 +0000 UTC m=+81.505879138" observedRunningTime="2026-05-20 14:10:23.293652652 +0000 UTC m=+83.033950569" watchObservedRunningTime="2026-05-20 14:10:23.294416217 +0000 UTC m=+83.034714133" May 20 14:10:23.311479 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:23.311412 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-v2ngr" podStartSLOduration=70.917295237 podStartE2EDuration="1m19.311393654s" podCreationTimestamp="2026-05-20 14:09:04 +0000 UTC" firstStartedPulling="2026-05-20 14:10:13.399485438 +0000 UTC m=+73.139783342" lastFinishedPulling="2026-05-20 14:10:21.793583863 +0000 UTC m=+81.533881759" observedRunningTime="2026-05-20 14:10:23.310223516 +0000 UTC m=+83.050521477" watchObservedRunningTime="2026-05-20 14:10:23.311393654 +0000 UTC m=+83.051691571" May 20 14:10:24.237749 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:24.237592 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-97b8c9d98-bg22m" event={"ID":"dbde0e4c-106c-47ed-98ad-5c2f072e5b94","Type":"ContainerStarted","Data":"765c0bab5013dd42df464cd5a9fd33620e9aa6c568e1358f97745356c4fc9bc1"} May 20 14:10:24.237749 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:24.237637 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-97b8c9d98-bg22m" event={"ID":"dbde0e4c-106c-47ed-98ad-5c2f072e5b94","Type":"ContainerStarted","Data":"add6e3b414b2301c6da41cc8d5479b79769e13f4723196acd9baddec08c9e95a"} May 20 14:10:24.237749 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:24.237653 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-97b8c9d98-bg22m" event={"ID":"dbde0e4c-106c-47ed-98ad-5c2f072e5b94","Type":"ContainerStarted","Data":"238d2e26bb7e392d42ee0a3abb15fad5a39d7bbc5f096048c79364d5266d08c0"} May 20 14:10:24.273989 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:24.273706 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-97b8c9d98-bg22m" podStartSLOduration=5.047304279 podStartE2EDuration="15.273688184s" podCreationTimestamp="2026-05-20 14:10:09 +0000 UTC" firstStartedPulling="2026-05-20 14:10:13.408336637 +0000 UTC m=+73.148634548" lastFinishedPulling="2026-05-20 14:10:23.634720548 +0000 UTC m=+83.375018453" observedRunningTime="2026-05-20 14:10:24.272426886 +0000 UTC m=+84.012724801" watchObservedRunningTime="2026-05-20 14:10:24.273688184 +0000 UTC m=+84.013986099" May 20 14:10:25.240909 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:25.240866 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-97b8c9d98-bg22m" May 20 14:10:26.246223 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:26.246188 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"061768ac-a4b2-4763-a9e6-643906183c48","Type":"ContainerStarted","Data":"f869d43f1649ce2cace9ca5b3cc512392cf52603705e05df7078770e8943211f"} May 20 14:10:26.246223 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:26.246228 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"061768ac-a4b2-4763-a9e6-643906183c48","Type":"ContainerStarted","Data":"d89f74147b3ee3175670ae18d72270f307416e172221bf906afb9f3544dd6073"} May 20 14:10:26.246686 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:26.246243 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"061768ac-a4b2-4763-a9e6-643906183c48","Type":"ContainerStarted","Data":"ec19e9f05953f0519ca69ac0c44be6b0d66f09dc33c970461239fa08d5c893b6"} May 20 14:10:26.246686 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:26.246254 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"061768ac-a4b2-4763-a9e6-643906183c48","Type":"ContainerStarted","Data":"85b3621729f96504b19f4ee4e985be436c032faabf7dc5c3981423bc05835afb"} May 20 14:10:26.246686 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:26.246265 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"061768ac-a4b2-4763-a9e6-643906183c48","Type":"ContainerStarted","Data":"67a89578803b295eff6ae56e62b38231d8db94b2247c925468decf37c4403458"} May 20 14:10:26.246686 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:26.246276 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"061768ac-a4b2-4763-a9e6-643906183c48","Type":"ContainerStarted","Data":"030bd07a271c42c2d20f5de4b8c655877dfcd485a336ae09eb8e622902f226ab"} May 20 14:10:26.281676 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:26.281623 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.215378424 podStartE2EDuration="14.28160822s" podCreationTimestamp="2026-05-20 14:10:12 +0000 UTC" firstStartedPulling="2026-05-20 14:10:13.462208854 +0000 UTC m=+73.202506760" lastFinishedPulling="2026-05-20 14:10:25.528438662 +0000 UTC m=+85.268736556" observedRunningTime="2026-05-20 14:10:26.280512083 +0000 UTC m=+86.020809998" watchObservedRunningTime="2026-05-20 14:10:26.28160822 +0000 UTC m=+86.021906131" May 20 14:10:27.857650 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:27.857613 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 20 14:10:31.252452 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:31.252420 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-97b8c9d98-bg22m" May 20 14:10:34.029173 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:34.029149 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8r442_12fd684e-4a9e-43eb-b15f-93074c235ffa/serve-healthcheck-canary/0.log" May 20 14:10:47.382573 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:47.382508 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5ff9fbfbdb-v5hgn" podUID="176900a6-e9f3-43ec-a17e-75e93646d940" containerName="console" containerID="cri-o://54aa32b4954a477756b8f207da0b9645186b471a92124c0e945a645312f4d565" gracePeriod=15 May 20 14:10:47.649342 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:47.649255 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5ff9fbfbdb-v5hgn_176900a6-e9f3-43ec-a17e-75e93646d940/console/0.log" May 20 14:10:47.649503 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:47.649358 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ff9fbfbdb-v5hgn" May 20 14:10:47.730354 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:47.730327 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/176900a6-e9f3-43ec-a17e-75e93646d940-console-serving-cert\") pod \"176900a6-e9f3-43ec-a17e-75e93646d940\" (UID: \"176900a6-e9f3-43ec-a17e-75e93646d940\") " May 20 14:10:47.730543 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:47.730414 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/176900a6-e9f3-43ec-a17e-75e93646d940-console-config\") pod \"176900a6-e9f3-43ec-a17e-75e93646d940\" (UID: \"176900a6-e9f3-43ec-a17e-75e93646d940\") " May 20 14:10:47.730543 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:47.730453 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/176900a6-e9f3-43ec-a17e-75e93646d940-service-ca\") pod \"176900a6-e9f3-43ec-a17e-75e93646d940\" (UID: \"176900a6-e9f3-43ec-a17e-75e93646d940\") " May 20 14:10:47.730543 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:47.730479 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/176900a6-e9f3-43ec-a17e-75e93646d940-oauth-serving-cert\") pod \"176900a6-e9f3-43ec-a17e-75e93646d940\" (UID: \"176900a6-e9f3-43ec-a17e-75e93646d940\") " May 20 14:10:47.730543 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:47.730515 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/176900a6-e9f3-43ec-a17e-75e93646d940-console-oauth-config\") pod \"176900a6-e9f3-43ec-a17e-75e93646d940\" (UID: \"176900a6-e9f3-43ec-a17e-75e93646d940\") " May 20 14:10:47.730740 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:47.730544 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kv4kt\" (UniqueName: \"kubernetes.io/projected/176900a6-e9f3-43ec-a17e-75e93646d940-kube-api-access-kv4kt\") pod \"176900a6-e9f3-43ec-a17e-75e93646d940\" (UID: \"176900a6-e9f3-43ec-a17e-75e93646d940\") " May 20 14:10:47.730835 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:47.730803 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/176900a6-e9f3-43ec-a17e-75e93646d940-console-config" (OuterVolumeSpecName: "console-config") pod "176900a6-e9f3-43ec-a17e-75e93646d940" (UID: "176900a6-e9f3-43ec-a17e-75e93646d940"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 14:10:47.731464 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:47.730820 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/176900a6-e9f3-43ec-a17e-75e93646d940-service-ca" (OuterVolumeSpecName: "service-ca") pod "176900a6-e9f3-43ec-a17e-75e93646d940" (UID: "176900a6-e9f3-43ec-a17e-75e93646d940"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 14:10:47.731825 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:47.731753 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/176900a6-e9f3-43ec-a17e-75e93646d940-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "176900a6-e9f3-43ec-a17e-75e93646d940" (UID: "176900a6-e9f3-43ec-a17e-75e93646d940"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 14:10:47.735825 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:47.733402 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/176900a6-e9f3-43ec-a17e-75e93646d940-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "176900a6-e9f3-43ec-a17e-75e93646d940" (UID: "176900a6-e9f3-43ec-a17e-75e93646d940"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 14:10:47.740734 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:47.740676 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/176900a6-e9f3-43ec-a17e-75e93646d940-kube-api-access-kv4kt" (OuterVolumeSpecName: "kube-api-access-kv4kt") pod "176900a6-e9f3-43ec-a17e-75e93646d940" (UID: "176900a6-e9f3-43ec-a17e-75e93646d940"). InnerVolumeSpecName "kube-api-access-kv4kt". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 14:10:47.741428 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:47.741394 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/176900a6-e9f3-43ec-a17e-75e93646d940-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "176900a6-e9f3-43ec-a17e-75e93646d940" (UID: "176900a6-e9f3-43ec-a17e-75e93646d940"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 14:10:47.832170 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:47.832133 2551 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/176900a6-e9f3-43ec-a17e-75e93646d940-service-ca\") on node \"ip-10-0-142-164.ec2.internal\" DevicePath \"\"" May 20 14:10:47.832170 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:47.832169 2551 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/176900a6-e9f3-43ec-a17e-75e93646d940-oauth-serving-cert\") on node \"ip-10-0-142-164.ec2.internal\" DevicePath \"\"" May 20 14:10:47.832170 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:47.832180 2551 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/176900a6-e9f3-43ec-a17e-75e93646d940-console-oauth-config\") on node \"ip-10-0-142-164.ec2.internal\" DevicePath \"\"" May 20 14:10:47.832464 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:47.832189 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kv4kt\" (UniqueName: \"kubernetes.io/projected/176900a6-e9f3-43ec-a17e-75e93646d940-kube-api-access-kv4kt\") on node \"ip-10-0-142-164.ec2.internal\" DevicePath \"\"" May 20 14:10:47.832464 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:47.832200 2551 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/176900a6-e9f3-43ec-a17e-75e93646d940-console-serving-cert\") on node \"ip-10-0-142-164.ec2.internal\" DevicePath \"\"" May 20 14:10:47.832464 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:47.832208 2551 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/176900a6-e9f3-43ec-a17e-75e93646d940-console-config\") on node \"ip-10-0-142-164.ec2.internal\" DevicePath \"\"" May 20 14:10:48.308993 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:48.308967 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5ff9fbfbdb-v5hgn_176900a6-e9f3-43ec-a17e-75e93646d940/console/0.log" May 20 14:10:48.309173 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:48.309006 2551 generic.go:358] "Generic (PLEG): container finished" podID="176900a6-e9f3-43ec-a17e-75e93646d940" containerID="54aa32b4954a477756b8f207da0b9645186b471a92124c0e945a645312f4d565" exitCode=2 May 20 14:10:48.309173 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:48.309089 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ff9fbfbdb-v5hgn" event={"ID":"176900a6-e9f3-43ec-a17e-75e93646d940","Type":"ContainerDied","Data":"54aa32b4954a477756b8f207da0b9645186b471a92124c0e945a645312f4d565"} May 20 14:10:48.309173 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:48.309103 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ff9fbfbdb-v5hgn" May 20 14:10:48.309173 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:48.309117 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ff9fbfbdb-v5hgn" event={"ID":"176900a6-e9f3-43ec-a17e-75e93646d940","Type":"ContainerDied","Data":"889aff6fb7ef53106fc63ac67ad8dd91bf0160df688ef309e11dcaba6d65fcc6"} May 20 14:10:48.309173 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:48.309131 2551 scope.go:117] "RemoveContainer" containerID="54aa32b4954a477756b8f207da0b9645186b471a92124c0e945a645312f4d565" May 20 14:10:48.316978 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:48.316956 2551 scope.go:117] "RemoveContainer" containerID="54aa32b4954a477756b8f207da0b9645186b471a92124c0e945a645312f4d565" May 20 14:10:48.317285 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:10:48.317244 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54aa32b4954a477756b8f207da0b9645186b471a92124c0e945a645312f4d565\": container with ID starting with 54aa32b4954a477756b8f207da0b9645186b471a92124c0e945a645312f4d565 not found: ID does not exist" containerID="54aa32b4954a477756b8f207da0b9645186b471a92124c0e945a645312f4d565" May 20 14:10:48.317360 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:48.317295 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54aa32b4954a477756b8f207da0b9645186b471a92124c0e945a645312f4d565"} err="failed to get container status \"54aa32b4954a477756b8f207da0b9645186b471a92124c0e945a645312f4d565\": rpc error: code = NotFound desc = could not find container \"54aa32b4954a477756b8f207da0b9645186b471a92124c0e945a645312f4d565\": container with ID starting with 54aa32b4954a477756b8f207da0b9645186b471a92124c0e945a645312f4d565 not found: ID does not exist" May 20 14:10:48.332212 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:48.332182 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5ff9fbfbdb-v5hgn"] May 20 14:10:48.336182 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:48.336160 2551 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5ff9fbfbdb-v5hgn"] May 20 14:10:48.867834 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:48.867802 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="176900a6-e9f3-43ec-a17e-75e93646d940" path="/var/lib/kubelet/pods/176900a6-e9f3-43ec-a17e-75e93646d940/volumes" May 20 14:10:53.233404 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:10:53.233370 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-647bg" May 20 14:11:12.857108 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:12.857068 2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:12.875932 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:12.875907 2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:13.396543 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:13.396515 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.090893 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.090850 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 20 14:11:31.091539 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.091469 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="061768ac-a4b2-4763-a9e6-643906183c48" containerName="prometheus" containerID="cri-o://030bd07a271c42c2d20f5de4b8c655877dfcd485a336ae09eb8e622902f226ab" gracePeriod=600 May 20 14:11:31.091813 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.091493 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="061768ac-a4b2-4763-a9e6-643906183c48" containerName="kube-rbac-proxy-web" containerID="cri-o://ec19e9f05953f0519ca69ac0c44be6b0d66f09dc33c970461239fa08d5c893b6" gracePeriod=600 May 20 14:11:31.091928 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.091488 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="061768ac-a4b2-4763-a9e6-643906183c48" containerName="kube-rbac-proxy" containerID="cri-o://d89f74147b3ee3175670ae18d72270f307416e172221bf906afb9f3544dd6073" gracePeriod=600 May 20 14:11:31.091928 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.091538 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="061768ac-a4b2-4763-a9e6-643906183c48" containerName="thanos-sidecar" containerID="cri-o://85b3621729f96504b19f4ee4e985be436c032faabf7dc5c3981423bc05835afb" gracePeriod=600 May 20 14:11:31.091928 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.091499 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="061768ac-a4b2-4763-a9e6-643906183c48" containerName="config-reloader" containerID="cri-o://67a89578803b295eff6ae56e62b38231d8db94b2247c925468decf37c4403458" gracePeriod=600 May 20 14:11:31.092080 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.091548 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="061768ac-a4b2-4763-a9e6-643906183c48" containerName="kube-rbac-proxy-thanos" containerID="cri-o://f869d43f1649ce2cace9ca5b3cc512392cf52603705e05df7078770e8943211f" gracePeriod=600 May 20 14:11:31.343102 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.343037 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.377865 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.377831 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-web-config\") pod \"061768ac-a4b2-4763-a9e6-643906183c48\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " May 20 14:11:31.378044 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.377913 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xmxf\" (UniqueName: \"kubernetes.io/projected/061768ac-a4b2-4763-a9e6-643906183c48-kube-api-access-8xmxf\") pod \"061768ac-a4b2-4763-a9e6-643906183c48\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " May 20 14:11:31.378044 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.377947 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-secret-grpc-tls\") pod \"061768ac-a4b2-4763-a9e6-643906183c48\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " May 20 14:11:31.378044 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.377977 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/061768ac-a4b2-4763-a9e6-643906183c48-configmap-metrics-client-ca\") pod \"061768ac-a4b2-4763-a9e6-643906183c48\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " May 20 14:11:31.378044 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.378011 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"061768ac-a4b2-4763-a9e6-643906183c48\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " May 20 14:11:31.378259 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.378050 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/061768ac-a4b2-4763-a9e6-643906183c48-config-out\") pod \"061768ac-a4b2-4763-a9e6-643906183c48\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " May 20 14:11:31.378259 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.378083 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/061768ac-a4b2-4763-a9e6-643906183c48-prometheus-k8s-rulefiles-0\") pod \"061768ac-a4b2-4763-a9e6-643906183c48\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " May 20 14:11:31.378259 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.378110 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-thanos-prometheus-http-client-file\") pod \"061768ac-a4b2-4763-a9e6-643906183c48\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " May 20 14:11:31.378259 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.378145 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/061768ac-a4b2-4763-a9e6-643906183c48-configmap-serving-certs-ca-bundle\") pod \"061768ac-a4b2-4763-a9e6-643906183c48\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " May 20 14:11:31.378259 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.378172 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-secret-metrics-client-certs\") pod \"061768ac-a4b2-4763-a9e6-643906183c48\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " May 20 14:11:31.378259 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.378200 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/061768ac-a4b2-4763-a9e6-643906183c48-prometheus-k8s-db\") pod \"061768ac-a4b2-4763-a9e6-643906183c48\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " May 20 14:11:31.378259 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.378225 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/061768ac-a4b2-4763-a9e6-643906183c48-tls-assets\") pod \"061768ac-a4b2-4763-a9e6-643906183c48\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " May 20 14:11:31.378259 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.378251 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"061768ac-a4b2-4763-a9e6-643906183c48\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " May 20 14:11:31.378638 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.378287 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/061768ac-a4b2-4763-a9e6-643906183c48-configmap-kubelet-serving-ca-bundle\") pod \"061768ac-a4b2-4763-a9e6-643906183c48\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " May 20 14:11:31.378638 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.378320 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/061768ac-a4b2-4763-a9e6-643906183c48-prometheus-trusted-ca-bundle\") pod \"061768ac-a4b2-4763-a9e6-643906183c48\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " May 20 14:11:31.378638 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.378353 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/061768ac-a4b2-4763-a9e6-643906183c48-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "061768ac-a4b2-4763-a9e6-643906183c48" (UID: "061768ac-a4b2-4763-a9e6-643906183c48"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 14:11:31.378638 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.378365 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-config\") pod \"061768ac-a4b2-4763-a9e6-643906183c48\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " May 20 14:11:31.378638 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.378425 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-secret-kube-rbac-proxy\") pod \"061768ac-a4b2-4763-a9e6-643906183c48\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " May 20 14:11:31.378638 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.378481 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-secret-prometheus-k8s-tls\") pod \"061768ac-a4b2-4763-a9e6-643906183c48\" (UID: \"061768ac-a4b2-4763-a9e6-643906183c48\") " May 20 14:11:31.378946 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.378702 2551 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/061768ac-a4b2-4763-a9e6-643906183c48-configmap-metrics-client-ca\") on node \"ip-10-0-142-164.ec2.internal\" DevicePath \"\"" May 20 14:11:31.379391 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.379361 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/061768ac-a4b2-4763-a9e6-643906183c48-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "061768ac-a4b2-4763-a9e6-643906183c48" (UID: "061768ac-a4b2-4763-a9e6-643906183c48"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 14:11:31.379674 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.379649 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/061768ac-a4b2-4763-a9e6-643906183c48-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "061768ac-a4b2-4763-a9e6-643906183c48" (UID: "061768ac-a4b2-4763-a9e6-643906183c48"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 14:11:31.380308 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.380232 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/061768ac-a4b2-4763-a9e6-643906183c48-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "061768ac-a4b2-4763-a9e6-643906183c48" (UID: "061768ac-a4b2-4763-a9e6-643906183c48"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 14:11:31.380308 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.380265 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/061768ac-a4b2-4763-a9e6-643906183c48-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "061768ac-a4b2-4763-a9e6-643906183c48" (UID: "061768ac-a4b2-4763-a9e6-643906183c48"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 14:11:31.380885 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.380827 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/061768ac-a4b2-4763-a9e6-643906183c48-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "061768ac-a4b2-4763-a9e6-643906183c48" (UID: "061768ac-a4b2-4763-a9e6-643906183c48"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 14:11:31.381361 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.381333 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-config" (OuterVolumeSpecName: "config") pod "061768ac-a4b2-4763-a9e6-643906183c48" (UID: "061768ac-a4b2-4763-a9e6-643906183c48"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 14:11:31.382379 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.382355 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/061768ac-a4b2-4763-a9e6-643906183c48-kube-api-access-8xmxf" (OuterVolumeSpecName: "kube-api-access-8xmxf") pod "061768ac-a4b2-4763-a9e6-643906183c48" (UID: "061768ac-a4b2-4763-a9e6-643906183c48"). InnerVolumeSpecName "kube-api-access-8xmxf". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 14:11:31.383088 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.383064 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "061768ac-a4b2-4763-a9e6-643906183c48" (UID: "061768ac-a4b2-4763-a9e6-643906183c48"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 14:11:31.383439 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.383408 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "061768ac-a4b2-4763-a9e6-643906183c48" (UID: "061768ac-a4b2-4763-a9e6-643906183c48"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 14:11:31.383662 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.383521 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "061768ac-a4b2-4763-a9e6-643906183c48" (UID: "061768ac-a4b2-4763-a9e6-643906183c48"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 14:11:31.383662 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.383553 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/061768ac-a4b2-4763-a9e6-643906183c48-config-out" (OuterVolumeSpecName: "config-out") pod "061768ac-a4b2-4763-a9e6-643906183c48" (UID: "061768ac-a4b2-4763-a9e6-643906183c48"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 14:11:31.383662 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.383610 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "061768ac-a4b2-4763-a9e6-643906183c48" (UID: "061768ac-a4b2-4763-a9e6-643906183c48"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 14:11:31.384260 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.384233 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "061768ac-a4b2-4763-a9e6-643906183c48" (UID: "061768ac-a4b2-4763-a9e6-643906183c48"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 14:11:31.384380 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.384260 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "061768ac-a4b2-4763-a9e6-643906183c48" (UID: "061768ac-a4b2-4763-a9e6-643906183c48"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 14:11:31.384380 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.384365 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "061768ac-a4b2-4763-a9e6-643906183c48" (UID: "061768ac-a4b2-4763-a9e6-643906183c48"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 14:11:31.385261 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.385238 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/061768ac-a4b2-4763-a9e6-643906183c48-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "061768ac-a4b2-4763-a9e6-643906183c48" (UID: "061768ac-a4b2-4763-a9e6-643906183c48"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 14:11:31.397149 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.397095 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-web-config" (OuterVolumeSpecName: "web-config") pod "061768ac-a4b2-4763-a9e6-643906183c48" (UID: "061768ac-a4b2-4763-a9e6-643906183c48"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 14:11:31.434865 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.434829 2551 generic.go:358] "Generic (PLEG): container finished" podID="061768ac-a4b2-4763-a9e6-643906183c48" containerID="f869d43f1649ce2cace9ca5b3cc512392cf52603705e05df7078770e8943211f" exitCode=0 May 20 14:11:31.434865 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.434859 2551 generic.go:358] "Generic (PLEG): container finished" podID="061768ac-a4b2-4763-a9e6-643906183c48" containerID="d89f74147b3ee3175670ae18d72270f307416e172221bf906afb9f3544dd6073" exitCode=0 May 20 14:11:31.434865 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.434868 2551 generic.go:358] "Generic (PLEG): container finished" podID="061768ac-a4b2-4763-a9e6-643906183c48" containerID="ec19e9f05953f0519ca69ac0c44be6b0d66f09dc33c970461239fa08d5c893b6" exitCode=0 May 20 14:11:31.434865 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.434875 2551 generic.go:358] "Generic (PLEG): container finished" podID="061768ac-a4b2-4763-a9e6-643906183c48" containerID="85b3621729f96504b19f4ee4e985be436c032faabf7dc5c3981423bc05835afb" exitCode=0 May 20 14:11:31.435192 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.434882 2551 generic.go:358] "Generic (PLEG): container finished" podID="061768ac-a4b2-4763-a9e6-643906183c48" containerID="67a89578803b295eff6ae56e62b38231d8db94b2247c925468decf37c4403458" exitCode=0 May 20 14:11:31.435192 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.434890 2551 generic.go:358] "Generic (PLEG): container finished" podID="061768ac-a4b2-4763-a9e6-643906183c48" containerID="030bd07a271c42c2d20f5de4b8c655877dfcd485a336ae09eb8e622902f226ab" exitCode=0 May 20 14:11:31.435192 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.434906 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"061768ac-a4b2-4763-a9e6-643906183c48","Type":"ContainerDied","Data":"f869d43f1649ce2cace9ca5b3cc512392cf52603705e05df7078770e8943211f"} May 20 14:11:31.435192 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.434948 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.435192 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.434982 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"061768ac-a4b2-4763-a9e6-643906183c48","Type":"ContainerDied","Data":"d89f74147b3ee3175670ae18d72270f307416e172221bf906afb9f3544dd6073"} May 20 14:11:31.435192 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.435000 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"061768ac-a4b2-4763-a9e6-643906183c48","Type":"ContainerDied","Data":"ec19e9f05953f0519ca69ac0c44be6b0d66f09dc33c970461239fa08d5c893b6"} May 20 14:11:31.435192 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.435016 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"061768ac-a4b2-4763-a9e6-643906183c48","Type":"ContainerDied","Data":"85b3621729f96504b19f4ee4e985be436c032faabf7dc5c3981423bc05835afb"} May 20 14:11:31.435192 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.435031 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"061768ac-a4b2-4763-a9e6-643906183c48","Type":"ContainerDied","Data":"67a89578803b295eff6ae56e62b38231d8db94b2247c925468decf37c4403458"} May 20 14:11:31.435192 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.435046 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"061768ac-a4b2-4763-a9e6-643906183c48","Type":"ContainerDied","Data":"030bd07a271c42c2d20f5de4b8c655877dfcd485a336ae09eb8e622902f226ab"} May 20 14:11:31.435192 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.435060 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"061768ac-a4b2-4763-a9e6-643906183c48","Type":"ContainerDied","Data":"8ba202ff5096838b7c237b365a230c5eb35fbc7ba1a103a7fde4b9bcc956d517"} May 20 14:11:31.435192 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.435080 2551 scope.go:117] "RemoveContainer" containerID="f869d43f1649ce2cace9ca5b3cc512392cf52603705e05df7078770e8943211f" May 20 14:11:31.443614 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.443599 2551 scope.go:117] "RemoveContainer" containerID="d89f74147b3ee3175670ae18d72270f307416e172221bf906afb9f3544dd6073" May 20 14:11:31.449940 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.449923 2551 scope.go:117] "RemoveContainer" containerID="ec19e9f05953f0519ca69ac0c44be6b0d66f09dc33c970461239fa08d5c893b6" May 20 14:11:31.456521 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.456499 2551 scope.go:117] "RemoveContainer" containerID="85b3621729f96504b19f4ee4e985be436c032faabf7dc5c3981423bc05835afb" May 20 14:11:31.465199 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.465179 2551 scope.go:117] "RemoveContainer" containerID="67a89578803b295eff6ae56e62b38231d8db94b2247c925468decf37c4403458" May 20 14:11:31.470964 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.470942 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 20 14:11:31.472091 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.472067 2551 scope.go:117] "RemoveContainer" containerID="030bd07a271c42c2d20f5de4b8c655877dfcd485a336ae09eb8e622902f226ab" May 20 14:11:31.478763 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.478745 2551 scope.go:117] "RemoveContainer" containerID="4b129cf1a89ca12789a8a0f83b4bc896bc0a5bbb7e8d3603b1a386fbc2d3e4bf" May 20 14:11:31.479807 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.479344 2551 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-142-164.ec2.internal\" DevicePath \"\"" May 20 14:11:31.479807 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.479378 2551 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/061768ac-a4b2-4763-a9e6-643906183c48-config-out\") on node \"ip-10-0-142-164.ec2.internal\" DevicePath \"\"" May 20 14:11:31.479807 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.479396 2551 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/061768ac-a4b2-4763-a9e6-643906183c48-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-142-164.ec2.internal\" DevicePath \"\"" May 20 14:11:31.479807 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.479413 2551 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-164.ec2.internal\" DevicePath \"\"" May 20 14:11:31.479807 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.479435 2551 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/061768ac-a4b2-4763-a9e6-643906183c48-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-142-164.ec2.internal\" DevicePath \"\"" May 20 14:11:31.479807 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.479449 2551 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-secret-metrics-client-certs\") on node \"ip-10-0-142-164.ec2.internal\" DevicePath \"\"" May 20 14:11:31.479807 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.479499 2551 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/061768ac-a4b2-4763-a9e6-643906183c48-prometheus-k8s-db\") on node \"ip-10-0-142-164.ec2.internal\" DevicePath \"\"" May 20 14:11:31.479807 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.479526 2551 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/061768ac-a4b2-4763-a9e6-643906183c48-tls-assets\") on node \"ip-10-0-142-164.ec2.internal\" DevicePath \"\"" May 20 14:11:31.479807 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.479546 2551 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-142-164.ec2.internal\" DevicePath \"\"" May 20 14:11:31.479807 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.479570 2551 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/061768ac-a4b2-4763-a9e6-643906183c48-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-142-164.ec2.internal\" DevicePath \"\"" May 20 14:11:31.479807 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.479587 2551 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/061768ac-a4b2-4763-a9e6-643906183c48-prometheus-trusted-ca-bundle\") on node \"ip-10-0-142-164.ec2.internal\" DevicePath \"\"" May 20 14:11:31.479807 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.479601 2551 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-config\") on node \"ip-10-0-142-164.ec2.internal\" DevicePath \"\"" May 20 14:11:31.479807 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.479616 2551 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-secret-kube-rbac-proxy\") on node \"ip-10-0-142-164.ec2.internal\" DevicePath \"\"" May 20 14:11:31.479807 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.479636 2551 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-secret-prometheus-k8s-tls\") on node \"ip-10-0-142-164.ec2.internal\" DevicePath \"\"" May 20 14:11:31.479807 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.479653 2551 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-web-config\") on node \"ip-10-0-142-164.ec2.internal\" DevicePath \"\"" May 20 14:11:31.479807 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.479667 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xmxf\" (UniqueName: \"kubernetes.io/projected/061768ac-a4b2-4763-a9e6-643906183c48-kube-api-access-8xmxf\") on node \"ip-10-0-142-164.ec2.internal\" DevicePath \"\"" May 20 14:11:31.479807 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.479680 2551 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/061768ac-a4b2-4763-a9e6-643906183c48-secret-grpc-tls\") on node \"ip-10-0-142-164.ec2.internal\" DevicePath \"\"" May 20 14:11:31.489583 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.489563 2551 scope.go:117] "RemoveContainer" containerID="f869d43f1649ce2cace9ca5b3cc512392cf52603705e05df7078770e8943211f" May 20 14:11:31.489844 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:11:31.489822 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f869d43f1649ce2cace9ca5b3cc512392cf52603705e05df7078770e8943211f\": container with ID starting with f869d43f1649ce2cace9ca5b3cc512392cf52603705e05df7078770e8943211f not found: ID does not exist" containerID="f869d43f1649ce2cace9ca5b3cc512392cf52603705e05df7078770e8943211f" May 20 14:11:31.489916 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.489852 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f869d43f1649ce2cace9ca5b3cc512392cf52603705e05df7078770e8943211f"} err="failed to get container status \"f869d43f1649ce2cace9ca5b3cc512392cf52603705e05df7078770e8943211f\": rpc error: code = NotFound desc = could not find container \"f869d43f1649ce2cace9ca5b3cc512392cf52603705e05df7078770e8943211f\": container with ID starting with f869d43f1649ce2cace9ca5b3cc512392cf52603705e05df7078770e8943211f not found: ID does not exist" May 20 14:11:31.489916 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.489886 2551 scope.go:117] "RemoveContainer" containerID="d89f74147b3ee3175670ae18d72270f307416e172221bf906afb9f3544dd6073" May 20 14:11:31.490151 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:11:31.490134 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d89f74147b3ee3175670ae18d72270f307416e172221bf906afb9f3544dd6073\": container with ID starting with d89f74147b3ee3175670ae18d72270f307416e172221bf906afb9f3544dd6073 not found: ID does not exist" containerID="d89f74147b3ee3175670ae18d72270f307416e172221bf906afb9f3544dd6073" May 20 14:11:31.490211 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.490163 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d89f74147b3ee3175670ae18d72270f307416e172221bf906afb9f3544dd6073"} err="failed to get container status \"d89f74147b3ee3175670ae18d72270f307416e172221bf906afb9f3544dd6073\": rpc error: code = NotFound desc = could not find container \"d89f74147b3ee3175670ae18d72270f307416e172221bf906afb9f3544dd6073\": container with ID starting with d89f74147b3ee3175670ae18d72270f307416e172221bf906afb9f3544dd6073 not found: ID does not exist" May 20 14:11:31.490211 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.490181 2551 scope.go:117] "RemoveContainer" containerID="ec19e9f05953f0519ca69ac0c44be6b0d66f09dc33c970461239fa08d5c893b6" May 20 14:11:31.490391 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:11:31.490370 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec19e9f05953f0519ca69ac0c44be6b0d66f09dc33c970461239fa08d5c893b6\": container with ID starting with ec19e9f05953f0519ca69ac0c44be6b0d66f09dc33c970461239fa08d5c893b6 not found: ID does not exist" containerID="ec19e9f05953f0519ca69ac0c44be6b0d66f09dc33c970461239fa08d5c893b6" May 20 14:11:31.490458 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.490402 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec19e9f05953f0519ca69ac0c44be6b0d66f09dc33c970461239fa08d5c893b6"} err="failed to get container status \"ec19e9f05953f0519ca69ac0c44be6b0d66f09dc33c970461239fa08d5c893b6\": rpc error: code = NotFound desc = could not find container \"ec19e9f05953f0519ca69ac0c44be6b0d66f09dc33c970461239fa08d5c893b6\": container with ID starting with ec19e9f05953f0519ca69ac0c44be6b0d66f09dc33c970461239fa08d5c893b6 not found: ID does not exist" May 20 14:11:31.490458 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.490424 2551 scope.go:117] "RemoveContainer" containerID="85b3621729f96504b19f4ee4e985be436c032faabf7dc5c3981423bc05835afb" May 20 14:11:31.490693 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:11:31.490674 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85b3621729f96504b19f4ee4e985be436c032faabf7dc5c3981423bc05835afb\": container with ID starting with 85b3621729f96504b19f4ee4e985be436c032faabf7dc5c3981423bc05835afb not found: ID does not exist" containerID="85b3621729f96504b19f4ee4e985be436c032faabf7dc5c3981423bc05835afb" May 20 14:11:31.490742 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.490697 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85b3621729f96504b19f4ee4e985be436c032faabf7dc5c3981423bc05835afb"} err="failed to get container status \"85b3621729f96504b19f4ee4e985be436c032faabf7dc5c3981423bc05835afb\": rpc error: code = NotFound desc = could not find container \"85b3621729f96504b19f4ee4e985be436c032faabf7dc5c3981423bc05835afb\": container with ID starting with 85b3621729f96504b19f4ee4e985be436c032faabf7dc5c3981423bc05835afb not found: ID does not exist" May 20 14:11:31.490742 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.490711 2551 scope.go:117] "RemoveContainer" containerID="67a89578803b295eff6ae56e62b38231d8db94b2247c925468decf37c4403458" May 20 14:11:31.491268 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:11:31.491245 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67a89578803b295eff6ae56e62b38231d8db94b2247c925468decf37c4403458\": container with ID starting with 67a89578803b295eff6ae56e62b38231d8db94b2247c925468decf37c4403458 not found: ID does not exist" containerID="67a89578803b295eff6ae56e62b38231d8db94b2247c925468decf37c4403458" May 20 14:11:31.491365 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.491275 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67a89578803b295eff6ae56e62b38231d8db94b2247c925468decf37c4403458"} err="failed to get container status \"67a89578803b295eff6ae56e62b38231d8db94b2247c925468decf37c4403458\": rpc error: code = NotFound desc = could not find container \"67a89578803b295eff6ae56e62b38231d8db94b2247c925468decf37c4403458\": container with ID starting with 67a89578803b295eff6ae56e62b38231d8db94b2247c925468decf37c4403458 not found: ID does not exist" May 20 14:11:31.491365 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.491295 2551 scope.go:117] "RemoveContainer" containerID="030bd07a271c42c2d20f5de4b8c655877dfcd485a336ae09eb8e622902f226ab" May 20 14:11:31.491585 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:11:31.491566 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"030bd07a271c42c2d20f5de4b8c655877dfcd485a336ae09eb8e622902f226ab\": container with ID starting with 030bd07a271c42c2d20f5de4b8c655877dfcd485a336ae09eb8e622902f226ab not found: ID does not exist" containerID="030bd07a271c42c2d20f5de4b8c655877dfcd485a336ae09eb8e622902f226ab" May 20 14:11:31.491650 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.491592 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"030bd07a271c42c2d20f5de4b8c655877dfcd485a336ae09eb8e622902f226ab"} err="failed to get container status \"030bd07a271c42c2d20f5de4b8c655877dfcd485a336ae09eb8e622902f226ab\": rpc error: code = NotFound desc = could not find container \"030bd07a271c42c2d20f5de4b8c655877dfcd485a336ae09eb8e622902f226ab\": container with ID starting with 030bd07a271c42c2d20f5de4b8c655877dfcd485a336ae09eb8e622902f226ab not found: ID does not exist" May 20 14:11:31.491650 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.491633 2551 scope.go:117] "RemoveContainer" containerID="4b129cf1a89ca12789a8a0f83b4bc896bc0a5bbb7e8d3603b1a386fbc2d3e4bf" May 20 14:11:31.491952 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:11:31.491933 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b129cf1a89ca12789a8a0f83b4bc896bc0a5bbb7e8d3603b1a386fbc2d3e4bf\": container with ID starting with 4b129cf1a89ca12789a8a0f83b4bc896bc0a5bbb7e8d3603b1a386fbc2d3e4bf not found: ID does not exist" containerID="4b129cf1a89ca12789a8a0f83b4bc896bc0a5bbb7e8d3603b1a386fbc2d3e4bf" May 20 14:11:31.492049 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.491958 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b129cf1a89ca12789a8a0f83b4bc896bc0a5bbb7e8d3603b1a386fbc2d3e4bf"} err="failed to get container status \"4b129cf1a89ca12789a8a0f83b4bc896bc0a5bbb7e8d3603b1a386fbc2d3e4bf\": rpc error: code = NotFound desc = could not find container \"4b129cf1a89ca12789a8a0f83b4bc896bc0a5bbb7e8d3603b1a386fbc2d3e4bf\": container with ID starting with 4b129cf1a89ca12789a8a0f83b4bc896bc0a5bbb7e8d3603b1a386fbc2d3e4bf not found: ID does not exist" May 20 14:11:31.492049 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.491977 2551 scope.go:117] "RemoveContainer" containerID="f869d43f1649ce2cace9ca5b3cc512392cf52603705e05df7078770e8943211f" May 20 14:11:31.492229 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.492209 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f869d43f1649ce2cace9ca5b3cc512392cf52603705e05df7078770e8943211f"} err="failed to get container status \"f869d43f1649ce2cace9ca5b3cc512392cf52603705e05df7078770e8943211f\": rpc error: code = NotFound desc = could not find container \"f869d43f1649ce2cace9ca5b3cc512392cf52603705e05df7078770e8943211f\": container with ID starting with f869d43f1649ce2cace9ca5b3cc512392cf52603705e05df7078770e8943211f not found: ID does not exist" May 20 14:11:31.492229 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.492230 2551 scope.go:117] "RemoveContainer" containerID="d89f74147b3ee3175670ae18d72270f307416e172221bf906afb9f3544dd6073" May 20 14:11:31.492479 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.492463 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d89f74147b3ee3175670ae18d72270f307416e172221bf906afb9f3544dd6073"} err="failed to get container status \"d89f74147b3ee3175670ae18d72270f307416e172221bf906afb9f3544dd6073\": rpc error: code = NotFound desc = could not find container \"d89f74147b3ee3175670ae18d72270f307416e172221bf906afb9f3544dd6073\": container with ID starting with d89f74147b3ee3175670ae18d72270f307416e172221bf906afb9f3544dd6073 not found: ID does not exist" May 20 14:11:31.492479 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.492479 2551 scope.go:117] "RemoveContainer" containerID="ec19e9f05953f0519ca69ac0c44be6b0d66f09dc33c970461239fa08d5c893b6" May 20 14:11:31.492802 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.492718 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec19e9f05953f0519ca69ac0c44be6b0d66f09dc33c970461239fa08d5c893b6"} err="failed to get container status \"ec19e9f05953f0519ca69ac0c44be6b0d66f09dc33c970461239fa08d5c893b6\": rpc error: code = NotFound desc = could not find container \"ec19e9f05953f0519ca69ac0c44be6b0d66f09dc33c970461239fa08d5c893b6\": container with ID starting with ec19e9f05953f0519ca69ac0c44be6b0d66f09dc33c970461239fa08d5c893b6 not found: ID does not exist" May 20 14:11:31.492802 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.492742 2551 scope.go:117] "RemoveContainer" containerID="85b3621729f96504b19f4ee4e985be436c032faabf7dc5c3981423bc05835afb" May 20 14:11:31.493198 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.493177 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85b3621729f96504b19f4ee4e985be436c032faabf7dc5c3981423bc05835afb"} err="failed to get container status \"85b3621729f96504b19f4ee4e985be436c032faabf7dc5c3981423bc05835afb\": rpc error: code = NotFound desc = could not find container \"85b3621729f96504b19f4ee4e985be436c032faabf7dc5c3981423bc05835afb\": container with ID starting with 85b3621729f96504b19f4ee4e985be436c032faabf7dc5c3981423bc05835afb not found: ID does not exist" May 20 14:11:31.493198 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.493196 2551 scope.go:117] "RemoveContainer" containerID="67a89578803b295eff6ae56e62b38231d8db94b2247c925468decf37c4403458" May 20 14:11:31.493434 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.493414 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67a89578803b295eff6ae56e62b38231d8db94b2247c925468decf37c4403458"} err="failed to get container status \"67a89578803b295eff6ae56e62b38231d8db94b2247c925468decf37c4403458\": rpc error: code = NotFound desc = could not find container \"67a89578803b295eff6ae56e62b38231d8db94b2247c925468decf37c4403458\": container with ID starting with 67a89578803b295eff6ae56e62b38231d8db94b2247c925468decf37c4403458 not found: ID does not exist" May 20 14:11:31.493496 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.493434 2551 scope.go:117] "RemoveContainer" containerID="030bd07a271c42c2d20f5de4b8c655877dfcd485a336ae09eb8e622902f226ab" May 20 14:11:31.493662 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.493645 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"030bd07a271c42c2d20f5de4b8c655877dfcd485a336ae09eb8e622902f226ab"} err="failed to get container status \"030bd07a271c42c2d20f5de4b8c655877dfcd485a336ae09eb8e622902f226ab\": rpc error: code = NotFound desc = could not find container \"030bd07a271c42c2d20f5de4b8c655877dfcd485a336ae09eb8e622902f226ab\": container with ID starting with 030bd07a271c42c2d20f5de4b8c655877dfcd485a336ae09eb8e622902f226ab not found: ID does not exist" May 20 14:11:31.493662 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.493661 2551 scope.go:117] "RemoveContainer" containerID="4b129cf1a89ca12789a8a0f83b4bc896bc0a5bbb7e8d3603b1a386fbc2d3e4bf" May 20 14:11:31.493896 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.493853 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b129cf1a89ca12789a8a0f83b4bc896bc0a5bbb7e8d3603b1a386fbc2d3e4bf"} err="failed to get container status \"4b129cf1a89ca12789a8a0f83b4bc896bc0a5bbb7e8d3603b1a386fbc2d3e4bf\": rpc error: code = NotFound desc = could not find container \"4b129cf1a89ca12789a8a0f83b4bc896bc0a5bbb7e8d3603b1a386fbc2d3e4bf\": container with ID starting with 4b129cf1a89ca12789a8a0f83b4bc896bc0a5bbb7e8d3603b1a386fbc2d3e4bf not found: ID does not exist" May 20 14:11:31.493965 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.493897 2551 scope.go:117] "RemoveContainer" containerID="f869d43f1649ce2cace9ca5b3cc512392cf52603705e05df7078770e8943211f" May 20 14:11:31.494100 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.494083 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f869d43f1649ce2cace9ca5b3cc512392cf52603705e05df7078770e8943211f"} err="failed to get container status \"f869d43f1649ce2cace9ca5b3cc512392cf52603705e05df7078770e8943211f\": rpc error: code = NotFound desc = could not find container \"f869d43f1649ce2cace9ca5b3cc512392cf52603705e05df7078770e8943211f\": container with ID starting with f869d43f1649ce2cace9ca5b3cc512392cf52603705e05df7078770e8943211f not found: ID does not exist" May 20 14:11:31.494158 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.494100 2551 scope.go:117] "RemoveContainer" containerID="d89f74147b3ee3175670ae18d72270f307416e172221bf906afb9f3544dd6073" May 20 14:11:31.494288 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.494271 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d89f74147b3ee3175670ae18d72270f307416e172221bf906afb9f3544dd6073"} err="failed to get container status \"d89f74147b3ee3175670ae18d72270f307416e172221bf906afb9f3544dd6073\": rpc error: code = NotFound desc = could not find container \"d89f74147b3ee3175670ae18d72270f307416e172221bf906afb9f3544dd6073\": container with ID starting with d89f74147b3ee3175670ae18d72270f307416e172221bf906afb9f3544dd6073 not found: ID does not exist" May 20 14:11:31.494345 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.494288 2551 scope.go:117] "RemoveContainer" containerID="ec19e9f05953f0519ca69ac0c44be6b0d66f09dc33c970461239fa08d5c893b6" May 20 14:11:31.494459 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.494444 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec19e9f05953f0519ca69ac0c44be6b0d66f09dc33c970461239fa08d5c893b6"} err="failed to get container status \"ec19e9f05953f0519ca69ac0c44be6b0d66f09dc33c970461239fa08d5c893b6\": rpc error: code = NotFound desc = could not find container \"ec19e9f05953f0519ca69ac0c44be6b0d66f09dc33c970461239fa08d5c893b6\": container with ID starting with ec19e9f05953f0519ca69ac0c44be6b0d66f09dc33c970461239fa08d5c893b6 not found: ID does not exist" May 20 14:11:31.494459 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.494458 2551 scope.go:117] "RemoveContainer" containerID="85b3621729f96504b19f4ee4e985be436c032faabf7dc5c3981423bc05835afb" May 20 14:11:31.494632 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.494616 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85b3621729f96504b19f4ee4e985be436c032faabf7dc5c3981423bc05835afb"} err="failed to get container status \"85b3621729f96504b19f4ee4e985be436c032faabf7dc5c3981423bc05835afb\": rpc error: code = NotFound desc = could not find container \"85b3621729f96504b19f4ee4e985be436c032faabf7dc5c3981423bc05835afb\": container with ID starting with 85b3621729f96504b19f4ee4e985be436c032faabf7dc5c3981423bc05835afb not found: ID does not exist" May 20 14:11:31.494632 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.494632 2551 scope.go:117] "RemoveContainer" containerID="67a89578803b295eff6ae56e62b38231d8db94b2247c925468decf37c4403458" May 20 14:11:31.494719 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.494647 2551 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 20 14:11:31.494871 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.494805 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67a89578803b295eff6ae56e62b38231d8db94b2247c925468decf37c4403458"} err="failed to get container status \"67a89578803b295eff6ae56e62b38231d8db94b2247c925468decf37c4403458\": rpc error: code = NotFound desc = could not find container \"67a89578803b295eff6ae56e62b38231d8db94b2247c925468decf37c4403458\": container with ID starting with 67a89578803b295eff6ae56e62b38231d8db94b2247c925468decf37c4403458 not found: ID does not exist" May 20 14:11:31.494871 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.494822 2551 scope.go:117] "RemoveContainer" containerID="030bd07a271c42c2d20f5de4b8c655877dfcd485a336ae09eb8e622902f226ab" May 20 14:11:31.494996 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.494981 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"030bd07a271c42c2d20f5de4b8c655877dfcd485a336ae09eb8e622902f226ab"} err="failed to get container status \"030bd07a271c42c2d20f5de4b8c655877dfcd485a336ae09eb8e622902f226ab\": rpc error: code = NotFound desc = could not find container \"030bd07a271c42c2d20f5de4b8c655877dfcd485a336ae09eb8e622902f226ab\": container with ID starting with 030bd07a271c42c2d20f5de4b8c655877dfcd485a336ae09eb8e622902f226ab not found: ID does not exist" May 20 14:11:31.495035 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.494998 2551 scope.go:117] "RemoveContainer" containerID="4b129cf1a89ca12789a8a0f83b4bc896bc0a5bbb7e8d3603b1a386fbc2d3e4bf" May 20 14:11:31.495186 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.495172 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b129cf1a89ca12789a8a0f83b4bc896bc0a5bbb7e8d3603b1a386fbc2d3e4bf"} err="failed to get container status \"4b129cf1a89ca12789a8a0f83b4bc896bc0a5bbb7e8d3603b1a386fbc2d3e4bf\": rpc error: code = NotFound desc = could not find container \"4b129cf1a89ca12789a8a0f83b4bc896bc0a5bbb7e8d3603b1a386fbc2d3e4bf\": container with ID starting with 4b129cf1a89ca12789a8a0f83b4bc896bc0a5bbb7e8d3603b1a386fbc2d3e4bf not found: ID does not exist" May 20 14:11:31.495226 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.495186 2551 scope.go:117] "RemoveContainer" containerID="f869d43f1649ce2cace9ca5b3cc512392cf52603705e05df7078770e8943211f" May 20 14:11:31.495372 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.495358 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f869d43f1649ce2cace9ca5b3cc512392cf52603705e05df7078770e8943211f"} err="failed to get container status \"f869d43f1649ce2cace9ca5b3cc512392cf52603705e05df7078770e8943211f\": rpc error: code = NotFound desc = could not find container \"f869d43f1649ce2cace9ca5b3cc512392cf52603705e05df7078770e8943211f\": container with ID starting with f869d43f1649ce2cace9ca5b3cc512392cf52603705e05df7078770e8943211f not found: ID does not exist" May 20 14:11:31.495416 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.495372 2551 scope.go:117] "RemoveContainer" containerID="d89f74147b3ee3175670ae18d72270f307416e172221bf906afb9f3544dd6073" May 20 14:11:31.495560 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.495539 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d89f74147b3ee3175670ae18d72270f307416e172221bf906afb9f3544dd6073"} err="failed to get container status \"d89f74147b3ee3175670ae18d72270f307416e172221bf906afb9f3544dd6073\": rpc error: code = NotFound desc = could not find container \"d89f74147b3ee3175670ae18d72270f307416e172221bf906afb9f3544dd6073\": container with ID starting with d89f74147b3ee3175670ae18d72270f307416e172221bf906afb9f3544dd6073 not found: ID does not exist" May 20 14:11:31.495560 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.495559 2551 scope.go:117] "RemoveContainer" containerID="ec19e9f05953f0519ca69ac0c44be6b0d66f09dc33c970461239fa08d5c893b6" May 20 14:11:31.495756 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.495741 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec19e9f05953f0519ca69ac0c44be6b0d66f09dc33c970461239fa08d5c893b6"} err="failed to get container status \"ec19e9f05953f0519ca69ac0c44be6b0d66f09dc33c970461239fa08d5c893b6\": rpc error: code = NotFound desc = could not find container \"ec19e9f05953f0519ca69ac0c44be6b0d66f09dc33c970461239fa08d5c893b6\": container with ID starting with ec19e9f05953f0519ca69ac0c44be6b0d66f09dc33c970461239fa08d5c893b6 not found: ID does not exist" May 20 14:11:31.495820 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.495755 2551 scope.go:117] "RemoveContainer" containerID="85b3621729f96504b19f4ee4e985be436c032faabf7dc5c3981423bc05835afb" May 20 14:11:31.495929 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.495913 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85b3621729f96504b19f4ee4e985be436c032faabf7dc5c3981423bc05835afb"} err="failed to get container status \"85b3621729f96504b19f4ee4e985be436c032faabf7dc5c3981423bc05835afb\": rpc error: code = NotFound desc = could not find container \"85b3621729f96504b19f4ee4e985be436c032faabf7dc5c3981423bc05835afb\": container with ID starting with 85b3621729f96504b19f4ee4e985be436c032faabf7dc5c3981423bc05835afb not found: ID does not exist" May 20 14:11:31.495982 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.495929 2551 scope.go:117] "RemoveContainer" containerID="67a89578803b295eff6ae56e62b38231d8db94b2247c925468decf37c4403458" May 20 14:11:31.496099 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.496085 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67a89578803b295eff6ae56e62b38231d8db94b2247c925468decf37c4403458"} err="failed to get container status \"67a89578803b295eff6ae56e62b38231d8db94b2247c925468decf37c4403458\": rpc error: code = NotFound desc = could not find container \"67a89578803b295eff6ae56e62b38231d8db94b2247c925468decf37c4403458\": container with ID starting with 67a89578803b295eff6ae56e62b38231d8db94b2247c925468decf37c4403458 not found: ID does not exist" May 20 14:11:31.496139 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.496100 2551 scope.go:117] "RemoveContainer" containerID="030bd07a271c42c2d20f5de4b8c655877dfcd485a336ae09eb8e622902f226ab" May 20 14:11:31.496307 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.496288 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"030bd07a271c42c2d20f5de4b8c655877dfcd485a336ae09eb8e622902f226ab"} err="failed to get container status \"030bd07a271c42c2d20f5de4b8c655877dfcd485a336ae09eb8e622902f226ab\": rpc error: code = NotFound desc = could not find container \"030bd07a271c42c2d20f5de4b8c655877dfcd485a336ae09eb8e622902f226ab\": container with ID starting with 030bd07a271c42c2d20f5de4b8c655877dfcd485a336ae09eb8e622902f226ab not found: ID does not exist" May 20 14:11:31.496307 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.496306 2551 scope.go:117] "RemoveContainer" containerID="4b129cf1a89ca12789a8a0f83b4bc896bc0a5bbb7e8d3603b1a386fbc2d3e4bf" May 20 14:11:31.496474 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.496458 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b129cf1a89ca12789a8a0f83b4bc896bc0a5bbb7e8d3603b1a386fbc2d3e4bf"} err="failed to get container status \"4b129cf1a89ca12789a8a0f83b4bc896bc0a5bbb7e8d3603b1a386fbc2d3e4bf\": rpc error: code = NotFound desc = could not find container \"4b129cf1a89ca12789a8a0f83b4bc896bc0a5bbb7e8d3603b1a386fbc2d3e4bf\": container with ID starting with 4b129cf1a89ca12789a8a0f83b4bc896bc0a5bbb7e8d3603b1a386fbc2d3e4bf not found: ID does not exist" May 20 14:11:31.496474 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.496473 2551 scope.go:117] "RemoveContainer" containerID="f869d43f1649ce2cace9ca5b3cc512392cf52603705e05df7078770e8943211f" May 20 14:11:31.496634 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.496619 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f869d43f1649ce2cace9ca5b3cc512392cf52603705e05df7078770e8943211f"} err="failed to get container status \"f869d43f1649ce2cace9ca5b3cc512392cf52603705e05df7078770e8943211f\": rpc error: code = NotFound desc = could not find container \"f869d43f1649ce2cace9ca5b3cc512392cf52603705e05df7078770e8943211f\": container with ID starting with f869d43f1649ce2cace9ca5b3cc512392cf52603705e05df7078770e8943211f not found: ID does not exist" May 20 14:11:31.496634 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.496633 2551 scope.go:117] "RemoveContainer" containerID="d89f74147b3ee3175670ae18d72270f307416e172221bf906afb9f3544dd6073" May 20 14:11:31.496820 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.496805 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d89f74147b3ee3175670ae18d72270f307416e172221bf906afb9f3544dd6073"} err="failed to get container status \"d89f74147b3ee3175670ae18d72270f307416e172221bf906afb9f3544dd6073\": rpc error: code = NotFound desc = could not find container \"d89f74147b3ee3175670ae18d72270f307416e172221bf906afb9f3544dd6073\": container with ID starting with d89f74147b3ee3175670ae18d72270f307416e172221bf906afb9f3544dd6073 not found: ID does not exist" May 20 14:11:31.496871 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.496820 2551 scope.go:117] "RemoveContainer" containerID="ec19e9f05953f0519ca69ac0c44be6b0d66f09dc33c970461239fa08d5c893b6" May 20 14:11:31.497018 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.497001 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec19e9f05953f0519ca69ac0c44be6b0d66f09dc33c970461239fa08d5c893b6"} err="failed to get container status \"ec19e9f05953f0519ca69ac0c44be6b0d66f09dc33c970461239fa08d5c893b6\": rpc error: code = NotFound desc = could not find container \"ec19e9f05953f0519ca69ac0c44be6b0d66f09dc33c970461239fa08d5c893b6\": container with ID starting with ec19e9f05953f0519ca69ac0c44be6b0d66f09dc33c970461239fa08d5c893b6 not found: ID does not exist" May 20 14:11:31.497018 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.497017 2551 scope.go:117] "RemoveContainer" containerID="85b3621729f96504b19f4ee4e985be436c032faabf7dc5c3981423bc05835afb" May 20 14:11:31.497198 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.497184 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85b3621729f96504b19f4ee4e985be436c032faabf7dc5c3981423bc05835afb"} err="failed to get container status \"85b3621729f96504b19f4ee4e985be436c032faabf7dc5c3981423bc05835afb\": rpc error: code = NotFound desc = could not find container \"85b3621729f96504b19f4ee4e985be436c032faabf7dc5c3981423bc05835afb\": container with ID starting with 85b3621729f96504b19f4ee4e985be436c032faabf7dc5c3981423bc05835afb not found: ID does not exist" May 20 14:11:31.497198 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.497198 2551 scope.go:117] "RemoveContainer" containerID="67a89578803b295eff6ae56e62b38231d8db94b2247c925468decf37c4403458" May 20 14:11:31.497380 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.497364 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67a89578803b295eff6ae56e62b38231d8db94b2247c925468decf37c4403458"} err="failed to get container status \"67a89578803b295eff6ae56e62b38231d8db94b2247c925468decf37c4403458\": rpc error: code = NotFound desc = could not find container \"67a89578803b295eff6ae56e62b38231d8db94b2247c925468decf37c4403458\": container with ID starting with 67a89578803b295eff6ae56e62b38231d8db94b2247c925468decf37c4403458 not found: ID does not exist" May 20 14:11:31.497423 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.497380 2551 scope.go:117] "RemoveContainer" containerID="030bd07a271c42c2d20f5de4b8c655877dfcd485a336ae09eb8e622902f226ab" May 20 14:11:31.497562 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.497543 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"030bd07a271c42c2d20f5de4b8c655877dfcd485a336ae09eb8e622902f226ab"} err="failed to get container status \"030bd07a271c42c2d20f5de4b8c655877dfcd485a336ae09eb8e622902f226ab\": rpc error: code = NotFound desc = could not find container \"030bd07a271c42c2d20f5de4b8c655877dfcd485a336ae09eb8e622902f226ab\": container with ID starting with 030bd07a271c42c2d20f5de4b8c655877dfcd485a336ae09eb8e622902f226ab not found: ID does not exist" May 20 14:11:31.497562 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.497561 2551 scope.go:117] "RemoveContainer" containerID="4b129cf1a89ca12789a8a0f83b4bc896bc0a5bbb7e8d3603b1a386fbc2d3e4bf" May 20 14:11:31.497752 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.497734 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b129cf1a89ca12789a8a0f83b4bc896bc0a5bbb7e8d3603b1a386fbc2d3e4bf"} err="failed to get container status \"4b129cf1a89ca12789a8a0f83b4bc896bc0a5bbb7e8d3603b1a386fbc2d3e4bf\": rpc error: code = NotFound desc = could not find container \"4b129cf1a89ca12789a8a0f83b4bc896bc0a5bbb7e8d3603b1a386fbc2d3e4bf\": container with ID starting with 4b129cf1a89ca12789a8a0f83b4bc896bc0a5bbb7e8d3603b1a386fbc2d3e4bf not found: ID does not exist" May 20 14:11:31.497817 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.497753 2551 scope.go:117] "RemoveContainer" containerID="f869d43f1649ce2cace9ca5b3cc512392cf52603705e05df7078770e8943211f" May 20 14:11:31.497988 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.497972 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f869d43f1649ce2cace9ca5b3cc512392cf52603705e05df7078770e8943211f"} err="failed to get container status \"f869d43f1649ce2cace9ca5b3cc512392cf52603705e05df7078770e8943211f\": rpc error: code = NotFound desc = could not find container \"f869d43f1649ce2cace9ca5b3cc512392cf52603705e05df7078770e8943211f\": container with ID starting with f869d43f1649ce2cace9ca5b3cc512392cf52603705e05df7078770e8943211f not found: ID does not exist" May 20 14:11:31.497988 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.497988 2551 scope.go:117] "RemoveContainer" containerID="d89f74147b3ee3175670ae18d72270f307416e172221bf906afb9f3544dd6073" May 20 14:11:31.498143 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.498129 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d89f74147b3ee3175670ae18d72270f307416e172221bf906afb9f3544dd6073"} err="failed to get container status \"d89f74147b3ee3175670ae18d72270f307416e172221bf906afb9f3544dd6073\": rpc error: code = NotFound desc = could not find container \"d89f74147b3ee3175670ae18d72270f307416e172221bf906afb9f3544dd6073\": container with ID starting with d89f74147b3ee3175670ae18d72270f307416e172221bf906afb9f3544dd6073 not found: ID does not exist" May 20 14:11:31.498186 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.498142 2551 scope.go:117] "RemoveContainer" containerID="ec19e9f05953f0519ca69ac0c44be6b0d66f09dc33c970461239fa08d5c893b6" May 20 14:11:31.498300 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.498286 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec19e9f05953f0519ca69ac0c44be6b0d66f09dc33c970461239fa08d5c893b6"} err="failed to get container status \"ec19e9f05953f0519ca69ac0c44be6b0d66f09dc33c970461239fa08d5c893b6\": rpc error: code = NotFound desc = could not find container \"ec19e9f05953f0519ca69ac0c44be6b0d66f09dc33c970461239fa08d5c893b6\": container with ID starting with ec19e9f05953f0519ca69ac0c44be6b0d66f09dc33c970461239fa08d5c893b6 not found: ID does not exist" May 20 14:11:31.498348 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.498300 2551 scope.go:117] "RemoveContainer" containerID="85b3621729f96504b19f4ee4e985be436c032faabf7dc5c3981423bc05835afb" May 20 14:11:31.498465 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.498450 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85b3621729f96504b19f4ee4e985be436c032faabf7dc5c3981423bc05835afb"} err="failed to get container status \"85b3621729f96504b19f4ee4e985be436c032faabf7dc5c3981423bc05835afb\": rpc error: code = NotFound desc = could not find container \"85b3621729f96504b19f4ee4e985be436c032faabf7dc5c3981423bc05835afb\": container with ID starting with 85b3621729f96504b19f4ee4e985be436c032faabf7dc5c3981423bc05835afb not found: ID does not exist" May 20 14:11:31.498508 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.498464 2551 scope.go:117] "RemoveContainer" containerID="67a89578803b295eff6ae56e62b38231d8db94b2247c925468decf37c4403458" May 20 14:11:31.498656 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.498638 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67a89578803b295eff6ae56e62b38231d8db94b2247c925468decf37c4403458"} err="failed to get container status \"67a89578803b295eff6ae56e62b38231d8db94b2247c925468decf37c4403458\": rpc error: code = NotFound desc = could not find container \"67a89578803b295eff6ae56e62b38231d8db94b2247c925468decf37c4403458\": container with ID starting with 67a89578803b295eff6ae56e62b38231d8db94b2247c925468decf37c4403458 not found: ID does not exist" May 20 14:11:31.498723 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.498658 2551 scope.go:117] "RemoveContainer" containerID="030bd07a271c42c2d20f5de4b8c655877dfcd485a336ae09eb8e622902f226ab" May 20 14:11:31.498866 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.498851 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"030bd07a271c42c2d20f5de4b8c655877dfcd485a336ae09eb8e622902f226ab"} err="failed to get container status \"030bd07a271c42c2d20f5de4b8c655877dfcd485a336ae09eb8e622902f226ab\": rpc error: code = NotFound desc = could not find container \"030bd07a271c42c2d20f5de4b8c655877dfcd485a336ae09eb8e622902f226ab\": container with ID starting with 030bd07a271c42c2d20f5de4b8c655877dfcd485a336ae09eb8e622902f226ab not found: ID does not exist" May 20 14:11:31.498923 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.498867 2551 scope.go:117] "RemoveContainer" containerID="4b129cf1a89ca12789a8a0f83b4bc896bc0a5bbb7e8d3603b1a386fbc2d3e4bf" May 20 14:11:31.499029 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.499015 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b129cf1a89ca12789a8a0f83b4bc896bc0a5bbb7e8d3603b1a386fbc2d3e4bf"} err="failed to get container status \"4b129cf1a89ca12789a8a0f83b4bc896bc0a5bbb7e8d3603b1a386fbc2d3e4bf\": rpc error: code = NotFound desc = could not find container \"4b129cf1a89ca12789a8a0f83b4bc896bc0a5bbb7e8d3603b1a386fbc2d3e4bf\": container with ID starting with 4b129cf1a89ca12789a8a0f83b4bc896bc0a5bbb7e8d3603b1a386fbc2d3e4bf not found: ID does not exist" May 20 14:11:31.554664 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.554625 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 20 14:11:31.554933 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.554919 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="061768ac-a4b2-4763-a9e6-643906183c48" containerName="prometheus" May 20 14:11:31.554998 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.554934 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="061768ac-a4b2-4763-a9e6-643906183c48" containerName="prometheus" May 20 14:11:31.554998 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.554944 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="061768ac-a4b2-4763-a9e6-643906183c48" containerName="thanos-sidecar" May 20 14:11:31.554998 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.554949 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="061768ac-a4b2-4763-a9e6-643906183c48" containerName="thanos-sidecar" May 20 14:11:31.554998 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.554957 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="061768ac-a4b2-4763-a9e6-643906183c48" containerName="kube-rbac-proxy-web" May 20 14:11:31.554998 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.554963 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="061768ac-a4b2-4763-a9e6-643906183c48" containerName="kube-rbac-proxy-web" May 20 14:11:31.554998 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.554969 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="061768ac-a4b2-4763-a9e6-643906183c48" containerName="init-config-reloader" May 20 14:11:31.554998 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.554974 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="061768ac-a4b2-4763-a9e6-643906183c48" containerName="init-config-reloader" May 20 14:11:31.554998 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.554981 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="061768ac-a4b2-4763-a9e6-643906183c48" containerName="kube-rbac-proxy-thanos" May 20 14:11:31.554998 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.554987 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="061768ac-a4b2-4763-a9e6-643906183c48" containerName="kube-rbac-proxy-thanos" May 20 14:11:31.554998 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.554994 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="061768ac-a4b2-4763-a9e6-643906183c48" containerName="kube-rbac-proxy" May 20 14:11:31.554998 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.554999 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="061768ac-a4b2-4763-a9e6-643906183c48" containerName="kube-rbac-proxy" May 20 14:11:31.555323 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.555011 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="176900a6-e9f3-43ec-a17e-75e93646d940" containerName="console" May 20 14:11:31.555323 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.555015 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="176900a6-e9f3-43ec-a17e-75e93646d940" containerName="console" May 20 14:11:31.555323 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.555020 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="061768ac-a4b2-4763-a9e6-643906183c48" containerName="config-reloader" May 20 14:11:31.555323 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.555025 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="061768ac-a4b2-4763-a9e6-643906183c48" containerName="config-reloader" May 20 14:11:31.555323 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.555066 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="061768ac-a4b2-4763-a9e6-643906183c48" containerName="prometheus" May 20 14:11:31.555323 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.555078 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="061768ac-a4b2-4763-a9e6-643906183c48" containerName="thanos-sidecar" May 20 14:11:31.555323 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.555086 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="061768ac-a4b2-4763-a9e6-643906183c48" containerName="kube-rbac-proxy-web" May 20 14:11:31.555323 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.555091 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="061768ac-a4b2-4763-a9e6-643906183c48" containerName="kube-rbac-proxy" May 20 14:11:31.555323 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.555097 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="176900a6-e9f3-43ec-a17e-75e93646d940" containerName="console" May 20 14:11:31.555323 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.555103 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="061768ac-a4b2-4763-a9e6-643906183c48" containerName="config-reloader" May 20 14:11:31.555323 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.555108 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="061768ac-a4b2-4763-a9e6-643906183c48" containerName="kube-rbac-proxy-thanos" May 20 14:11:31.560022 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.559994 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.564073 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.564052 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 20 14:11:31.564192 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.564090 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 20 14:11:31.564476 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.564460 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 20 14:11:31.564476 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.564467 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 20 14:11:31.564657 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.564626 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 20 14:11:31.565145 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.565130 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 20 14:11:31.565291 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.565271 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8q038bhhs24ag\"" May 20 14:11:31.565929 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.565689 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-trvjc\"" May 20 14:11:31.568138 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.568110 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 20 14:11:31.568246 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.568114 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 20 14:11:31.568246 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.568235 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 20 14:11:31.568372 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.568248 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 20 14:11:31.568372 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.568284 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 20 14:11:31.570293 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.570277 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 20 14:11:31.573452 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.573434 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 20 14:11:31.579575 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.579551 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 20 14:11:31.580736 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.580714 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61a7bb40-8f5a-443c-9172-97356497a81d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.580848 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.580748 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/61a7bb40-8f5a-443c-9172-97356497a81d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.580848 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.580778 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61a7bb40-8f5a-443c-9172-97356497a81d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.580926 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.580859 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/61a7bb40-8f5a-443c-9172-97356497a81d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.580926 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.580895 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61a7bb40-8f5a-443c-9172-97356497a81d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.581008 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.580948 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/61a7bb40-8f5a-443c-9172-97356497a81d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.581008 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.580990 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61a7bb40-8f5a-443c-9172-97356497a81d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.581096 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.581059 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/61a7bb40-8f5a-443c-9172-97356497a81d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.581096 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.581088 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/61a7bb40-8f5a-443c-9172-97356497a81d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.581179 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.581114 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/61a7bb40-8f5a-443c-9172-97356497a81d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.581179 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.581135 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/61a7bb40-8f5a-443c-9172-97356497a81d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.581179 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.581151 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/61a7bb40-8f5a-443c-9172-97356497a81d-web-config\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.581179 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.581171 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/61a7bb40-8f5a-443c-9172-97356497a81d-config\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.581354 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.581203 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/61a7bb40-8f5a-443c-9172-97356497a81d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.581354 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.581242 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/61a7bb40-8f5a-443c-9172-97356497a81d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.581354 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.581267 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfpvz\" (UniqueName: \"kubernetes.io/projected/61a7bb40-8f5a-443c-9172-97356497a81d-kube-api-access-tfpvz\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.581354 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.581310 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/61a7bb40-8f5a-443c-9172-97356497a81d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.581354 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.581334 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/61a7bb40-8f5a-443c-9172-97356497a81d-config-out\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.682339 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.682251 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/61a7bb40-8f5a-443c-9172-97356497a81d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.682339 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.682286 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61a7bb40-8f5a-443c-9172-97356497a81d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.682339 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.682310 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/61a7bb40-8f5a-443c-9172-97356497a81d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.682339 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.682326 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/61a7bb40-8f5a-443c-9172-97356497a81d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.682339 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.682343 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/61a7bb40-8f5a-443c-9172-97356497a81d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.682893 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.682483 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/61a7bb40-8f5a-443c-9172-97356497a81d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.682893 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.682526 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/61a7bb40-8f5a-443c-9172-97356497a81d-web-config\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.682893 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.682561 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/61a7bb40-8f5a-443c-9172-97356497a81d-config\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.682893 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.682588 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/61a7bb40-8f5a-443c-9172-97356497a81d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.683154 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.683102 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61a7bb40-8f5a-443c-9172-97356497a81d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.685530 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.685506 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/61a7bb40-8f5a-443c-9172-97356497a81d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.685669 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.685562 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/61a7bb40-8f5a-443c-9172-97356497a81d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.685669 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.685585 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/61a7bb40-8f5a-443c-9172-97356497a81d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.685669 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.685593 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tfpvz\" (UniqueName: \"kubernetes.io/projected/61a7bb40-8f5a-443c-9172-97356497a81d-kube-api-access-tfpvz\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.685669 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.685603 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/61a7bb40-8f5a-443c-9172-97356497a81d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.685965 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.685737 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/61a7bb40-8f5a-443c-9172-97356497a81d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.685965 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.685772 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/61a7bb40-8f5a-443c-9172-97356497a81d-config-out\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.685965 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.685856 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61a7bb40-8f5a-443c-9172-97356497a81d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.685965 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.685887 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/61a7bb40-8f5a-443c-9172-97356497a81d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.685965 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.685920 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61a7bb40-8f5a-443c-9172-97356497a81d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.685965 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.685923 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/61a7bb40-8f5a-443c-9172-97356497a81d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.685965 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.685929 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/61a7bb40-8f5a-443c-9172-97356497a81d-web-config\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.686327 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.685898 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/61a7bb40-8f5a-443c-9172-97356497a81d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.686327 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.686013 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/61a7bb40-8f5a-443c-9172-97356497a81d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.686327 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.686306 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/61a7bb40-8f5a-443c-9172-97356497a81d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.686475 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.686349 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61a7bb40-8f5a-443c-9172-97356497a81d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.686475 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.686397 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/61a7bb40-8f5a-443c-9172-97356497a81d-config\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.686689 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.686629 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61a7bb40-8f5a-443c-9172-97356497a81d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.686803 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.686692 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61a7bb40-8f5a-443c-9172-97356497a81d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.686803 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.686714 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/61a7bb40-8f5a-443c-9172-97356497a81d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.687372 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.687345 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61a7bb40-8f5a-443c-9172-97356497a81d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.687969 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.687946 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/61a7bb40-8f5a-443c-9172-97356497a81d-config-out\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.688254 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.688235 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/61a7bb40-8f5a-443c-9172-97356497a81d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.688550 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.688532 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/61a7bb40-8f5a-443c-9172-97356497a81d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.688616 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.688599 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/61a7bb40-8f5a-443c-9172-97356497a81d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.694142 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.694126 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfpvz\" (UniqueName: \"kubernetes.io/projected/61a7bb40-8f5a-443c-9172-97356497a81d-kube-api-access-tfpvz\") pod \"prometheus-k8s-0\" (UID: \"61a7bb40-8f5a-443c-9172-97356497a81d\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:31.869736 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:31.869685 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 20 14:11:32.013831 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:32.013801 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 20 14:11:32.015294 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:11:32.015266 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61a7bb40_8f5a_443c_9172_97356497a81d.slice/crio-53d6b1a0c164386188087e5eca3274a4a12088eeaf91d06c546efaa741df195b WatchSource:0}: Error finding container 53d6b1a0c164386188087e5eca3274a4a12088eeaf91d06c546efaa741df195b: Status 404 returned error can't find the container with id 53d6b1a0c164386188087e5eca3274a4a12088eeaf91d06c546efaa741df195b May 20 14:11:32.438986 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:32.438946 2551 generic.go:358] "Generic (PLEG): container finished" podID="61a7bb40-8f5a-443c-9172-97356497a81d" containerID="0efb07b617bc7c1cceadfccb96e7e7287eddaf448cf968174ae8bbe4b1492581" exitCode=0 May 20 14:11:32.439405 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:32.439036 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"61a7bb40-8f5a-443c-9172-97356497a81d","Type":"ContainerDied","Data":"0efb07b617bc7c1cceadfccb96e7e7287eddaf448cf968174ae8bbe4b1492581"} May 20 14:11:32.439405 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:32.439077 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"61a7bb40-8f5a-443c-9172-97356497a81d","Type":"ContainerStarted","Data":"53d6b1a0c164386188087e5eca3274a4a12088eeaf91d06c546efaa741df195b"} May 20 14:11:32.872037 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:32.872000 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="061768ac-a4b2-4763-a9e6-643906183c48" path="/var/lib/kubelet/pods/061768ac-a4b2-4763-a9e6-643906183c48/volumes" May 20 14:11:33.445450 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:33.445410 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"61a7bb40-8f5a-443c-9172-97356497a81d","Type":"ContainerStarted","Data":"1903fa03c2ef1e0cc0d1cb50954f3515dc44b2f5e7ecf3cdd28f74aaf9f5833d"} May 20 14:11:33.445450 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:33.445449 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"61a7bb40-8f5a-443c-9172-97356497a81d","Type":"ContainerStarted","Data":"6183f9f5a089fd148e89733ad3e25e22a755510f4d0e1d363419070d93e6d24f"} May 20 14:11:33.445450 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:33.445461 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"61a7bb40-8f5a-443c-9172-97356497a81d","Type":"ContainerStarted","Data":"a78fd0659a363b47114f55dc62e74f2970c0efaf208195a8fece772ee68686bc"} May 20 14:11:33.446005 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:33.445471 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"61a7bb40-8f5a-443c-9172-97356497a81d","Type":"ContainerStarted","Data":"f9fefde13b06bcaa202e5fadc5793b05168582a0dc10ccad3cbb2fc2c2f31287"} May 20 14:11:33.446005 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:33.445479 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"61a7bb40-8f5a-443c-9172-97356497a81d","Type":"ContainerStarted","Data":"6a33cefe38049b99e1b5afe418e9974c7d7ecb8ae9cb814ba1db547a9295195c"} May 20 14:11:33.446005 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:33.445487 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"61a7bb40-8f5a-443c-9172-97356497a81d","Type":"ContainerStarted","Data":"fa62e518e98f5b1d045a356b521546c24155afe3751352c7b4352e8d0b879d40"} May 20 14:11:33.489334 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:33.489267 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.4892508380000002 podStartE2EDuration="2.489250838s" podCreationTimestamp="2026-05-20 14:11:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 14:11:33.486037595 +0000 UTC m=+153.226335513" watchObservedRunningTime="2026-05-20 14:11:33.489250838 +0000 UTC m=+153.229548762" May 20 14:11:36.870254 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:11:36.870226 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 20 14:12:31.869861 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:12:31.869818 2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 20 14:12:31.884806 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:12:31.884759 2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 20 14:12:32.622377 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:12:32.622348 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 20 14:14:00.758085 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:14:00.758054 2551 kubelet.go:1628] "Image garbage collection succeeded" May 20 14:24:04.472561 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:04.472526 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-552tv"] May 20 14:24:04.475684 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:04.475667 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-552tv" May 20 14:24:04.478321 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:04.478296 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 20 14:24:04.479296 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:04.479272 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-9mjwt\"" May 20 14:24:04.479380 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:04.479274 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 20 14:24:04.483201 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:04.483180 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-552tv"] May 20 14:24:04.586115 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:04.586076 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdc85\" (UniqueName: \"kubernetes.io/projected/53e235fd-72de-46ab-a2e2-4b01e84675e9-kube-api-access-mdc85\") pod \"cert-manager-cainjector-68b757865b-552tv\" (UID: \"53e235fd-72de-46ab-a2e2-4b01e84675e9\") " pod="cert-manager/cert-manager-cainjector-68b757865b-552tv" May 20 14:24:04.586115 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:04.586117 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/53e235fd-72de-46ab-a2e2-4b01e84675e9-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-552tv\" (UID: \"53e235fd-72de-46ab-a2e2-4b01e84675e9\") " pod="cert-manager/cert-manager-cainjector-68b757865b-552tv" May 20 14:24:04.686664 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:04.686624 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mdc85\" (UniqueName: \"kubernetes.io/projected/53e235fd-72de-46ab-a2e2-4b01e84675e9-kube-api-access-mdc85\") pod \"cert-manager-cainjector-68b757865b-552tv\" (UID: \"53e235fd-72de-46ab-a2e2-4b01e84675e9\") " pod="cert-manager/cert-manager-cainjector-68b757865b-552tv" May 20 14:24:04.686664 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:04.686671 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/53e235fd-72de-46ab-a2e2-4b01e84675e9-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-552tv\" (UID: \"53e235fd-72de-46ab-a2e2-4b01e84675e9\") " pod="cert-manager/cert-manager-cainjector-68b757865b-552tv" May 20 14:24:04.694832 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:04.694809 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/53e235fd-72de-46ab-a2e2-4b01e84675e9-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-552tv\" (UID: \"53e235fd-72de-46ab-a2e2-4b01e84675e9\") " pod="cert-manager/cert-manager-cainjector-68b757865b-552tv" May 20 14:24:04.695005 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:04.694980 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdc85\" (UniqueName: \"kubernetes.io/projected/53e235fd-72de-46ab-a2e2-4b01e84675e9-kube-api-access-mdc85\") pod \"cert-manager-cainjector-68b757865b-552tv\" (UID: \"53e235fd-72de-46ab-a2e2-4b01e84675e9\") " pod="cert-manager/cert-manager-cainjector-68b757865b-552tv" May 20 14:24:04.796028 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:04.796001 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-552tv" May 20 14:24:04.917497 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:04.917473 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-552tv"] May 20 14:24:04.919897 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:24:04.919863 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod53e235fd_72de_46ab_a2e2_4b01e84675e9.slice/crio-d7ae9bd68ac0f2d3e01a7f49eb369fe1b29247a41fe6e34041b227083ce038b2 WatchSource:0}: Error finding container d7ae9bd68ac0f2d3e01a7f49eb369fe1b29247a41fe6e34041b227083ce038b2: Status 404 returned error can't find the container with id d7ae9bd68ac0f2d3e01a7f49eb369fe1b29247a41fe6e34041b227083ce038b2 May 20 14:24:04.921951 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:04.921922 2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 20 14:24:05.416441 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:05.416403 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-552tv" event={"ID":"53e235fd-72de-46ab-a2e2-4b01e84675e9","Type":"ContainerStarted","Data":"d7ae9bd68ac0f2d3e01a7f49eb369fe1b29247a41fe6e34041b227083ce038b2"} May 20 14:24:08.427233 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:08.427199 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-552tv" event={"ID":"53e235fd-72de-46ab-a2e2-4b01e84675e9","Type":"ContainerStarted","Data":"0f46e6abc46d2ec6f44265b7a42250a2e6b6b7766ab73d3f89b4dd7142ce65f8"} May 20 14:24:08.443397 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:08.443342 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-552tv" podStartSLOduration=1.434100116 podStartE2EDuration="4.443326539s" podCreationTimestamp="2026-05-20 14:24:04 +0000 UTC" firstStartedPulling="2026-05-20 14:24:04.922160079 +0000 UTC m=+904.662457981" lastFinishedPulling="2026-05-20 14:24:07.931386507 +0000 UTC m=+907.671684404" observedRunningTime="2026-05-20 14:24:08.441804047 +0000 UTC m=+908.182101954" watchObservedRunningTime="2026-05-20 14:24:08.443326539 +0000 UTC m=+908.183624454" May 20 14:24:28.962734 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:28.962704 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c4b767bc-lhnhp"] May 20 14:24:28.965757 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:28.965740 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c4b767bc-lhnhp" May 20 14:24:28.968686 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:28.968665 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 20 14:24:28.968941 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:28.968928 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 20 14:24:28.969137 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:28.969121 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 20 14:24:28.969386 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:28.969369 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-fdvsb\"" May 20 14:24:28.969471 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:28.969371 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 20 14:24:28.983970 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:28.983933 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e749e656-d3ee-4d3e-a548-f980c68f89a6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c4b767bc-lhnhp\" (UID: \"e749e656-d3ee-4d3e-a548-f980c68f89a6\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4b767bc-lhnhp" May 20 14:24:28.984106 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:28.983982 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzqtr\" (UniqueName: \"kubernetes.io/projected/e749e656-d3ee-4d3e-a548-f980c68f89a6-kube-api-access-mzqtr\") pod \"opendatahub-operator-controller-manager-7c4b767bc-lhnhp\" (UID: \"e749e656-d3ee-4d3e-a548-f980c68f89a6\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4b767bc-lhnhp" May 20 14:24:28.984106 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:28.984034 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e749e656-d3ee-4d3e-a548-f980c68f89a6-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c4b767bc-lhnhp\" (UID: \"e749e656-d3ee-4d3e-a548-f980c68f89a6\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4b767bc-lhnhp" May 20 14:24:28.988038 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:28.988013 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c4b767bc-lhnhp"] May 20 14:24:29.084578 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:29.084542 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e749e656-d3ee-4d3e-a548-f980c68f89a6-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c4b767bc-lhnhp\" (UID: \"e749e656-d3ee-4d3e-a548-f980c68f89a6\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4b767bc-lhnhp" May 20 14:24:29.084766 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:29.084624 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e749e656-d3ee-4d3e-a548-f980c68f89a6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c4b767bc-lhnhp\" (UID: \"e749e656-d3ee-4d3e-a548-f980c68f89a6\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4b767bc-lhnhp" May 20 14:24:29.084766 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:29.084661 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mzqtr\" (UniqueName: \"kubernetes.io/projected/e749e656-d3ee-4d3e-a548-f980c68f89a6-kube-api-access-mzqtr\") pod \"opendatahub-operator-controller-manager-7c4b767bc-lhnhp\" (UID: \"e749e656-d3ee-4d3e-a548-f980c68f89a6\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4b767bc-lhnhp" May 20 14:24:29.087343 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:29.087314 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e749e656-d3ee-4d3e-a548-f980c68f89a6-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c4b767bc-lhnhp\" (UID: \"e749e656-d3ee-4d3e-a548-f980c68f89a6\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4b767bc-lhnhp" May 20 14:24:29.087463 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:29.087382 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e749e656-d3ee-4d3e-a548-f980c68f89a6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c4b767bc-lhnhp\" (UID: \"e749e656-d3ee-4d3e-a548-f980c68f89a6\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4b767bc-lhnhp" May 20 14:24:29.094163 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:29.094134 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzqtr\" (UniqueName: \"kubernetes.io/projected/e749e656-d3ee-4d3e-a548-f980c68f89a6-kube-api-access-mzqtr\") pod \"opendatahub-operator-controller-manager-7c4b767bc-lhnhp\" (UID: \"e749e656-d3ee-4d3e-a548-f980c68f89a6\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4b767bc-lhnhp" May 20 14:24:29.275937 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:29.275838 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c4b767bc-lhnhp" May 20 14:24:29.400914 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:29.400871 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c4b767bc-lhnhp"] May 20 14:24:29.403993 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:24:29.403955 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode749e656_d3ee_4d3e_a548_f980c68f89a6.slice/crio-e5bc6602db63ac282ebcc9ad06bad071581d5b9b43d7c50e4376a8aadc628e47 WatchSource:0}: Error finding container e5bc6602db63ac282ebcc9ad06bad071581d5b9b43d7c50e4376a8aadc628e47: Status 404 returned error can't find the container with id e5bc6602db63ac282ebcc9ad06bad071581d5b9b43d7c50e4376a8aadc628e47 May 20 14:24:29.483456 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:29.483422 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c4b767bc-lhnhp" event={"ID":"e749e656-d3ee-4d3e-a548-f980c68f89a6","Type":"ContainerStarted","Data":"e5bc6602db63ac282ebcc9ad06bad071581d5b9b43d7c50e4376a8aadc628e47"} May 20 14:24:32.494588 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:32.494555 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c4b767bc-lhnhp" event={"ID":"e749e656-d3ee-4d3e-a548-f980c68f89a6","Type":"ContainerStarted","Data":"8ef11015893280b77da768239394f7ec28198a45ab3e39a440f571788d08fd4b"} May 20 14:24:32.495019 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:32.494669 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7c4b767bc-lhnhp" May 20 14:24:32.519185 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:32.519140 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7c4b767bc-lhnhp" podStartSLOduration=1.9786111100000001 podStartE2EDuration="4.519126141s" podCreationTimestamp="2026-05-20 14:24:28 +0000 UTC" firstStartedPulling="2026-05-20 14:24:29.406105225 +0000 UTC m=+929.146403119" lastFinishedPulling="2026-05-20 14:24:31.946620257 +0000 UTC m=+931.686918150" observedRunningTime="2026-05-20 14:24:32.516957588 +0000 UTC m=+932.257255505" watchObservedRunningTime="2026-05-20 14:24:32.519126141 +0000 UTC m=+932.259424057" May 20 14:24:38.378576 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:38.378543 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5dd8647f4-zjzk4"] May 20 14:24:38.382021 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:38.382005 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5dd8647f4-zjzk4" May 20 14:24:38.386122 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:38.386092 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 20 14:24:38.386122 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:38.386107 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 20 14:24:38.386314 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:38.386143 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-z656p\"" May 20 14:24:38.386314 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:38.386155 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 20 14:24:38.386314 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:38.386107 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 20 14:24:38.386314 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:38.386093 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 20 14:24:38.397135 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:38.397111 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5dd8647f4-zjzk4"] May 20 14:24:38.457001 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:38.456970 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d1943d2d-dbc7-4170-98d4-34172d7dcdb4-cert\") pod \"lws-controller-manager-5dd8647f4-zjzk4\" (UID: \"d1943d2d-dbc7-4170-98d4-34172d7dcdb4\") " pod="openshift-lws-operator/lws-controller-manager-5dd8647f4-zjzk4" May 20 14:24:38.457174 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:38.457023 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d1943d2d-dbc7-4170-98d4-34172d7dcdb4-metrics-cert\") pod \"lws-controller-manager-5dd8647f4-zjzk4\" (UID: \"d1943d2d-dbc7-4170-98d4-34172d7dcdb4\") " pod="openshift-lws-operator/lws-controller-manager-5dd8647f4-zjzk4" May 20 14:24:38.457174 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:38.457093 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qplsp\" (UniqueName: \"kubernetes.io/projected/d1943d2d-dbc7-4170-98d4-34172d7dcdb4-kube-api-access-qplsp\") pod \"lws-controller-manager-5dd8647f4-zjzk4\" (UID: \"d1943d2d-dbc7-4170-98d4-34172d7dcdb4\") " pod="openshift-lws-operator/lws-controller-manager-5dd8647f4-zjzk4" May 20 14:24:38.457174 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:38.457128 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d1943d2d-dbc7-4170-98d4-34172d7dcdb4-manager-config\") pod \"lws-controller-manager-5dd8647f4-zjzk4\" (UID: \"d1943d2d-dbc7-4170-98d4-34172d7dcdb4\") " pod="openshift-lws-operator/lws-controller-manager-5dd8647f4-zjzk4" May 20 14:24:38.557492 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:38.557462 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d1943d2d-dbc7-4170-98d4-34172d7dcdb4-cert\") pod \"lws-controller-manager-5dd8647f4-zjzk4\" (UID: \"d1943d2d-dbc7-4170-98d4-34172d7dcdb4\") " pod="openshift-lws-operator/lws-controller-manager-5dd8647f4-zjzk4" May 20 14:24:38.557667 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:38.557506 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d1943d2d-dbc7-4170-98d4-34172d7dcdb4-metrics-cert\") pod \"lws-controller-manager-5dd8647f4-zjzk4\" (UID: \"d1943d2d-dbc7-4170-98d4-34172d7dcdb4\") " pod="openshift-lws-operator/lws-controller-manager-5dd8647f4-zjzk4" May 20 14:24:38.557667 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:38.557545 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qplsp\" (UniqueName: \"kubernetes.io/projected/d1943d2d-dbc7-4170-98d4-34172d7dcdb4-kube-api-access-qplsp\") pod \"lws-controller-manager-5dd8647f4-zjzk4\" (UID: \"d1943d2d-dbc7-4170-98d4-34172d7dcdb4\") " pod="openshift-lws-operator/lws-controller-manager-5dd8647f4-zjzk4" May 20 14:24:38.557667 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:38.557565 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d1943d2d-dbc7-4170-98d4-34172d7dcdb4-manager-config\") pod \"lws-controller-manager-5dd8647f4-zjzk4\" (UID: \"d1943d2d-dbc7-4170-98d4-34172d7dcdb4\") " pod="openshift-lws-operator/lws-controller-manager-5dd8647f4-zjzk4" May 20 14:24:38.558248 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:38.558218 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d1943d2d-dbc7-4170-98d4-34172d7dcdb4-manager-config\") pod \"lws-controller-manager-5dd8647f4-zjzk4\" (UID: \"d1943d2d-dbc7-4170-98d4-34172d7dcdb4\") " pod="openshift-lws-operator/lws-controller-manager-5dd8647f4-zjzk4" May 20 14:24:38.559955 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:38.559932 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d1943d2d-dbc7-4170-98d4-34172d7dcdb4-metrics-cert\") pod \"lws-controller-manager-5dd8647f4-zjzk4\" (UID: \"d1943d2d-dbc7-4170-98d4-34172d7dcdb4\") " pod="openshift-lws-operator/lws-controller-manager-5dd8647f4-zjzk4" May 20 14:24:38.560035 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:38.559996 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d1943d2d-dbc7-4170-98d4-34172d7dcdb4-cert\") pod \"lws-controller-manager-5dd8647f4-zjzk4\" (UID: \"d1943d2d-dbc7-4170-98d4-34172d7dcdb4\") " pod="openshift-lws-operator/lws-controller-manager-5dd8647f4-zjzk4" May 20 14:24:38.567066 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:38.567045 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qplsp\" (UniqueName: \"kubernetes.io/projected/d1943d2d-dbc7-4170-98d4-34172d7dcdb4-kube-api-access-qplsp\") pod \"lws-controller-manager-5dd8647f4-zjzk4\" (UID: \"d1943d2d-dbc7-4170-98d4-34172d7dcdb4\") " pod="openshift-lws-operator/lws-controller-manager-5dd8647f4-zjzk4" May 20 14:24:38.691020 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:38.690936 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5dd8647f4-zjzk4" May 20 14:24:38.815626 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:38.815594 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5dd8647f4-zjzk4"] May 20 14:24:38.818266 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:24:38.818237 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1943d2d_dbc7_4170_98d4_34172d7dcdb4.slice/crio-84f33657f53b821db81bea8714f5db2cbdef519cbb569308ddc3baca5edc7755 WatchSource:0}: Error finding container 84f33657f53b821db81bea8714f5db2cbdef519cbb569308ddc3baca5edc7755: Status 404 returned error can't find the container with id 84f33657f53b821db81bea8714f5db2cbdef519cbb569308ddc3baca5edc7755 May 20 14:24:39.513396 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:39.513353 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5dd8647f4-zjzk4" event={"ID":"d1943d2d-dbc7-4170-98d4-34172d7dcdb4","Type":"ContainerStarted","Data":"84f33657f53b821db81bea8714f5db2cbdef519cbb569308ddc3baca5edc7755"} May 20 14:24:42.523301 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:42.523266 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5dd8647f4-zjzk4" event={"ID":"d1943d2d-dbc7-4170-98d4-34172d7dcdb4","Type":"ContainerStarted","Data":"7af7616313af01ea79e7dd4ea22ee67a02a2c7e88f0bce82f7fb15f9398d1914"} May 20 14:24:42.523725 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:42.523388 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5dd8647f4-zjzk4" May 20 14:24:42.540682 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:42.540630 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5dd8647f4-zjzk4" podStartSLOduration=1.6011131939999999 podStartE2EDuration="4.540613446s" podCreationTimestamp="2026-05-20 14:24:38 +0000 UTC" firstStartedPulling="2026-05-20 14:24:38.820139766 +0000 UTC m=+938.560437662" lastFinishedPulling="2026-05-20 14:24:41.759640004 +0000 UTC m=+941.499937914" observedRunningTime="2026-05-20 14:24:42.539601277 +0000 UTC m=+942.279899193" watchObservedRunningTime="2026-05-20 14:24:42.540613446 +0000 UTC m=+942.280911360" May 20 14:24:43.500134 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:43.500104 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7c4b767bc-lhnhp" May 20 14:24:46.021647 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:46.021607 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6987ff4ccd-rgwpz"] May 20 14:24:46.025023 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:46.025006 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6987ff4ccd-rgwpz" May 20 14:24:46.028976 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:46.028955 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 20 14:24:46.029211 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:46.029192 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-fqsk6\"" May 20 14:24:46.030001 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:46.029980 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 20 14:24:46.030369 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:46.030351 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 20 14:24:46.030369 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:46.030362 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 20 14:24:46.051923 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:46.051899 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6987ff4ccd-rgwpz"] May 20 14:24:46.117905 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:46.117861 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbqck\" (UniqueName: \"kubernetes.io/projected/7ad2c58e-0d02-426d-b3d6-451ef5b910b6-kube-api-access-kbqck\") pod \"kube-auth-proxy-6987ff4ccd-rgwpz\" (UID: \"7ad2c58e-0d02-426d-b3d6-451ef5b910b6\") " pod="openshift-ingress/kube-auth-proxy-6987ff4ccd-rgwpz" May 20 14:24:46.118087 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:46.117921 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ad2c58e-0d02-426d-b3d6-451ef5b910b6-tmp\") pod \"kube-auth-proxy-6987ff4ccd-rgwpz\" (UID: \"7ad2c58e-0d02-426d-b3d6-451ef5b910b6\") " pod="openshift-ingress/kube-auth-proxy-6987ff4ccd-rgwpz" May 20 14:24:46.118087 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:46.118036 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ad2c58e-0d02-426d-b3d6-451ef5b910b6-tls-certs\") pod \"kube-auth-proxy-6987ff4ccd-rgwpz\" (UID: \"7ad2c58e-0d02-426d-b3d6-451ef5b910b6\") " pod="openshift-ingress/kube-auth-proxy-6987ff4ccd-rgwpz" May 20 14:24:46.218611 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:46.218580 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ad2c58e-0d02-426d-b3d6-451ef5b910b6-tls-certs\") pod \"kube-auth-proxy-6987ff4ccd-rgwpz\" (UID: \"7ad2c58e-0d02-426d-b3d6-451ef5b910b6\") " pod="openshift-ingress/kube-auth-proxy-6987ff4ccd-rgwpz" May 20 14:24:46.218831 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:46.218631 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kbqck\" (UniqueName: \"kubernetes.io/projected/7ad2c58e-0d02-426d-b3d6-451ef5b910b6-kube-api-access-kbqck\") pod \"kube-auth-proxy-6987ff4ccd-rgwpz\" (UID: \"7ad2c58e-0d02-426d-b3d6-451ef5b910b6\") " pod="openshift-ingress/kube-auth-proxy-6987ff4ccd-rgwpz" May 20 14:24:46.218831 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:46.218667 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ad2c58e-0d02-426d-b3d6-451ef5b910b6-tmp\") pod \"kube-auth-proxy-6987ff4ccd-rgwpz\" (UID: \"7ad2c58e-0d02-426d-b3d6-451ef5b910b6\") " pod="openshift-ingress/kube-auth-proxy-6987ff4ccd-rgwpz" May 20 14:24:46.221018 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:46.220984 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ad2c58e-0d02-426d-b3d6-451ef5b910b6-tmp\") pod \"kube-auth-proxy-6987ff4ccd-rgwpz\" (UID: \"7ad2c58e-0d02-426d-b3d6-451ef5b910b6\") " pod="openshift-ingress/kube-auth-proxy-6987ff4ccd-rgwpz" May 20 14:24:46.221214 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:46.221198 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ad2c58e-0d02-426d-b3d6-451ef5b910b6-tls-certs\") pod \"kube-auth-proxy-6987ff4ccd-rgwpz\" (UID: \"7ad2c58e-0d02-426d-b3d6-451ef5b910b6\") " pod="openshift-ingress/kube-auth-proxy-6987ff4ccd-rgwpz" May 20 14:24:46.232852 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:46.232827 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbqck\" (UniqueName: \"kubernetes.io/projected/7ad2c58e-0d02-426d-b3d6-451ef5b910b6-kube-api-access-kbqck\") pod \"kube-auth-proxy-6987ff4ccd-rgwpz\" (UID: \"7ad2c58e-0d02-426d-b3d6-451ef5b910b6\") " pod="openshift-ingress/kube-auth-proxy-6987ff4ccd-rgwpz" May 20 14:24:46.334382 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:46.334334 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6987ff4ccd-rgwpz" May 20 14:24:46.483556 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:46.483395 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6987ff4ccd-rgwpz"] May 20 14:24:46.486128 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:24:46.486104 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ad2c58e_0d02_426d_b3d6_451ef5b910b6.slice/crio-03bf0966ef820c6f387fa1e6a5de3c71ef1d6ad9408e2e3ce19150f87b46d396 WatchSource:0}: Error finding container 03bf0966ef820c6f387fa1e6a5de3c71ef1d6ad9408e2e3ce19150f87b46d396: Status 404 returned error can't find the container with id 03bf0966ef820c6f387fa1e6a5de3c71ef1d6ad9408e2e3ce19150f87b46d396 May 20 14:24:46.536438 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:46.536405 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6987ff4ccd-rgwpz" event={"ID":"7ad2c58e-0d02-426d-b3d6-451ef5b910b6","Type":"ContainerStarted","Data":"03bf0966ef820c6f387fa1e6a5de3c71ef1d6ad9408e2e3ce19150f87b46d396"} May 20 14:24:49.546362 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:49.546325 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6987ff4ccd-rgwpz" event={"ID":"7ad2c58e-0d02-426d-b3d6-451ef5b910b6","Type":"ContainerStarted","Data":"96f5b87c94706bdb4aefec6e6c9890354a3e1a167aed9abc42743e903458eb11"} May 20 14:24:49.564101 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:49.564052 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6987ff4ccd-rgwpz" podStartSLOduration=1.6584006310000001 podStartE2EDuration="4.564037397s" podCreationTimestamp="2026-05-20 14:24:45 +0000 UTC" firstStartedPulling="2026-05-20 14:24:46.487731118 +0000 UTC m=+946.228029014" lastFinishedPulling="2026-05-20 14:24:49.393367871 +0000 UTC m=+949.133665780" observedRunningTime="2026-05-20 14:24:49.562388336 +0000 UTC m=+949.302686255" watchObservedRunningTime="2026-05-20 14:24:49.564037397 +0000 UTC m=+949.304335312" May 20 14:24:53.528517 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:24:53.528478 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5dd8647f4-zjzk4" May 20 14:26:26.155304 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:26:26.155270 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-g52zc"] May 20 14:26:26.158461 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:26:26.158442 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-g52zc" May 20 14:26:26.160998 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:26:26.160977 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 20 14:26:26.161111 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:26:26.161020 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-4lc7m\"" May 20 14:26:26.161964 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:26:26.161946 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 20 14:26:26.171362 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:26:26.171341 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-g52zc"] May 20 14:26:26.208951 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:26:26.208922 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgd7h\" (UniqueName: \"kubernetes.io/projected/09b08bb1-1d81-49d8-af2e-13ee06c2b2a4-kube-api-access-sgd7h\") pod \"authorino-operator-657f44b778-g52zc\" (UID: \"09b08bb1-1d81-49d8-af2e-13ee06c2b2a4\") " pod="kuadrant-system/authorino-operator-657f44b778-g52zc" May 20 14:26:26.309696 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:26:26.309665 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sgd7h\" (UniqueName: \"kubernetes.io/projected/09b08bb1-1d81-49d8-af2e-13ee06c2b2a4-kube-api-access-sgd7h\") pod \"authorino-operator-657f44b778-g52zc\" (UID: \"09b08bb1-1d81-49d8-af2e-13ee06c2b2a4\") " pod="kuadrant-system/authorino-operator-657f44b778-g52zc" May 20 14:26:26.323668 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:26:26.323636 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgd7h\" (UniqueName: \"kubernetes.io/projected/09b08bb1-1d81-49d8-af2e-13ee06c2b2a4-kube-api-access-sgd7h\") pod \"authorino-operator-657f44b778-g52zc\" (UID: \"09b08bb1-1d81-49d8-af2e-13ee06c2b2a4\") " pod="kuadrant-system/authorino-operator-657f44b778-g52zc" May 20 14:26:26.468102 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:26:26.468027 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-g52zc" May 20 14:26:26.603220 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:26:26.603180 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-g52zc"] May 20 14:26:26.605554 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:26:26.605528 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09b08bb1_1d81_49d8_af2e_13ee06c2b2a4.slice/crio-f792b13ac1e87e765b8e33ad0eef5cf9b9d2abae3547a0b0e6742d8333709f45 WatchSource:0}: Error finding container f792b13ac1e87e765b8e33ad0eef5cf9b9d2abae3547a0b0e6742d8333709f45: Status 404 returned error can't find the container with id f792b13ac1e87e765b8e33ad0eef5cf9b9d2abae3547a0b0e6742d8333709f45 May 20 14:26:26.827639 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:26:26.827601 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-g52zc" event={"ID":"09b08bb1-1d81-49d8-af2e-13ee06c2b2a4","Type":"ContainerStarted","Data":"f792b13ac1e87e765b8e33ad0eef5cf9b9d2abae3547a0b0e6742d8333709f45"} May 20 14:26:28.835641 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:26:28.835605 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-g52zc" event={"ID":"09b08bb1-1d81-49d8-af2e-13ee06c2b2a4","Type":"ContainerStarted","Data":"f7d33b14befd7e385e3ba79477532687ab23c99d56a7fcc50174b22a35eba7e4"} May 20 14:26:28.836059 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:26:28.835733 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-g52zc" May 20 14:26:28.857608 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:26:28.857516 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-g52zc" podStartSLOduration=0.863986994 podStartE2EDuration="2.857501663s" podCreationTimestamp="2026-05-20 14:26:26 +0000 UTC" firstStartedPulling="2026-05-20 14:26:26.607476107 +0000 UTC m=+1046.347774000" lastFinishedPulling="2026-05-20 14:26:28.600990777 +0000 UTC m=+1048.341288669" observedRunningTime="2026-05-20 14:26:28.855366155 +0000 UTC m=+1048.595664070" watchObservedRunningTime="2026-05-20 14:26:28.857501663 +0000 UTC m=+1048.597799577" May 20 14:26:32.091010 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:26:32.090978 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-q8gmp"] May 20 14:26:32.094191 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:26:32.094175 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-q8gmp" May 20 14:26:32.096672 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:26:32.096646 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" May 20 14:26:32.096833 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:26:32.096800 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" May 20 14:26:32.096949 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:26:32.096840 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-hk2rk\"" May 20 14:26:32.102237 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:26:32.102213 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-q8gmp"] May 20 14:26:32.165043 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:26:32.165010 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/97e75a7c-b2cb-490f-be53-88f097d169a7-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-q8gmp\" (UID: \"97e75a7c-b2cb-490f-be53-88f097d169a7\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-q8gmp" May 20 14:26:32.165209 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:26:32.165050 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/97e75a7c-b2cb-490f-be53-88f097d169a7-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-q8gmp\" (UID: \"97e75a7c-b2cb-490f-be53-88f097d169a7\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-q8gmp" May 20 14:26:32.165209 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:26:32.165193 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqln9\" (UniqueName: \"kubernetes.io/projected/97e75a7c-b2cb-490f-be53-88f097d169a7-kube-api-access-zqln9\") pod \"kuadrant-console-plugin-6cb54b5c86-q8gmp\" (UID: \"97e75a7c-b2cb-490f-be53-88f097d169a7\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-q8gmp" May 20 14:26:32.265733 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:26:32.265701 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zqln9\" (UniqueName: \"kubernetes.io/projected/97e75a7c-b2cb-490f-be53-88f097d169a7-kube-api-access-zqln9\") pod \"kuadrant-console-plugin-6cb54b5c86-q8gmp\" (UID: \"97e75a7c-b2cb-490f-be53-88f097d169a7\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-q8gmp" May 20 14:26:32.265733 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:26:32.265737 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/97e75a7c-b2cb-490f-be53-88f097d169a7-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-q8gmp\" (UID: \"97e75a7c-b2cb-490f-be53-88f097d169a7\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-q8gmp" May 20 14:26:32.265948 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:26:32.265765 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/97e75a7c-b2cb-490f-be53-88f097d169a7-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-q8gmp\" (UID: \"97e75a7c-b2cb-490f-be53-88f097d169a7\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-q8gmp" May 20 14:26:32.265948 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:26:32.265912 2551 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found May 20 14:26:32.266011 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:26:32.265995 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97e75a7c-b2cb-490f-be53-88f097d169a7-plugin-serving-cert podName:97e75a7c-b2cb-490f-be53-88f097d169a7 nodeName:}" failed. No retries permitted until 2026-05-20 14:26:32.765966972 +0000 UTC m=+1052.506264865 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/97e75a7c-b2cb-490f-be53-88f097d169a7-plugin-serving-cert") pod "kuadrant-console-plugin-6cb54b5c86-q8gmp" (UID: "97e75a7c-b2cb-490f-be53-88f097d169a7") : secret "plugin-serving-cert" not found May 20 14:26:32.266308 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:26:32.266289 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/97e75a7c-b2cb-490f-be53-88f097d169a7-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-q8gmp\" (UID: \"97e75a7c-b2cb-490f-be53-88f097d169a7\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-q8gmp" May 20 14:26:32.275376 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:26:32.275340 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqln9\" (UniqueName: \"kubernetes.io/projected/97e75a7c-b2cb-490f-be53-88f097d169a7-kube-api-access-zqln9\") pod \"kuadrant-console-plugin-6cb54b5c86-q8gmp\" (UID: \"97e75a7c-b2cb-490f-be53-88f097d169a7\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-q8gmp" May 20 14:26:32.769541 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:26:32.769500 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/97e75a7c-b2cb-490f-be53-88f097d169a7-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-q8gmp\" (UID: \"97e75a7c-b2cb-490f-be53-88f097d169a7\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-q8gmp" May 20 14:26:32.769756 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:26:32.769673 2551 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found May 20 14:26:32.769756 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:26:32.769753 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97e75a7c-b2cb-490f-be53-88f097d169a7-plugin-serving-cert podName:97e75a7c-b2cb-490f-be53-88f097d169a7 nodeName:}" failed. No retries permitted until 2026-05-20 14:26:33.76973366 +0000 UTC m=+1053.510031566 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/97e75a7c-b2cb-490f-be53-88f097d169a7-plugin-serving-cert") pod "kuadrant-console-plugin-6cb54b5c86-q8gmp" (UID: "97e75a7c-b2cb-490f-be53-88f097d169a7") : secret "plugin-serving-cert" not found May 20 14:26:33.777559 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:26:33.777522 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/97e75a7c-b2cb-490f-be53-88f097d169a7-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-q8gmp\" (UID: \"97e75a7c-b2cb-490f-be53-88f097d169a7\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-q8gmp" May 20 14:26:33.780075 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:26:33.780050 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/97e75a7c-b2cb-490f-be53-88f097d169a7-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-q8gmp\" (UID: \"97e75a7c-b2cb-490f-be53-88f097d169a7\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-q8gmp" May 20 14:26:33.903661 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:26:33.903630 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-q8gmp" May 20 14:26:34.047147 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:26:34.047121 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-q8gmp"] May 20 14:26:34.049420 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:26:34.049396 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod97e75a7c_b2cb_490f_be53_88f097d169a7.slice/crio-024c99b8f9449630a91ca2b3fc38facbdb37f86fb76edfb36ee82f63d0922f92 WatchSource:0}: Error finding container 024c99b8f9449630a91ca2b3fc38facbdb37f86fb76edfb36ee82f63d0922f92: Status 404 returned error can't find the container with id 024c99b8f9449630a91ca2b3fc38facbdb37f86fb76edfb36ee82f63d0922f92 May 20 14:26:34.856348 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:26:34.856303 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-q8gmp" event={"ID":"97e75a7c-b2cb-490f-be53-88f097d169a7","Type":"ContainerStarted","Data":"024c99b8f9449630a91ca2b3fc38facbdb37f86fb76edfb36ee82f63d0922f92"} May 20 14:26:39.841507 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:26:39.841476 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-g52zc" May 20 14:26:57.931933 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:26:57.931892 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-q8gmp" event={"ID":"97e75a7c-b2cb-490f-be53-88f097d169a7","Type":"ContainerStarted","Data":"d73339bf4cda2a37b45c41ef91affdc3982693a462a50ee3b99db0018004a840"} May 20 14:26:57.949016 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:26:57.948967 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-q8gmp" podStartSLOduration=2.497679214 podStartE2EDuration="25.948954126s" podCreationTimestamp="2026-05-20 14:26:32 +0000 UTC" firstStartedPulling="2026-05-20 14:26:34.050680197 +0000 UTC m=+1053.790978089" lastFinishedPulling="2026-05-20 14:26:57.501955109 +0000 UTC m=+1077.242253001" observedRunningTime="2026-05-20 14:26:57.946966097 +0000 UTC m=+1077.687264011" watchObservedRunningTime="2026-05-20 14:26:57.948954126 +0000 UTC m=+1077.689252040" May 20 14:27:20.832590 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:20.832556 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-9xkbn"] May 20 14:27:20.872359 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:20.872327 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-9xkbn"] May 20 14:27:20.872514 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:20.872446 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-9xkbn" May 20 14:27:20.876681 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:20.876655 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-27sg4\"" May 20 14:27:20.978886 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:20.978856 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klcdv\" (UniqueName: \"kubernetes.io/projected/90608caa-c02b-43d4-ac6f-e4980e191c04-kube-api-access-klcdv\") pod \"authorino-7498df8756-9xkbn\" (UID: \"90608caa-c02b-43d4-ac6f-e4980e191c04\") " pod="kuadrant-system/authorino-7498df8756-9xkbn" May 20 14:27:21.080334 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:21.080290 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-klcdv\" (UniqueName: \"kubernetes.io/projected/90608caa-c02b-43d4-ac6f-e4980e191c04-kube-api-access-klcdv\") pod \"authorino-7498df8756-9xkbn\" (UID: \"90608caa-c02b-43d4-ac6f-e4980e191c04\") " pod="kuadrant-system/authorino-7498df8756-9xkbn" May 20 14:27:21.088773 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:21.088711 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klcdv\" (UniqueName: \"kubernetes.io/projected/90608caa-c02b-43d4-ac6f-e4980e191c04-kube-api-access-klcdv\") pod \"authorino-7498df8756-9xkbn\" (UID: \"90608caa-c02b-43d4-ac6f-e4980e191c04\") " pod="kuadrant-system/authorino-7498df8756-9xkbn" May 20 14:27:21.181490 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:21.181455 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-9xkbn" May 20 14:27:21.322324 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:21.322292 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-9xkbn"] May 20 14:27:21.323434 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:27:21.323399 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod90608caa_c02b_43d4_ac6f_e4980e191c04.slice/crio-c9388056dad1846d8adba8c39bd075eeeaf08163f7efb38aaceb9293eafca189 WatchSource:0}: Error finding container c9388056dad1846d8adba8c39bd075eeeaf08163f7efb38aaceb9293eafca189: Status 404 returned error can't find the container with id c9388056dad1846d8adba8c39bd075eeeaf08163f7efb38aaceb9293eafca189 May 20 14:27:22.012688 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:22.012634 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-9xkbn" event={"ID":"90608caa-c02b-43d4-ac6f-e4980e191c04","Type":"ContainerStarted","Data":"c9388056dad1846d8adba8c39bd075eeeaf08163f7efb38aaceb9293eafca189"} May 20 14:27:25.025773 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:25.025737 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-9xkbn" event={"ID":"90608caa-c02b-43d4-ac6f-e4980e191c04","Type":"ContainerStarted","Data":"7293127adb532f5da950e473990da84f1fb7d8af19c9cb10a1a12c5de3ec8a2a"} May 20 14:27:25.041949 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:25.041860 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-9xkbn" podStartSLOduration=1.484709962 podStartE2EDuration="5.041841259s" podCreationTimestamp="2026-05-20 14:27:20 +0000 UTC" firstStartedPulling="2026-05-20 14:27:21.324744243 +0000 UTC m=+1101.065042135" lastFinishedPulling="2026-05-20 14:27:24.881875536 +0000 UTC m=+1104.622173432" observedRunningTime="2026-05-20 14:27:25.041051895 +0000 UTC m=+1104.781349823" watchObservedRunningTime="2026-05-20 14:27:25.041841259 +0000 UTC m=+1104.782139174" May 20 14:27:53.464931 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:53.464894 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-78557dfb4f-tw4s2"] May 20 14:27:53.467550 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:53.467533 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78557dfb4f-tw4s2" May 20 14:27:53.477190 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:53.477163 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-78557dfb4f-tw4s2"] May 20 14:27:53.543197 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:53.543164 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88vtb\" (UniqueName: \"kubernetes.io/projected/e7856ead-adef-4e25-924b-c8484c279ec4-kube-api-access-88vtb\") pod \"authorino-78557dfb4f-tw4s2\" (UID: \"e7856ead-adef-4e25-924b-c8484c279ec4\") " pod="kuadrant-system/authorino-78557dfb4f-tw4s2" May 20 14:27:53.644341 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:53.644303 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-88vtb\" (UniqueName: \"kubernetes.io/projected/e7856ead-adef-4e25-924b-c8484c279ec4-kube-api-access-88vtb\") pod \"authorino-78557dfb4f-tw4s2\" (UID: \"e7856ead-adef-4e25-924b-c8484c279ec4\") " pod="kuadrant-system/authorino-78557dfb4f-tw4s2" May 20 14:27:53.654962 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:53.654930 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88vtb\" (UniqueName: \"kubernetes.io/projected/e7856ead-adef-4e25-924b-c8484c279ec4-kube-api-access-88vtb\") pod \"authorino-78557dfb4f-tw4s2\" (UID: \"e7856ead-adef-4e25-924b-c8484c279ec4\") " pod="kuadrant-system/authorino-78557dfb4f-tw4s2" May 20 14:27:53.684143 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:53.684106 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-78557dfb4f-tw4s2"] May 20 14:27:53.684332 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:53.684319 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78557dfb4f-tw4s2" May 20 14:27:53.805034 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:53.805007 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-78557dfb4f-tw4s2"] May 20 14:27:53.807227 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:27:53.807198 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode7856ead_adef_4e25_924b_c8484c279ec4.slice/crio-fdf401848a52736f4010c6a28dc8d163f9842534e9e7c3e084c593c3e2ac7f20 WatchSource:0}: Error finding container fdf401848a52736f4010c6a28dc8d163f9842534e9e7c3e084c593c3e2ac7f20: Status 404 returned error can't find the container with id fdf401848a52736f4010c6a28dc8d163f9842534e9e7c3e084c593c3e2ac7f20 May 20 14:27:54.118759 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:54.118727 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-78557dfb4f-tw4s2" event={"ID":"e7856ead-adef-4e25-924b-c8484c279ec4","Type":"ContainerStarted","Data":"fdf401848a52736f4010c6a28dc8d163f9842534e9e7c3e084c593c3e2ac7f20"} May 20 14:27:55.123416 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:55.123381 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-78557dfb4f-tw4s2" event={"ID":"e7856ead-adef-4e25-924b-c8484c279ec4","Type":"ContainerStarted","Data":"d16c689f982f63603518e7e4353e239d803c19cd2c17ad04695a2c459fadbc03"} May 20 14:27:55.123837 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:55.123500 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-78557dfb4f-tw4s2" podUID="e7856ead-adef-4e25-924b-c8484c279ec4" containerName="authorino" containerID="cri-o://d16c689f982f63603518e7e4353e239d803c19cd2c17ad04695a2c459fadbc03" gracePeriod=30 May 20 14:27:55.138990 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:55.138927 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-78557dfb4f-tw4s2" podStartSLOduration=1.750318512 podStartE2EDuration="2.138909201s" podCreationTimestamp="2026-05-20 14:27:53 +0000 UTC" firstStartedPulling="2026-05-20 14:27:53.808349231 +0000 UTC m=+1133.548647124" lastFinishedPulling="2026-05-20 14:27:54.196939919 +0000 UTC m=+1133.937237813" observedRunningTime="2026-05-20 14:27:55.137432597 +0000 UTC m=+1134.877730513" watchObservedRunningTime="2026-05-20 14:27:55.138909201 +0000 UTC m=+1134.879207118" May 20 14:27:55.361954 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:55.361930 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78557dfb4f-tw4s2" May 20 14:27:55.458482 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:55.458395 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88vtb\" (UniqueName: \"kubernetes.io/projected/e7856ead-adef-4e25-924b-c8484c279ec4-kube-api-access-88vtb\") pod \"e7856ead-adef-4e25-924b-c8484c279ec4\" (UID: \"e7856ead-adef-4e25-924b-c8484c279ec4\") " May 20 14:27:55.460626 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:55.460597 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7856ead-adef-4e25-924b-c8484c279ec4-kube-api-access-88vtb" (OuterVolumeSpecName: "kube-api-access-88vtb") pod "e7856ead-adef-4e25-924b-c8484c279ec4" (UID: "e7856ead-adef-4e25-924b-c8484c279ec4"). InnerVolumeSpecName "kube-api-access-88vtb". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 14:27:55.559940 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:55.559901 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88vtb\" (UniqueName: \"kubernetes.io/projected/e7856ead-adef-4e25-924b-c8484c279ec4-kube-api-access-88vtb\") on node \"ip-10-0-142-164.ec2.internal\" DevicePath \"\"" May 20 14:27:55.721386 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:55.721307 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-9xkbn"] May 20 14:27:55.721521 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:55.721499 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-9xkbn" podUID="90608caa-c02b-43d4-ac6f-e4980e191c04" containerName="authorino" containerID="cri-o://7293127adb532f5da950e473990da84f1fb7d8af19c9cb10a1a12c5de3ec8a2a" gracePeriod=30 May 20 14:27:55.949671 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:55.949642 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-9xkbn" May 20 14:27:55.962556 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:55.962533 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klcdv\" (UniqueName: \"kubernetes.io/projected/90608caa-c02b-43d4-ac6f-e4980e191c04-kube-api-access-klcdv\") pod \"90608caa-c02b-43d4-ac6f-e4980e191c04\" (UID: \"90608caa-c02b-43d4-ac6f-e4980e191c04\") " May 20 14:27:55.964490 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:55.964468 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90608caa-c02b-43d4-ac6f-e4980e191c04-kube-api-access-klcdv" (OuterVolumeSpecName: "kube-api-access-klcdv") pod "90608caa-c02b-43d4-ac6f-e4980e191c04" (UID: "90608caa-c02b-43d4-ac6f-e4980e191c04"). InnerVolumeSpecName "kube-api-access-klcdv". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 14:27:56.064069 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:56.064041 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klcdv\" (UniqueName: \"kubernetes.io/projected/90608caa-c02b-43d4-ac6f-e4980e191c04-kube-api-access-klcdv\") on node \"ip-10-0-142-164.ec2.internal\" DevicePath \"\"" May 20 14:27:56.127810 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:56.127749 2551 generic.go:358] "Generic (PLEG): container finished" podID="e7856ead-adef-4e25-924b-c8484c279ec4" containerID="d16c689f982f63603518e7e4353e239d803c19cd2c17ad04695a2c459fadbc03" exitCode=0 May 20 14:27:56.127810 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:56.127811 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78557dfb4f-tw4s2" May 20 14:27:56.128328 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:56.127829 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-78557dfb4f-tw4s2" event={"ID":"e7856ead-adef-4e25-924b-c8484c279ec4","Type":"ContainerDied","Data":"d16c689f982f63603518e7e4353e239d803c19cd2c17ad04695a2c459fadbc03"} May 20 14:27:56.128328 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:56.127866 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-78557dfb4f-tw4s2" event={"ID":"e7856ead-adef-4e25-924b-c8484c279ec4","Type":"ContainerDied","Data":"fdf401848a52736f4010c6a28dc8d163f9842534e9e7c3e084c593c3e2ac7f20"} May 20 14:27:56.128328 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:56.127883 2551 scope.go:117] "RemoveContainer" containerID="d16c689f982f63603518e7e4353e239d803c19cd2c17ad04695a2c459fadbc03" May 20 14:27:56.129134 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:56.129062 2551 generic.go:358] "Generic (PLEG): container finished" podID="90608caa-c02b-43d4-ac6f-e4980e191c04" containerID="7293127adb532f5da950e473990da84f1fb7d8af19c9cb10a1a12c5de3ec8a2a" exitCode=0 May 20 14:27:56.129134 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:56.129127 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-9xkbn" May 20 14:27:56.129268 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:56.129163 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-9xkbn" event={"ID":"90608caa-c02b-43d4-ac6f-e4980e191c04","Type":"ContainerDied","Data":"7293127adb532f5da950e473990da84f1fb7d8af19c9cb10a1a12c5de3ec8a2a"} May 20 14:27:56.129268 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:56.129222 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-9xkbn" event={"ID":"90608caa-c02b-43d4-ac6f-e4980e191c04","Type":"ContainerDied","Data":"c9388056dad1846d8adba8c39bd075eeeaf08163f7efb38aaceb9293eafca189"} May 20 14:27:56.144070 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:56.144027 2551 scope.go:117] "RemoveContainer" containerID="d16c689f982f63603518e7e4353e239d803c19cd2c17ad04695a2c459fadbc03" May 20 14:27:56.148559 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:27:56.147699 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d16c689f982f63603518e7e4353e239d803c19cd2c17ad04695a2c459fadbc03\": container with ID starting with d16c689f982f63603518e7e4353e239d803c19cd2c17ad04695a2c459fadbc03 not found: ID does not exist" containerID="d16c689f982f63603518e7e4353e239d803c19cd2c17ad04695a2c459fadbc03" May 20 14:27:56.148559 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:56.147743 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d16c689f982f63603518e7e4353e239d803c19cd2c17ad04695a2c459fadbc03"} err="failed to get container status \"d16c689f982f63603518e7e4353e239d803c19cd2c17ad04695a2c459fadbc03\": rpc error: code = NotFound desc = could not find container \"d16c689f982f63603518e7e4353e239d803c19cd2c17ad04695a2c459fadbc03\": container with ID starting with d16c689f982f63603518e7e4353e239d803c19cd2c17ad04695a2c459fadbc03 not found: ID does not exist" May 20 14:27:56.148559 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:56.147768 2551 scope.go:117] "RemoveContainer" containerID="7293127adb532f5da950e473990da84f1fb7d8af19c9cb10a1a12c5de3ec8a2a" May 20 14:27:56.155387 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:56.155359 2551 scope.go:117] "RemoveContainer" containerID="7293127adb532f5da950e473990da84f1fb7d8af19c9cb10a1a12c5de3ec8a2a" May 20 14:27:56.155689 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:27:56.155668 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7293127adb532f5da950e473990da84f1fb7d8af19c9cb10a1a12c5de3ec8a2a\": container with ID starting with 7293127adb532f5da950e473990da84f1fb7d8af19c9cb10a1a12c5de3ec8a2a not found: ID does not exist" containerID="7293127adb532f5da950e473990da84f1fb7d8af19c9cb10a1a12c5de3ec8a2a" May 20 14:27:56.155748 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:56.155697 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7293127adb532f5da950e473990da84f1fb7d8af19c9cb10a1a12c5de3ec8a2a"} err="failed to get container status \"7293127adb532f5da950e473990da84f1fb7d8af19c9cb10a1a12c5de3ec8a2a\": rpc error: code = NotFound desc = could not find container \"7293127adb532f5da950e473990da84f1fb7d8af19c9cb10a1a12c5de3ec8a2a\": container with ID starting with 7293127adb532f5da950e473990da84f1fb7d8af19c9cb10a1a12c5de3ec8a2a not found: ID does not exist" May 20 14:27:56.170036 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:56.170015 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-78557dfb4f-tw4s2"] May 20 14:27:56.173997 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:56.173977 2551 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-78557dfb4f-tw4s2"] May 20 14:27:56.189677 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:56.189656 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-9xkbn"] May 20 14:27:56.196662 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:56.196638 2551 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-9xkbn"] May 20 14:27:56.868379 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:56.868347 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90608caa-c02b-43d4-ac6f-e4980e191c04" path="/var/lib/kubelet/pods/90608caa-c02b-43d4-ac6f-e4980e191c04/volumes" May 20 14:27:56.868666 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:56.868653 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7856ead-adef-4e25-924b-c8484c279ec4" path="/var/lib/kubelet/pods/e7856ead-adef-4e25-924b-c8484c279ec4/volumes" May 20 14:27:58.741656 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:58.741622 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7f5b54b7cd-qg6z2"] May 20 14:27:58.742120 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:58.741980 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7856ead-adef-4e25-924b-c8484c279ec4" containerName="authorino" May 20 14:27:58.742120 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:58.741992 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7856ead-adef-4e25-924b-c8484c279ec4" containerName="authorino" May 20 14:27:58.742120 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:58.742001 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90608caa-c02b-43d4-ac6f-e4980e191c04" containerName="authorino" May 20 14:27:58.742120 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:58.742007 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="90608caa-c02b-43d4-ac6f-e4980e191c04" containerName="authorino" May 20 14:27:58.742120 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:58.742072 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="e7856ead-adef-4e25-924b-c8484c279ec4" containerName="authorino" May 20 14:27:58.742120 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:58.742082 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="90608caa-c02b-43d4-ac6f-e4980e191c04" containerName="authorino" May 20 14:27:58.746744 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:58.746723 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f5b54b7cd-qg6z2" May 20 14:27:58.749875 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:58.749777 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 20 14:27:58.749875 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:58.749800 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-9v4m7\"" May 20 14:27:58.753088 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:58.753065 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f5b54b7cd-qg6z2"] May 20 14:27:58.785712 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:58.785681 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2fg2\" (UniqueName: \"kubernetes.io/projected/528ec0d6-1654-45f0-8034-f3fe681f6b76-kube-api-access-q2fg2\") pod \"maas-controller-7f5b54b7cd-qg6z2\" (UID: \"528ec0d6-1654-45f0-8034-f3fe681f6b76\") " pod="opendatahub/maas-controller-7f5b54b7cd-qg6z2" May 20 14:27:58.886464 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:58.886430 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q2fg2\" (UniqueName: \"kubernetes.io/projected/528ec0d6-1654-45f0-8034-f3fe681f6b76-kube-api-access-q2fg2\") pod \"maas-controller-7f5b54b7cd-qg6z2\" (UID: \"528ec0d6-1654-45f0-8034-f3fe681f6b76\") " pod="opendatahub/maas-controller-7f5b54b7cd-qg6z2" May 20 14:27:58.890210 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:58.890188 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-78c9bdc58-ccj9t"] May 20 14:27:58.893354 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:58.893339 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78c9bdc58-ccj9t" May 20 14:27:58.894943 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:58.894925 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2fg2\" (UniqueName: \"kubernetes.io/projected/528ec0d6-1654-45f0-8034-f3fe681f6b76-kube-api-access-q2fg2\") pod \"maas-controller-7f5b54b7cd-qg6z2\" (UID: \"528ec0d6-1654-45f0-8034-f3fe681f6b76\") " pod="opendatahub/maas-controller-7f5b54b7cd-qg6z2" May 20 14:27:58.901999 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:58.901976 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-78c9bdc58-ccj9t"] May 20 14:27:58.987274 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:58.987242 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9h2h\" (UniqueName: \"kubernetes.io/projected/009f4968-0871-4be5-ad7d-d821db3c318d-kube-api-access-n9h2h\") pod \"maas-controller-78c9bdc58-ccj9t\" (UID: \"009f4968-0871-4be5-ad7d-d821db3c318d\") " pod="opendatahub/maas-controller-78c9bdc58-ccj9t" May 20 14:27:59.058415 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:59.058383 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f5b54b7cd-qg6z2" May 20 14:27:59.087962 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:59.087930 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n9h2h\" (UniqueName: \"kubernetes.io/projected/009f4968-0871-4be5-ad7d-d821db3c318d-kube-api-access-n9h2h\") pod \"maas-controller-78c9bdc58-ccj9t\" (UID: \"009f4968-0871-4be5-ad7d-d821db3c318d\") " pod="opendatahub/maas-controller-78c9bdc58-ccj9t" May 20 14:27:59.098807 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:59.098765 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9h2h\" (UniqueName: \"kubernetes.io/projected/009f4968-0871-4be5-ad7d-d821db3c318d-kube-api-access-n9h2h\") pod \"maas-controller-78c9bdc58-ccj9t\" (UID: \"009f4968-0871-4be5-ad7d-d821db3c318d\") " pod="opendatahub/maas-controller-78c9bdc58-ccj9t" May 20 14:27:59.188480 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:59.188396 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f5b54b7cd-qg6z2"] May 20 14:27:59.191134 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:27:59.191097 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod528ec0d6_1654_45f0_8034_f3fe681f6b76.slice/crio-40c0828d19b0769bd473e287ac2f871ac1ddc235e30955ac46327b37522708cd WatchSource:0}: Error finding container 40c0828d19b0769bd473e287ac2f871ac1ddc235e30955ac46327b37522708cd: Status 404 returned error can't find the container with id 40c0828d19b0769bd473e287ac2f871ac1ddc235e30955ac46327b37522708cd May 20 14:27:59.210496 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:59.210471 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78c9bdc58-ccj9t" May 20 14:27:59.337102 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:27:59.337073 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-78c9bdc58-ccj9t"] May 20 14:27:59.339555 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:27:59.339525 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod009f4968_0871_4be5_ad7d_d821db3c318d.slice/crio-9ef5283a23cd43d605d1d5508d895f2458ee0f32cb1948450704920358047109 WatchSource:0}: Error finding container 9ef5283a23cd43d605d1d5508d895f2458ee0f32cb1948450704920358047109: Status 404 returned error can't find the container with id 9ef5283a23cd43d605d1d5508d895f2458ee0f32cb1948450704920358047109 May 20 14:28:00.147037 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:00.146999 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78c9bdc58-ccj9t" event={"ID":"009f4968-0871-4be5-ad7d-d821db3c318d","Type":"ContainerStarted","Data":"9ef5283a23cd43d605d1d5508d895f2458ee0f32cb1948450704920358047109"} May 20 14:28:00.148268 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:00.148233 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f5b54b7cd-qg6z2" event={"ID":"528ec0d6-1654-45f0-8034-f3fe681f6b76","Type":"ContainerStarted","Data":"40c0828d19b0769bd473e287ac2f871ac1ddc235e30955ac46327b37522708cd"} May 20 14:28:01.604568 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:01.604543 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 20 14:28:02.159175 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:02.159129 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78c9bdc58-ccj9t" event={"ID":"009f4968-0871-4be5-ad7d-d821db3c318d","Type":"ContainerStarted","Data":"73753827e50a8aea943104cfcb6d0c4ade5f10d294e5168f8a407f9d4095d107"} May 20 14:28:02.159385 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:02.159209 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-78c9bdc58-ccj9t" May 20 14:28:02.160572 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:02.160548 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f5b54b7cd-qg6z2" event={"ID":"528ec0d6-1654-45f0-8034-f3fe681f6b76","Type":"ContainerStarted","Data":"36d494ccbeb1bd2e5cedeb08564b020be7801a652fd4a69be635a39471a32c0e"} May 20 14:28:02.160691 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:02.160657 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7f5b54b7cd-qg6z2" May 20 14:28:02.177604 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:02.177557 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-78c9bdc58-ccj9t" podStartSLOduration=1.915791136 podStartE2EDuration="4.177544578s" podCreationTimestamp="2026-05-20 14:27:58 +0000 UTC" firstStartedPulling="2026-05-20 14:27:59.340889085 +0000 UTC m=+1139.081186982" lastFinishedPulling="2026-05-20 14:28:01.602642531 +0000 UTC m=+1141.342940424" observedRunningTime="2026-05-20 14:28:02.175425931 +0000 UTC m=+1141.915723846" watchObservedRunningTime="2026-05-20 14:28:02.177544578 +0000 UTC m=+1141.917842499" May 20 14:28:02.192092 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:02.192051 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-7f5b54b7cd-qg6z2" podStartSLOduration=1.7824501179999999 podStartE2EDuration="4.192038021s" podCreationTimestamp="2026-05-20 14:27:58 +0000 UTC" firstStartedPulling="2026-05-20 14:27:59.192482465 +0000 UTC m=+1138.932780359" lastFinishedPulling="2026-05-20 14:28:01.602070369 +0000 UTC m=+1141.342368262" observedRunningTime="2026-05-20 14:28:02.19065836 +0000 UTC m=+1141.930956274" watchObservedRunningTime="2026-05-20 14:28:02.192038021 +0000 UTC m=+1141.932335936" May 20 14:28:13.168911 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:13.168871 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7f5b54b7cd-qg6z2" May 20 14:28:13.169275 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:13.168944 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-78c9bdc58-ccj9t" May 20 14:28:13.224297 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:13.224271 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f5b54b7cd-qg6z2"] May 20 14:28:13.224470 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:13.224442 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-7f5b54b7cd-qg6z2" podUID="528ec0d6-1654-45f0-8034-f3fe681f6b76" containerName="manager" containerID="cri-o://36d494ccbeb1bd2e5cedeb08564b020be7801a652fd4a69be635a39471a32c0e" gracePeriod=30 May 20 14:28:13.409625 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:13.409595 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-85d798d6c4-q7ksm"] May 20 14:28:13.412725 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:13.412708 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85d798d6c4-q7ksm" May 20 14:28:13.421011 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:13.420806 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85d798d6c4-q7ksm"] May 20 14:28:13.468114 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:13.468092 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f5b54b7cd-qg6z2" May 20 14:28:13.510314 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:13.510282 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2fg2\" (UniqueName: \"kubernetes.io/projected/528ec0d6-1654-45f0-8034-f3fe681f6b76-kube-api-access-q2fg2\") pod \"528ec0d6-1654-45f0-8034-f3fe681f6b76\" (UID: \"528ec0d6-1654-45f0-8034-f3fe681f6b76\") " May 20 14:28:13.510558 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:13.510538 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qt5j\" (UniqueName: \"kubernetes.io/projected/26cb496f-ab29-4e93-88cd-9ac90c72f05f-kube-api-access-5qt5j\") pod \"maas-controller-85d798d6c4-q7ksm\" (UID: \"26cb496f-ab29-4e93-88cd-9ac90c72f05f\") " pod="opendatahub/maas-controller-85d798d6c4-q7ksm" May 20 14:28:13.512462 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:13.512436 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/528ec0d6-1654-45f0-8034-f3fe681f6b76-kube-api-access-q2fg2" (OuterVolumeSpecName: "kube-api-access-q2fg2") pod "528ec0d6-1654-45f0-8034-f3fe681f6b76" (UID: "528ec0d6-1654-45f0-8034-f3fe681f6b76"). InnerVolumeSpecName "kube-api-access-q2fg2". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 14:28:13.610981 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:13.610946 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5qt5j\" (UniqueName: \"kubernetes.io/projected/26cb496f-ab29-4e93-88cd-9ac90c72f05f-kube-api-access-5qt5j\") pod \"maas-controller-85d798d6c4-q7ksm\" (UID: \"26cb496f-ab29-4e93-88cd-9ac90c72f05f\") " pod="opendatahub/maas-controller-85d798d6c4-q7ksm" May 20 14:28:13.611144 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:13.611045 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2fg2\" (UniqueName: \"kubernetes.io/projected/528ec0d6-1654-45f0-8034-f3fe681f6b76-kube-api-access-q2fg2\") on node \"ip-10-0-142-164.ec2.internal\" DevicePath \"\"" May 20 14:28:13.619528 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:13.619493 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qt5j\" (UniqueName: \"kubernetes.io/projected/26cb496f-ab29-4e93-88cd-9ac90c72f05f-kube-api-access-5qt5j\") pod \"maas-controller-85d798d6c4-q7ksm\" (UID: \"26cb496f-ab29-4e93-88cd-9ac90c72f05f\") " pod="opendatahub/maas-controller-85d798d6c4-q7ksm" May 20 14:28:13.725326 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:13.725251 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85d798d6c4-q7ksm" May 20 14:28:13.848086 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:13.848033 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85d798d6c4-q7ksm"] May 20 14:28:13.850619 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:28:13.850591 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26cb496f_ab29_4e93_88cd_9ac90c72f05f.slice/crio-e4708861ee78ff88e7a31f99939995e5a89d1adb083f44c4463dbc9f47fc0233 WatchSource:0}: Error finding container e4708861ee78ff88e7a31f99939995e5a89d1adb083f44c4463dbc9f47fc0233: Status 404 returned error can't find the container with id e4708861ee78ff88e7a31f99939995e5a89d1adb083f44c4463dbc9f47fc0233 May 20 14:28:14.197998 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:14.197971 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85d798d6c4-q7ksm" event={"ID":"26cb496f-ab29-4e93-88cd-9ac90c72f05f","Type":"ContainerStarted","Data":"e4708861ee78ff88e7a31f99939995e5a89d1adb083f44c4463dbc9f47fc0233"} May 20 14:28:14.199020 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:14.198997 2551 generic.go:358] "Generic (PLEG): container finished" podID="528ec0d6-1654-45f0-8034-f3fe681f6b76" containerID="36d494ccbeb1bd2e5cedeb08564b020be7801a652fd4a69be635a39471a32c0e" exitCode=0 May 20 14:28:14.199112 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:14.199040 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f5b54b7cd-qg6z2" event={"ID":"528ec0d6-1654-45f0-8034-f3fe681f6b76","Type":"ContainerDied","Data":"36d494ccbeb1bd2e5cedeb08564b020be7801a652fd4a69be635a39471a32c0e"} May 20 14:28:14.199112 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:14.199055 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f5b54b7cd-qg6z2" May 20 14:28:14.199112 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:14.199064 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f5b54b7cd-qg6z2" event={"ID":"528ec0d6-1654-45f0-8034-f3fe681f6b76","Type":"ContainerDied","Data":"40c0828d19b0769bd473e287ac2f871ac1ddc235e30955ac46327b37522708cd"} May 20 14:28:14.199112 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:14.199085 2551 scope.go:117] "RemoveContainer" containerID="36d494ccbeb1bd2e5cedeb08564b020be7801a652fd4a69be635a39471a32c0e" May 20 14:28:14.207001 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:14.206956 2551 scope.go:117] "RemoveContainer" containerID="36d494ccbeb1bd2e5cedeb08564b020be7801a652fd4a69be635a39471a32c0e" May 20 14:28:14.207306 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:28:14.207276 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36d494ccbeb1bd2e5cedeb08564b020be7801a652fd4a69be635a39471a32c0e\": container with ID starting with 36d494ccbeb1bd2e5cedeb08564b020be7801a652fd4a69be635a39471a32c0e not found: ID does not exist" containerID="36d494ccbeb1bd2e5cedeb08564b020be7801a652fd4a69be635a39471a32c0e" May 20 14:28:14.207402 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:14.207317 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36d494ccbeb1bd2e5cedeb08564b020be7801a652fd4a69be635a39471a32c0e"} err="failed to get container status \"36d494ccbeb1bd2e5cedeb08564b020be7801a652fd4a69be635a39471a32c0e\": rpc error: code = NotFound desc = could not find container \"36d494ccbeb1bd2e5cedeb08564b020be7801a652fd4a69be635a39471a32c0e\": container with ID starting with 36d494ccbeb1bd2e5cedeb08564b020be7801a652fd4a69be635a39471a32c0e not found: ID does not exist" May 20 14:28:14.222485 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:14.222462 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f5b54b7cd-qg6z2"] May 20 14:28:14.231808 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:14.230031 2551 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7f5b54b7cd-qg6z2"] May 20 14:28:14.868213 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:14.868177 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="528ec0d6-1654-45f0-8034-f3fe681f6b76" path="/var/lib/kubelet/pods/528ec0d6-1654-45f0-8034-f3fe681f6b76/volumes" May 20 14:28:15.203629 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:15.203542 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85d798d6c4-q7ksm" event={"ID":"26cb496f-ab29-4e93-88cd-9ac90c72f05f","Type":"ContainerStarted","Data":"9ae8ff4dcd1423847ef3fa1a71b8949ed31b334f9787b4f8b34e89ddff5244c3"} May 20 14:28:15.204082 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:15.203714 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-85d798d6c4-q7ksm" May 20 14:28:15.220887 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:15.220842 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-85d798d6c4-q7ksm" podStartSLOduration=1.917873234 podStartE2EDuration="2.22082643s" podCreationTimestamp="2026-05-20 14:28:13 +0000 UTC" firstStartedPulling="2026-05-20 14:28:13.851720521 +0000 UTC m=+1153.592018427" lastFinishedPulling="2026-05-20 14:28:14.154673726 +0000 UTC m=+1153.894971623" observedRunningTime="2026-05-20 14:28:15.219202946 +0000 UTC m=+1154.959500861" watchObservedRunningTime="2026-05-20 14:28:15.22082643 +0000 UTC m=+1154.961124346" May 20 14:28:26.213422 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:26.213344 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-85d798d6c4-q7ksm" May 20 14:28:26.269177 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:26.269148 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-78c9bdc58-ccj9t"] May 20 14:28:26.269396 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:26.269370 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-78c9bdc58-ccj9t" podUID="009f4968-0871-4be5-ad7d-d821db3c318d" containerName="manager" containerID="cri-o://73753827e50a8aea943104cfcb6d0c4ade5f10d294e5168f8a407f9d4095d107" gracePeriod=30 May 20 14:28:26.508471 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:26.508445 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78c9bdc58-ccj9t" May 20 14:28:26.621642 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:26.621611 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n9h2h\" (UniqueName: \"kubernetes.io/projected/009f4968-0871-4be5-ad7d-d821db3c318d-kube-api-access-n9h2h\") pod \"009f4968-0871-4be5-ad7d-d821db3c318d\" (UID: \"009f4968-0871-4be5-ad7d-d821db3c318d\") " May 20 14:28:26.623654 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:26.623628 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/009f4968-0871-4be5-ad7d-d821db3c318d-kube-api-access-n9h2h" (OuterVolumeSpecName: "kube-api-access-n9h2h") pod "009f4968-0871-4be5-ad7d-d821db3c318d" (UID: "009f4968-0871-4be5-ad7d-d821db3c318d"). InnerVolumeSpecName "kube-api-access-n9h2h". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 14:28:26.722230 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:26.722196 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n9h2h\" (UniqueName: \"kubernetes.io/projected/009f4968-0871-4be5-ad7d-d821db3c318d-kube-api-access-n9h2h\") on node \"ip-10-0-142-164.ec2.internal\" DevicePath \"\"" May 20 14:28:27.243126 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:27.243034 2551 generic.go:358] "Generic (PLEG): container finished" podID="009f4968-0871-4be5-ad7d-d821db3c318d" containerID="73753827e50a8aea943104cfcb6d0c4ade5f10d294e5168f8a407f9d4095d107" exitCode=0 May 20 14:28:27.243126 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:27.243095 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78c9bdc58-ccj9t" event={"ID":"009f4968-0871-4be5-ad7d-d821db3c318d","Type":"ContainerDied","Data":"73753827e50a8aea943104cfcb6d0c4ade5f10d294e5168f8a407f9d4095d107"} May 20 14:28:27.243126 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:27.243104 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78c9bdc58-ccj9t" May 20 14:28:27.243640 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:27.243131 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78c9bdc58-ccj9t" event={"ID":"009f4968-0871-4be5-ad7d-d821db3c318d","Type":"ContainerDied","Data":"9ef5283a23cd43d605d1d5508d895f2458ee0f32cb1948450704920358047109"} May 20 14:28:27.243640 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:27.243148 2551 scope.go:117] "RemoveContainer" containerID="73753827e50a8aea943104cfcb6d0c4ade5f10d294e5168f8a407f9d4095d107" May 20 14:28:27.250747 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:27.250727 2551 scope.go:117] "RemoveContainer" containerID="73753827e50a8aea943104cfcb6d0c4ade5f10d294e5168f8a407f9d4095d107" May 20 14:28:27.251034 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:28:27.251013 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73753827e50a8aea943104cfcb6d0c4ade5f10d294e5168f8a407f9d4095d107\": container with ID starting with 73753827e50a8aea943104cfcb6d0c4ade5f10d294e5168f8a407f9d4095d107 not found: ID does not exist" containerID="73753827e50a8aea943104cfcb6d0c4ade5f10d294e5168f8a407f9d4095d107" May 20 14:28:27.251109 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:27.251045 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73753827e50a8aea943104cfcb6d0c4ade5f10d294e5168f8a407f9d4095d107"} err="failed to get container status \"73753827e50a8aea943104cfcb6d0c4ade5f10d294e5168f8a407f9d4095d107\": rpc error: code = NotFound desc = could not find container \"73753827e50a8aea943104cfcb6d0c4ade5f10d294e5168f8a407f9d4095d107\": container with ID starting with 73753827e50a8aea943104cfcb6d0c4ade5f10d294e5168f8a407f9d4095d107 not found: ID does not exist" May 20 14:28:27.258274 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:27.258253 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-78c9bdc58-ccj9t"] May 20 14:28:27.262694 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:27.262672 2551 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-78c9bdc58-ccj9t"] May 20 14:28:28.867829 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:28.867774 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="009f4968-0871-4be5-ad7d-d821db3c318d" path="/var/lib/kubelet/pods/009f4968-0871-4be5-ad7d-d821db3c318d/volumes" May 20 14:28:42.803886 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:42.803849 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-jgnp5"] May 20 14:28:42.804336 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:42.804153 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="009f4968-0871-4be5-ad7d-d821db3c318d" containerName="manager" May 20 14:28:42.804336 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:42.804164 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="009f4968-0871-4be5-ad7d-d821db3c318d" containerName="manager" May 20 14:28:42.804336 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:42.804176 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="528ec0d6-1654-45f0-8034-f3fe681f6b76" containerName="manager" May 20 14:28:42.804336 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:42.804181 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="528ec0d6-1654-45f0-8034-f3fe681f6b76" containerName="manager" May 20 14:28:42.804336 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:42.804243 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="009f4968-0871-4be5-ad7d-d821db3c318d" containerName="manager" May 20 14:28:42.804336 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:42.804254 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="528ec0d6-1654-45f0-8034-f3fe681f6b76" containerName="manager" May 20 14:28:42.809293 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:42.809271 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-jgnp5" May 20 14:28:42.811850 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:42.811825 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" May 20 14:28:42.811952 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:42.811866 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-6hngn\"" May 20 14:28:42.820313 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:42.820291 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-jgnp5"] May 20 14:28:42.860201 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:42.860173 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8nvz\" (UniqueName: \"kubernetes.io/projected/824d095f-b3e8-4ca4-b962-29f82daca8c9-kube-api-access-q8nvz\") pod \"payload-processing-58b6c8fdc7-jgnp5\" (UID: \"824d095f-b3e8-4ca4-b962-29f82daca8c9\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-jgnp5" May 20 14:28:42.960748 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:42.960695 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q8nvz\" (UniqueName: \"kubernetes.io/projected/824d095f-b3e8-4ca4-b962-29f82daca8c9-kube-api-access-q8nvz\") pod \"payload-processing-58b6c8fdc7-jgnp5\" (UID: \"824d095f-b3e8-4ca4-b962-29f82daca8c9\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-jgnp5" May 20 14:28:42.972321 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:42.972291 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8nvz\" (UniqueName: \"kubernetes.io/projected/824d095f-b3e8-4ca4-b962-29f82daca8c9-kube-api-access-q8nvz\") pod \"payload-processing-58b6c8fdc7-jgnp5\" (UID: \"824d095f-b3e8-4ca4-b962-29f82daca8c9\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-jgnp5" May 20 14:28:43.119752 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:43.119669 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-jgnp5" May 20 14:28:43.259897 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:43.259868 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-jgnp5"] May 20 14:28:43.263250 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:28:43.263218 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod824d095f_b3e8_4ca4_b962_29f82daca8c9.slice/crio-cf7c49dce237080324ba75b12dd5f2ca340cd7107ea7392e6a9412aa3fed208e WatchSource:0}: Error finding container cf7c49dce237080324ba75b12dd5f2ca340cd7107ea7392e6a9412aa3fed208e: Status 404 returned error can't find the container with id cf7c49dce237080324ba75b12dd5f2ca340cd7107ea7392e6a9412aa3fed208e May 20 14:28:43.297404 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:43.297367 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-jgnp5" event={"ID":"824d095f-b3e8-4ca4-b962-29f82daca8c9","Type":"ContainerStarted","Data":"cf7c49dce237080324ba75b12dd5f2ca340cd7107ea7392e6a9412aa3fed208e"} May 20 14:28:46.309217 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:46.309182 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-jgnp5" event={"ID":"824d095f-b3e8-4ca4-b962-29f82daca8c9","Type":"ContainerStarted","Data":"a9e49bc5550a3b9083a0099f2647634d26a8d834dd0fef2288e6822a25bc1420"} May 20 14:28:46.309592 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:46.309232 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-jgnp5" May 20 14:28:46.327500 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:46.327451 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-jgnp5" podStartSLOduration=2.068731855 podStartE2EDuration="4.327436835s" podCreationTimestamp="2026-05-20 14:28:42 +0000 UTC" firstStartedPulling="2026-05-20 14:28:43.264975211 +0000 UTC m=+1183.005273118" lastFinishedPulling="2026-05-20 14:28:45.523680205 +0000 UTC m=+1185.263978098" observedRunningTime="2026-05-20 14:28:46.326212484 +0000 UTC m=+1186.066510398" watchObservedRunningTime="2026-05-20 14:28:46.327436835 +0000 UTC m=+1186.067734749" May 20 14:28:57.314928 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:28:57.314896 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-jgnp5" May 20 14:29:07.207907 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:07.207870 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-g9qc5"] May 20 14:29:07.213038 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:07.213016 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-g9qc5" May 20 14:29:07.216585 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:07.216561 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" May 20 14:29:07.216585 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:07.216578 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 20 14:29:07.216765 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:07.216612 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 20 14:29:07.216765 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:07.216581 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-7vbbz\"" May 20 14:29:07.221043 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:07.221021 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-g9qc5"] May 20 14:29:07.245672 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:07.245643 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b093d8d-2360-40fd-9f99-597c90aa1678-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-g9qc5\" (UID: \"0b093d8d-2360-40fd-9f99-597c90aa1678\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-g9qc5" May 20 14:29:07.245821 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:07.245679 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0b093d8d-2360-40fd-9f99-597c90aa1678-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-g9qc5\" (UID: \"0b093d8d-2360-40fd-9f99-597c90aa1678\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-g9qc5" May 20 14:29:07.245821 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:07.245698 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjdgf\" (UniqueName: \"kubernetes.io/projected/0b093d8d-2360-40fd-9f99-597c90aa1678-kube-api-access-mjdgf\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-g9qc5\" (UID: \"0b093d8d-2360-40fd-9f99-597c90aa1678\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-g9qc5" May 20 14:29:07.245821 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:07.245773 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b093d8d-2360-40fd-9f99-597c90aa1678-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-g9qc5\" (UID: \"0b093d8d-2360-40fd-9f99-597c90aa1678\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-g9qc5" May 20 14:29:07.245963 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:07.245837 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b093d8d-2360-40fd-9f99-597c90aa1678-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-g9qc5\" (UID: \"0b093d8d-2360-40fd-9f99-597c90aa1678\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-g9qc5" May 20 14:29:07.245963 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:07.245871 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b093d8d-2360-40fd-9f99-597c90aa1678-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-g9qc5\" (UID: \"0b093d8d-2360-40fd-9f99-597c90aa1678\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-g9qc5" May 20 14:29:07.346987 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:07.346948 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0b093d8d-2360-40fd-9f99-597c90aa1678-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-g9qc5\" (UID: \"0b093d8d-2360-40fd-9f99-597c90aa1678\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-g9qc5" May 20 14:29:07.346987 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:07.346986 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mjdgf\" (UniqueName: \"kubernetes.io/projected/0b093d8d-2360-40fd-9f99-597c90aa1678-kube-api-access-mjdgf\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-g9qc5\" (UID: \"0b093d8d-2360-40fd-9f99-597c90aa1678\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-g9qc5" May 20 14:29:07.347201 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:07.347017 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b093d8d-2360-40fd-9f99-597c90aa1678-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-g9qc5\" (UID: \"0b093d8d-2360-40fd-9f99-597c90aa1678\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-g9qc5" May 20 14:29:07.347201 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:07.347051 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b093d8d-2360-40fd-9f99-597c90aa1678-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-g9qc5\" (UID: \"0b093d8d-2360-40fd-9f99-597c90aa1678\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-g9qc5" May 20 14:29:07.347201 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:07.347091 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b093d8d-2360-40fd-9f99-597c90aa1678-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-g9qc5\" (UID: \"0b093d8d-2360-40fd-9f99-597c90aa1678\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-g9qc5" May 20 14:29:07.347201 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:07.347154 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b093d8d-2360-40fd-9f99-597c90aa1678-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-g9qc5\" (UID: \"0b093d8d-2360-40fd-9f99-597c90aa1678\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-g9qc5" May 20 14:29:07.347429 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:07.347402 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0b093d8d-2360-40fd-9f99-597c90aa1678-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-g9qc5\" (UID: \"0b093d8d-2360-40fd-9f99-597c90aa1678\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-g9qc5" May 20 14:29:07.347494 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:07.347411 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b093d8d-2360-40fd-9f99-597c90aa1678-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-g9qc5\" (UID: \"0b093d8d-2360-40fd-9f99-597c90aa1678\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-g9qc5" May 20 14:29:07.347494 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:07.347458 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b093d8d-2360-40fd-9f99-597c90aa1678-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-g9qc5\" (UID: \"0b093d8d-2360-40fd-9f99-597c90aa1678\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-g9qc5" May 20 14:29:07.349299 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:07.349278 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b093d8d-2360-40fd-9f99-597c90aa1678-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-g9qc5\" (UID: \"0b093d8d-2360-40fd-9f99-597c90aa1678\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-g9qc5" May 20 14:29:07.349602 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:07.349585 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b093d8d-2360-40fd-9f99-597c90aa1678-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-g9qc5\" (UID: \"0b093d8d-2360-40fd-9f99-597c90aa1678\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-g9qc5" May 20 14:29:07.356336 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:07.356311 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjdgf\" (UniqueName: \"kubernetes.io/projected/0b093d8d-2360-40fd-9f99-597c90aa1678-kube-api-access-mjdgf\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-g9qc5\" (UID: \"0b093d8d-2360-40fd-9f99-597c90aa1678\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-g9qc5" May 20 14:29:07.525286 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:07.525200 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-g9qc5" May 20 14:29:07.655626 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:07.655603 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-g9qc5"] May 20 14:29:07.657585 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:29:07.657544 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b093d8d_2360_40fd_9f99_597c90aa1678.slice/crio-3550a8546bf4a7dae7eb0fb76909a981971fea782085ee61133442a99c0a6598 WatchSource:0}: Error finding container 3550a8546bf4a7dae7eb0fb76909a981971fea782085ee61133442a99c0a6598: Status 404 returned error can't find the container with id 3550a8546bf4a7dae7eb0fb76909a981971fea782085ee61133442a99c0a6598 May 20 14:29:07.659464 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:07.659449 2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 20 14:29:08.381170 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:08.381131 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-g9qc5" event={"ID":"0b093d8d-2360-40fd-9f99-597c90aa1678","Type":"ContainerStarted","Data":"3550a8546bf4a7dae7eb0fb76909a981971fea782085ee61133442a99c0a6598"} May 20 14:29:13.401545 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:13.401509 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-g9qc5" event={"ID":"0b093d8d-2360-40fd-9f99-597c90aa1678","Type":"ContainerStarted","Data":"4374772dca912dc77f13768e22065a717ef2d0ab35bba5c2b38695fea08b88e5"} May 20 14:29:18.420330 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:18.420296 2551 generic.go:358] "Generic (PLEG): container finished" podID="0b093d8d-2360-40fd-9f99-597c90aa1678" containerID="4374772dca912dc77f13768e22065a717ef2d0ab35bba5c2b38695fea08b88e5" exitCode=0 May 20 14:29:18.420752 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:18.420383 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-g9qc5" event={"ID":"0b093d8d-2360-40fd-9f99-597c90aa1678","Type":"ContainerDied","Data":"4374772dca912dc77f13768e22065a717ef2d0ab35bba5c2b38695fea08b88e5"} May 20 14:29:20.428649 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:20.428604 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-g9qc5" event={"ID":"0b093d8d-2360-40fd-9f99-597c90aa1678","Type":"ContainerStarted","Data":"2df1d7e85aed3654520c990a0cb43208fa60640ebf50355936674782d87dabcb"} May 20 14:29:20.429083 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:20.428842 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-g9qc5" May 20 14:29:20.452073 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:20.452020 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-g9qc5" podStartSLOduration=1.375386112 podStartE2EDuration="13.452006387s" podCreationTimestamp="2026-05-20 14:29:07 +0000 UTC" firstStartedPulling="2026-05-20 14:29:07.659594132 +0000 UTC m=+1207.399892026" lastFinishedPulling="2026-05-20 14:29:19.736214403 +0000 UTC m=+1219.476512301" observedRunningTime="2026-05-20 14:29:20.450547201 +0000 UTC m=+1220.190845117" watchObservedRunningTime="2026-05-20 14:29:20.452006387 +0000 UTC m=+1220.192304302" May 20 14:29:31.445483 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:31.445448 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-g9qc5" May 20 14:29:34.790730 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:34.790693 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-dn4t6"] May 20 14:29:34.796122 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:34.796098 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dn4t6" May 20 14:29:34.799474 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:34.799457 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" May 20 14:29:34.806372 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:34.806350 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-dn4t6"] May 20 14:29:34.883409 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:34.883375 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7bjw\" (UniqueName: \"kubernetes.io/projected/d4b27ab4-568b-4590-a358-5d0c82577686-kube-api-access-g7bjw\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-dn4t6\" (UID: \"d4b27ab4-568b-4590-a358-5d0c82577686\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dn4t6" May 20 14:29:34.883596 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:34.883419 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d4b27ab4-568b-4590-a358-5d0c82577686-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-dn4t6\" (UID: \"d4b27ab4-568b-4590-a358-5d0c82577686\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dn4t6" May 20 14:29:34.883596 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:34.883493 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d4b27ab4-568b-4590-a358-5d0c82577686-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-dn4t6\" (UID: \"d4b27ab4-568b-4590-a358-5d0c82577686\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dn4t6" May 20 14:29:34.883596 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:34.883554 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d4b27ab4-568b-4590-a358-5d0c82577686-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-dn4t6\" (UID: \"d4b27ab4-568b-4590-a358-5d0c82577686\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dn4t6" May 20 14:29:34.883729 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:34.883606 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4b27ab4-568b-4590-a358-5d0c82577686-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-dn4t6\" (UID: \"d4b27ab4-568b-4590-a358-5d0c82577686\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dn4t6" May 20 14:29:34.883729 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:34.883664 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d4b27ab4-568b-4590-a358-5d0c82577686-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-dn4t6\" (UID: \"d4b27ab4-568b-4590-a358-5d0c82577686\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dn4t6" May 20 14:29:34.984441 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:34.984407 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g7bjw\" (UniqueName: \"kubernetes.io/projected/d4b27ab4-568b-4590-a358-5d0c82577686-kube-api-access-g7bjw\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-dn4t6\" (UID: \"d4b27ab4-568b-4590-a358-5d0c82577686\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dn4t6" May 20 14:29:34.984635 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:34.984454 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d4b27ab4-568b-4590-a358-5d0c82577686-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-dn4t6\" (UID: \"d4b27ab4-568b-4590-a358-5d0c82577686\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dn4t6" May 20 14:29:34.984635 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:34.984488 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d4b27ab4-568b-4590-a358-5d0c82577686-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-dn4t6\" (UID: \"d4b27ab4-568b-4590-a358-5d0c82577686\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dn4t6" May 20 14:29:34.984635 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:34.984508 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d4b27ab4-568b-4590-a358-5d0c82577686-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-dn4t6\" (UID: \"d4b27ab4-568b-4590-a358-5d0c82577686\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dn4t6" May 20 14:29:34.984635 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:34.984545 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4b27ab4-568b-4590-a358-5d0c82577686-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-dn4t6\" (UID: \"d4b27ab4-568b-4590-a358-5d0c82577686\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dn4t6" May 20 14:29:34.984880 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:34.984670 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d4b27ab4-568b-4590-a358-5d0c82577686-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-dn4t6\" (UID: \"d4b27ab4-568b-4590-a358-5d0c82577686\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dn4t6" May 20 14:29:34.984937 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:34.984911 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d4b27ab4-568b-4590-a358-5d0c82577686-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-dn4t6\" (UID: \"d4b27ab4-568b-4590-a358-5d0c82577686\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dn4t6" May 20 14:29:34.984998 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:34.984979 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d4b27ab4-568b-4590-a358-5d0c82577686-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-dn4t6\" (UID: \"d4b27ab4-568b-4590-a358-5d0c82577686\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dn4t6" May 20 14:29:34.985088 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:34.985068 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d4b27ab4-568b-4590-a358-5d0c82577686-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-dn4t6\" (UID: \"d4b27ab4-568b-4590-a358-5d0c82577686\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dn4t6" May 20 14:29:34.987476 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:34.987431 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4b27ab4-568b-4590-a358-5d0c82577686-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-dn4t6\" (UID: \"d4b27ab4-568b-4590-a358-5d0c82577686\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dn4t6" May 20 14:29:34.987949 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:34.987924 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d4b27ab4-568b-4590-a358-5d0c82577686-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-dn4t6\" (UID: \"d4b27ab4-568b-4590-a358-5d0c82577686\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dn4t6" May 20 14:29:34.995615 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:34.995591 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7bjw\" (UniqueName: \"kubernetes.io/projected/d4b27ab4-568b-4590-a358-5d0c82577686-kube-api-access-g7bjw\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-dn4t6\" (UID: \"d4b27ab4-568b-4590-a358-5d0c82577686\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dn4t6" May 20 14:29:35.106489 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:35.106452 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dn4t6" May 20 14:29:35.237321 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:35.237291 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-dn4t6"] May 20 14:29:35.239065 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:29:35.239035 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4b27ab4_568b_4590_a358_5d0c82577686.slice/crio-e5070eac8c38a06e13caa507967e75bf4185668a7c0daf5d94b231be0b184387 WatchSource:0}: Error finding container e5070eac8c38a06e13caa507967e75bf4185668a7c0daf5d94b231be0b184387: Status 404 returned error can't find the container with id e5070eac8c38a06e13caa507967e75bf4185668a7c0daf5d94b231be0b184387 May 20 14:29:35.475539 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:35.475442 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dn4t6" event={"ID":"d4b27ab4-568b-4590-a358-5d0c82577686","Type":"ContainerStarted","Data":"2815ed68d21744775c69b908973c741465d485c11f51d3481167e4e7c4e3f48b"} May 20 14:29:35.475539 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:35.475502 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dn4t6" event={"ID":"d4b27ab4-568b-4590-a358-5d0c82577686","Type":"ContainerStarted","Data":"e5070eac8c38a06e13caa507967e75bf4185668a7c0daf5d94b231be0b184387"} May 20 14:29:41.494663 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:41.494628 2551 generic.go:358] "Generic (PLEG): container finished" podID="d4b27ab4-568b-4590-a358-5d0c82577686" containerID="2815ed68d21744775c69b908973c741465d485c11f51d3481167e4e7c4e3f48b" exitCode=0 May 20 14:29:41.495101 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:41.494670 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dn4t6" event={"ID":"d4b27ab4-568b-4590-a358-5d0c82577686","Type":"ContainerDied","Data":"2815ed68d21744775c69b908973c741465d485c11f51d3481167e4e7c4e3f48b"} May 20 14:29:43.502509 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:43.502476 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dn4t6" event={"ID":"d4b27ab4-568b-4590-a358-5d0c82577686","Type":"ContainerStarted","Data":"6a2ae4c420faaabc9fff261a84b546127b9eda678c0dd182a36d006e77eec06e"} May 20 14:29:43.502902 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:43.502676 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dn4t6" May 20 14:29:43.531807 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:43.530265 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dn4t6" podStartSLOduration=8.088404044 podStartE2EDuration="9.53024724s" podCreationTimestamp="2026-05-20 14:29:34 +0000 UTC" firstStartedPulling="2026-05-20 14:29:41.495271046 +0000 UTC m=+1241.235568942" lastFinishedPulling="2026-05-20 14:29:42.93711424 +0000 UTC m=+1242.677412138" observedRunningTime="2026-05-20 14:29:43.527241304 +0000 UTC m=+1243.267539220" watchObservedRunningTime="2026-05-20 14:29:43.53024724 +0000 UTC m=+1243.270545157" May 20 14:29:51.188519 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:51.188430 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-25rwl"] May 20 14:29:51.208486 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:51.208456 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-25rwl" May 20 14:29:51.208765 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:51.208738 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-25rwl"] May 20 14:29:51.212062 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:51.212041 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" May 20 14:29:51.213987 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:51.213959 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76940cff-99e2-471d-a9e4-b6089eadccef-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-25rwl\" (UID: \"76940cff-99e2-471d-a9e4-b6089eadccef\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-25rwl" May 20 14:29:51.214108 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:51.214001 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62ltn\" (UniqueName: \"kubernetes.io/projected/76940cff-99e2-471d-a9e4-b6089eadccef-kube-api-access-62ltn\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-25rwl\" (UID: \"76940cff-99e2-471d-a9e4-b6089eadccef\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-25rwl" May 20 14:29:51.214108 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:51.214048 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76940cff-99e2-471d-a9e4-b6089eadccef-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-25rwl\" (UID: \"76940cff-99e2-471d-a9e4-b6089eadccef\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-25rwl" May 20 14:29:51.214108 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:51.214083 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76940cff-99e2-471d-a9e4-b6089eadccef-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-25rwl\" (UID: \"76940cff-99e2-471d-a9e4-b6089eadccef\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-25rwl" May 20 14:29:51.214259 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:51.214202 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76940cff-99e2-471d-a9e4-b6089eadccef-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-25rwl\" (UID: \"76940cff-99e2-471d-a9e4-b6089eadccef\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-25rwl" May 20 14:29:51.214259 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:51.214238 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/76940cff-99e2-471d-a9e4-b6089eadccef-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-25rwl\" (UID: \"76940cff-99e2-471d-a9e4-b6089eadccef\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-25rwl" May 20 14:29:51.314944 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:51.314910 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76940cff-99e2-471d-a9e4-b6089eadccef-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-25rwl\" (UID: \"76940cff-99e2-471d-a9e4-b6089eadccef\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-25rwl" May 20 14:29:51.315139 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:51.314967 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76940cff-99e2-471d-a9e4-b6089eadccef-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-25rwl\" (UID: \"76940cff-99e2-471d-a9e4-b6089eadccef\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-25rwl" May 20 14:29:51.315139 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:51.314986 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/76940cff-99e2-471d-a9e4-b6089eadccef-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-25rwl\" (UID: \"76940cff-99e2-471d-a9e4-b6089eadccef\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-25rwl" May 20 14:29:51.315139 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:51.315024 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76940cff-99e2-471d-a9e4-b6089eadccef-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-25rwl\" (UID: \"76940cff-99e2-471d-a9e4-b6089eadccef\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-25rwl" May 20 14:29:51.315139 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:51.315040 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-62ltn\" (UniqueName: \"kubernetes.io/projected/76940cff-99e2-471d-a9e4-b6089eadccef-kube-api-access-62ltn\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-25rwl\" (UID: \"76940cff-99e2-471d-a9e4-b6089eadccef\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-25rwl" May 20 14:29:51.315139 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:51.315067 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76940cff-99e2-471d-a9e4-b6089eadccef-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-25rwl\" (UID: \"76940cff-99e2-471d-a9e4-b6089eadccef\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-25rwl" May 20 14:29:51.315409 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:51.315355 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76940cff-99e2-471d-a9e4-b6089eadccef-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-25rwl\" (UID: \"76940cff-99e2-471d-a9e4-b6089eadccef\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-25rwl" May 20 14:29:51.315461 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:51.315409 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/76940cff-99e2-471d-a9e4-b6089eadccef-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-25rwl\" (UID: \"76940cff-99e2-471d-a9e4-b6089eadccef\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-25rwl" May 20 14:29:51.315501 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:51.315468 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76940cff-99e2-471d-a9e4-b6089eadccef-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-25rwl\" (UID: \"76940cff-99e2-471d-a9e4-b6089eadccef\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-25rwl" May 20 14:29:51.317192 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:51.317173 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76940cff-99e2-471d-a9e4-b6089eadccef-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-25rwl\" (UID: \"76940cff-99e2-471d-a9e4-b6089eadccef\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-25rwl" May 20 14:29:51.317484 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:51.317467 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76940cff-99e2-471d-a9e4-b6089eadccef-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-25rwl\" (UID: \"76940cff-99e2-471d-a9e4-b6089eadccef\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-25rwl" May 20 14:29:51.324921 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:51.324897 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62ltn\" (UniqueName: \"kubernetes.io/projected/76940cff-99e2-471d-a9e4-b6089eadccef-kube-api-access-62ltn\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-25rwl\" (UID: \"76940cff-99e2-471d-a9e4-b6089eadccef\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-25rwl" May 20 14:29:51.519459 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:51.519369 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-25rwl" May 20 14:29:51.647004 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:51.646977 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-25rwl"] May 20 14:29:51.649233 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:29:51.649204 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76940cff_99e2_471d_a9e4_b6089eadccef.slice/crio-5d5ef53691166ff76df6b174614e5930d0df2a7d657d24b42184475ba3dfb9ef WatchSource:0}: Error finding container 5d5ef53691166ff76df6b174614e5930d0df2a7d657d24b42184475ba3dfb9ef: Status 404 returned error can't find the container with id 5d5ef53691166ff76df6b174614e5930d0df2a7d657d24b42184475ba3dfb9ef May 20 14:29:52.537192 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:52.537140 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-25rwl" event={"ID":"76940cff-99e2-471d-a9e4-b6089eadccef","Type":"ContainerStarted","Data":"f43c18af042757fc03dfe26369d2ca3dec3e86641aa424fa3cb1965e50442815"} May 20 14:29:52.537662 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:52.537200 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-25rwl" event={"ID":"76940cff-99e2-471d-a9e4-b6089eadccef","Type":"ContainerStarted","Data":"5d5ef53691166ff76df6b174614e5930d0df2a7d657d24b42184475ba3dfb9ef"} May 20 14:29:54.517806 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:54.517758 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-dn4t6" May 20 14:29:57.556639 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:57.556607 2551 generic.go:358] "Generic (PLEG): container finished" podID="76940cff-99e2-471d-a9e4-b6089eadccef" containerID="f43c18af042757fc03dfe26369d2ca3dec3e86641aa424fa3cb1965e50442815" exitCode=0 May 20 14:29:57.557042 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:57.556683 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-25rwl" event={"ID":"76940cff-99e2-471d-a9e4-b6089eadccef","Type":"ContainerDied","Data":"f43c18af042757fc03dfe26369d2ca3dec3e86641aa424fa3cb1965e50442815"} May 20 14:29:58.562223 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:58.562188 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-25rwl" event={"ID":"76940cff-99e2-471d-a9e4-b6089eadccef","Type":"ContainerStarted","Data":"ef5324b54edf75514bd69e1d0f89512b35617ab6d1303abee889663f249a1039"} May 20 14:29:58.562584 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:58.562411 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-25rwl" May 20 14:29:58.583609 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:29:58.583555 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-25rwl" podStartSLOduration=7.085533542 podStartE2EDuration="7.583541391s" podCreationTimestamp="2026-05-20 14:29:51 +0000 UTC" firstStartedPulling="2026-05-20 14:29:57.557353544 +0000 UTC m=+1257.297651437" lastFinishedPulling="2026-05-20 14:29:58.055361394 +0000 UTC m=+1257.795659286" observedRunningTime="2026-05-20 14:29:58.582287204 +0000 UTC m=+1258.322585119" watchObservedRunningTime="2026-05-20 14:29:58.583541391 +0000 UTC m=+1258.323839306" May 20 14:30:09.578756 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:30:09.578721 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-25rwl" May 20 14:31:45.919668 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:31:45.919590 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-85d798d6c4-q7ksm"] May 20 14:31:45.920214 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:31:45.919835 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-85d798d6c4-q7ksm" podUID="26cb496f-ab29-4e93-88cd-9ac90c72f05f" containerName="manager" containerID="cri-o://9ae8ff4dcd1423847ef3fa1a71b8949ed31b334f9787b4f8b34e89ddff5244c3" gracePeriod=30 May 20 14:31:46.160914 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:31:46.160885 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85d798d6c4-q7ksm" May 20 14:31:46.213083 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:31:46.212997 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qt5j\" (UniqueName: \"kubernetes.io/projected/26cb496f-ab29-4e93-88cd-9ac90c72f05f-kube-api-access-5qt5j\") pod \"26cb496f-ab29-4e93-88cd-9ac90c72f05f\" (UID: \"26cb496f-ab29-4e93-88cd-9ac90c72f05f\") " May 20 14:31:46.215031 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:31:46.215006 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26cb496f-ab29-4e93-88cd-9ac90c72f05f-kube-api-access-5qt5j" (OuterVolumeSpecName: "kube-api-access-5qt5j") pod "26cb496f-ab29-4e93-88cd-9ac90c72f05f" (UID: "26cb496f-ab29-4e93-88cd-9ac90c72f05f"). InnerVolumeSpecName "kube-api-access-5qt5j". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 14:31:46.314171 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:31:46.314138 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qt5j\" (UniqueName: \"kubernetes.io/projected/26cb496f-ab29-4e93-88cd-9ac90c72f05f-kube-api-access-5qt5j\") on node \"ip-10-0-142-164.ec2.internal\" DevicePath \"\"" May 20 14:31:46.919735 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:31:46.919703 2551 generic.go:358] "Generic (PLEG): container finished" podID="26cb496f-ab29-4e93-88cd-9ac90c72f05f" containerID="9ae8ff4dcd1423847ef3fa1a71b8949ed31b334f9787b4f8b34e89ddff5244c3" exitCode=0 May 20 14:31:46.920121 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:31:46.919812 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85d798d6c4-q7ksm" May 20 14:31:46.920121 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:31:46.919808 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85d798d6c4-q7ksm" event={"ID":"26cb496f-ab29-4e93-88cd-9ac90c72f05f","Type":"ContainerDied","Data":"9ae8ff4dcd1423847ef3fa1a71b8949ed31b334f9787b4f8b34e89ddff5244c3"} May 20 14:31:46.920121 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:31:46.919930 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85d798d6c4-q7ksm" event={"ID":"26cb496f-ab29-4e93-88cd-9ac90c72f05f","Type":"ContainerDied","Data":"e4708861ee78ff88e7a31f99939995e5a89d1adb083f44c4463dbc9f47fc0233"} May 20 14:31:46.920121 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:31:46.919949 2551 scope.go:117] "RemoveContainer" containerID="9ae8ff4dcd1423847ef3fa1a71b8949ed31b334f9787b4f8b34e89ddff5244c3" May 20 14:31:46.927768 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:31:46.927752 2551 scope.go:117] "RemoveContainer" containerID="9ae8ff4dcd1423847ef3fa1a71b8949ed31b334f9787b4f8b34e89ddff5244c3" May 20 14:31:46.928062 ip-10-0-142-164 kubenswrapper[2551]: E0520 14:31:46.928042 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ae8ff4dcd1423847ef3fa1a71b8949ed31b334f9787b4f8b34e89ddff5244c3\": container with ID starting with 9ae8ff4dcd1423847ef3fa1a71b8949ed31b334f9787b4f8b34e89ddff5244c3 not found: ID does not exist" containerID="9ae8ff4dcd1423847ef3fa1a71b8949ed31b334f9787b4f8b34e89ddff5244c3" May 20 14:31:46.928125 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:31:46.928068 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ae8ff4dcd1423847ef3fa1a71b8949ed31b334f9787b4f8b34e89ddff5244c3"} err="failed to get container status \"9ae8ff4dcd1423847ef3fa1a71b8949ed31b334f9787b4f8b34e89ddff5244c3\": rpc error: code = NotFound desc = could not find container \"9ae8ff4dcd1423847ef3fa1a71b8949ed31b334f9787b4f8b34e89ddff5244c3\": container with ID starting with 9ae8ff4dcd1423847ef3fa1a71b8949ed31b334f9787b4f8b34e89ddff5244c3 not found: ID does not exist" May 20 14:31:46.936869 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:31:46.936844 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-85d798d6c4-q7ksm"] May 20 14:31:46.940813 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:31:46.940779 2551 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-85d798d6c4-q7ksm"] May 20 14:31:47.653141 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:31:47.653110 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-85d798d6c4-5kdcq"] May 20 14:31:47.653529 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:31:47.653513 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26cb496f-ab29-4e93-88cd-9ac90c72f05f" containerName="manager" May 20 14:31:47.653529 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:31:47.653529 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="26cb496f-ab29-4e93-88cd-9ac90c72f05f" containerName="manager" May 20 14:31:47.653675 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:31:47.653601 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="26cb496f-ab29-4e93-88cd-9ac90c72f05f" containerName="manager" May 20 14:31:47.657907 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:31:47.657884 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85d798d6c4-5kdcq" May 20 14:31:47.660441 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:31:47.660420 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 20 14:31:47.660600 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:31:47.660583 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-9v4m7\"" May 20 14:31:47.667411 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:31:47.667389 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85d798d6c4-5kdcq"] May 20 14:31:47.725244 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:31:47.725214 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfwmr\" (UniqueName: \"kubernetes.io/projected/814bce4d-7cee-48a0-aec5-1a9a5ee319e3-kube-api-access-mfwmr\") pod \"maas-controller-85d798d6c4-5kdcq\" (UID: \"814bce4d-7cee-48a0-aec5-1a9a5ee319e3\") " pod="opendatahub/maas-controller-85d798d6c4-5kdcq" May 20 14:31:47.826526 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:31:47.826491 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mfwmr\" (UniqueName: \"kubernetes.io/projected/814bce4d-7cee-48a0-aec5-1a9a5ee319e3-kube-api-access-mfwmr\") pod \"maas-controller-85d798d6c4-5kdcq\" (UID: \"814bce4d-7cee-48a0-aec5-1a9a5ee319e3\") " pod="opendatahub/maas-controller-85d798d6c4-5kdcq" May 20 14:31:47.836850 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:31:47.836821 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfwmr\" (UniqueName: \"kubernetes.io/projected/814bce4d-7cee-48a0-aec5-1a9a5ee319e3-kube-api-access-mfwmr\") pod \"maas-controller-85d798d6c4-5kdcq\" (UID: \"814bce4d-7cee-48a0-aec5-1a9a5ee319e3\") " pod="opendatahub/maas-controller-85d798d6c4-5kdcq" May 20 14:31:47.969247 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:31:47.969150 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85d798d6c4-5kdcq" May 20 14:31:48.097511 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:31:48.097469 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85d798d6c4-5kdcq"] May 20 14:31:48.100141 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:31:48.100111 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod814bce4d_7cee_48a0_aec5_1a9a5ee319e3.slice/crio-a04c2d8114bc3b06c4353c9cd23c8e229569b32a1cc699decbe2dd99401e905f WatchSource:0}: Error finding container a04c2d8114bc3b06c4353c9cd23c8e229569b32a1cc699decbe2dd99401e905f: Status 404 returned error can't find the container with id a04c2d8114bc3b06c4353c9cd23c8e229569b32a1cc699decbe2dd99401e905f May 20 14:31:48.869176 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:31:48.869144 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26cb496f-ab29-4e93-88cd-9ac90c72f05f" path="/var/lib/kubelet/pods/26cb496f-ab29-4e93-88cd-9ac90c72f05f/volumes" May 20 14:31:48.928541 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:31:48.928504 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85d798d6c4-5kdcq" event={"ID":"814bce4d-7cee-48a0-aec5-1a9a5ee319e3","Type":"ContainerStarted","Data":"9c555e46e294c7b06bb2fae990920bde00511f7488881df63f3e2b412d13da2a"} May 20 14:31:48.928541 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:31:48.928541 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85d798d6c4-5kdcq" event={"ID":"814bce4d-7cee-48a0-aec5-1a9a5ee319e3","Type":"ContainerStarted","Data":"a04c2d8114bc3b06c4353c9cd23c8e229569b32a1cc699decbe2dd99401e905f"} May 20 14:31:48.928755 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:31:48.928632 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-85d798d6c4-5kdcq" May 20 14:31:59.937511 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:31:59.937429 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-85d798d6c4-5kdcq" May 20 14:31:59.958530 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:31:59.958477 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-85d798d6c4-5kdcq" podStartSLOduration=12.522847002 podStartE2EDuration="12.9584622s" podCreationTimestamp="2026-05-20 14:31:47 +0000 UTC" firstStartedPulling="2026-05-20 14:31:48.10147116 +0000 UTC m=+1367.841769056" lastFinishedPulling="2026-05-20 14:31:48.537086358 +0000 UTC m=+1368.277384254" observedRunningTime="2026-05-20 14:31:48.948888869 +0000 UTC m=+1368.689186809" watchObservedRunningTime="2026-05-20 14:31:59.9584622 +0000 UTC m=+1379.698760114" May 20 14:52:57.204350 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:52:57.204262 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-85d798d6c4-5kdcq_814bce4d-7cee-48a0-aec5-1a9a5ee319e3/manager/0.log" May 20 14:52:57.638930 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:52:57.638905 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c4b767bc-lhnhp_e749e656-d3ee-4d3e-a548-f980c68f89a6/manager/0.log" May 20 14:52:59.094819 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:52:59.094771 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-g52zc_09b08bb1-1d81-49d8-af2e-13ee06c2b2a4/manager/0.log" May 20 14:52:59.307033 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:52:59.307005 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-q8gmp_97e75a7c-b2cb-490f-be53-88f097d169a7/kuadrant-console-plugin/0.log" May 20 14:53:00.416752 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:00.416726 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6987ff4ccd-rgwpz_7ad2c58e-0d02-426d-b3d6-451ef5b910b6/kube-auth-proxy/0.log" May 20 14:53:00.653902 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:00.653867 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-jgnp5_824d095f-b3e8-4ca4-b962-29f82daca8c9/payload-processing/0.log" May 20 14:53:01.128109 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:01.128071 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-g9qc5_0b093d8d-2360-40fd-9f99-597c90aa1678/storage-initializer/0.log" May 20 14:53:01.135414 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:01.135383 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-g9qc5_0b093d8d-2360-40fd-9f99-597c90aa1678/main/0.log" May 20 14:53:01.247110 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:01.247072 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-25rwl_76940cff-99e2-471d-a9e4-b6089eadccef/storage-initializer/0.log" May 20 14:53:01.255274 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:01.255249 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-25rwl_76940cff-99e2-471d-a9e4-b6089eadccef/main/0.log" May 20 14:53:01.364375 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:01.364341 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-dn4t6_d4b27ab4-568b-4590-a358-5d0c82577686/storage-initializer/0.log" May 20 14:53:01.373151 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:01.373127 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-dn4t6_d4b27ab4-568b-4590-a358-5d0c82577686/main/0.log" May 20 14:53:08.951670 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:08.951641 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-v2ngr_d3e67e53-49ad-4cb8-81dd-583176e309a3/global-pull-secret-syncer/0.log" May 20 14:53:09.094665 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:09.094631 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-wl72b_03ff3c4e-874c-46d1-bc2f-a86677878e83/konnectivity-agent/0.log" May 20 14:53:09.175484 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:09.175449 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-164.ec2.internal_9f433c144673f44ac68220eba4eaa3a1/haproxy/0.log" May 20 14:53:13.788997 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:13.788918 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-g52zc_09b08bb1-1d81-49d8-af2e-13ee06c2b2a4/manager/0.log" May 20 14:53:13.845617 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:13.845586 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-q8gmp_97e75a7c-b2cb-490f-be53-88f097d169a7/kuadrant-console-plugin/0.log" May 20 14:53:15.724550 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:15.724513 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-xr2xr_f4c50283-8dd2-43b8-baaf-312629ac8a44/kube-state-metrics/0.log" May 20 14:53:15.741062 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:15.741035 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-xr2xr_f4c50283-8dd2-43b8-baaf-312629ac8a44/kube-rbac-proxy-main/0.log" May 20 14:53:15.764077 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:15.764048 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-xr2xr_f4c50283-8dd2-43b8-baaf-312629ac8a44/kube-rbac-proxy-self/0.log" May 20 14:53:15.931202 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:15.931176 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cfxkz_10fe0991-123c-4342-a808-8d1a47454f56/node-exporter/0.log" May 20 14:53:15.949881 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:15.949848 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cfxkz_10fe0991-123c-4342-a808-8d1a47454f56/kube-rbac-proxy/0.log" May 20 14:53:15.970067 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:15.970045 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cfxkz_10fe0991-123c-4342-a808-8d1a47454f56/init-textfile/0.log" May 20 14:53:16.145814 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:16.145772 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_61a7bb40-8f5a-443c-9172-97356497a81d/prometheus/0.log" May 20 14:53:16.167164 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:16.167138 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_61a7bb40-8f5a-443c-9172-97356497a81d/config-reloader/0.log" May 20 14:53:16.187598 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:16.187566 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_61a7bb40-8f5a-443c-9172-97356497a81d/thanos-sidecar/0.log" May 20 14:53:16.206947 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:16.206922 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_61a7bb40-8f5a-443c-9172-97356497a81d/kube-rbac-proxy-web/0.log" May 20 14:53:16.227253 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:16.227220 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_61a7bb40-8f5a-443c-9172-97356497a81d/kube-rbac-proxy/0.log" May 20 14:53:16.248817 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:16.248774 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_61a7bb40-8f5a-443c-9172-97356497a81d/kube-rbac-proxy-thanos/0.log" May 20 14:53:16.278147 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:16.278121 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_61a7bb40-8f5a-443c-9172-97356497a81d/init-config-reloader/0.log" May 20 14:53:16.310820 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:16.310775 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-scnxp_1a9e3e14-2909-41fd-95bd-ca60e50b4a8d/prometheus-operator/0.log" May 20 14:53:16.328170 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:16.328137 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-scnxp_1a9e3e14-2909-41fd-95bd-ca60e50b4a8d/kube-rbac-proxy/0.log" May 20 14:53:16.462329 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:16.462250 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-97b8c9d98-bg22m_dbde0e4c-106c-47ed-98ad-5c2f072e5b94/thanos-query/0.log" May 20 14:53:16.492523 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:16.492487 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-97b8c9d98-bg22m_dbde0e4c-106c-47ed-98ad-5c2f072e5b94/kube-rbac-proxy-web/0.log" May 20 14:53:16.516071 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:16.516042 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-97b8c9d98-bg22m_dbde0e4c-106c-47ed-98ad-5c2f072e5b94/kube-rbac-proxy/0.log" May 20 14:53:16.535846 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:16.535817 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-97b8c9d98-bg22m_dbde0e4c-106c-47ed-98ad-5c2f072e5b94/prom-label-proxy/0.log" May 20 14:53:16.557117 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:16.557086 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-97b8c9d98-bg22m_dbde0e4c-106c-47ed-98ad-5c2f072e5b94/kube-rbac-proxy-rules/0.log" May 20 14:53:16.576254 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:16.576228 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-97b8c9d98-bg22m_dbde0e4c-106c-47ed-98ad-5c2f072e5b94/kube-rbac-proxy-metrics/0.log" May 20 14:53:17.203906 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:17.203878 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fwt2m/perf-node-gather-daemonset-hdnlq"] May 20 14:53:17.207356 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:17.207339 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fwt2m/perf-node-gather-daemonset-hdnlq" May 20 14:53:17.210829 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:17.210809 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fwt2m\"/\"kube-root-ca.crt\"" May 20 14:53:17.210969 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:17.210869 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fwt2m\"/\"openshift-service-ca.crt\"" May 20 14:53:17.211954 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:17.211937 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fwt2m\"/\"default-dockercfg-rmdr4\"" May 20 14:53:17.221098 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:17.221079 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fwt2m/perf-node-gather-daemonset-hdnlq"] May 20 14:53:17.225506 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:17.225482 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db3fb124-281b-498a-9bfa-413a3f8baca5-sys\") pod \"perf-node-gather-daemonset-hdnlq\" (UID: \"db3fb124-281b-498a-9bfa-413a3f8baca5\") " pod="openshift-must-gather-fwt2m/perf-node-gather-daemonset-hdnlq" May 20 14:53:17.225596 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:17.225547 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db3fb124-281b-498a-9bfa-413a3f8baca5-lib-modules\") pod \"perf-node-gather-daemonset-hdnlq\" (UID: \"db3fb124-281b-498a-9bfa-413a3f8baca5\") " pod="openshift-must-gather-fwt2m/perf-node-gather-daemonset-hdnlq" May 20 14:53:17.225648 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:17.225603 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/db3fb124-281b-498a-9bfa-413a3f8baca5-podres\") pod \"perf-node-gather-daemonset-hdnlq\" (UID: \"db3fb124-281b-498a-9bfa-413a3f8baca5\") " pod="openshift-must-gather-fwt2m/perf-node-gather-daemonset-hdnlq" May 20 14:53:17.225686 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:17.225653 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/db3fb124-281b-498a-9bfa-413a3f8baca5-proc\") pod \"perf-node-gather-daemonset-hdnlq\" (UID: \"db3fb124-281b-498a-9bfa-413a3f8baca5\") " pod="openshift-must-gather-fwt2m/perf-node-gather-daemonset-hdnlq" May 20 14:53:17.225720 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:17.225704 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v85n9\" (UniqueName: \"kubernetes.io/projected/db3fb124-281b-498a-9bfa-413a3f8baca5-kube-api-access-v85n9\") pod \"perf-node-gather-daemonset-hdnlq\" (UID: \"db3fb124-281b-498a-9bfa-413a3f8baca5\") " pod="openshift-must-gather-fwt2m/perf-node-gather-daemonset-hdnlq" May 20 14:53:17.327232 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:17.327202 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db3fb124-281b-498a-9bfa-413a3f8baca5-lib-modules\") pod \"perf-node-gather-daemonset-hdnlq\" (UID: \"db3fb124-281b-498a-9bfa-413a3f8baca5\") " pod="openshift-must-gather-fwt2m/perf-node-gather-daemonset-hdnlq" May 20 14:53:17.327232 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:17.327236 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/db3fb124-281b-498a-9bfa-413a3f8baca5-podres\") pod \"perf-node-gather-daemonset-hdnlq\" (UID: \"db3fb124-281b-498a-9bfa-413a3f8baca5\") " pod="openshift-must-gather-fwt2m/perf-node-gather-daemonset-hdnlq" May 20 14:53:17.327490 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:17.327258 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/db3fb124-281b-498a-9bfa-413a3f8baca5-proc\") pod \"perf-node-gather-daemonset-hdnlq\" (UID: \"db3fb124-281b-498a-9bfa-413a3f8baca5\") " pod="openshift-must-gather-fwt2m/perf-node-gather-daemonset-hdnlq" May 20 14:53:17.327490 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:17.327325 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/db3fb124-281b-498a-9bfa-413a3f8baca5-proc\") pod \"perf-node-gather-daemonset-hdnlq\" (UID: \"db3fb124-281b-498a-9bfa-413a3f8baca5\") " pod="openshift-must-gather-fwt2m/perf-node-gather-daemonset-hdnlq" May 20 14:53:17.327490 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:17.327369 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/db3fb124-281b-498a-9bfa-413a3f8baca5-podres\") pod \"perf-node-gather-daemonset-hdnlq\" (UID: \"db3fb124-281b-498a-9bfa-413a3f8baca5\") " pod="openshift-must-gather-fwt2m/perf-node-gather-daemonset-hdnlq" May 20 14:53:17.327490 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:17.327375 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db3fb124-281b-498a-9bfa-413a3f8baca5-lib-modules\") pod \"perf-node-gather-daemonset-hdnlq\" (UID: \"db3fb124-281b-498a-9bfa-413a3f8baca5\") " pod="openshift-must-gather-fwt2m/perf-node-gather-daemonset-hdnlq" May 20 14:53:17.327490 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:17.327370 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v85n9\" (UniqueName: \"kubernetes.io/projected/db3fb124-281b-498a-9bfa-413a3f8baca5-kube-api-access-v85n9\") pod \"perf-node-gather-daemonset-hdnlq\" (UID: \"db3fb124-281b-498a-9bfa-413a3f8baca5\") " pod="openshift-must-gather-fwt2m/perf-node-gather-daemonset-hdnlq" May 20 14:53:17.327490 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:17.327435 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db3fb124-281b-498a-9bfa-413a3f8baca5-sys\") pod \"perf-node-gather-daemonset-hdnlq\" (UID: \"db3fb124-281b-498a-9bfa-413a3f8baca5\") " pod="openshift-must-gather-fwt2m/perf-node-gather-daemonset-hdnlq" May 20 14:53:17.327490 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:17.327487 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db3fb124-281b-498a-9bfa-413a3f8baca5-sys\") pod \"perf-node-gather-daemonset-hdnlq\" (UID: \"db3fb124-281b-498a-9bfa-413a3f8baca5\") " pod="openshift-must-gather-fwt2m/perf-node-gather-daemonset-hdnlq" May 20 14:53:17.336482 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:17.336461 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v85n9\" (UniqueName: \"kubernetes.io/projected/db3fb124-281b-498a-9bfa-413a3f8baca5-kube-api-access-v85n9\") pod \"perf-node-gather-daemonset-hdnlq\" (UID: \"db3fb124-281b-498a-9bfa-413a3f8baca5\") " pod="openshift-must-gather-fwt2m/perf-node-gather-daemonset-hdnlq" May 20 14:53:17.517527 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:17.517433 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fwt2m/perf-node-gather-daemonset-hdnlq" May 20 14:53:17.648676 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:17.648652 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fwt2m/perf-node-gather-daemonset-hdnlq"] May 20 14:53:17.651232 ip-10-0-142-164 kubenswrapper[2551]: W0520 14:53:17.651205 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddb3fb124_281b_498a_9bfa_413a3f8baca5.slice/crio-86d7f825c2f2c4b99990d4b0afcd4aa559c8442326f974c7be2a2edfcb540ce4 WatchSource:0}: Error finding container 86d7f825c2f2c4b99990d4b0afcd4aa559c8442326f974c7be2a2edfcb540ce4: Status 404 returned error can't find the container with id 86d7f825c2f2c4b99990d4b0afcd4aa559c8442326f974c7be2a2edfcb540ce4 May 20 14:53:17.652755 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:17.652733 2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 20 14:53:18.158817 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:18.158761 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fwt2m/perf-node-gather-daemonset-hdnlq" event={"ID":"db3fb124-281b-498a-9bfa-413a3f8baca5","Type":"ContainerStarted","Data":"0cb124b5dcc4b442f625ce61392b11f977ce5a97c84a899774c1c5217670d920"} May 20 14:53:18.158817 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:18.158818 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fwt2m/perf-node-gather-daemonset-hdnlq" event={"ID":"db3fb124-281b-498a-9bfa-413a3f8baca5","Type":"ContainerStarted","Data":"86d7f825c2f2c4b99990d4b0afcd4aa559c8442326f974c7be2a2edfcb540ce4"} May 20 14:53:18.159021 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:18.158942 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fwt2m/perf-node-gather-daemonset-hdnlq" May 20 14:53:18.174288 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:18.174246 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-fwt2m/perf-node-gather-daemonset-hdnlq" podStartSLOduration=1.174233306 podStartE2EDuration="1.174233306s" podCreationTimestamp="2026-05-20 14:53:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 14:53:18.173444837 +0000 UTC m=+2657.913742775" watchObservedRunningTime="2026-05-20 14:53:18.174233306 +0000 UTC m=+2657.914531221" May 20 14:53:18.681515 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:18.681485 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-4cwpv_a6ec7480-6297-463d-82b8-2388d6e6f914/download-server/0.log" May 20 14:53:20.083335 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:20.083307 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tk4mc_2a54ec7c-1906-444e-b76c-340571083dec/dns/0.log" May 20 14:53:20.103522 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:20.103491 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tk4mc_2a54ec7c-1906-444e-b76c-340571083dec/kube-rbac-proxy/0.log" May 20 14:53:20.148754 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:20.148727 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pjwj8_357ba598-e6a1-4cf4-9824-9206db075905/dns-node-resolver/0.log" May 20 14:53:20.669622 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:20.669592 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zklgl_a2289b16-7fb4-4409-bfc9-5805b74161dc/node-ca/0.log" May 20 14:53:21.668082 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:21.668054 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6987ff4ccd-rgwpz_7ad2c58e-0d02-426d-b3d6-451ef5b910b6/kube-auth-proxy/0.log" May 20 14:53:21.853900 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:21.853865 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-jgnp5_824d095f-b3e8-4ca4-b962-29f82daca8c9/payload-processing/0.log" May 20 14:53:22.376334 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:22.376302 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8r442_12fd684e-4a9e-43eb-b15f-93074c235ffa/serve-healthcheck-canary/0.log" May 20 14:53:22.937738 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:22.937699 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mzs7q_475bb6aa-70af-41d2-a009-d11abbbc4484/kube-rbac-proxy/0.log" May 20 14:53:22.962922 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:22.962891 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mzs7q_475bb6aa-70af-41d2-a009-d11abbbc4484/exporter/0.log" May 20 14:53:22.987605 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:22.987575 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mzs7q_475bb6aa-70af-41d2-a009-d11abbbc4484/extractor/0.log" May 20 14:53:24.172251 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:24.172220 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fwt2m/perf-node-gather-daemonset-hdnlq" May 20 14:53:25.165896 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:25.165866 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-85d798d6c4-5kdcq_814bce4d-7cee-48a0-aec5-1a9a5ee319e3/manager/0.log" May 20 14:53:25.279331 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:25.279298 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c4b767bc-lhnhp_e749e656-d3ee-4d3e-a548-f980c68f89a6/manager/0.log" May 20 14:53:26.668975 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:26.668940 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5dd8647f4-zjzk4_d1943d2d-dbc7-4170-98d4-34172d7dcdb4/manager/0.log" May 20 14:53:32.515343 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:32.515312 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-69szq_b8a30337-47c1-4c73-ad43-87551f5adf02/kube-multus-additional-cni-plugins/0.log" May 20 14:53:32.535553 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:32.535523 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-69szq_b8a30337-47c1-4c73-ad43-87551f5adf02/egress-router-binary-copy/0.log" May 20 14:53:32.557887 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:32.557857 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-69szq_b8a30337-47c1-4c73-ad43-87551f5adf02/cni-plugins/0.log" May 20 14:53:32.577927 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:32.577893 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-69szq_b8a30337-47c1-4c73-ad43-87551f5adf02/bond-cni-plugin/0.log" May 20 14:53:32.601210 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:32.601188 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-69szq_b8a30337-47c1-4c73-ad43-87551f5adf02/routeoverride-cni/0.log" May 20 14:53:32.620732 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:32.620709 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-69szq_b8a30337-47c1-4c73-ad43-87551f5adf02/whereabouts-cni-bincopy/0.log" May 20 14:53:32.639666 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:32.639633 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-69szq_b8a30337-47c1-4c73-ad43-87551f5adf02/whereabouts-cni/0.log" May 20 14:53:33.029388 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:33.029355 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qqv5s_efac700d-53e9-4404-83e9-c97b81f73d7b/kube-multus/0.log" May 20 14:53:33.136494 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:33.136461 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-m2p6p_ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb/network-metrics-daemon/0.log" May 20 14:53:33.154518 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:33.154494 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-m2p6p_ca1c032d-7d4d-4aba-9cdc-4d4e2eec8adb/kube-rbac-proxy/0.log" May 20 14:53:34.337167 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:34.337113 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ggb6b_75f22758-90d8-4dd5-ab8e-74e8ec2badc1/ovn-controller/0.log" May 20 14:53:34.378713 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:34.378681 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ggb6b_75f22758-90d8-4dd5-ab8e-74e8ec2badc1/ovn-acl-logging/0.log" May 20 14:53:34.399759 ip-10-0-142-164 kubenswrapper[2551]: I0520 14:53:34.399719 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ggb6b_75f22758-90d8-4dd5-ab8e-74e8ec2badc1/kube-rbac-proxy-node/0.log"