May 25 13:05:33.971428 ip-10-0-132-184 systemd[1]: Starting Kubernetes Kubelet... May 25 13:05:34.466210 ip-10-0-132-184 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 25 13:05:34.466210 ip-10-0-132-184 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 25 13:05:34.466210 ip-10-0-132-184 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 25 13:05:34.466210 ip-10-0-132-184 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 25 13:05:34.466210 ip-10-0-132-184 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 25 13:05:34.468123 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.468044 2568 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 25 13:05:34.475441 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475427 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 25 13:05:34.475441 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475442 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 25 13:05:34.475511 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475445 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 25 13:05:34.475511 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475448 2568 feature_gate.go:328] unrecognized feature gate: NewOLM May 25 13:05:34.475511 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475452 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 25 13:05:34.475511 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475455 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 25 13:05:34.475511 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475458 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 25 13:05:34.475511 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475460 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 25 13:05:34.475511 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475462 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 25 13:05:34.475511 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475465 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 25 13:05:34.475511 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475468 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 25 13:05:34.475511 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475471 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 25 13:05:34.475511 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475474 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 25 13:05:34.475511 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475477 2568 feature_gate.go:328] unrecognized feature gate: Example May 25 13:05:34.475511 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475479 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 25 13:05:34.475511 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475486 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 25 13:05:34.475511 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475489 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 25 13:05:34.475511 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475492 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 25 13:05:34.475511 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475495 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 25 13:05:34.475511 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475497 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 25 13:05:34.475511 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475500 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability May 25 13:05:34.475511 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475503 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 25 13:05:34.475989 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475505 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 25 13:05:34.475989 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475508 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 25 13:05:34.475989 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475511 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages May 25 13:05:34.475989 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475513 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 25 13:05:34.475989 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475516 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 25 13:05:34.475989 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475519 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 25 13:05:34.475989 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475522 2568 feature_gate.go:328] unrecognized feature gate: Example2 May 25 13:05:34.475989 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475524 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 25 13:05:34.475989 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475527 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 25 13:05:34.475989 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475529 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 25 13:05:34.475989 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475532 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 25 13:05:34.475989 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475535 2568 feature_gate.go:328] unrecognized feature gate: DualReplica May 25 13:05:34.475989 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475537 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 25 13:05:34.475989 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475540 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 25 13:05:34.475989 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475543 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores May 25 13:05:34.475989 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475545 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 25 13:05:34.475989 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475548 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 25 13:05:34.475989 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475550 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 25 13:05:34.475989 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475554 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 25 13:05:34.475989 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475556 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 25 13:05:34.476504 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475559 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 25 13:05:34.476504 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475561 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 25 13:05:34.476504 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475563 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 25 13:05:34.476504 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475566 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 25 13:05:34.476504 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475569 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 25 13:05:34.476504 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475571 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 25 13:05:34.476504 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475573 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 25 13:05:34.476504 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475576 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 25 13:05:34.476504 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475579 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 25 13:05:34.476504 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475582 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 25 13:05:34.476504 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475584 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 25 13:05:34.476504 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475586 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 25 13:05:34.476504 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475589 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 25 13:05:34.476504 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475592 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 25 13:05:34.476504 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475594 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 25 13:05:34.476504 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475598 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 25 13:05:34.476504 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475600 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 25 13:05:34.476504 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475602 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 25 13:05:34.476504 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475605 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 25 13:05:34.476504 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475607 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 25 13:05:34.476999 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475610 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 25 13:05:34.476999 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475612 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 25 13:05:34.476999 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475615 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 25 13:05:34.476999 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475618 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 25 13:05:34.476999 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475626 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 25 13:05:34.476999 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475629 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 25 13:05:34.476999 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475631 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 25 13:05:34.476999 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475634 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 25 13:05:34.476999 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475636 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 25 13:05:34.476999 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475639 2568 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 25 13:05:34.476999 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475641 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 25 13:05:34.476999 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475644 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 25 13:05:34.476999 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475646 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 25 13:05:34.476999 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475649 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 25 13:05:34.476999 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475652 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 25 13:05:34.476999 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475654 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 25 13:05:34.476999 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475657 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 25 13:05:34.476999 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475659 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 25 13:05:34.476999 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475664 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 25 13:05:34.477463 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475667 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 25 13:05:34.477463 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475671 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 25 13:05:34.477463 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475675 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 25 13:05:34.477463 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475679 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 25 13:05:34.477463 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.475682 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 25 13:05:34.477463 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476077 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 25 13:05:34.477463 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476083 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 25 13:05:34.477463 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476086 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 25 13:05:34.477463 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476089 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 25 13:05:34.477463 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476093 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 25 13:05:34.477463 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476097 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 25 13:05:34.477463 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476100 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 25 13:05:34.477463 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476103 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 25 13:05:34.477463 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476106 2568 feature_gate.go:328] unrecognized feature gate: NewOLM May 25 13:05:34.477463 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476108 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 25 13:05:34.477463 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476110 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 25 13:05:34.477463 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476113 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability May 25 13:05:34.477463 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476117 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 25 13:05:34.477463 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476120 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 25 13:05:34.477911 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476123 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 25 13:05:34.477911 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476125 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 25 13:05:34.477911 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476128 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores May 25 13:05:34.477911 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476131 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 25 13:05:34.477911 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476133 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 25 13:05:34.477911 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476136 2568 feature_gate.go:328] unrecognized feature gate: Example May 25 13:05:34.477911 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476138 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 25 13:05:34.477911 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476141 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 25 13:05:34.477911 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476143 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 25 13:05:34.477911 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476146 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 25 13:05:34.477911 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476167 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 25 13:05:34.477911 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476170 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 25 13:05:34.477911 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476172 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 25 13:05:34.477911 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476175 2568 feature_gate.go:328] unrecognized feature gate: DualReplica May 25 13:05:34.477911 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476178 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 25 13:05:34.477911 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476181 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 25 13:05:34.477911 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476183 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 25 13:05:34.477911 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476186 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 25 13:05:34.477911 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476188 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 25 13:05:34.477911 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476192 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 25 13:05:34.478437 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476194 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 25 13:05:34.478437 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476203 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 25 13:05:34.478437 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476206 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 25 13:05:34.478437 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476208 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 25 13:05:34.478437 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476211 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 25 13:05:34.478437 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476214 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 25 13:05:34.478437 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476217 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 25 13:05:34.478437 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476219 2568 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 25 13:05:34.478437 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476222 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 25 13:05:34.478437 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476224 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 25 13:05:34.478437 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476227 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 25 13:05:34.478437 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476235 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 25 13:05:34.478437 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476238 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 25 13:05:34.478437 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476240 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 25 13:05:34.478437 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476243 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 25 13:05:34.478437 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476245 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 25 13:05:34.478437 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476248 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 25 13:05:34.478437 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476250 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 25 13:05:34.478437 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476252 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 25 13:05:34.478437 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476255 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 25 13:05:34.478924 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476263 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 25 13:05:34.478924 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476265 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 25 13:05:34.478924 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476268 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 25 13:05:34.478924 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476270 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 25 13:05:34.478924 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476273 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 25 13:05:34.478924 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476275 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 25 13:05:34.478924 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476278 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 25 13:05:34.478924 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476281 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 25 13:05:34.478924 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476283 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 25 13:05:34.478924 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476286 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 25 13:05:34.478924 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476288 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 25 13:05:34.478924 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476292 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 25 13:05:34.478924 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476294 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 25 13:05:34.478924 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476297 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages May 25 13:05:34.478924 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476299 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 25 13:05:34.478924 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476302 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 25 13:05:34.478924 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476304 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 25 13:05:34.478924 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476307 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 25 13:05:34.478924 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476310 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 25 13:05:34.478924 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476312 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 25 13:05:34.479556 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476315 2568 feature_gate.go:328] unrecognized feature gate: Example2 May 25 13:05:34.479556 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476317 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 25 13:05:34.479556 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476320 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 25 13:05:34.479556 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476322 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 25 13:05:34.479556 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476332 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 25 13:05:34.479556 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476336 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 25 13:05:34.479556 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476338 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 25 13:05:34.479556 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476341 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 25 13:05:34.479556 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476345 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 25 13:05:34.479556 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476348 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 25 13:05:34.479556 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476351 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 25 13:05:34.479556 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.476354 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 25 13:05:34.479556 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477262 2568 flags.go:64] FLAG: --address="0.0.0.0" May 25 13:05:34.479556 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477272 2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 25 13:05:34.479556 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477279 2568 flags.go:64] FLAG: --anonymous-auth="true" May 25 13:05:34.479556 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477284 2568 flags.go:64] FLAG: --application-metrics-count-limit="100" May 25 13:05:34.479556 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477289 2568 flags.go:64] FLAG: --authentication-token-webhook="false" May 25 13:05:34.479556 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477293 2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 25 13:05:34.479556 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477297 2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 25 13:05:34.479556 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477302 2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 25 13:05:34.480049 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477305 2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 25 13:05:34.480049 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477308 2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 25 13:05:34.480049 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477312 2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 25 13:05:34.480049 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477315 2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 25 13:05:34.480049 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477319 2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 25 13:05:34.480049 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477321 2568 flags.go:64] FLAG: --cgroup-root="" May 25 13:05:34.480049 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477324 2568 flags.go:64] FLAG: --cgroups-per-qos="true" May 25 13:05:34.480049 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477327 2568 flags.go:64] FLAG: --client-ca-file="" May 25 13:05:34.480049 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477330 2568 flags.go:64] FLAG: --cloud-config="" May 25 13:05:34.480049 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477333 2568 flags.go:64] FLAG: --cloud-provider="external" May 25 13:05:34.480049 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477336 2568 flags.go:64] FLAG: --cluster-dns="[]" May 25 13:05:34.480049 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477339 2568 flags.go:64] FLAG: --cluster-domain="" May 25 13:05:34.480049 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477342 2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 25 13:05:34.480049 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477345 2568 flags.go:64] FLAG: --config-dir="" May 25 13:05:34.480049 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477348 2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 25 13:05:34.480049 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477351 2568 flags.go:64] FLAG: --container-log-max-files="5" May 25 13:05:34.480049 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477355 2568 flags.go:64] FLAG: --container-log-max-size="10Mi" May 25 13:05:34.480049 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477359 2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 25 13:05:34.480049 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477362 2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 25 13:05:34.480049 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477365 2568 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 25 13:05:34.480049 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477368 2568 flags.go:64] FLAG: --contention-profiling="false" May 25 13:05:34.480049 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477371 2568 flags.go:64] FLAG: --cpu-cfs-quota="true" May 25 13:05:34.480049 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477374 2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 25 13:05:34.480049 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477378 2568 flags.go:64] FLAG: --cpu-manager-policy="none" May 25 13:05:34.480049 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477381 2568 flags.go:64] FLAG: --cpu-manager-policy-options="" May 25 13:05:34.480662 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477385 2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 25 13:05:34.480662 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477388 2568 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 25 13:05:34.480662 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477392 2568 flags.go:64] FLAG: --enable-debugging-handlers="true" May 25 13:05:34.480662 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477395 2568 flags.go:64] FLAG: --enable-load-reader="false" May 25 13:05:34.480662 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477398 2568 flags.go:64] FLAG: --enable-server="true" May 25 13:05:34.480662 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477400 2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 25 13:05:34.480662 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477405 2568 flags.go:64] FLAG: --event-burst="100" May 25 13:05:34.480662 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477408 2568 flags.go:64] FLAG: --event-qps="50" May 25 13:05:34.480662 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477411 2568 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 25 13:05:34.480662 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477414 2568 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 25 13:05:34.480662 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477417 2568 flags.go:64] FLAG: --eviction-hard="" May 25 13:05:34.480662 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477421 2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 25 13:05:34.480662 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477424 2568 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 25 13:05:34.480662 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477427 2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 25 13:05:34.480662 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477431 2568 flags.go:64] FLAG: --eviction-soft="" May 25 13:05:34.480662 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477434 2568 flags.go:64] FLAG: --eviction-soft-grace-period="" May 25 13:05:34.480662 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477437 2568 flags.go:64] FLAG: --exit-on-lock-contention="false" May 25 13:05:34.480662 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477440 2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 25 13:05:34.480662 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477443 2568 flags.go:64] FLAG: --experimental-mounter-path="" May 25 13:05:34.480662 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477446 2568 flags.go:64] FLAG: --fail-cgroupv1="false" May 25 13:05:34.480662 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477448 2568 flags.go:64] FLAG: --fail-swap-on="true" May 25 13:05:34.480662 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477451 2568 flags.go:64] FLAG: --feature-gates="" May 25 13:05:34.480662 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477455 2568 flags.go:64] FLAG: --file-check-frequency="20s" May 25 13:05:34.480662 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477458 2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 25 13:05:34.480662 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477462 2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 25 13:05:34.481284 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477465 2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 25 13:05:34.481284 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477468 2568 flags.go:64] FLAG: --healthz-port="10248" May 25 13:05:34.481284 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477472 2568 flags.go:64] FLAG: --help="false" May 25 13:05:34.481284 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477475 2568 flags.go:64] FLAG: --hostname-override="ip-10-0-132-184.ec2.internal" May 25 13:05:34.481284 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477479 2568 flags.go:64] FLAG: --housekeeping-interval="10s" May 25 13:05:34.481284 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477482 2568 flags.go:64] FLAG: --http-check-frequency="20s" May 25 13:05:34.481284 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477485 2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 25 13:05:34.481284 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477488 2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 25 13:05:34.481284 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477492 2568 flags.go:64] FLAG: --image-gc-high-threshold="85" May 25 13:05:34.481284 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477494 2568 flags.go:64] FLAG: --image-gc-low-threshold="80" May 25 13:05:34.481284 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477497 2568 flags.go:64] FLAG: --image-service-endpoint="" May 25 13:05:34.481284 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477500 2568 flags.go:64] FLAG: --kernel-memcg-notification="false" May 25 13:05:34.481284 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477503 2568 flags.go:64] FLAG: --kube-api-burst="100" May 25 13:05:34.481284 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477506 2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 25 13:05:34.481284 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477509 2568 flags.go:64] FLAG: --kube-api-qps="50" May 25 13:05:34.481284 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477512 2568 flags.go:64] FLAG: --kube-reserved="" May 25 13:05:34.481284 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477515 2568 flags.go:64] FLAG: --kube-reserved-cgroup="" May 25 13:05:34.481284 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477518 2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 25 13:05:34.481284 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477521 2568 flags.go:64] FLAG: --kubelet-cgroups="" May 25 13:05:34.481284 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477524 2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 25 13:05:34.481284 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477527 2568 flags.go:64] FLAG: --lock-file="" May 25 13:05:34.481284 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477530 2568 flags.go:64] FLAG: --log-cadvisor-usage="false" May 25 13:05:34.481284 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477533 2568 flags.go:64] FLAG: --log-flush-frequency="5s" May 25 13:05:34.481284 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477535 2568 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 25 13:05:34.481860 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477541 2568 flags.go:64] FLAG: --log-json-split-stream="false" May 25 13:05:34.481860 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477544 2568 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 25 13:05:34.481860 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477547 2568 flags.go:64] FLAG: --log-text-split-stream="false" May 25 13:05:34.481860 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477549 2568 flags.go:64] FLAG: --logging-format="text" May 25 13:05:34.481860 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477552 2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 25 13:05:34.481860 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477555 2568 flags.go:64] FLAG: --make-iptables-util-chains="true" May 25 13:05:34.481860 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477558 2568 flags.go:64] FLAG: --manifest-url="" May 25 13:05:34.481860 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477561 2568 flags.go:64] FLAG: --manifest-url-header="" May 25 13:05:34.481860 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477565 2568 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 25 13:05:34.481860 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477568 2568 flags.go:64] FLAG: --max-open-files="1000000" May 25 13:05:34.481860 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477572 2568 flags.go:64] FLAG: --max-pods="110" May 25 13:05:34.481860 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477575 2568 flags.go:64] FLAG: --maximum-dead-containers="-1" May 25 13:05:34.481860 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477579 2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 25 13:05:34.481860 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477582 2568 flags.go:64] FLAG: --memory-manager-policy="None" May 25 13:05:34.481860 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477585 2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 25 13:05:34.481860 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477588 2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 25 13:05:34.481860 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477591 2568 flags.go:64] FLAG: --node-ip="0.0.0.0" May 25 13:05:34.481860 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477595 2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 25 13:05:34.481860 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477602 2568 flags.go:64] FLAG: --node-status-max-images="50" May 25 13:05:34.481860 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477605 2568 flags.go:64] FLAG: --node-status-update-frequency="10s" May 25 13:05:34.481860 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477608 2568 flags.go:64] FLAG: --oom-score-adj="-999" May 25 13:05:34.481860 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477611 2568 flags.go:64] FLAG: --pod-cidr="" May 25 13:05:34.481860 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477614 2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 25 13:05:34.482420 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477619 2568 flags.go:64] FLAG: --pod-manifest-path="" May 25 13:05:34.482420 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477622 2568 flags.go:64] FLAG: --pod-max-pids="-1" May 25 13:05:34.482420 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477625 2568 flags.go:64] FLAG: --pods-per-core="0" May 25 13:05:34.482420 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477628 2568 flags.go:64] FLAG: --port="10250" May 25 13:05:34.482420 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477631 2568 flags.go:64] FLAG: --protect-kernel-defaults="false" May 25 13:05:34.482420 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477634 2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01a26cd38679c8e13" May 25 13:05:34.482420 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477637 2568 flags.go:64] FLAG: --qos-reserved="" May 25 13:05:34.482420 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477640 2568 flags.go:64] FLAG: --read-only-port="10255" May 25 13:05:34.482420 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477643 2568 flags.go:64] FLAG: --register-node="true" May 25 13:05:34.482420 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477646 2568 flags.go:64] FLAG: --register-schedulable="true" May 25 13:05:34.482420 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477649 2568 flags.go:64] FLAG: --register-with-taints="" May 25 13:05:34.482420 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477653 2568 flags.go:64] FLAG: --registry-burst="10" May 25 13:05:34.482420 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477655 2568 flags.go:64] FLAG: --registry-qps="5" May 25 13:05:34.482420 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477658 2568 flags.go:64] FLAG: --reserved-cpus="" May 25 13:05:34.482420 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477661 2568 flags.go:64] FLAG: --reserved-memory="" May 25 13:05:34.482420 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477665 2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 25 13:05:34.482420 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477668 2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 25 13:05:34.482420 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477670 2568 flags.go:64] FLAG: --rotate-certificates="false" May 25 13:05:34.482420 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477673 2568 flags.go:64] FLAG: --rotate-server-certificates="false" May 25 13:05:34.482420 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477676 2568 flags.go:64] FLAG: --runonce="false" May 25 13:05:34.482420 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477679 2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 25 13:05:34.482420 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477682 2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 25 13:05:34.482420 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477685 2568 flags.go:64] FLAG: --seccomp-default="false" May 25 13:05:34.482420 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477689 2568 flags.go:64] FLAG: --serialize-image-pulls="true" May 25 13:05:34.482420 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477691 2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 25 13:05:34.482420 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477695 2568 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 25 13:05:34.483057 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477698 2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 25 13:05:34.483057 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477701 2568 flags.go:64] FLAG: --storage-driver-password="root" May 25 13:05:34.483057 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477704 2568 flags.go:64] FLAG: --storage-driver-secure="false" May 25 13:05:34.483057 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477707 2568 flags.go:64] FLAG: --storage-driver-table="stats" May 25 13:05:34.483057 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477710 2568 flags.go:64] FLAG: --storage-driver-user="root" May 25 13:05:34.483057 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477712 2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 25 13:05:34.483057 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477715 2568 flags.go:64] FLAG: --sync-frequency="1m0s" May 25 13:05:34.483057 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477718 2568 flags.go:64] FLAG: --system-cgroups="" May 25 13:05:34.483057 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477721 2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 25 13:05:34.483057 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477727 2568 flags.go:64] FLAG: --system-reserved-cgroup="" May 25 13:05:34.483057 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477730 2568 flags.go:64] FLAG: --tls-cert-file="" May 25 13:05:34.483057 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477733 2568 flags.go:64] FLAG: --tls-cipher-suites="[]" May 25 13:05:34.483057 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477736 2568 flags.go:64] FLAG: --tls-min-version="" May 25 13:05:34.483057 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477739 2568 flags.go:64] FLAG: --tls-private-key-file="" May 25 13:05:34.483057 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477742 2568 flags.go:64] FLAG: --topology-manager-policy="none" May 25 13:05:34.483057 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477745 2568 flags.go:64] FLAG: --topology-manager-policy-options="" May 25 13:05:34.483057 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477748 2568 flags.go:64] FLAG: --topology-manager-scope="container" May 25 13:05:34.483057 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477751 2568 flags.go:64] FLAG: --v="2" May 25 13:05:34.483057 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477755 2568 flags.go:64] FLAG: --version="false" May 25 13:05:34.483057 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477759 2568 flags.go:64] FLAG: --vmodule="" May 25 13:05:34.483057 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477763 2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 25 13:05:34.483057 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.477766 2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 25 13:05:34.483057 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.477869 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 25 13:05:34.483057 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.477874 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 25 13:05:34.483057 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.477877 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 25 13:05:34.483845 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.477880 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 25 13:05:34.483845 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.477883 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 25 13:05:34.483845 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.477886 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 25 13:05:34.483845 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.477893 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 25 13:05:34.483845 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.477895 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 25 13:05:34.483845 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.477898 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 25 13:05:34.483845 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.477901 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 25 13:05:34.483845 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.477903 2568 feature_gate.go:328] unrecognized feature gate: DualReplica May 25 13:05:34.483845 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.477906 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 25 13:05:34.483845 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.477910 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 25 13:05:34.483845 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.477914 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 25 13:05:34.483845 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.477917 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 25 13:05:34.483845 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.477920 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 25 13:05:34.483845 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.477923 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 25 13:05:34.483845 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.477925 2568 feature_gate.go:328] unrecognized feature gate: NewOLM May 25 13:05:34.483845 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.477928 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 25 13:05:34.483845 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.477931 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 25 13:05:34.483845 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.477934 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 25 13:05:34.483845 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.477936 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 25 13:05:34.483845 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.477939 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 25 13:05:34.484721 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.477942 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 25 13:05:34.484721 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.477945 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 25 13:05:34.484721 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.477947 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 25 13:05:34.484721 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.477950 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 25 13:05:34.484721 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.477953 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 25 13:05:34.484721 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.477956 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 25 13:05:34.484721 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.477958 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 25 13:05:34.484721 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.477961 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 25 13:05:34.484721 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.477964 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 25 13:05:34.484721 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.477966 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 25 13:05:34.484721 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.477969 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 25 13:05:34.484721 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.477971 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 25 13:05:34.484721 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.477974 2568 feature_gate.go:328] unrecognized feature gate: Example2 May 25 13:05:34.484721 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.477977 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 25 13:05:34.484721 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.477980 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages May 25 13:05:34.484721 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.477984 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 25 13:05:34.484721 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.477986 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 25 13:05:34.484721 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.477989 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 25 13:05:34.484721 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.477991 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 25 13:05:34.484721 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.477994 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 25 13:05:34.485579 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.477996 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 25 13:05:34.485579 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.477999 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 25 13:05:34.485579 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.478002 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 25 13:05:34.485579 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.478004 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 25 13:05:34.485579 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.478006 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 25 13:05:34.485579 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.478009 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 25 13:05:34.485579 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.478012 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 25 13:05:34.485579 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.478014 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 25 13:05:34.485579 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.478017 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 25 13:05:34.485579 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.478019 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 25 13:05:34.485579 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.478022 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 25 13:05:34.485579 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.478025 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 25 13:05:34.485579 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.478027 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 25 13:05:34.485579 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.478030 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 25 13:05:34.485579 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.478032 2568 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 25 13:05:34.485579 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.478036 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 25 13:05:34.485579 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.478039 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 25 13:05:34.485579 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.478042 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 25 13:05:34.485579 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.478044 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 25 13:05:34.485579 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.478047 2568 feature_gate.go:328] unrecognized feature gate: Example May 25 13:05:34.486483 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.478049 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 25 13:05:34.486483 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.478052 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 25 13:05:34.486483 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.478054 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 25 13:05:34.486483 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.478057 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 25 13:05:34.486483 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.478059 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 25 13:05:34.486483 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.478062 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores May 25 13:05:34.486483 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.478064 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 25 13:05:34.486483 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.478069 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 25 13:05:34.486483 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.478071 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 25 13:05:34.486483 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.478074 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 25 13:05:34.486483 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.478077 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 25 13:05:34.486483 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.478079 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 25 13:05:34.486483 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.478082 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 25 13:05:34.486483 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.478085 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 25 13:05:34.486483 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.478087 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability May 25 13:05:34.486483 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.478090 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 25 13:05:34.486483 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.478092 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 25 13:05:34.486483 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.478094 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 25 13:05:34.486483 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.478097 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 25 13:05:34.487004 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.478099 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 25 13:05:34.487004 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.478102 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 25 13:05:34.487004 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.478106 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 25 13:05:34.487004 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.478109 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 25 13:05:34.487004 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.478114 2568 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 25 13:05:34.487004 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.485384 2568 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 25 13:05:34.487004 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.485405 2568 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 25 13:05:34.487004 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485497 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 25 13:05:34.487004 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485505 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores May 25 13:05:34.487004 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485510 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 25 13:05:34.487004 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485515 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 25 13:05:34.487004 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485521 2568 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 25 13:05:34.487004 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485527 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 25 13:05:34.487004 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485532 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 25 13:05:34.487004 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485537 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 25 13:05:34.487449 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485541 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 25 13:05:34.487449 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485546 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 25 13:05:34.487449 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485550 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 25 13:05:34.487449 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485554 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 25 13:05:34.487449 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485558 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 25 13:05:34.487449 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485563 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 25 13:05:34.487449 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485567 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 25 13:05:34.487449 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485571 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 25 13:05:34.487449 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485575 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 25 13:05:34.487449 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485579 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 25 13:05:34.487449 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485582 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 25 13:05:34.487449 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485589 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 25 13:05:34.487449 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485595 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 25 13:05:34.487449 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485599 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 25 13:05:34.487449 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485604 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 25 13:05:34.487449 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485608 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 25 13:05:34.487449 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485612 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 25 13:05:34.487449 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485616 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 25 13:05:34.487449 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485621 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability May 25 13:05:34.487939 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485626 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 25 13:05:34.487939 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485630 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 25 13:05:34.487939 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485634 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 25 13:05:34.487939 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485639 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 25 13:05:34.487939 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485646 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 25 13:05:34.487939 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485652 2568 feature_gate.go:328] unrecognized feature gate: Example May 25 13:05:34.487939 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485656 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 25 13:05:34.487939 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485661 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 25 13:05:34.487939 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485665 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 25 13:05:34.487939 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485669 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 25 13:05:34.487939 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485674 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 25 13:05:34.487939 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485678 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 25 13:05:34.487939 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485682 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 25 13:05:34.487939 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485687 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 25 13:05:34.487939 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485694 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 25 13:05:34.487939 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485699 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 25 13:05:34.487939 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485703 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 25 13:05:34.487939 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485708 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 25 13:05:34.487939 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485712 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 25 13:05:34.487939 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485717 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 25 13:05:34.488700 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485721 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 25 13:05:34.488700 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485725 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 25 13:05:34.488700 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485729 2568 feature_gate.go:328] unrecognized feature gate: NewOLM May 25 13:05:34.488700 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485733 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 25 13:05:34.488700 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485738 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 25 13:05:34.488700 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485742 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 25 13:05:34.488700 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485746 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 25 13:05:34.488700 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485750 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 25 13:05:34.488700 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485755 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 25 13:05:34.488700 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485759 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 25 13:05:34.488700 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485763 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 25 13:05:34.488700 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485768 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 25 13:05:34.488700 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485772 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 25 13:05:34.488700 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485776 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages May 25 13:05:34.488700 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485780 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 25 13:05:34.488700 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485784 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 25 13:05:34.488700 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485789 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 25 13:05:34.488700 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485795 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 25 13:05:34.488700 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485800 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 25 13:05:34.488700 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485804 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 25 13:05:34.489591 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485809 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 25 13:05:34.489591 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485813 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 25 13:05:34.489591 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485817 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 25 13:05:34.489591 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485821 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 25 13:05:34.489591 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485826 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 25 13:05:34.489591 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485830 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 25 13:05:34.489591 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485834 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 25 13:05:34.489591 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485838 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 25 13:05:34.489591 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485843 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 25 13:05:34.489591 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485847 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 25 13:05:34.489591 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485851 2568 feature_gate.go:328] unrecognized feature gate: Example2 May 25 13:05:34.489591 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485855 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 25 13:05:34.489591 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485859 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 25 13:05:34.489591 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485863 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 25 13:05:34.489591 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485867 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 25 13:05:34.489591 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485871 2568 feature_gate.go:328] unrecognized feature gate: DualReplica May 25 13:05:34.489591 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485876 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 25 13:05:34.489591 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485880 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 25 13:05:34.489591 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.485884 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 25 13:05:34.490084 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.485891 2568 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 25 13:05:34.490084 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486052 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 25 13:05:34.490084 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486060 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 25 13:05:34.490084 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486065 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 25 13:05:34.490084 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486070 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 25 13:05:34.490084 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486076 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 25 13:05:34.490084 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486082 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 25 13:05:34.490084 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486087 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 25 13:05:34.490084 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486091 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 25 13:05:34.490084 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486095 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 25 13:05:34.490084 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486099 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 25 13:05:34.490084 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486104 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 25 13:05:34.490084 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486109 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability May 25 13:05:34.490084 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486113 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 25 13:05:34.490084 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486117 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 25 13:05:34.490647 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486122 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 25 13:05:34.490647 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486126 2568 feature_gate.go:328] unrecognized feature gate: Example May 25 13:05:34.490647 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486130 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 25 13:05:34.490647 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486135 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 25 13:05:34.490647 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486139 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 25 13:05:34.490647 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486143 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 25 13:05:34.490647 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486165 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 25 13:05:34.490647 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486170 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 25 13:05:34.490647 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486175 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 25 13:05:34.490647 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486178 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 25 13:05:34.490647 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486182 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 25 13:05:34.490647 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486186 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 25 13:05:34.490647 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486190 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 25 13:05:34.490647 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486194 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 25 13:05:34.490647 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486198 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 25 13:05:34.490647 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486202 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 25 13:05:34.490647 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486206 2568 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 25 13:05:34.490647 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486210 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 25 13:05:34.490647 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486215 2568 feature_gate.go:328] unrecognized feature gate: Example2 May 25 13:05:34.490647 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486219 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 25 13:05:34.491179 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486223 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 25 13:05:34.491179 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486229 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 25 13:05:34.491179 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486235 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 25 13:05:34.491179 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486240 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 25 13:05:34.491179 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486244 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 25 13:05:34.491179 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486248 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 25 13:05:34.491179 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486253 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 25 13:05:34.491179 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486258 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 25 13:05:34.491179 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486262 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 25 13:05:34.491179 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486267 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 25 13:05:34.491179 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486272 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 25 13:05:34.491179 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486276 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 25 13:05:34.491179 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486280 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 25 13:05:34.491179 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486284 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 25 13:05:34.491179 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486288 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 25 13:05:34.491179 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486292 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 25 13:05:34.491179 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486296 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 25 13:05:34.491179 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486300 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 25 13:05:34.491179 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486305 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 25 13:05:34.491688 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486309 2568 feature_gate.go:328] unrecognized feature gate: DualReplica May 25 13:05:34.491688 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486313 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 25 13:05:34.491688 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486317 2568 feature_gate.go:328] unrecognized feature gate: NewOLM May 25 13:05:34.491688 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486321 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 25 13:05:34.491688 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486325 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 25 13:05:34.491688 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486329 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 25 13:05:34.491688 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486333 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 25 13:05:34.491688 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486337 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 25 13:05:34.491688 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486341 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 25 13:05:34.491688 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486345 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 25 13:05:34.491688 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486349 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 25 13:05:34.491688 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486353 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 25 13:05:34.491688 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486358 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 25 13:05:34.491688 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486362 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 25 13:05:34.491688 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486366 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 25 13:05:34.491688 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486369 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages May 25 13:05:34.491688 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486374 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 25 13:05:34.491688 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486378 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 25 13:05:34.491688 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486382 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 25 13:05:34.491688 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486386 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 25 13:05:34.492186 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486390 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 25 13:05:34.492186 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486395 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 25 13:05:34.492186 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486398 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 25 13:05:34.492186 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486403 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 25 13:05:34.492186 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486407 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 25 13:05:34.492186 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486411 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 25 13:05:34.492186 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486415 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 25 13:05:34.492186 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486419 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 25 13:05:34.492186 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486424 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 25 13:05:34.492186 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486428 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 25 13:05:34.492186 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486432 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 25 13:05:34.492186 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486436 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 25 13:05:34.492186 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:34.486440 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores May 25 13:05:34.492186 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.486448 2568 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 25 13:05:34.492186 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.487357 2568 server.go:962] "Client rotation is on, will bootstrap in background" May 25 13:05:34.492590 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.490296 2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 25 13:05:34.492590 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.491453 2568 server.go:1019] "Starting client certificate rotation" May 25 13:05:34.492590 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.491559 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 25 13:05:34.492590 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.491596 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 25 13:05:34.518566 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.518543 2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 25 13:05:34.524618 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.524596 2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 25 13:05:34.545375 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.545356 2568 log.go:25] "Validated CRI v1 runtime API" May 25 13:05:34.552365 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.552339 2568 log.go:25] "Validated CRI v1 image API" May 25 13:05:34.553834 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.553809 2568 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 25 13:05:34.554966 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.554949 2568 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 25 13:05:34.558679 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.558661 2568 fs.go:135] Filesystem UUIDs: map[1c8f635b-2fa4-4da1-92e6-60e5d1a2bb58:/dev/nvme0n1p3 596678ae-8455-48cb-bbe0-3d5d327fc7b3:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] May 25 13:05:34.558734 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.558680 2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 25 13:05:34.562835 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.562728 2568 manager.go:217] Machine: {Timestamp:2026-05-25 13:05:34.56223986 +0000 UTC m=+0.459509483 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098838 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2179b09c081b44803ab134b350d636 SystemUUID:ec2179b0-9c08-1b44-803a-b134b350d636 BootID:026dd18f-080b-455a-bca2-4451794f3c69 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:02:15:cc:76:9d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:02:15:cc:76:9d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f6:1b:91:5c:99:6e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 25 13:05:34.563627 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.563616 2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 25 13:05:34.563711 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.563699 2568 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 25 13:05:34.565645 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.565619 2568 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 25 13:05:34.565783 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.565648 2568 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-184.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 25 13:05:34.565829 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.565792 2568 topology_manager.go:138] "Creating topology manager with none policy" May 25 13:05:34.565829 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.565802 2568 container_manager_linux.go:306] "Creating device plugin manager" May 25 13:05:34.565829 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.565809 2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 25 13:05:34.566697 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.566687 2568 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 25 13:05:34.567867 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.567857 2568 state_mem.go:36] "Initialized new in-memory state store" May 25 13:05:34.567986 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.567977 2568 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 25 13:05:34.571231 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.571221 2568 kubelet.go:491] "Attempting to sync node with API server" May 25 13:05:34.571270 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.571240 2568 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 25 13:05:34.571270 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.571256 2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 25 13:05:34.571270 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.571265 2568 kubelet.go:397] "Adding apiserver pod source" May 25 13:05:34.571344 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.571273 2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 25 13:05:34.572683 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.572671 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 25 13:05:34.572736 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.572691 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 25 13:05:34.577857 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.577834 2568 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 25 13:05:34.580398 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.580382 2568 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 25 13:05:34.582780 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.582766 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 25 13:05:34.582780 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.582784 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 25 13:05:34.582896 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.582790 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 25 13:05:34.582896 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.582796 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 25 13:05:34.582896 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.582805 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 25 13:05:34.582896 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.582811 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 25 13:05:34.582896 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.582817 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 25 13:05:34.582896 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.582822 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 25 13:05:34.582896 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.582829 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 25 13:05:34.582896 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.582836 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 25 13:05:34.582896 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.582844 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 25 13:05:34.582896 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.582850 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 25 13:05:34.583547 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:34.583528 2568 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 25 13:05:34.583547 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:34.583536 2568 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-184.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 25 13:05:34.585313 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.585302 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 25 13:05:34.585313 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.585314 2568 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 25 13:05:34.588190 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.588178 2568 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 25 13:05:34.588228 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.588216 2568 server.go:1295] "Started kubelet" May 25 13:05:34.588356 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.588309 2568 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 25 13:05:34.588396 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.588377 2568 server_v1.go:47] "podresources" method="list" useActivePods=true May 25 13:05:34.588520 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.588313 2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 25 13:05:34.588902 ip-10-0-132-184 systemd[1]: Started Kubernetes Kubelet. May 25 13:05:34.589842 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.589829 2568 server.go:317] "Adding debug handlers to kubelet server" May 25 13:05:34.591816 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.591800 2568 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 25 13:05:34.595074 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.595060 2568 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-184.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 25 13:05:34.596159 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:34.595103 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-184.ec2.internal.18b2d0c20accb958 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-184.ec2.internal,UID:ip-10-0-132-184.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-184.ec2.internal,},FirstTimestamp:2026-05-25 13:05:34.588189016 +0000 UTC m=+0.485458640,LastTimestamp:2026-05-25 13:05:34.588189016 +0000 UTC m=+0.485458640,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-184.ec2.internal,}" May 25 13:05:34.597275 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:34.597259 2568 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 25 13:05:34.598855 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.598840 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 25 13:05:34.599535 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.599508 2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 25 13:05:34.599968 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.599941 2568 volume_manager.go:295] "The desired_state_of_world populator starts" May 25 13:05:34.599968 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.599958 2568 volume_manager.go:297] "Starting Kubelet Volume Manager" May 25 13:05:34.600120 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.600103 2568 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 25 13:05:34.600201 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.600193 2568 reconstruct.go:97] "Volume reconstruction finished" May 25 13:05:34.600201 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.600201 2568 reconciler.go:26] "Reconciler: start to sync state" May 25 13:05:34.600610 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.600593 2568 factory.go:55] Registering systemd factory May 25 13:05:34.600690 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.600641 2568 factory.go:223] Registration of the systemd container factory successfully May 25 13:05:34.600747 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:34.600734 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-184.ec2.internal\" not found" May 25 13:05:34.600877 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.600858 2568 factory.go:153] Registering CRI-O factory May 25 13:05:34.600877 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.600878 2568 factory.go:223] Registration of the crio container factory successfully May 25 13:05:34.600993 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.600929 2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 25 13:05:34.600993 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.600950 2568 factory.go:103] Registering Raw factory May 25 13:05:34.600993 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.600968 2568 manager.go:1196] Started watching for new ooms in manager May 25 13:05:34.601343 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.601329 2568 manager.go:319] Starting recovery of all containers May 25 13:05:34.602277 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:34.602250 2568 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-184.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 25 13:05:34.602383 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:34.602363 2568 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 25 13:05:34.607323 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.607196 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-286jt" May 25 13:05:34.611747 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.611725 2568 manager.go:324] Recovery completed May 25 13:05:34.615036 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.615010 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-286jt" May 25 13:05:34.616401 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.616388 2568 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 25 13:05:34.618041 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.618028 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-184.ec2.internal" event="NodeHasSufficientMemory" May 25 13:05:34.618124 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.618052 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-184.ec2.internal" event="NodeHasNoDiskPressure" May 25 13:05:34.618124 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.618061 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-184.ec2.internal" event="NodeHasSufficientPID" May 25 13:05:34.618548 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.618529 2568 cpu_manager.go:222] "Starting CPU manager" policy="none" May 25 13:05:34.618548 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.618540 2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 25 13:05:34.618651 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.618554 2568 state_mem.go:36] "Initialized new in-memory state store" May 25 13:05:34.619735 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:34.619672 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-184.ec2.internal.18b2d0c20c9437f8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-184.ec2.internal,UID:ip-10-0-132-184.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-184.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-184.ec2.internal,},FirstTimestamp:2026-05-25 13:05:34.618040312 +0000 UTC m=+0.515309935,LastTimestamp:2026-05-25 13:05:34.618040312 +0000 UTC m=+0.515309935,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-184.ec2.internal,}" May 25 13:05:34.622326 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.622313 2568 policy_none.go:49] "None policy: Start" May 25 13:05:34.622379 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.622330 2568 memory_manager.go:186] "Starting memorymanager" policy="None" May 25 13:05:34.622379 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.622340 2568 state_mem.go:35] "Initializing new in-memory state store" May 25 13:05:34.659702 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.659686 2568 manager.go:341] "Starting Device Plugin manager" May 25 13:05:34.684797 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:34.659716 2568 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 25 13:05:34.684797 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.659726 2568 server.go:85] "Starting device plugin registration server" May 25 13:05:34.684797 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.659915 2568 eviction_manager.go:189] "Eviction manager: starting control loop" May 25 13:05:34.684797 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.659925 2568 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 25 13:05:34.684797 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.660002 2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 25 13:05:34.684797 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.660097 2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 25 13:05:34.684797 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.660106 2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 25 13:05:34.684797 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:34.660537 2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 25 13:05:34.684797 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:34.660568 2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-184.ec2.internal\" not found" May 25 13:05:34.735933 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.735876 2568 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 25 13:05:34.736937 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.736924 2568 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 25 13:05:34.737001 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.736944 2568 status_manager.go:230] "Starting to sync pod status with apiserver" May 25 13:05:34.737001 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.736965 2568 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 25 13:05:34.737001 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.736971 2568 kubelet.go:2451] "Starting kubelet main sync loop" May 25 13:05:34.737121 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:34.737009 2568 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 25 13:05:34.739255 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.739228 2568 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 25 13:05:34.761039 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.761022 2568 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 25 13:05:34.761760 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.761745 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-184.ec2.internal" event="NodeHasSufficientMemory" May 25 13:05:34.761828 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.761771 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-184.ec2.internal" event="NodeHasNoDiskPressure" May 25 13:05:34.761828 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.761781 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-184.ec2.internal" event="NodeHasSufficientPID" May 25 13:05:34.761828 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.761809 2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-184.ec2.internal" May 25 13:05:34.772575 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.772559 2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-184.ec2.internal" May 25 13:05:34.772618 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:34.772578 2568 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-184.ec2.internal\": node \"ip-10-0-132-184.ec2.internal\" not found" May 25 13:05:34.786632 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:34.786613 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-184.ec2.internal\" not found" May 25 13:05:34.837830 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.837802 2568 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-184.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-184.ec2.internal"] May 25 13:05:34.837892 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.837876 2568 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 25 13:05:34.838603 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.838589 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-184.ec2.internal" event="NodeHasSufficientMemory" May 25 13:05:34.838665 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.838616 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-184.ec2.internal" event="NodeHasNoDiskPressure" May 25 13:05:34.838665 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.838625 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-184.ec2.internal" event="NodeHasSufficientPID" May 25 13:05:34.839787 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.839775 2568 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 25 13:05:34.839948 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.839935 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-184.ec2.internal" May 25 13:05:34.840015 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.839965 2568 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 25 13:05:34.840416 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.840402 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-184.ec2.internal" event="NodeHasSufficientMemory" May 25 13:05:34.840416 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.840413 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-184.ec2.internal" event="NodeHasSufficientMemory" May 25 13:05:34.840508 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.840429 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-184.ec2.internal" event="NodeHasNoDiskPressure" May 25 13:05:34.840508 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.840432 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-184.ec2.internal" event="NodeHasNoDiskPressure" May 25 13:05:34.840508 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.840439 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-184.ec2.internal" event="NodeHasSufficientPID" May 25 13:05:34.840508 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.840447 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-184.ec2.internal" event="NodeHasSufficientPID" May 25 13:05:34.841557 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.841545 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-184.ec2.internal" May 25 13:05:34.841600 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.841569 2568 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 25 13:05:34.842114 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.842099 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-184.ec2.internal" event="NodeHasSufficientMemory" May 25 13:05:34.842192 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.842132 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-184.ec2.internal" event="NodeHasNoDiskPressure" May 25 13:05:34.842192 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.842144 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-184.ec2.internal" event="NodeHasSufficientPID" May 25 13:05:34.869775 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:34.869758 2568 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-184.ec2.internal\" not found" node="ip-10-0-132-184.ec2.internal" May 25 13:05:34.874394 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:34.874376 2568 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-184.ec2.internal\" not found" node="ip-10-0-132-184.ec2.internal" May 25 13:05:34.887010 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:34.886993 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-184.ec2.internal\" not found" May 25 13:05:34.901547 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.901529 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b3198ce26826a8440f825450cecbd5cd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-184.ec2.internal\" (UID: \"b3198ce26826a8440f825450cecbd5cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-184.ec2.internal" May 25 13:05:34.901596 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.901554 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b3198ce26826a8440f825450cecbd5cd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-184.ec2.internal\" (UID: \"b3198ce26826a8440f825450cecbd5cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-184.ec2.internal" May 25 13:05:34.901596 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:34.901572 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b64d94a369cdbb899d57a84157c70d6c-config\") pod \"kube-apiserver-proxy-ip-10-0-132-184.ec2.internal\" (UID: \"b64d94a369cdbb899d57a84157c70d6c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-184.ec2.internal" May 25 13:05:34.987109 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:34.987061 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-184.ec2.internal\" not found" May 25 13:05:35.002318 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:35.002300 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b3198ce26826a8440f825450cecbd5cd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-184.ec2.internal\" (UID: \"b3198ce26826a8440f825450cecbd5cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-184.ec2.internal" May 25 13:05:35.002375 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:35.002324 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b3198ce26826a8440f825450cecbd5cd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-184.ec2.internal\" (UID: \"b3198ce26826a8440f825450cecbd5cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-184.ec2.internal" May 25 13:05:35.002375 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:35.002341 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b64d94a369cdbb899d57a84157c70d6c-config\") pod \"kube-apiserver-proxy-ip-10-0-132-184.ec2.internal\" (UID: \"b64d94a369cdbb899d57a84157c70d6c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-184.ec2.internal" May 25 13:05:35.002440 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:35.002364 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b64d94a369cdbb899d57a84157c70d6c-config\") pod \"kube-apiserver-proxy-ip-10-0-132-184.ec2.internal\" (UID: \"b64d94a369cdbb899d57a84157c70d6c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-184.ec2.internal" May 25 13:05:35.002440 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:35.002400 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b3198ce26826a8440f825450cecbd5cd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-184.ec2.internal\" (UID: \"b3198ce26826a8440f825450cecbd5cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-184.ec2.internal" May 25 13:05:35.002440 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:35.002400 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b3198ce26826a8440f825450cecbd5cd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-184.ec2.internal\" (UID: \"b3198ce26826a8440f825450cecbd5cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-184.ec2.internal" May 25 13:05:35.087702 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:35.087672 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-184.ec2.internal\" not found" May 25 13:05:35.172134 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:35.172102 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-184.ec2.internal" May 25 13:05:35.176653 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:35.176639 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-184.ec2.internal" May 25 13:05:35.188184 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:35.188165 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-184.ec2.internal\" not found" May 25 13:05:35.288631 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:35.288564 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-184.ec2.internal\" not found" May 25 13:05:35.389068 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:35.389042 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-184.ec2.internal\" not found" May 25 13:05:35.416975 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:35.416960 2568 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 25 13:05:35.480598 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:35.480574 2568 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 25 13:05:35.489532 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:35.489509 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-184.ec2.internal\" not found" May 25 13:05:35.490600 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:35.490586 2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 25 13:05:35.490701 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:35.490686 2568 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 25 13:05:35.490756 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:35.490698 2568 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 25 13:05:35.490756 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:35.490734 2568 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 25 13:05:35.590513 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:35.590455 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-184.ec2.internal\" not found" May 25 13:05:35.599687 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:35.599661 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 25 13:05:35.614698 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:35.614665 2568 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 25 13:05:35.616730 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:35.616693 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-24 13:00:34 +0000 UTC" deadline="2028-03-02 00:23:27.483578088 +0000 UTC" May 25 13:05:35.616730 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:35.616719 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15515h17m51.866861667s" May 25 13:05:35.642602 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:35.642580 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gqj4b" May 25 13:05:35.657514 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:35.657493 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gqj4b" May 25 13:05:35.690584 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:35.690561 2568 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-184.ec2.internal\" not found" May 25 13:05:35.713661 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:35.713645 2568 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 25 13:05:35.743536 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:35.743514 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb64d94a369cdbb899d57a84157c70d6c.slice/crio-39f5fe73163f517a43e6bb1a3afb60269d19795c154735a52613797b1487eba3 WatchSource:0}: Error finding container 39f5fe73163f517a43e6bb1a3afb60269d19795c154735a52613797b1487eba3: Status 404 returned error can't find the container with id 39f5fe73163f517a43e6bb1a3afb60269d19795c154735a52613797b1487eba3 May 25 13:05:35.743750 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:35.743734 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3198ce26826a8440f825450cecbd5cd.slice/crio-25c5f6ec6c70ff21abff0145e448074cc516fab8f6093ad608ff023751d916d2 WatchSource:0}: Error finding container 25c5f6ec6c70ff21abff0145e448074cc516fab8f6093ad608ff023751d916d2: Status 404 returned error can't find the container with id 25c5f6ec6c70ff21abff0145e448074cc516fab8f6093ad608ff023751d916d2 May 25 13:05:35.749406 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:35.749389 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 25 13:05:35.800248 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:35.800228 2568 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-184.ec2.internal" May 25 13:05:35.813506 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:35.813483 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 25 13:05:35.814633 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:35.814621 2568 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-184.ec2.internal" May 25 13:05:35.825241 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:35.825229 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 25 13:05:36.572633 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.572604 2568 apiserver.go:52] "Watching apiserver" May 25 13:05:36.585432 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.585403 2568 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 25 13:05:36.585798 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.585771 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-pq8f8","kube-system/kube-apiserver-proxy-ip-10-0-132-184.ec2.internal","openshift-image-registry/node-ca-tp7gs","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-184.ec2.internal","openshift-multus/multus-additional-cni-plugins-c2tbd","openshift-network-operator/iptables-alerter-qlrrq","openshift-ovn-kubernetes/ovnkube-node-nvqnb","kube-system/konnectivity-agent-5qhzs","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvx82","openshift-cluster-node-tuning-operator/tuned-5qj29","openshift-multus/multus-jbqmt","openshift-multus/network-metrics-daemon-xc9t7"] May 25 13:05:36.588598 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.588576 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pq8f8" May 25 13:05:36.588714 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:36.588660 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pq8f8" podUID="760c3981-3ce6-4b45-af76-a545105d4b0b" May 25 13:05:36.590595 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.590572 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tp7gs" May 25 13:05:36.592621 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.592596 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-c2tbd" May 25 13:05:36.593224 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.593204 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 25 13:05:36.593317 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.593290 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 25 13:05:36.593428 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.593407 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 25 13:05:36.593490 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.593428 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qzxcp\"" May 25 13:05:36.594749 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.594715 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qlrrq" May 25 13:05:36.595205 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.595175 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 25 13:05:36.595291 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.595263 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4r4qt\"" May 25 13:05:36.595480 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.595461 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 25 13:05:36.595584 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.595563 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 25 13:05:36.595649 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.595637 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 25 13:05:36.596454 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.596438 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 25 13:05:36.596973 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.596941 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.598080 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.597877 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 25 13:05:36.598080 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.597949 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 25 13:05:36.598080 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.598002 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wrvjj\"" May 25 13:05:36.598473 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.598447 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 25 13:05:36.599373 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.599354 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 25 13:05:36.599457 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.599417 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 25 13:05:36.600036 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.600019 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 25 13:05:36.600282 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.600262 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 25 13:05:36.601263 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.601242 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5qhzs" May 25 13:05:36.601394 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.601377 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cn9g4\"" May 25 13:05:36.601478 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.601246 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 25 13:05:36.601700 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.601683 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 25 13:05:36.603471 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.603436 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvx82" May 25 13:05:36.604031 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.604007 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 25 13:05:36.604259 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.604241 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 25 13:05:36.604482 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.604457 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hht9v\"" May 25 13:05:36.605704 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.605685 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 25 13:05:36.605794 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.605716 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jbqmt" May 25 13:05:36.608230 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.606423 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 25 13:05:36.608230 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.606838 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-t6b65\"" May 25 13:05:36.608230 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.606860 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 25 13:05:36.609481 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.608927 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 25 13:05:36.609481 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.609087 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ggcdh\"" May 25 13:05:36.609481 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.609366 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gmm2\" (UniqueName: \"kubernetes.io/projected/7b18b763-4588-4019-b55a-649ec6f90d8b-kube-api-access-6gmm2\") pod \"iptables-alerter-qlrrq\" (UID: \"7b18b763-4588-4019-b55a-649ec6f90d8b\") " pod="openshift-network-operator/iptables-alerter-qlrrq" May 25 13:05:36.609481 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.609400 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eeec714b-fedf-44ce-810b-fca091e4364a-run-systemd\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.609481 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.609440 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eeec714b-fedf-44ce-810b-fca091e4364a-ovnkube-script-lib\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.609481 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.609466 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c3e2cf07-68ec-4934-a1a7-64d381a0f004-os-release\") pod \"multus-additional-cni-plugins-c2tbd\" (UID: \"c3e2cf07-68ec-4934-a1a7-64d381a0f004\") " pod="openshift-multus/multus-additional-cni-plugins-c2tbd" May 25 13:05:36.609773 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.609494 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eeec714b-fedf-44ce-810b-fca091e4364a-var-lib-openvswitch\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.609773 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.609522 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eeec714b-fedf-44ce-810b-fca091e4364a-ovn-node-metrics-cert\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.609773 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.609550 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5e42b4e6-e70c-466b-a6c9-9bb52af69a67-konnectivity-ca\") pod \"konnectivity-agent-5qhzs\" (UID: \"5e42b4e6-e70c-466b-a6c9-9bb52af69a67\") " pod="kube-system/konnectivity-agent-5qhzs" May 25 13:05:36.609912 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.609577 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b658050c-b570-4192-8cf6-d1f3a23fef5f-host\") pod \"node-ca-tp7gs\" (UID: \"b658050c-b570-4192-8cf6-d1f3a23fef5f\") " pod="openshift-image-registry/node-ca-tp7gs" May 25 13:05:36.610008 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.609987 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c3e2cf07-68ec-4934-a1a7-64d381a0f004-cnibin\") pod \"multus-additional-cni-plugins-c2tbd\" (UID: \"c3e2cf07-68ec-4934-a1a7-64d381a0f004\") " pod="openshift-multus/multus-additional-cni-plugins-c2tbd" May 25 13:05:36.610092 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.610064 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c3e2cf07-68ec-4934-a1a7-64d381a0f004-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c2tbd\" (UID: \"c3e2cf07-68ec-4934-a1a7-64d381a0f004\") " pod="openshift-multus/multus-additional-cni-plugins-c2tbd" May 25 13:05:36.610209 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.610102 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eeec714b-fedf-44ce-810b-fca091e4364a-log-socket\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.610272 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.610185 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wrjz\" (UniqueName: \"kubernetes.io/projected/eeec714b-fedf-44ce-810b-fca091e4364a-kube-api-access-8wrjz\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.610272 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.610245 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf9k4\" (UniqueName: \"kubernetes.io/projected/760c3981-3ce6-4b45-af76-a545105d4b0b-kube-api-access-rf9k4\") pod \"network-check-target-pq8f8\" (UID: \"760c3981-3ce6-4b45-af76-a545105d4b0b\") " pod="openshift-network-diagnostics/network-check-target-pq8f8" May 25 13:05:36.610650 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.610624 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c3e2cf07-68ec-4934-a1a7-64d381a0f004-system-cni-dir\") pod \"multus-additional-cni-plugins-c2tbd\" (UID: \"c3e2cf07-68ec-4934-a1a7-64d381a0f004\") " pod="openshift-multus/multus-additional-cni-plugins-c2tbd" May 25 13:05:36.610738 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.610670 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c3e2cf07-68ec-4934-a1a7-64d381a0f004-cni-binary-copy\") pod \"multus-additional-cni-plugins-c2tbd\" (UID: \"c3e2cf07-68ec-4934-a1a7-64d381a0f004\") " pod="openshift-multus/multus-additional-cni-plugins-c2tbd" May 25 13:05:36.610738 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.610696 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7b18b763-4588-4019-b55a-649ec6f90d8b-iptables-alerter-script\") pod \"iptables-alerter-qlrrq\" (UID: \"7b18b763-4588-4019-b55a-649ec6f90d8b\") " pod="openshift-network-operator/iptables-alerter-qlrrq" May 25 13:05:36.610738 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.610719 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eeec714b-fedf-44ce-810b-fca091e4364a-etc-openvswitch\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.610888 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.610749 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eeec714b-fedf-44ce-810b-fca091e4364a-run-ovn\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.610888 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.610776 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eeec714b-fedf-44ce-810b-fca091e4364a-env-overrides\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.610888 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.610800 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c3e2cf07-68ec-4934-a1a7-64d381a0f004-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c2tbd\" (UID: \"c3e2cf07-68ec-4934-a1a7-64d381a0f004\") " pod="openshift-multus/multus-additional-cni-plugins-c2tbd" May 25 13:05:36.610888 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.610844 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b18b763-4588-4019-b55a-649ec6f90d8b-host-slash\") pod \"iptables-alerter-qlrrq\" (UID: \"7b18b763-4588-4019-b55a-649ec6f90d8b\") " pod="openshift-network-operator/iptables-alerter-qlrrq" May 25 13:05:36.610888 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.610882 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eeec714b-fedf-44ce-810b-fca091e4364a-host-slash\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.611122 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.610905 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5e42b4e6-e70c-466b-a6c9-9bb52af69a67-agent-certs\") pod \"konnectivity-agent-5qhzs\" (UID: \"5e42b4e6-e70c-466b-a6c9-9bb52af69a67\") " pod="kube-system/konnectivity-agent-5qhzs" May 25 13:05:36.611122 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.610972 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b658050c-b570-4192-8cf6-d1f3a23fef5f-serviceca\") pod \"node-ca-tp7gs\" (UID: \"b658050c-b570-4192-8cf6-d1f3a23fef5f\") " pod="openshift-image-registry/node-ca-tp7gs" May 25 13:05:36.611122 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.611000 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c3e2cf07-68ec-4934-a1a7-64d381a0f004-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c2tbd\" (UID: \"c3e2cf07-68ec-4934-a1a7-64d381a0f004\") " pod="openshift-multus/multus-additional-cni-plugins-c2tbd" May 25 13:05:36.611122 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.611034 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d9v8\" (UniqueName: \"kubernetes.io/projected/c3e2cf07-68ec-4934-a1a7-64d381a0f004-kube-api-access-7d9v8\") pod \"multus-additional-cni-plugins-c2tbd\" (UID: \"c3e2cf07-68ec-4934-a1a7-64d381a0f004\") " pod="openshift-multus/multus-additional-cni-plugins-c2tbd" May 25 13:05:36.611122 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.611097 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eeec714b-fedf-44ce-810b-fca091e4364a-host-run-netns\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.611381 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.611180 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eeec714b-fedf-44ce-810b-fca091e4364a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.611381 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.611214 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfctx\" (UniqueName: \"kubernetes.io/projected/b658050c-b570-4192-8cf6-d1f3a23fef5f-kube-api-access-sfctx\") pod \"node-ca-tp7gs\" (UID: \"b658050c-b570-4192-8cf6-d1f3a23fef5f\") " pod="openshift-image-registry/node-ca-tp7gs" May 25 13:05:36.611381 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.611252 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eeec714b-fedf-44ce-810b-fca091e4364a-host-kubelet\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.611381 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.611281 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eeec714b-fedf-44ce-810b-fca091e4364a-systemd-units\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.611381 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.611315 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eeec714b-fedf-44ce-810b-fca091e4364a-node-log\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.611381 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.611338 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eeec714b-fedf-44ce-810b-fca091e4364a-host-run-ovn-kubernetes\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.611381 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.611362 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eeec714b-fedf-44ce-810b-fca091e4364a-run-openvswitch\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.611697 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.611385 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eeec714b-fedf-44ce-810b-fca091e4364a-host-cni-bin\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.611697 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.611407 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eeec714b-fedf-44ce-810b-fca091e4364a-host-cni-netd\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.611697 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.611429 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eeec714b-fedf-44ce-810b-fca091e4364a-ovnkube-config\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.611697 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.611524 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5qj29" May 25 13:05:36.611697 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.611531 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xc9t7" May 25 13:05:36.611938 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:36.611693 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xc9t7" podUID="6afe74f8-11aa-4aee-9629-498ec110bc21" May 25 13:05:36.614325 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.614262 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 25 13:05:36.614423 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.614310 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zwzfv\"" May 25 13:05:36.614487 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.614440 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 25 13:05:36.659007 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.658979 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-24 13:00:35 +0000 UTC" deadline="2028-01-08 00:21:21.441481546 +0000 UTC" May 25 13:05:36.659007 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.659004 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14219h15m44.782479652s" May 25 13:05:36.700998 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.700973 2568 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 25 13:05:36.711607 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.711578 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c3e2cf07-68ec-4934-a1a7-64d381a0f004-os-release\") pod \"multus-additional-cni-plugins-c2tbd\" (UID: \"c3e2cf07-68ec-4934-a1a7-64d381a0f004\") " pod="openshift-multus/multus-additional-cni-plugins-c2tbd" May 25 13:05:36.711607 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.711606 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eeec714b-fedf-44ce-810b-fca091e4364a-var-lib-openvswitch\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.711790 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.711665 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd-etc-systemd\") pod \"tuned-5qj29\" (UID: \"8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd\") " pod="openshift-cluster-node-tuning-operator/tuned-5qj29" May 25 13:05:36.711790 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.711682 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b658050c-b570-4192-8cf6-d1f3a23fef5f-host\") pod \"node-ca-tp7gs\" (UID: \"b658050c-b570-4192-8cf6-d1f3a23fef5f\") " pod="openshift-image-registry/node-ca-tp7gs" May 25 13:05:36.711790 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.711708 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c3e2cf07-68ec-4934-a1a7-64d381a0f004-cnibin\") pod \"multus-additional-cni-plugins-c2tbd\" (UID: \"c3e2cf07-68ec-4934-a1a7-64d381a0f004\") " pod="openshift-multus/multus-additional-cni-plugins-c2tbd" May 25 13:05:36.711790 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.711716 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c3e2cf07-68ec-4934-a1a7-64d381a0f004-os-release\") pod \"multus-additional-cni-plugins-c2tbd\" (UID: \"c3e2cf07-68ec-4934-a1a7-64d381a0f004\") " pod="openshift-multus/multus-additional-cni-plugins-c2tbd" May 25 13:05:36.711790 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.711763 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-host-var-lib-cni-multus\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.712052 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.711793 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-multus-conf-dir\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.712052 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.711796 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c3e2cf07-68ec-4934-a1a7-64d381a0f004-cnibin\") pod \"multus-additional-cni-plugins-c2tbd\" (UID: \"c3e2cf07-68ec-4934-a1a7-64d381a0f004\") " pod="openshift-multus/multus-additional-cni-plugins-c2tbd" May 25 13:05:36.712052 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.711811 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d38be102-bd9a-42f1-bcc5-63369972318d-etc-selinux\") pod \"aws-ebs-csi-driver-node-cvx82\" (UID: \"d38be102-bd9a-42f1-bcc5-63369972318d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvx82" May 25 13:05:36.712052 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.711867 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b658050c-b570-4192-8cf6-d1f3a23fef5f-host\") pod \"node-ca-tp7gs\" (UID: \"b658050c-b570-4192-8cf6-d1f3a23fef5f\") " pod="openshift-image-registry/node-ca-tp7gs" May 25 13:05:36.712052 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.711895 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eeec714b-fedf-44ce-810b-fca091e4364a-var-lib-openvswitch\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.712052 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.711929 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rf9k4\" (UniqueName: \"kubernetes.io/projected/760c3981-3ce6-4b45-af76-a545105d4b0b-kube-api-access-rf9k4\") pod \"network-check-target-pq8f8\" (UID: \"760c3981-3ce6-4b45-af76-a545105d4b0b\") " pod="openshift-network-diagnostics/network-check-target-pq8f8" May 25 13:05:36.712052 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.711956 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c3e2cf07-68ec-4934-a1a7-64d381a0f004-cni-binary-copy\") pod \"multus-additional-cni-plugins-c2tbd\" (UID: \"c3e2cf07-68ec-4934-a1a7-64d381a0f004\") " pod="openshift-multus/multus-additional-cni-plugins-c2tbd" May 25 13:05:36.712052 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.711984 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eeec714b-fedf-44ce-810b-fca091e4364a-etc-openvswitch\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.712052 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.712008 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eeec714b-fedf-44ce-810b-fca091e4364a-run-ovn\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.712501 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.712072 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eeec714b-fedf-44ce-810b-fca091e4364a-env-overrides\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.712501 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.712103 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-cni-binary-copy\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.712501 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.712131 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c3e2cf07-68ec-4934-a1a7-64d381a0f004-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c2tbd\" (UID: \"c3e2cf07-68ec-4934-a1a7-64d381a0f004\") " pod="openshift-multus/multus-additional-cni-plugins-c2tbd" May 25 13:05:36.712501 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.712172 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b18b763-4588-4019-b55a-649ec6f90d8b-host-slash\") pod \"iptables-alerter-qlrrq\" (UID: \"7b18b763-4588-4019-b55a-649ec6f90d8b\") " pod="openshift-network-operator/iptables-alerter-qlrrq" May 25 13:05:36.712501 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.712199 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5e42b4e6-e70c-466b-a6c9-9bb52af69a67-agent-certs\") pod \"konnectivity-agent-5qhzs\" (UID: \"5e42b4e6-e70c-466b-a6c9-9bb52af69a67\") " pod="kube-system/konnectivity-agent-5qhzs" May 25 13:05:36.712501 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.712240 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-multus-cni-dir\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.712501 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.712266 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-host-run-k8s-cni-cncf-io\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.712501 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.712349 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd-etc-sysctl-conf\") pod \"tuned-5qj29\" (UID: \"8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd\") " pod="openshift-cluster-node-tuning-operator/tuned-5qj29" May 25 13:05:36.712501 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.712397 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c3e2cf07-68ec-4934-a1a7-64d381a0f004-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c2tbd\" (UID: \"c3e2cf07-68ec-4934-a1a7-64d381a0f004\") " pod="openshift-multus/multus-additional-cni-plugins-c2tbd" May 25 13:05:36.712501 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.712434 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eeec714b-fedf-44ce-810b-fca091e4364a-run-ovn\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.712501 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.712443 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eeec714b-fedf-44ce-810b-fca091e4364a-host-run-netns\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.712501 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.712473 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-system-cni-dir\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.712501 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.712505 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sfctx\" (UniqueName: \"kubernetes.io/projected/b658050c-b570-4192-8cf6-d1f3a23fef5f-kube-api-access-sfctx\") pod \"node-ca-tp7gs\" (UID: \"b658050c-b570-4192-8cf6-d1f3a23fef5f\") " pod="openshift-image-registry/node-ca-tp7gs" May 25 13:05:36.713073 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.712529 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eeec714b-fedf-44ce-810b-fca091e4364a-systemd-units\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.713073 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.712785 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eeec714b-fedf-44ce-810b-fca091e4364a-systemd-units\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.713073 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.712790 2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 25 13:05:36.713073 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.712830 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-cnibin\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.713073 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.712858 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-os-release\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.713073 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.712923 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd-host\") pod \"tuned-5qj29\" (UID: \"8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd\") " pod="openshift-cluster-node-tuning-operator/tuned-5qj29" May 25 13:05:36.713073 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.712972 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d38be102-bd9a-42f1-bcc5-63369972318d-device-dir\") pod \"aws-ebs-csi-driver-node-cvx82\" (UID: \"d38be102-bd9a-42f1-bcc5-63369972318d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvx82" May 25 13:05:36.713073 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.713000 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxtk8\" (UniqueName: \"kubernetes.io/projected/d38be102-bd9a-42f1-bcc5-63369972318d-kube-api-access-lxtk8\") pod \"aws-ebs-csi-driver-node-cvx82\" (UID: \"d38be102-bd9a-42f1-bcc5-63369972318d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvx82" May 25 13:05:36.713073 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.713031 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c3e2cf07-68ec-4934-a1a7-64d381a0f004-cni-binary-copy\") pod \"multus-additional-cni-plugins-c2tbd\" (UID: \"c3e2cf07-68ec-4934-a1a7-64d381a0f004\") " pod="openshift-multus/multus-additional-cni-plugins-c2tbd" May 25 13:05:36.713073 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.713034 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eeec714b-fedf-44ce-810b-fca091e4364a-ovnkube-script-lib\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.713563 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.713081 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-host-run-netns\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.713563 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.712999 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eeec714b-fedf-44ce-810b-fca091e4364a-env-overrides\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.713563 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.713104 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eeec714b-fedf-44ce-810b-fca091e4364a-etc-openvswitch\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.713563 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.713165 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b18b763-4588-4019-b55a-649ec6f90d8b-host-slash\") pod \"iptables-alerter-qlrrq\" (UID: \"7b18b763-4588-4019-b55a-649ec6f90d8b\") " pod="openshift-network-operator/iptables-alerter-qlrrq" May 25 13:05:36.713563 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.713184 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-host-var-lib-cni-bin\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.713563 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.713212 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd-etc-sysctl-d\") pod \"tuned-5qj29\" (UID: \"8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd\") " pod="openshift-cluster-node-tuning-operator/tuned-5qj29" May 25 13:05:36.713563 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.713229 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eeec714b-fedf-44ce-810b-fca091e4364a-host-run-netns\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.713563 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.713238 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd-var-lib-kubelet\") pod \"tuned-5qj29\" (UID: \"8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd\") " pod="openshift-cluster-node-tuning-operator/tuned-5qj29" May 25 13:05:36.713563 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.713266 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eeec714b-fedf-44ce-810b-fca091e4364a-ovn-node-metrics-cert\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.713563 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.713294 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5e42b4e6-e70c-466b-a6c9-9bb52af69a67-konnectivity-ca\") pod \"konnectivity-agent-5qhzs\" (UID: \"5e42b4e6-e70c-466b-a6c9-9bb52af69a67\") " pod="kube-system/konnectivity-agent-5qhzs" May 25 13:05:36.713563 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.713333 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6afe74f8-11aa-4aee-9629-498ec110bc21-metrics-certs\") pod \"network-metrics-daemon-xc9t7\" (UID: \"6afe74f8-11aa-4aee-9629-498ec110bc21\") " pod="openshift-multus/network-metrics-daemon-xc9t7" May 25 13:05:36.713563 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.713353 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c3e2cf07-68ec-4934-a1a7-64d381a0f004-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c2tbd\" (UID: \"c3e2cf07-68ec-4934-a1a7-64d381a0f004\") " pod="openshift-multus/multus-additional-cni-plugins-c2tbd" May 25 13:05:36.713563 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.713362 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d38be102-bd9a-42f1-bcc5-63369972318d-sys-fs\") pod \"aws-ebs-csi-driver-node-cvx82\" (UID: \"d38be102-bd9a-42f1-bcc5-63369972318d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvx82" May 25 13:05:36.713563 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.713385 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c3e2cf07-68ec-4934-a1a7-64d381a0f004-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c2tbd\" (UID: \"c3e2cf07-68ec-4934-a1a7-64d381a0f004\") " pod="openshift-multus/multus-additional-cni-plugins-c2tbd" May 25 13:05:36.713563 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.713513 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eeec714b-fedf-44ce-810b-fca091e4364a-log-socket\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.713563 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.713538 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8wrjz\" (UniqueName: \"kubernetes.io/projected/eeec714b-fedf-44ce-810b-fca091e4364a-kube-api-access-8wrjz\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.713563 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.713567 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-host-var-lib-kubelet\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.714403 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.713592 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5vl4\" (UniqueName: \"kubernetes.io/projected/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-kube-api-access-z5vl4\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.714403 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.713616 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f446m\" (UniqueName: \"kubernetes.io/projected/8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd-kube-api-access-f446m\") pod \"tuned-5qj29\" (UID: \"8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd\") " pod="openshift-cluster-node-tuning-operator/tuned-5qj29" May 25 13:05:36.714403 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.713642 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-etc-kubernetes\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.714403 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.713703 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c3e2cf07-68ec-4934-a1a7-64d381a0f004-system-cni-dir\") pod \"multus-additional-cni-plugins-c2tbd\" (UID: \"c3e2cf07-68ec-4934-a1a7-64d381a0f004\") " pod="openshift-multus/multus-additional-cni-plugins-c2tbd" May 25 13:05:36.714403 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.713727 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7b18b763-4588-4019-b55a-649ec6f90d8b-iptables-alerter-script\") pod \"iptables-alerter-qlrrq\" (UID: \"7b18b763-4588-4019-b55a-649ec6f90d8b\") " pod="openshift-network-operator/iptables-alerter-qlrrq" May 25 13:05:36.714403 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.713753 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d38be102-bd9a-42f1-bcc5-63369972318d-socket-dir\") pod \"aws-ebs-csi-driver-node-cvx82\" (UID: \"d38be102-bd9a-42f1-bcc5-63369972318d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvx82" May 25 13:05:36.714403 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.713779 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eeec714b-fedf-44ce-810b-fca091e4364a-host-slash\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.714403 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.713801 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-hostroot\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.714403 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.713825 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd-etc-tuned\") pod \"tuned-5qj29\" (UID: \"8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd\") " pod="openshift-cluster-node-tuning-operator/tuned-5qj29" May 25 13:05:36.714403 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.713852 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b658050c-b570-4192-8cf6-d1f3a23fef5f-serviceca\") pod \"node-ca-tp7gs\" (UID: \"b658050c-b570-4192-8cf6-d1f3a23fef5f\") " pod="openshift-image-registry/node-ca-tp7gs" May 25 13:05:36.714403 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.713875 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7d9v8\" (UniqueName: \"kubernetes.io/projected/c3e2cf07-68ec-4934-a1a7-64d381a0f004-kube-api-access-7d9v8\") pod \"multus-additional-cni-plugins-c2tbd\" (UID: \"c3e2cf07-68ec-4934-a1a7-64d381a0f004\") " pod="openshift-multus/multus-additional-cni-plugins-c2tbd" May 25 13:05:36.714403 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.713976 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eeec714b-fedf-44ce-810b-fca091e4364a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.714403 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.714005 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-multus-socket-dir-parent\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.714403 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.714032 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d38be102-bd9a-42f1-bcc5-63369972318d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cvx82\" (UID: \"d38be102-bd9a-42f1-bcc5-63369972318d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvx82" May 25 13:05:36.714403 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.714069 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd-etc-sysconfig\") pod \"tuned-5qj29\" (UID: \"8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd\") " pod="openshift-cluster-node-tuning-operator/tuned-5qj29" May 25 13:05:36.714403 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.714093 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd-etc-kubernetes\") pod \"tuned-5qj29\" (UID: \"8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd\") " pod="openshift-cluster-node-tuning-operator/tuned-5qj29" May 25 13:05:36.715112 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.714120 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eeec714b-fedf-44ce-810b-fca091e4364a-host-kubelet\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.715112 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.714334 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c3e2cf07-68ec-4934-a1a7-64d381a0f004-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c2tbd\" (UID: \"c3e2cf07-68ec-4934-a1a7-64d381a0f004\") " pod="openshift-multus/multus-additional-cni-plugins-c2tbd" May 25 13:05:36.715112 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.714387 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eeec714b-fedf-44ce-810b-fca091e4364a-ovnkube-script-lib\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.715112 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.714444 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eeec714b-fedf-44ce-810b-fca091e4364a-host-slash\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.715112 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.714623 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5e42b4e6-e70c-466b-a6c9-9bb52af69a67-konnectivity-ca\") pod \"konnectivity-agent-5qhzs\" (UID: \"5e42b4e6-e70c-466b-a6c9-9bb52af69a67\") " pod="kube-system/konnectivity-agent-5qhzs" May 25 13:05:36.715112 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.714715 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eeec714b-fedf-44ce-810b-fca091e4364a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.715112 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.714766 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eeec714b-fedf-44ce-810b-fca091e4364a-log-socket\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.715112 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.714816 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7b18b763-4588-4019-b55a-649ec6f90d8b-iptables-alerter-script\") pod \"iptables-alerter-qlrrq\" (UID: \"7b18b763-4588-4019-b55a-649ec6f90d8b\") " pod="openshift-network-operator/iptables-alerter-qlrrq" May 25 13:05:36.715112 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.714879 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c3e2cf07-68ec-4934-a1a7-64d381a0f004-system-cni-dir\") pod \"multus-additional-cni-plugins-c2tbd\" (UID: \"c3e2cf07-68ec-4934-a1a7-64d381a0f004\") " pod="openshift-multus/multus-additional-cni-plugins-c2tbd" May 25 13:05:36.715112 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.714953 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b658050c-b570-4192-8cf6-d1f3a23fef5f-serviceca\") pod \"node-ca-tp7gs\" (UID: \"b658050c-b570-4192-8cf6-d1f3a23fef5f\") " pod="openshift-image-registry/node-ca-tp7gs" May 25 13:05:36.715112 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.715041 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eeec714b-fedf-44ce-810b-fca091e4364a-host-kubelet\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.715112 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.715042 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eeec714b-fedf-44ce-810b-fca091e4364a-node-log\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.715558 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.715121 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eeec714b-fedf-44ce-810b-fca091e4364a-node-log\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.715558 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.715165 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eeec714b-fedf-44ce-810b-fca091e4364a-host-run-ovn-kubernetes\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.715558 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.715195 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-host-run-multus-certs\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.715558 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.715226 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd-tmp\") pod \"tuned-5qj29\" (UID: \"8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd\") " pod="openshift-cluster-node-tuning-operator/tuned-5qj29" May 25 13:05:36.715558 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.715278 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eeec714b-fedf-44ce-810b-fca091e4364a-host-run-ovn-kubernetes\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.715558 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.715286 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eeec714b-fedf-44ce-810b-fca091e4364a-run-openvswitch\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.715558 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.715313 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eeec714b-fedf-44ce-810b-fca091e4364a-host-cni-bin\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.715558 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.715355 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eeec714b-fedf-44ce-810b-fca091e4364a-host-cni-netd\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.715558 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.715381 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eeec714b-fedf-44ce-810b-fca091e4364a-ovnkube-config\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.715558 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.715407 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bkvl\" (UniqueName: \"kubernetes.io/projected/6afe74f8-11aa-4aee-9629-498ec110bc21-kube-api-access-4bkvl\") pod \"network-metrics-daemon-xc9t7\" (UID: \"6afe74f8-11aa-4aee-9629-498ec110bc21\") " pod="openshift-multus/network-metrics-daemon-xc9t7" May 25 13:05:36.715558 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.715447 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d38be102-bd9a-42f1-bcc5-63369972318d-registration-dir\") pod \"aws-ebs-csi-driver-node-cvx82\" (UID: \"d38be102-bd9a-42f1-bcc5-63369972318d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvx82" May 25 13:05:36.715558 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.715488 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd-etc-modprobe-d\") pod \"tuned-5qj29\" (UID: \"8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd\") " pod="openshift-cluster-node-tuning-operator/tuned-5qj29" May 25 13:05:36.715558 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.715513 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd-run\") pod \"tuned-5qj29\" (UID: \"8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd\") " pod="openshift-cluster-node-tuning-operator/tuned-5qj29" May 25 13:05:36.715558 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.715540 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6gmm2\" (UniqueName: \"kubernetes.io/projected/7b18b763-4588-4019-b55a-649ec6f90d8b-kube-api-access-6gmm2\") pod \"iptables-alerter-qlrrq\" (UID: \"7b18b763-4588-4019-b55a-649ec6f90d8b\") " pod="openshift-network-operator/iptables-alerter-qlrrq" May 25 13:05:36.715558 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.715564 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eeec714b-fedf-44ce-810b-fca091e4364a-run-systemd\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.716195 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.715590 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-multus-daemon-config\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.716195 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.715616 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd-sys\") pod \"tuned-5qj29\" (UID: \"8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd\") " pod="openshift-cluster-node-tuning-operator/tuned-5qj29" May 25 13:05:36.716195 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.715636 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd-lib-modules\") pod \"tuned-5qj29\" (UID: \"8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd\") " pod="openshift-cluster-node-tuning-operator/tuned-5qj29" May 25 13:05:36.716195 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.715763 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eeec714b-fedf-44ce-810b-fca091e4364a-host-cni-bin\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.716195 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.715788 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eeec714b-fedf-44ce-810b-fca091e4364a-run-openvswitch\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.716195 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.715828 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eeec714b-fedf-44ce-810b-fca091e4364a-host-cni-netd\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.716195 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.715959 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eeec714b-fedf-44ce-810b-fca091e4364a-run-systemd\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.716423 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.716413 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eeec714b-fedf-44ce-810b-fca091e4364a-ovn-node-metrics-cert\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.716542 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.716503 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5e42b4e6-e70c-466b-a6c9-9bb52af69a67-agent-certs\") pod \"konnectivity-agent-5qhzs\" (UID: \"5e42b4e6-e70c-466b-a6c9-9bb52af69a67\") " pod="kube-system/konnectivity-agent-5qhzs" May 25 13:05:36.716953 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.716928 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c3e2cf07-68ec-4934-a1a7-64d381a0f004-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c2tbd\" (UID: \"c3e2cf07-68ec-4934-a1a7-64d381a0f004\") " pod="openshift-multus/multus-additional-cni-plugins-c2tbd" May 25 13:05:36.717029 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.716965 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eeec714b-fedf-44ce-810b-fca091e4364a-ovnkube-config\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.719834 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:36.717667 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 13:05:36.719834 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:36.717693 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 13:05:36.719834 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:36.717708 2568 projected.go:194] Error preparing data for projected volume kube-api-access-rf9k4 for pod openshift-network-diagnostics/network-check-target-pq8f8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 13:05:36.719834 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:36.717808 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/760c3981-3ce6-4b45-af76-a545105d4b0b-kube-api-access-rf9k4 podName:760c3981-3ce6-4b45-af76-a545105d4b0b nodeName:}" failed. No retries permitted until 2026-05-25 13:05:37.217769019 +0000 UTC m=+3.115038649 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rf9k4" (UniqueName: "kubernetes.io/projected/760c3981-3ce6-4b45-af76-a545105d4b0b-kube-api-access-rf9k4") pod "network-check-target-pq8f8" (UID: "760c3981-3ce6-4b45-af76-a545105d4b0b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 13:05:36.723065 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.723041 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d9v8\" (UniqueName: \"kubernetes.io/projected/c3e2cf07-68ec-4934-a1a7-64d381a0f004-kube-api-access-7d9v8\") pod \"multus-additional-cni-plugins-c2tbd\" (UID: \"c3e2cf07-68ec-4934-a1a7-64d381a0f004\") " pod="openshift-multus/multus-additional-cni-plugins-c2tbd" May 25 13:05:36.723330 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.723310 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wrjz\" (UniqueName: \"kubernetes.io/projected/eeec714b-fedf-44ce-810b-fca091e4364a-kube-api-access-8wrjz\") pod \"ovnkube-node-nvqnb\" (UID: \"eeec714b-fedf-44ce-810b-fca091e4364a\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.723376 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.723319 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfctx\" (UniqueName: \"kubernetes.io/projected/b658050c-b570-4192-8cf6-d1f3a23fef5f-kube-api-access-sfctx\") pod \"node-ca-tp7gs\" (UID: \"b658050c-b570-4192-8cf6-d1f3a23fef5f\") " pod="openshift-image-registry/node-ca-tp7gs" May 25 13:05:36.723492 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.723472 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gmm2\" (UniqueName: \"kubernetes.io/projected/7b18b763-4588-4019-b55a-649ec6f90d8b-kube-api-access-6gmm2\") pod \"iptables-alerter-qlrrq\" (UID: \"7b18b763-4588-4019-b55a-649ec6f90d8b\") " pod="openshift-network-operator/iptables-alerter-qlrrq" May 25 13:05:36.740735 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.740697 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-184.ec2.internal" event={"ID":"b64d94a369cdbb899d57a84157c70d6c","Type":"ContainerStarted","Data":"39f5fe73163f517a43e6bb1a3afb60269d19795c154735a52613797b1487eba3"} May 25 13:05:36.741855 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.741828 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-184.ec2.internal" event={"ID":"b3198ce26826a8440f825450cecbd5cd","Type":"ContainerStarted","Data":"25c5f6ec6c70ff21abff0145e448074cc516fab8f6093ad608ff023751d916d2"} May 25 13:05:36.795079 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.795050 2568 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 25 13:05:36.816400 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.816369 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-multus-socket-dir-parent\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.816400 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.816402 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d38be102-bd9a-42f1-bcc5-63369972318d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cvx82\" (UID: \"d38be102-bd9a-42f1-bcc5-63369972318d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvx82" May 25 13:05:36.816630 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.816419 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd-etc-sysconfig\") pod \"tuned-5qj29\" (UID: \"8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd\") " pod="openshift-cluster-node-tuning-operator/tuned-5qj29" May 25 13:05:36.816630 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.816436 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd-etc-kubernetes\") pod \"tuned-5qj29\" (UID: \"8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd\") " pod="openshift-cluster-node-tuning-operator/tuned-5qj29" May 25 13:05:36.816630 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.816485 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd-etc-kubernetes\") pod \"tuned-5qj29\" (UID: \"8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd\") " pod="openshift-cluster-node-tuning-operator/tuned-5qj29" May 25 13:05:36.816630 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.816510 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d38be102-bd9a-42f1-bcc5-63369972318d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cvx82\" (UID: \"d38be102-bd9a-42f1-bcc5-63369972318d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvx82" May 25 13:05:36.816630 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.816512 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-multus-socket-dir-parent\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.816630 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.816537 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-host-run-multus-certs\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.816630 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.816567 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd-tmp\") pod \"tuned-5qj29\" (UID: \"8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd\") " pod="openshift-cluster-node-tuning-operator/tuned-5qj29" May 25 13:05:36.816630 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.816577 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-host-run-multus-certs\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.816630 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.816510 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd-etc-sysconfig\") pod \"tuned-5qj29\" (UID: \"8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd\") " pod="openshift-cluster-node-tuning-operator/tuned-5qj29" May 25 13:05:36.816630 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.816590 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4bkvl\" (UniqueName: \"kubernetes.io/projected/6afe74f8-11aa-4aee-9629-498ec110bc21-kube-api-access-4bkvl\") pod \"network-metrics-daemon-xc9t7\" (UID: \"6afe74f8-11aa-4aee-9629-498ec110bc21\") " pod="openshift-multus/network-metrics-daemon-xc9t7" May 25 13:05:36.816630 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.816618 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d38be102-bd9a-42f1-bcc5-63369972318d-registration-dir\") pod \"aws-ebs-csi-driver-node-cvx82\" (UID: \"d38be102-bd9a-42f1-bcc5-63369972318d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvx82" May 25 13:05:36.817121 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.816668 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d38be102-bd9a-42f1-bcc5-63369972318d-registration-dir\") pod \"aws-ebs-csi-driver-node-cvx82\" (UID: \"d38be102-bd9a-42f1-bcc5-63369972318d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvx82" May 25 13:05:36.817121 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.816760 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd-etc-modprobe-d\") pod \"tuned-5qj29\" (UID: \"8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd\") " pod="openshift-cluster-node-tuning-operator/tuned-5qj29" May 25 13:05:36.817121 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.816787 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd-run\") pod \"tuned-5qj29\" (UID: \"8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd\") " pod="openshift-cluster-node-tuning-operator/tuned-5qj29" May 25 13:05:36.817121 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.816806 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-multus-daemon-config\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.817121 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.816820 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd-sys\") pod \"tuned-5qj29\" (UID: \"8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd\") " pod="openshift-cluster-node-tuning-operator/tuned-5qj29" May 25 13:05:36.817121 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.816852 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd-lib-modules\") pod \"tuned-5qj29\" (UID: \"8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd\") " pod="openshift-cluster-node-tuning-operator/tuned-5qj29" May 25 13:05:36.817121 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.816862 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd-run\") pod \"tuned-5qj29\" (UID: \"8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd\") " pod="openshift-cluster-node-tuning-operator/tuned-5qj29" May 25 13:05:36.817121 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.816879 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd-etc-systemd\") pod \"tuned-5qj29\" (UID: \"8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd\") " pod="openshift-cluster-node-tuning-operator/tuned-5qj29" May 25 13:05:36.817121 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.816886 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd-sys\") pod \"tuned-5qj29\" (UID: \"8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd\") " pod="openshift-cluster-node-tuning-operator/tuned-5qj29" May 25 13:05:36.817121 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.816903 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-host-var-lib-cni-multus\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.817121 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.816932 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd-etc-modprobe-d\") pod \"tuned-5qj29\" (UID: \"8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd\") " pod="openshift-cluster-node-tuning-operator/tuned-5qj29" May 25 13:05:36.817121 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.816936 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-multus-conf-dir\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.817121 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.816966 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd-lib-modules\") pod \"tuned-5qj29\" (UID: \"8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd\") " pod="openshift-cluster-node-tuning-operator/tuned-5qj29" May 25 13:05:36.817121 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.816967 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-multus-conf-dir\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.817121 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.816974 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-host-var-lib-cni-multus\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.817121 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.816984 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d38be102-bd9a-42f1-bcc5-63369972318d-etc-selinux\") pod \"aws-ebs-csi-driver-node-cvx82\" (UID: \"d38be102-bd9a-42f1-bcc5-63369972318d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvx82" May 25 13:05:36.817121 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.817035 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-cni-binary-copy\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.817121 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.816937 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd-etc-systemd\") pod \"tuned-5qj29\" (UID: \"8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd\") " pod="openshift-cluster-node-tuning-operator/tuned-5qj29" May 25 13:05:36.818037 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.817053 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d38be102-bd9a-42f1-bcc5-63369972318d-etc-selinux\") pod \"aws-ebs-csi-driver-node-cvx82\" (UID: \"d38be102-bd9a-42f1-bcc5-63369972318d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvx82" May 25 13:05:36.818037 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.817064 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-multus-cni-dir\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.818037 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.817088 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-host-run-k8s-cni-cncf-io\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.818037 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.817112 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd-etc-sysctl-conf\") pod \"tuned-5qj29\" (UID: \"8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd\") " pod="openshift-cluster-node-tuning-operator/tuned-5qj29" May 25 13:05:36.818037 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.817137 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-system-cni-dir\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.818037 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.817166 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-multus-cni-dir\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.818037 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.817174 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-host-run-k8s-cni-cncf-io\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.818037 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.817183 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-cnibin\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.818037 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.817210 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-os-release\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.818037 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.817231 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd-host\") pod \"tuned-5qj29\" (UID: \"8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd\") " pod="openshift-cluster-node-tuning-operator/tuned-5qj29" May 25 13:05:36.818037 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.817237 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-cnibin\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.818037 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.817242 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-system-cni-dir\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.818037 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.817254 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d38be102-bd9a-42f1-bcc5-63369972318d-device-dir\") pod \"aws-ebs-csi-driver-node-cvx82\" (UID: \"d38be102-bd9a-42f1-bcc5-63369972318d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvx82" May 25 13:05:36.818037 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.817287 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd-etc-sysctl-conf\") pod \"tuned-5qj29\" (UID: \"8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd\") " pod="openshift-cluster-node-tuning-operator/tuned-5qj29" May 25 13:05:36.818037 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.817297 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd-host\") pod \"tuned-5qj29\" (UID: \"8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd\") " pod="openshift-cluster-node-tuning-operator/tuned-5qj29" May 25 13:05:36.818037 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.817306 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d38be102-bd9a-42f1-bcc5-63369972318d-device-dir\") pod \"aws-ebs-csi-driver-node-cvx82\" (UID: \"d38be102-bd9a-42f1-bcc5-63369972318d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvx82" May 25 13:05:36.818037 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.817320 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lxtk8\" (UniqueName: \"kubernetes.io/projected/d38be102-bd9a-42f1-bcc5-63369972318d-kube-api-access-lxtk8\") pod \"aws-ebs-csi-driver-node-cvx82\" (UID: \"d38be102-bd9a-42f1-bcc5-63369972318d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvx82" May 25 13:05:36.818037 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.817298 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-os-release\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.818873 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.817363 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-multus-daemon-config\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.818873 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.817411 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-host-run-netns\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.818873 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.817430 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-host-var-lib-cni-bin\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.818873 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.817471 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-host-var-lib-cni-bin\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.818873 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.817470 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-host-run-netns\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.818873 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.817493 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd-etc-sysctl-d\") pod \"tuned-5qj29\" (UID: \"8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd\") " pod="openshift-cluster-node-tuning-operator/tuned-5qj29" May 25 13:05:36.818873 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.817514 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-cni-binary-copy\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.818873 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.817519 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd-var-lib-kubelet\") pod \"tuned-5qj29\" (UID: \"8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd\") " pod="openshift-cluster-node-tuning-operator/tuned-5qj29" May 25 13:05:36.818873 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.817555 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd-var-lib-kubelet\") pod \"tuned-5qj29\" (UID: \"8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd\") " pod="openshift-cluster-node-tuning-operator/tuned-5qj29" May 25 13:05:36.818873 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.817567 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6afe74f8-11aa-4aee-9629-498ec110bc21-metrics-certs\") pod \"network-metrics-daemon-xc9t7\" (UID: \"6afe74f8-11aa-4aee-9629-498ec110bc21\") " pod="openshift-multus/network-metrics-daemon-xc9t7" May 25 13:05:36.818873 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.817582 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd-etc-sysctl-d\") pod \"tuned-5qj29\" (UID: \"8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd\") " pod="openshift-cluster-node-tuning-operator/tuned-5qj29" May 25 13:05:36.818873 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.817590 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d38be102-bd9a-42f1-bcc5-63369972318d-sys-fs\") pod \"aws-ebs-csi-driver-node-cvx82\" (UID: \"d38be102-bd9a-42f1-bcc5-63369972318d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvx82" May 25 13:05:36.818873 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.817615 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-host-var-lib-kubelet\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.818873 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.817640 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d38be102-bd9a-42f1-bcc5-63369972318d-sys-fs\") pod \"aws-ebs-csi-driver-node-cvx82\" (UID: \"d38be102-bd9a-42f1-bcc5-63369972318d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvx82" May 25 13:05:36.818873 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.817640 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z5vl4\" (UniqueName: \"kubernetes.io/projected/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-kube-api-access-z5vl4\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.818873 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.817662 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-host-var-lib-kubelet\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.818873 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.817672 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f446m\" (UniqueName: \"kubernetes.io/projected/8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd-kube-api-access-f446m\") pod \"tuned-5qj29\" (UID: \"8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd\") " pod="openshift-cluster-node-tuning-operator/tuned-5qj29" May 25 13:05:36.818873 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:36.817643 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 13:05:36.819564 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.817710 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-etc-kubernetes\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.819564 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.817757 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d38be102-bd9a-42f1-bcc5-63369972318d-socket-dir\") pod \"aws-ebs-csi-driver-node-cvx82\" (UID: \"d38be102-bd9a-42f1-bcc5-63369972318d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvx82" May 25 13:05:36.819564 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:36.817766 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6afe74f8-11aa-4aee-9629-498ec110bc21-metrics-certs podName:6afe74f8-11aa-4aee-9629-498ec110bc21 nodeName:}" failed. No retries permitted until 2026-05-25 13:05:37.317747425 +0000 UTC m=+3.215017066 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6afe74f8-11aa-4aee-9629-498ec110bc21-metrics-certs") pod "network-metrics-daemon-xc9t7" (UID: "6afe74f8-11aa-4aee-9629-498ec110bc21") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 13:05:36.819564 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.817773 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-etc-kubernetes\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.819564 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.817794 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-hostroot\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.819564 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.817820 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd-etc-tuned\") pod \"tuned-5qj29\" (UID: \"8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd\") " pod="openshift-cluster-node-tuning-operator/tuned-5qj29" May 25 13:05:36.819564 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.817842 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-hostroot\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.819564 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.817852 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d38be102-bd9a-42f1-bcc5-63369972318d-socket-dir\") pod \"aws-ebs-csi-driver-node-cvx82\" (UID: \"d38be102-bd9a-42f1-bcc5-63369972318d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvx82" May 25 13:05:36.819564 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.819277 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd-tmp\") pod \"tuned-5qj29\" (UID: \"8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd\") " pod="openshift-cluster-node-tuning-operator/tuned-5qj29" May 25 13:05:36.819855 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.819628 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd-etc-tuned\") pod \"tuned-5qj29\" (UID: \"8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd\") " pod="openshift-cluster-node-tuning-operator/tuned-5qj29" May 25 13:05:36.826268 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.826205 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxtk8\" (UniqueName: \"kubernetes.io/projected/d38be102-bd9a-42f1-bcc5-63369972318d-kube-api-access-lxtk8\") pod \"aws-ebs-csi-driver-node-cvx82\" (UID: \"d38be102-bd9a-42f1-bcc5-63369972318d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvx82" May 25 13:05:36.826379 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.826320 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bkvl\" (UniqueName: \"kubernetes.io/projected/6afe74f8-11aa-4aee-9629-498ec110bc21-kube-api-access-4bkvl\") pod \"network-metrics-daemon-xc9t7\" (UID: \"6afe74f8-11aa-4aee-9629-498ec110bc21\") " pod="openshift-multus/network-metrics-daemon-xc9t7" May 25 13:05:36.826738 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.826715 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f446m\" (UniqueName: \"kubernetes.io/projected/8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd-kube-api-access-f446m\") pod \"tuned-5qj29\" (UID: \"8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd\") " pod="openshift-cluster-node-tuning-operator/tuned-5qj29" May 25 13:05:36.826854 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.826760 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5vl4\" (UniqueName: \"kubernetes.io/projected/4895aab1-2ec5-43d8-a7ac-536ae4e3e442-kube-api-access-z5vl4\") pod \"multus-jbqmt\" (UID: \"4895aab1-2ec5-43d8-a7ac-536ae4e3e442\") " pod="openshift-multus/multus-jbqmt" May 25 13:05:36.903838 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.903795 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tp7gs" May 25 13:05:36.912514 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.912494 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-c2tbd" May 25 13:05:36.922241 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.922222 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qlrrq" May 25 13:05:36.927846 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.927824 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:05:36.934457 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.934438 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5qhzs" May 25 13:05:36.940955 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.940932 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvx82" May 25 13:05:36.948549 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.948530 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jbqmt" May 25 13:05:36.953053 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:36.953036 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5qj29" May 25 13:05:37.219895 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:37.219817 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rf9k4\" (UniqueName: \"kubernetes.io/projected/760c3981-3ce6-4b45-af76-a545105d4b0b-kube-api-access-rf9k4\") pod \"network-check-target-pq8f8\" (UID: \"760c3981-3ce6-4b45-af76-a545105d4b0b\") " pod="openshift-network-diagnostics/network-check-target-pq8f8" May 25 13:05:37.220041 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:37.219990 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 13:05:37.220041 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:37.220016 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 13:05:37.220041 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:37.220029 2568 projected.go:194] Error preparing data for projected volume kube-api-access-rf9k4 for pod openshift-network-diagnostics/network-check-target-pq8f8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 13:05:37.220212 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:37.220096 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/760c3981-3ce6-4b45-af76-a545105d4b0b-kube-api-access-rf9k4 podName:760c3981-3ce6-4b45-af76-a545105d4b0b nodeName:}" failed. No retries permitted until 2026-05-25 13:05:38.220076565 +0000 UTC m=+4.117346195 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rf9k4" (UniqueName: "kubernetes.io/projected/760c3981-3ce6-4b45-af76-a545105d4b0b-kube-api-access-rf9k4") pod "network-check-target-pq8f8" (UID: "760c3981-3ce6-4b45-af76-a545105d4b0b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 13:05:37.320165 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:37.320120 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6afe74f8-11aa-4aee-9629-498ec110bc21-metrics-certs\") pod \"network-metrics-daemon-xc9t7\" (UID: \"6afe74f8-11aa-4aee-9629-498ec110bc21\") " pod="openshift-multus/network-metrics-daemon-xc9t7" May 25 13:05:37.320323 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:37.320265 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 13:05:37.320395 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:37.320331 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6afe74f8-11aa-4aee-9629-498ec110bc21-metrics-certs podName:6afe74f8-11aa-4aee-9629-498ec110bc21 nodeName:}" failed. No retries permitted until 2026-05-25 13:05:38.320312442 +0000 UTC m=+4.217582065 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6afe74f8-11aa-4aee-9629-498ec110bc21-metrics-certs") pod "network-metrics-daemon-xc9t7" (UID: "6afe74f8-11aa-4aee-9629-498ec110bc21") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 13:05:37.351416 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:37.351388 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e42b4e6_e70c_466b_a6c9_9bb52af69a67.slice/crio-783909df1cdd39b592a81431fb5a5f0ac944d17dcb291365bd71c0440e419163 WatchSource:0}: Error finding container 783909df1cdd39b592a81431fb5a5f0ac944d17dcb291365bd71c0440e419163: Status 404 returned error can't find the container with id 783909df1cdd39b592a81431fb5a5f0ac944d17dcb291365bd71c0440e419163 May 25 13:05:37.351966 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:37.351941 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4895aab1_2ec5_43d8_a7ac_536ae4e3e442.slice/crio-277356c974735ad5a3ee817f0adf9e6454318bc253c4f8138c9f0d452a6fdd3f WatchSource:0}: Error finding container 277356c974735ad5a3ee817f0adf9e6454318bc253c4f8138c9f0d452a6fdd3f: Status 404 returned error can't find the container with id 277356c974735ad5a3ee817f0adf9e6454318bc253c4f8138c9f0d452a6fdd3f May 25 13:05:37.353775 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:37.353748 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b18b763_4588_4019_b55a_649ec6f90d8b.slice/crio-7b626d208d714f7e005cf5de2d318912c876ad6c571629ab65bd4f06ea5de877 WatchSource:0}: Error finding container 7b626d208d714f7e005cf5de2d318912c876ad6c571629ab65bd4f06ea5de877: Status 404 returned error can't find the container with id 7b626d208d714f7e005cf5de2d318912c876ad6c571629ab65bd4f06ea5de877 May 25 13:05:37.354675 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:37.354655 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3e2cf07_68ec_4934_a1a7_64d381a0f004.slice/crio-1d0131502e127bf15912050733f9067a1e38d8d5d41f396a6af43d816810dde5 WatchSource:0}: Error finding container 1d0131502e127bf15912050733f9067a1e38d8d5d41f396a6af43d816810dde5: Status 404 returned error can't find the container with id 1d0131502e127bf15912050733f9067a1e38d8d5d41f396a6af43d816810dde5 May 25 13:05:37.355551 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:37.355517 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb658050c_b570_4192_8cf6_d1f3a23fef5f.slice/crio-bb449d20da9153ca0aa8358c3f45d5b5faf5222ac060b668e8cca4ad864caf5b WatchSource:0}: Error finding container bb449d20da9153ca0aa8358c3f45d5b5faf5222ac060b668e8cca4ad864caf5b: Status 404 returned error can't find the container with id bb449d20da9153ca0aa8358c3f45d5b5faf5222ac060b668e8cca4ad864caf5b May 25 13:05:37.357955 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:37.357931 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd38be102_bd9a_42f1_bcc5_63369972318d.slice/crio-11d975948ea741fb7b57a19129045df0189b3e565d4941d3157cf70116099f43 WatchSource:0}: Error finding container 11d975948ea741fb7b57a19129045df0189b3e565d4941d3157cf70116099f43: Status 404 returned error can't find the container with id 11d975948ea741fb7b57a19129045df0189b3e565d4941d3157cf70116099f43 May 25 13:05:37.359844 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:37.359586 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ea4404f_9c9f_48c0_8bfc_109fcd43b4dd.slice/crio-8f9a659b6266df17e934934d4f2bd28fdc2d5483fd0eab8607d3a3a3f3be65fb WatchSource:0}: Error finding container 8f9a659b6266df17e934934d4f2bd28fdc2d5483fd0eab8607d3a3a3f3be65fb: Status 404 returned error can't find the container with id 8f9a659b6266df17e934934d4f2bd28fdc2d5483fd0eab8607d3a3a3f3be65fb May 25 13:05:37.360478 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:37.360457 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeec714b_fedf_44ce_810b_fca091e4364a.slice/crio-45a5689d162436da43b7091f4a01968b01389b525946694c153d85e6942fc7df WatchSource:0}: Error finding container 45a5689d162436da43b7091f4a01968b01389b525946694c153d85e6942fc7df: Status 404 returned error can't find the container with id 45a5689d162436da43b7091f4a01968b01389b525946694c153d85e6942fc7df May 25 13:05:37.659870 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:37.659719 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-24 13:00:35 +0000 UTC" deadline="2027-12-12 05:35:46.622485484 +0000 UTC" May 25 13:05:37.659870 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:37.659869 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13576h30m8.962619526s" May 25 13:05:37.716102 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:37.715876 2568 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 25 13:05:37.738569 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:37.738091 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xc9t7" May 25 13:05:37.738569 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:37.738248 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xc9t7" podUID="6afe74f8-11aa-4aee-9629-498ec110bc21" May 25 13:05:37.742275 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:37.741910 2568 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 25 13:05:37.752216 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:37.752163 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" event={"ID":"eeec714b-fedf-44ce-810b-fca091e4364a","Type":"ContainerStarted","Data":"45a5689d162436da43b7091f4a01968b01389b525946694c153d85e6942fc7df"} May 25 13:05:37.756667 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:37.756617 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5qj29" event={"ID":"8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd","Type":"ContainerStarted","Data":"8f9a659b6266df17e934934d4f2bd28fdc2d5483fd0eab8607d3a3a3f3be65fb"} May 25 13:05:37.757976 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:37.757933 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jbqmt" event={"ID":"4895aab1-2ec5-43d8-a7ac-536ae4e3e442","Type":"ContainerStarted","Data":"277356c974735ad5a3ee817f0adf9e6454318bc253c4f8138c9f0d452a6fdd3f"} May 25 13:05:37.759557 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:37.759508 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5qhzs" event={"ID":"5e42b4e6-e70c-466b-a6c9-9bb52af69a67","Type":"ContainerStarted","Data":"783909df1cdd39b592a81431fb5a5f0ac944d17dcb291365bd71c0440e419163"} May 25 13:05:37.761392 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:37.761343 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvx82" event={"ID":"d38be102-bd9a-42f1-bcc5-63369972318d","Type":"ContainerStarted","Data":"11d975948ea741fb7b57a19129045df0189b3e565d4941d3157cf70116099f43"} May 25 13:05:37.764875 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:37.764828 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tp7gs" event={"ID":"b658050c-b570-4192-8cf6-d1f3a23fef5f","Type":"ContainerStarted","Data":"bb449d20da9153ca0aa8358c3f45d5b5faf5222ac060b668e8cca4ad864caf5b"} May 25 13:05:37.771954 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:37.771929 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c2tbd" event={"ID":"c3e2cf07-68ec-4934-a1a7-64d381a0f004","Type":"ContainerStarted","Data":"1d0131502e127bf15912050733f9067a1e38d8d5d41f396a6af43d816810dde5"} May 25 13:05:37.773463 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:37.773410 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qlrrq" event={"ID":"7b18b763-4588-4019-b55a-649ec6f90d8b","Type":"ContainerStarted","Data":"7b626d208d714f7e005cf5de2d318912c876ad6c571629ab65bd4f06ea5de877"} May 25 13:05:37.778388 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:37.778344 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-184.ec2.internal" event={"ID":"b64d94a369cdbb899d57a84157c70d6c","Type":"ContainerStarted","Data":"d795809c93b0aaf74537e38e6f7961d1672223b245d642c28b6cf9899deefbf8"} May 25 13:05:37.785335 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:37.784869 2568 generic.go:358] "Generic (PLEG): container finished" podID="b3198ce26826a8440f825450cecbd5cd" containerID="d46de8c350be40faa609946271d16e795d2b094f2dea0e6b3a2ebaf706684e34" exitCode=0 May 25 13:05:37.785335 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:37.784905 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-184.ec2.internal" event={"ID":"b3198ce26826a8440f825450cecbd5cd","Type":"ContainerDied","Data":"d46de8c350be40faa609946271d16e795d2b094f2dea0e6b3a2ebaf706684e34"} May 25 13:05:37.813856 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:37.813806 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-184.ec2.internal" podStartSLOduration=2.8137886979999998 podStartE2EDuration="2.813788698s" podCreationTimestamp="2026-05-25 13:05:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 13:05:37.797523218 +0000 UTC m=+3.694792852" watchObservedRunningTime="2026-05-25 13:05:37.813788698 +0000 UTC m=+3.711058334" May 25 13:05:38.231473 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:38.231382 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rf9k4\" (UniqueName: \"kubernetes.io/projected/760c3981-3ce6-4b45-af76-a545105d4b0b-kube-api-access-rf9k4\") pod \"network-check-target-pq8f8\" (UID: \"760c3981-3ce6-4b45-af76-a545105d4b0b\") " pod="openshift-network-diagnostics/network-check-target-pq8f8" May 25 13:05:38.231687 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:38.231652 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 13:05:38.231687 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:38.231674 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 13:05:38.231687 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:38.231688 2568 projected.go:194] Error preparing data for projected volume kube-api-access-rf9k4 for pod openshift-network-diagnostics/network-check-target-pq8f8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 13:05:38.231845 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:38.231747 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/760c3981-3ce6-4b45-af76-a545105d4b0b-kube-api-access-rf9k4 podName:760c3981-3ce6-4b45-af76-a545105d4b0b nodeName:}" failed. No retries permitted until 2026-05-25 13:05:40.231726891 +0000 UTC m=+6.128996506 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rf9k4" (UniqueName: "kubernetes.io/projected/760c3981-3ce6-4b45-af76-a545105d4b0b-kube-api-access-rf9k4") pod "network-check-target-pq8f8" (UID: "760c3981-3ce6-4b45-af76-a545105d4b0b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 13:05:38.332429 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:38.332389 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6afe74f8-11aa-4aee-9629-498ec110bc21-metrics-certs\") pod \"network-metrics-daemon-xc9t7\" (UID: \"6afe74f8-11aa-4aee-9629-498ec110bc21\") " pod="openshift-multus/network-metrics-daemon-xc9t7" May 25 13:05:38.332637 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:38.332585 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 13:05:38.332705 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:38.332648 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6afe74f8-11aa-4aee-9629-498ec110bc21-metrics-certs podName:6afe74f8-11aa-4aee-9629-498ec110bc21 nodeName:}" failed. No retries permitted until 2026-05-25 13:05:40.332629099 +0000 UTC m=+6.229898731 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6afe74f8-11aa-4aee-9629-498ec110bc21-metrics-certs") pod "network-metrics-daemon-xc9t7" (UID: "6afe74f8-11aa-4aee-9629-498ec110bc21") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 13:05:38.739566 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:38.739534 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pq8f8" May 25 13:05:38.740036 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:38.739660 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pq8f8" podUID="760c3981-3ce6-4b45-af76-a545105d4b0b" May 25 13:05:38.796362 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:38.796327 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-184.ec2.internal" event={"ID":"b3198ce26826a8440f825450cecbd5cd","Type":"ContainerStarted","Data":"bd1c4892fb566811a0f2b3e0b3703ea11d31adad56b0164d43846db5bf745442"} May 25 13:05:39.737128 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:39.737096 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xc9t7" May 25 13:05:39.737328 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:39.737250 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xc9t7" podUID="6afe74f8-11aa-4aee-9629-498ec110bc21" May 25 13:05:40.253527 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:40.253478 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rf9k4\" (UniqueName: \"kubernetes.io/projected/760c3981-3ce6-4b45-af76-a545105d4b0b-kube-api-access-rf9k4\") pod \"network-check-target-pq8f8\" (UID: \"760c3981-3ce6-4b45-af76-a545105d4b0b\") " pod="openshift-network-diagnostics/network-check-target-pq8f8" May 25 13:05:40.253974 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:40.253632 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 13:05:40.253974 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:40.253649 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 13:05:40.253974 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:40.253661 2568 projected.go:194] Error preparing data for projected volume kube-api-access-rf9k4 for pod openshift-network-diagnostics/network-check-target-pq8f8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 13:05:40.253974 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:40.253713 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/760c3981-3ce6-4b45-af76-a545105d4b0b-kube-api-access-rf9k4 podName:760c3981-3ce6-4b45-af76-a545105d4b0b nodeName:}" failed. No retries permitted until 2026-05-25 13:05:44.253695366 +0000 UTC m=+10.150964982 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rf9k4" (UniqueName: "kubernetes.io/projected/760c3981-3ce6-4b45-af76-a545105d4b0b-kube-api-access-rf9k4") pod "network-check-target-pq8f8" (UID: "760c3981-3ce6-4b45-af76-a545105d4b0b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 13:05:40.354815 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:40.354778 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6afe74f8-11aa-4aee-9629-498ec110bc21-metrics-certs\") pod \"network-metrics-daemon-xc9t7\" (UID: \"6afe74f8-11aa-4aee-9629-498ec110bc21\") " pod="openshift-multus/network-metrics-daemon-xc9t7" May 25 13:05:40.354988 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:40.354924 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 13:05:40.355042 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:40.354980 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6afe74f8-11aa-4aee-9629-498ec110bc21-metrics-certs podName:6afe74f8-11aa-4aee-9629-498ec110bc21 nodeName:}" failed. No retries permitted until 2026-05-25 13:05:44.354966336 +0000 UTC m=+10.252235951 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6afe74f8-11aa-4aee-9629-498ec110bc21-metrics-certs") pod "network-metrics-daemon-xc9t7" (UID: "6afe74f8-11aa-4aee-9629-498ec110bc21") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 13:05:40.737580 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:40.737326 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pq8f8" May 25 13:05:40.737580 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:40.737513 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pq8f8" podUID="760c3981-3ce6-4b45-af76-a545105d4b0b" May 25 13:05:41.354777 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:41.354614 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-184.ec2.internal" podStartSLOduration=6.354594886 podStartE2EDuration="6.354594886s" podCreationTimestamp="2026-05-25 13:05:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 13:05:38.810114566 +0000 UTC m=+4.707384199" watchObservedRunningTime="2026-05-25 13:05:41.354594886 +0000 UTC m=+7.251864520" May 25 13:05:41.355428 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:41.355306 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-trnzh"] May 25 13:05:41.359751 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:41.359729 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-trnzh" May 25 13:05:41.362973 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:41.362829 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9pmml\"" May 25 13:05:41.362973 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:41.362848 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 25 13:05:41.362973 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:41.362882 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 25 13:05:41.463503 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:41.463455 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dx7v5\" (UniqueName: \"kubernetes.io/projected/8a8b5d2e-cd8d-48a6-8ea3-ce157207fb61-kube-api-access-dx7v5\") pod \"node-resolver-trnzh\" (UID: \"8a8b5d2e-cd8d-48a6-8ea3-ce157207fb61\") " pod="openshift-dns/node-resolver-trnzh" May 25 13:05:41.463668 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:41.463521 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a8b5d2e-cd8d-48a6-8ea3-ce157207fb61-tmp-dir\") pod \"node-resolver-trnzh\" (UID: \"8a8b5d2e-cd8d-48a6-8ea3-ce157207fb61\") " pod="openshift-dns/node-resolver-trnzh" May 25 13:05:41.463668 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:41.463576 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8a8b5d2e-cd8d-48a6-8ea3-ce157207fb61-hosts-file\") pod \"node-resolver-trnzh\" (UID: \"8a8b5d2e-cd8d-48a6-8ea3-ce157207fb61\") " pod="openshift-dns/node-resolver-trnzh" May 25 13:05:41.564397 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:41.564347 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dx7v5\" (UniqueName: \"kubernetes.io/projected/8a8b5d2e-cd8d-48a6-8ea3-ce157207fb61-kube-api-access-dx7v5\") pod \"node-resolver-trnzh\" (UID: \"8a8b5d2e-cd8d-48a6-8ea3-ce157207fb61\") " pod="openshift-dns/node-resolver-trnzh" May 25 13:05:41.564753 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:41.564724 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a8b5d2e-cd8d-48a6-8ea3-ce157207fb61-tmp-dir\") pod \"node-resolver-trnzh\" (UID: \"8a8b5d2e-cd8d-48a6-8ea3-ce157207fb61\") " pod="openshift-dns/node-resolver-trnzh" May 25 13:05:41.564829 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:41.564811 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8a8b5d2e-cd8d-48a6-8ea3-ce157207fb61-hosts-file\") pod \"node-resolver-trnzh\" (UID: \"8a8b5d2e-cd8d-48a6-8ea3-ce157207fb61\") " pod="openshift-dns/node-resolver-trnzh" May 25 13:05:41.564910 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:41.564894 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8a8b5d2e-cd8d-48a6-8ea3-ce157207fb61-hosts-file\") pod \"node-resolver-trnzh\" (UID: \"8a8b5d2e-cd8d-48a6-8ea3-ce157207fb61\") " pod="openshift-dns/node-resolver-trnzh" May 25 13:05:41.565229 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:41.565210 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a8b5d2e-cd8d-48a6-8ea3-ce157207fb61-tmp-dir\") pod \"node-resolver-trnzh\" (UID: \"8a8b5d2e-cd8d-48a6-8ea3-ce157207fb61\") " pod="openshift-dns/node-resolver-trnzh" May 25 13:05:41.575050 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:41.575010 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dx7v5\" (UniqueName: \"kubernetes.io/projected/8a8b5d2e-cd8d-48a6-8ea3-ce157207fb61-kube-api-access-dx7v5\") pod \"node-resolver-trnzh\" (UID: \"8a8b5d2e-cd8d-48a6-8ea3-ce157207fb61\") " pod="openshift-dns/node-resolver-trnzh" May 25 13:05:41.672488 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:41.672328 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-trnzh" May 25 13:05:41.738193 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:41.737791 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xc9t7" May 25 13:05:41.738193 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:41.737933 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xc9t7" podUID="6afe74f8-11aa-4aee-9629-498ec110bc21" May 25 13:05:42.738098 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:42.738061 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pq8f8" May 25 13:05:42.738547 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:42.738222 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pq8f8" podUID="760c3981-3ce6-4b45-af76-a545105d4b0b" May 25 13:05:43.738242 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:43.738162 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xc9t7" May 25 13:05:43.738692 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:43.738295 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xc9t7" podUID="6afe74f8-11aa-4aee-9629-498ec110bc21" May 25 13:05:44.284456 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:44.284406 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rf9k4\" (UniqueName: \"kubernetes.io/projected/760c3981-3ce6-4b45-af76-a545105d4b0b-kube-api-access-rf9k4\") pod \"network-check-target-pq8f8\" (UID: \"760c3981-3ce6-4b45-af76-a545105d4b0b\") " pod="openshift-network-diagnostics/network-check-target-pq8f8" May 25 13:05:44.284622 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:44.284569 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 13:05:44.284622 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:44.284590 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 13:05:44.284622 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:44.284604 2568 projected.go:194] Error preparing data for projected volume kube-api-access-rf9k4 for pod openshift-network-diagnostics/network-check-target-pq8f8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 13:05:44.284727 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:44.284673 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/760c3981-3ce6-4b45-af76-a545105d4b0b-kube-api-access-rf9k4 podName:760c3981-3ce6-4b45-af76-a545105d4b0b nodeName:}" failed. No retries permitted until 2026-05-25 13:05:52.284652142 +0000 UTC m=+18.181921756 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rf9k4" (UniqueName: "kubernetes.io/projected/760c3981-3ce6-4b45-af76-a545105d4b0b-kube-api-access-rf9k4") pod "network-check-target-pq8f8" (UID: "760c3981-3ce6-4b45-af76-a545105d4b0b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 13:05:44.385790 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:44.385275 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6afe74f8-11aa-4aee-9629-498ec110bc21-metrics-certs\") pod \"network-metrics-daemon-xc9t7\" (UID: \"6afe74f8-11aa-4aee-9629-498ec110bc21\") " pod="openshift-multus/network-metrics-daemon-xc9t7" May 25 13:05:44.385790 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:44.385455 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 13:05:44.385790 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:44.385504 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6afe74f8-11aa-4aee-9629-498ec110bc21-metrics-certs podName:6afe74f8-11aa-4aee-9629-498ec110bc21 nodeName:}" failed. No retries permitted until 2026-05-25 13:05:52.385490625 +0000 UTC m=+18.282760235 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6afe74f8-11aa-4aee-9629-498ec110bc21-metrics-certs") pod "network-metrics-daemon-xc9t7" (UID: "6afe74f8-11aa-4aee-9629-498ec110bc21") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 13:05:44.738933 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:44.738401 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pq8f8" May 25 13:05:44.738933 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:44.738512 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pq8f8" podUID="760c3981-3ce6-4b45-af76-a545105d4b0b" May 25 13:05:45.737356 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:45.737318 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xc9t7" May 25 13:05:45.737536 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:45.737466 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xc9t7" podUID="6afe74f8-11aa-4aee-9629-498ec110bc21" May 25 13:05:46.737607 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:46.737571 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pq8f8" May 25 13:05:46.738028 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:46.737703 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pq8f8" podUID="760c3981-3ce6-4b45-af76-a545105d4b0b" May 25 13:05:47.175169 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:47.175070 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-45rjq"] May 25 13:05:47.194586 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:47.194563 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45rjq" May 25 13:05:47.194744 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:47.194658 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45rjq" podUID="22715e7e-5167-48b9-9c76-70114a0fe045" May 25 13:05:47.309875 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:47.309837 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/22715e7e-5167-48b9-9c76-70114a0fe045-kubelet-config\") pod \"global-pull-secret-syncer-45rjq\" (UID: \"22715e7e-5167-48b9-9c76-70114a0fe045\") " pod="kube-system/global-pull-secret-syncer-45rjq" May 25 13:05:47.310056 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:47.309941 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/22715e7e-5167-48b9-9c76-70114a0fe045-dbus\") pod \"global-pull-secret-syncer-45rjq\" (UID: \"22715e7e-5167-48b9-9c76-70114a0fe045\") " pod="kube-system/global-pull-secret-syncer-45rjq" May 25 13:05:47.310056 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:47.310041 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22715e7e-5167-48b9-9c76-70114a0fe045-original-pull-secret\") pod \"global-pull-secret-syncer-45rjq\" (UID: \"22715e7e-5167-48b9-9c76-70114a0fe045\") " pod="kube-system/global-pull-secret-syncer-45rjq" May 25 13:05:47.410907 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:47.410876 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/22715e7e-5167-48b9-9c76-70114a0fe045-dbus\") pod \"global-pull-secret-syncer-45rjq\" (UID: \"22715e7e-5167-48b9-9c76-70114a0fe045\") " pod="kube-system/global-pull-secret-syncer-45rjq" May 25 13:05:47.411069 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:47.410928 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22715e7e-5167-48b9-9c76-70114a0fe045-original-pull-secret\") pod \"global-pull-secret-syncer-45rjq\" (UID: \"22715e7e-5167-48b9-9c76-70114a0fe045\") " pod="kube-system/global-pull-secret-syncer-45rjq" May 25 13:05:47.411069 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:47.410981 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/22715e7e-5167-48b9-9c76-70114a0fe045-kubelet-config\") pod \"global-pull-secret-syncer-45rjq\" (UID: \"22715e7e-5167-48b9-9c76-70114a0fe045\") " pod="kube-system/global-pull-secret-syncer-45rjq" May 25 13:05:47.411210 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:47.411084 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/22715e7e-5167-48b9-9c76-70114a0fe045-kubelet-config\") pod \"global-pull-secret-syncer-45rjq\" (UID: \"22715e7e-5167-48b9-9c76-70114a0fe045\") " pod="kube-system/global-pull-secret-syncer-45rjq" May 25 13:05:47.411210 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:47.411110 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/22715e7e-5167-48b9-9c76-70114a0fe045-dbus\") pod \"global-pull-secret-syncer-45rjq\" (UID: \"22715e7e-5167-48b9-9c76-70114a0fe045\") " pod="kube-system/global-pull-secret-syncer-45rjq" May 25 13:05:47.411210 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:47.411139 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 25 13:05:47.411311 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:47.411227 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22715e7e-5167-48b9-9c76-70114a0fe045-original-pull-secret podName:22715e7e-5167-48b9-9c76-70114a0fe045 nodeName:}" failed. No retries permitted until 2026-05-25 13:05:47.911208509 +0000 UTC m=+13.808478129 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22715e7e-5167-48b9-9c76-70114a0fe045-original-pull-secret") pod "global-pull-secret-syncer-45rjq" (UID: "22715e7e-5167-48b9-9c76-70114a0fe045") : object "kube-system"/"original-pull-secret" not registered May 25 13:05:47.737608 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:47.737572 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xc9t7" May 25 13:05:47.737758 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:47.737685 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xc9t7" podUID="6afe74f8-11aa-4aee-9629-498ec110bc21" May 25 13:05:47.913963 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:47.913929 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22715e7e-5167-48b9-9c76-70114a0fe045-original-pull-secret\") pod \"global-pull-secret-syncer-45rjq\" (UID: \"22715e7e-5167-48b9-9c76-70114a0fe045\") " pod="kube-system/global-pull-secret-syncer-45rjq" May 25 13:05:47.914132 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:47.914117 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 25 13:05:47.914207 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:47.914196 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22715e7e-5167-48b9-9c76-70114a0fe045-original-pull-secret podName:22715e7e-5167-48b9-9c76-70114a0fe045 nodeName:}" failed. No retries permitted until 2026-05-25 13:05:48.914175238 +0000 UTC m=+14.811444868 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22715e7e-5167-48b9-9c76-70114a0fe045-original-pull-secret") pod "global-pull-secret-syncer-45rjq" (UID: "22715e7e-5167-48b9-9c76-70114a0fe045") : object "kube-system"/"original-pull-secret" not registered May 25 13:05:48.737481 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:48.737446 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45rjq" May 25 13:05:48.737721 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:48.737511 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pq8f8" May 25 13:05:48.737721 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:48.737604 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pq8f8" podUID="760c3981-3ce6-4b45-af76-a545105d4b0b" May 25 13:05:48.737721 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:48.737683 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45rjq" podUID="22715e7e-5167-48b9-9c76-70114a0fe045" May 25 13:05:48.922739 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:48.922708 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22715e7e-5167-48b9-9c76-70114a0fe045-original-pull-secret\") pod \"global-pull-secret-syncer-45rjq\" (UID: \"22715e7e-5167-48b9-9c76-70114a0fe045\") " pod="kube-system/global-pull-secret-syncer-45rjq" May 25 13:05:48.922917 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:48.922860 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 25 13:05:48.922978 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:48.922928 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22715e7e-5167-48b9-9c76-70114a0fe045-original-pull-secret podName:22715e7e-5167-48b9-9c76-70114a0fe045 nodeName:}" failed. No retries permitted until 2026-05-25 13:05:50.92291105 +0000 UTC m=+16.820180678 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22715e7e-5167-48b9-9c76-70114a0fe045-original-pull-secret") pod "global-pull-secret-syncer-45rjq" (UID: "22715e7e-5167-48b9-9c76-70114a0fe045") : object "kube-system"/"original-pull-secret" not registered May 25 13:05:49.737787 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:49.737757 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xc9t7" May 25 13:05:49.738252 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:49.737861 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xc9t7" podUID="6afe74f8-11aa-4aee-9629-498ec110bc21" May 25 13:05:50.737505 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:50.737468 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pq8f8" May 25 13:05:50.737701 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:50.737468 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45rjq" May 25 13:05:50.737701 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:50.737600 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pq8f8" podUID="760c3981-3ce6-4b45-af76-a545105d4b0b" May 25 13:05:50.737701 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:50.737645 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45rjq" podUID="22715e7e-5167-48b9-9c76-70114a0fe045" May 25 13:05:50.940318 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:50.940285 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22715e7e-5167-48b9-9c76-70114a0fe045-original-pull-secret\") pod \"global-pull-secret-syncer-45rjq\" (UID: \"22715e7e-5167-48b9-9c76-70114a0fe045\") " pod="kube-system/global-pull-secret-syncer-45rjq" May 25 13:05:50.940749 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:50.940427 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 25 13:05:50.940749 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:50.940509 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22715e7e-5167-48b9-9c76-70114a0fe045-original-pull-secret podName:22715e7e-5167-48b9-9c76-70114a0fe045 nodeName:}" failed. No retries permitted until 2026-05-25 13:05:54.940495552 +0000 UTC m=+20.837765166 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22715e7e-5167-48b9-9c76-70114a0fe045-original-pull-secret") pod "global-pull-secret-syncer-45rjq" (UID: "22715e7e-5167-48b9-9c76-70114a0fe045") : object "kube-system"/"original-pull-secret" not registered May 25 13:05:51.738164 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:51.738120 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xc9t7" May 25 13:05:51.738382 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:51.738269 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xc9t7" podUID="6afe74f8-11aa-4aee-9629-498ec110bc21" May 25 13:05:52.350395 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:52.350352 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rf9k4\" (UniqueName: \"kubernetes.io/projected/760c3981-3ce6-4b45-af76-a545105d4b0b-kube-api-access-rf9k4\") pod \"network-check-target-pq8f8\" (UID: \"760c3981-3ce6-4b45-af76-a545105d4b0b\") " pod="openshift-network-diagnostics/network-check-target-pq8f8" May 25 13:05:52.350857 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:52.350526 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 13:05:52.350857 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:52.350541 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 13:05:52.350857 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:52.350551 2568 projected.go:194] Error preparing data for projected volume kube-api-access-rf9k4 for pod openshift-network-diagnostics/network-check-target-pq8f8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 13:05:52.350857 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:52.350603 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/760c3981-3ce6-4b45-af76-a545105d4b0b-kube-api-access-rf9k4 podName:760c3981-3ce6-4b45-af76-a545105d4b0b nodeName:}" failed. No retries permitted until 2026-05-25 13:06:08.350585684 +0000 UTC m=+34.247855301 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rf9k4" (UniqueName: "kubernetes.io/projected/760c3981-3ce6-4b45-af76-a545105d4b0b-kube-api-access-rf9k4") pod "network-check-target-pq8f8" (UID: "760c3981-3ce6-4b45-af76-a545105d4b0b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 13:05:52.451185 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:52.451133 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6afe74f8-11aa-4aee-9629-498ec110bc21-metrics-certs\") pod \"network-metrics-daemon-xc9t7\" (UID: \"6afe74f8-11aa-4aee-9629-498ec110bc21\") " pod="openshift-multus/network-metrics-daemon-xc9t7" May 25 13:05:52.451353 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:52.451276 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 13:05:52.451353 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:52.451346 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6afe74f8-11aa-4aee-9629-498ec110bc21-metrics-certs podName:6afe74f8-11aa-4aee-9629-498ec110bc21 nodeName:}" failed. No retries permitted until 2026-05-25 13:06:08.451330802 +0000 UTC m=+34.348600412 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6afe74f8-11aa-4aee-9629-498ec110bc21-metrics-certs") pod "network-metrics-daemon-xc9t7" (UID: "6afe74f8-11aa-4aee-9629-498ec110bc21") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 13:05:52.737162 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:52.737110 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45rjq" May 25 13:05:52.737325 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:52.737114 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pq8f8" May 25 13:05:52.737325 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:52.737257 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45rjq" podUID="22715e7e-5167-48b9-9c76-70114a0fe045" May 25 13:05:52.737325 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:52.737308 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pq8f8" podUID="760c3981-3ce6-4b45-af76-a545105d4b0b" May 25 13:05:53.737888 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:53.737849 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xc9t7" May 25 13:05:53.738367 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:53.737993 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xc9t7" podUID="6afe74f8-11aa-4aee-9629-498ec110bc21" May 25 13:05:54.738779 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:54.738745 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45rjq" May 25 13:05:54.739267 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:54.738851 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45rjq" podUID="22715e7e-5167-48b9-9c76-70114a0fe045" May 25 13:05:54.739267 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:54.738931 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pq8f8" May 25 13:05:54.739267 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:54.739041 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pq8f8" podUID="760c3981-3ce6-4b45-af76-a545105d4b0b" May 25 13:05:54.868776 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:05:54.868725 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a8b5d2e_cd8d_48a6_8ea3_ce157207fb61.slice/crio-d953f070850c0d700c16f8b33f438a9b415305b247b0c913c3e78d3110769fea WatchSource:0}: Error finding container d953f070850c0d700c16f8b33f438a9b415305b247b0c913c3e78d3110769fea: Status 404 returned error can't find the container with id d953f070850c0d700c16f8b33f438a9b415305b247b0c913c3e78d3110769fea May 25 13:05:54.971292 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:54.971262 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22715e7e-5167-48b9-9c76-70114a0fe045-original-pull-secret\") pod \"global-pull-secret-syncer-45rjq\" (UID: \"22715e7e-5167-48b9-9c76-70114a0fe045\") " pod="kube-system/global-pull-secret-syncer-45rjq" May 25 13:05:54.971457 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:54.971436 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 25 13:05:54.971539 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:54.971518 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22715e7e-5167-48b9-9c76-70114a0fe045-original-pull-secret podName:22715e7e-5167-48b9-9c76-70114a0fe045 nodeName:}" failed. No retries permitted until 2026-05-25 13:06:02.971497184 +0000 UTC m=+28.868766802 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22715e7e-5167-48b9-9c76-70114a0fe045-original-pull-secret") pod "global-pull-secret-syncer-45rjq" (UID: "22715e7e-5167-48b9-9c76-70114a0fe045") : object "kube-system"/"original-pull-secret" not registered May 25 13:05:55.737717 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:55.737372 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xc9t7" May 25 13:05:55.737879 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:55.737847 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xc9t7" podUID="6afe74f8-11aa-4aee-9629-498ec110bc21" May 25 13:05:55.822462 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:55.822382 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jbqmt" event={"ID":"4895aab1-2ec5-43d8-a7ac-536ae4e3e442","Type":"ContainerStarted","Data":"6b42c33eb0fad06bbae0b745e21d17f60a675e01af7033fae7d7d63c863b555a"} May 25 13:05:55.823952 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:55.823914 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5qhzs" event={"ID":"5e42b4e6-e70c-466b-a6c9-9bb52af69a67","Type":"ContainerStarted","Data":"c9a160c6535c4fa2b8ef01b59ad8de451b93c2ef232037546e0a0421a954b42e"} May 25 13:05:55.825316 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:55.825292 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvx82" event={"ID":"d38be102-bd9a-42f1-bcc5-63369972318d","Type":"ContainerStarted","Data":"141e40be3e27059a1c545fe2d89e54dfd9508eb5a1f2bb8410b0e787102af916"} May 25 13:05:55.826837 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:55.826811 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tp7gs" event={"ID":"b658050c-b570-4192-8cf6-d1f3a23fef5f","Type":"ContainerStarted","Data":"6702c39819c3b74c5b5db28bd8d10f6e2a4bee5d506ae4bd47d524c1db8ef4eb"} May 25 13:05:55.828352 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:55.828326 2568 generic.go:358] "Generic (PLEG): container finished" podID="c3e2cf07-68ec-4934-a1a7-64d381a0f004" containerID="89cb03365d943f7a5b18438a0dfaa62da078173a6c228f05ba61f40c83275bc1" exitCode=0 May 25 13:05:55.828440 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:55.828402 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c2tbd" event={"ID":"c3e2cf07-68ec-4934-a1a7-64d381a0f004","Type":"ContainerDied","Data":"89cb03365d943f7a5b18438a0dfaa62da078173a6c228f05ba61f40c83275bc1"} May 25 13:05:55.829776 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:55.829754 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-trnzh" event={"ID":"8a8b5d2e-cd8d-48a6-8ea3-ce157207fb61","Type":"ContainerStarted","Data":"b1342d6cd437485518c9a927a5fb5a32b5560698d8a2b609862ad1849a95ccb3"} May 25 13:05:55.829856 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:55.829785 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-trnzh" event={"ID":"8a8b5d2e-cd8d-48a6-8ea3-ce157207fb61","Type":"ContainerStarted","Data":"d953f070850c0d700c16f8b33f438a9b415305b247b0c913c3e78d3110769fea"} May 25 13:05:55.832647 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:55.832625 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvqnb_eeec714b-fedf-44ce-810b-fca091e4364a/ovn-acl-logging/0.log" May 25 13:05:55.832980 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:55.832958 2568 generic.go:358] "Generic (PLEG): container finished" podID="eeec714b-fedf-44ce-810b-fca091e4364a" containerID="dec02fab8ee2d17802ea4af22c6941c6fb288cf83724f27c811677b32acc17af" exitCode=1 May 25 13:05:55.833066 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:55.833020 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" event={"ID":"eeec714b-fedf-44ce-810b-fca091e4364a","Type":"ContainerStarted","Data":"bbd8a08c3ca83ec3b65837d3ca8ceda8cac92e9c0368ff4d179d385a7ece6950"} May 25 13:05:55.833066 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:55.833039 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" event={"ID":"eeec714b-fedf-44ce-810b-fca091e4364a","Type":"ContainerStarted","Data":"a66fa9c64b92beb31b4a52f7ee4e8faa96b2343d588681f06eeaad6b7d5b366d"} May 25 13:05:55.833066 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:55.833053 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" event={"ID":"eeec714b-fedf-44ce-810b-fca091e4364a","Type":"ContainerStarted","Data":"050eaffcd8c3cf1e88d2ee7308e3d4cc6a36023170642567f4ebca40a7d0d35e"} May 25 13:05:55.833224 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:55.833065 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" event={"ID":"eeec714b-fedf-44ce-810b-fca091e4364a","Type":"ContainerStarted","Data":"b0f982e24611d310f9925e328693afa24e4d112bb297f921299f2a0fc3786e05"} May 25 13:05:55.833224 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:55.833080 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" event={"ID":"eeec714b-fedf-44ce-810b-fca091e4364a","Type":"ContainerDied","Data":"dec02fab8ee2d17802ea4af22c6941c6fb288cf83724f27c811677b32acc17af"} May 25 13:05:55.833224 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:55.833092 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" event={"ID":"eeec714b-fedf-44ce-810b-fca091e4364a","Type":"ContainerStarted","Data":"6ca8144cee6a3ab30763a14106271dfe335348f02d96694be82d5242deb3fdce"} May 25 13:05:55.834507 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:55.834484 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5qj29" event={"ID":"8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd","Type":"ContainerStarted","Data":"a75cf510aab309444c1e95e50301f763c9c10ecc2ddf8737fb828c64b983fdc9"} May 25 13:05:55.837721 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:55.837688 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-jbqmt" podStartSLOduration=3.837399397 podStartE2EDuration="21.837678535s" podCreationTimestamp="2026-05-25 13:05:34 +0000 UTC" firstStartedPulling="2026-05-25 13:05:37.35371788 +0000 UTC m=+3.250987490" lastFinishedPulling="2026-05-25 13:05:55.353997001 +0000 UTC m=+21.251266628" observedRunningTime="2026-05-25 13:05:55.837480971 +0000 UTC m=+21.734750603" watchObservedRunningTime="2026-05-25 13:05:55.837678535 +0000 UTC m=+21.734948166" May 25 13:05:55.850675 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:55.850643 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-trnzh" podStartSLOduration=14.850630931 podStartE2EDuration="14.850630931s" podCreationTimestamp="2026-05-25 13:05:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 13:05:55.850225556 +0000 UTC m=+21.747495199" watchObservedRunningTime="2026-05-25 13:05:55.850630931 +0000 UTC m=+21.747900567" May 25 13:05:55.881404 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:55.881367 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5qj29" podStartSLOduration=3.386997616 podStartE2EDuration="20.881356138s" podCreationTimestamp="2026-05-25 13:05:35 +0000 UTC" firstStartedPulling="2026-05-25 13:05:37.361195195 +0000 UTC m=+3.258464813" lastFinishedPulling="2026-05-25 13:05:54.855553711 +0000 UTC m=+20.752823335" observedRunningTime="2026-05-25 13:05:55.881042519 +0000 UTC m=+21.778312152" watchObservedRunningTime="2026-05-25 13:05:55.881356138 +0000 UTC m=+21.778625795" May 25 13:05:55.892402 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:55.892370 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-tp7gs" podStartSLOduration=4.395159057 podStartE2EDuration="21.892362164s" podCreationTimestamp="2026-05-25 13:05:34 +0000 UTC" firstStartedPulling="2026-05-25 13:05:37.358137959 +0000 UTC m=+3.255407575" lastFinishedPulling="2026-05-25 13:05:54.855341059 +0000 UTC m=+20.752610682" observedRunningTime="2026-05-25 13:05:55.892103984 +0000 UTC m=+21.789373615" watchObservedRunningTime="2026-05-25 13:05:55.892362164 +0000 UTC m=+21.789631795" May 25 13:05:55.905797 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:55.905767 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5qhzs" podStartSLOduration=4.403017059 podStartE2EDuration="21.905758559s" podCreationTimestamp="2026-05-25 13:05:34 +0000 UTC" firstStartedPulling="2026-05-25 13:05:37.352924749 +0000 UTC m=+3.250194358" lastFinishedPulling="2026-05-25 13:05:54.855666235 +0000 UTC m=+20.752935858" observedRunningTime="2026-05-25 13:05:55.905124406 +0000 UTC m=+21.802394038" watchObservedRunningTime="2026-05-25 13:05:55.905758559 +0000 UTC m=+21.803028235" May 25 13:05:56.350447 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:56.350408 2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 25 13:05:56.672822 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:56.672515 2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-25T13:05:56.3504297Z","UUID":"bb002a4c-2e64-4495-a8e4-55797c7f5ed0","Handler":null,"Name":"","Endpoint":""} May 25 13:05:56.674997 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:56.674971 2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 25 13:05:56.675146 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:56.675006 2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 25 13:05:56.737352 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:56.737321 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45rjq" May 25 13:05:56.737532 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:56.737364 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pq8f8" May 25 13:05:56.737532 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:56.737451 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45rjq" podUID="22715e7e-5167-48b9-9c76-70114a0fe045" May 25 13:05:56.737730 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:56.737542 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pq8f8" podUID="760c3981-3ce6-4b45-af76-a545105d4b0b" May 25 13:05:56.839033 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:56.838981 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvx82" event={"ID":"d38be102-bd9a-42f1-bcc5-63369972318d","Type":"ContainerStarted","Data":"805e1f3807b308120e41c6360c80d3ce6a432fd2951cdd9092521594555a7553"} May 25 13:05:56.840944 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:56.840884 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qlrrq" event={"ID":"7b18b763-4588-4019-b55a-649ec6f90d8b","Type":"ContainerStarted","Data":"a7f9639ea3813616eb1568d7c26e640c4619ab371ec2f3a62d865b544ca29bde"} May 25 13:05:56.865295 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:56.865256 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qlrrq" podStartSLOduration=5.353896542 podStartE2EDuration="22.865243316s" podCreationTimestamp="2026-05-25 13:05:34 +0000 UTC" firstStartedPulling="2026-05-25 13:05:37.356182359 +0000 UTC m=+3.253451985" lastFinishedPulling="2026-05-25 13:05:54.867529135 +0000 UTC m=+20.764798759" observedRunningTime="2026-05-25 13:05:56.865097079 +0000 UTC m=+22.762366712" watchObservedRunningTime="2026-05-25 13:05:56.865243316 +0000 UTC m=+22.762512947" May 25 13:05:57.158544 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:57.158444 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5qhzs" May 25 13:05:57.159038 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:57.159010 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5qhzs" May 25 13:05:57.737423 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:57.737396 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xc9t7" May 25 13:05:57.737604 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:57.737542 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xc9t7" podUID="6afe74f8-11aa-4aee-9629-498ec110bc21" May 25 13:05:57.846164 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:57.846120 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvqnb_eeec714b-fedf-44ce-810b-fca091e4364a/ovn-acl-logging/0.log" May 25 13:05:57.846660 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:57.846503 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" event={"ID":"eeec714b-fedf-44ce-810b-fca091e4364a","Type":"ContainerStarted","Data":"ecef730e8d795112c5e5c2d58a928b5bc79900cdba80a8c84022711f57a9b8dd"} May 25 13:05:57.848572 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:57.848546 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvx82" event={"ID":"d38be102-bd9a-42f1-bcc5-63369972318d","Type":"ContainerStarted","Data":"bbd2c5c0bfcc98055b6aa5dfcf07ed85c5298374775beb712e7a59dd6d44dc4f"} May 25 13:05:57.848966 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:57.848942 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5qhzs" May 25 13:05:57.849268 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:57.849245 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5qhzs" May 25 13:05:57.886614 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:57.886555 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvx82" podStartSLOduration=4.155136358 podStartE2EDuration="23.886537184s" podCreationTimestamp="2026-05-25 13:05:34 +0000 UTC" firstStartedPulling="2026-05-25 13:05:37.360300306 +0000 UTC m=+3.257569932" lastFinishedPulling="2026-05-25 13:05:57.091701135 +0000 UTC m=+22.988970758" observedRunningTime="2026-05-25 13:05:57.869339742 +0000 UTC m=+23.766609374" watchObservedRunningTime="2026-05-25 13:05:57.886537184 +0000 UTC m=+23.783806818" May 25 13:05:58.737531 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:58.737489 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45rjq" May 25 13:05:58.737714 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:58.737532 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pq8f8" May 25 13:05:58.737714 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:58.737616 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45rjq" podUID="22715e7e-5167-48b9-9c76-70114a0fe045" May 25 13:05:58.737827 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:58.737730 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pq8f8" podUID="760c3981-3ce6-4b45-af76-a545105d4b0b" May 25 13:05:59.737800 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:05:59.737768 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xc9t7" May 25 13:05:59.738317 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:05:59.737890 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xc9t7" podUID="6afe74f8-11aa-4aee-9629-498ec110bc21" May 25 13:06:00.738071 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:00.737904 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45rjq" May 25 13:06:00.738630 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:00.737909 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pq8f8" May 25 13:06:00.738630 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:00.738137 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45rjq" podUID="22715e7e-5167-48b9-9c76-70114a0fe045" May 25 13:06:00.738630 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:00.738240 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pq8f8" podUID="760c3981-3ce6-4b45-af76-a545105d4b0b" May 25 13:06:00.857220 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:00.857197 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvqnb_eeec714b-fedf-44ce-810b-fca091e4364a/ovn-acl-logging/0.log" May 25 13:06:00.857556 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:00.857528 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" event={"ID":"eeec714b-fedf-44ce-810b-fca091e4364a","Type":"ContainerStarted","Data":"138fccafe657c3e37985d37dbe588a64d9ba0577141d0e6112bee41121bf831a"} May 25 13:06:00.857862 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:00.857843 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:06:00.857862 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:00.857868 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:06:00.858040 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:00.857880 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:06:00.858040 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:00.858008 2568 scope.go:117] "RemoveContainer" containerID="dec02fab8ee2d17802ea4af22c6941c6fb288cf83724f27c811677b32acc17af" May 25 13:06:00.859334 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:00.859314 2568 generic.go:358] "Generic (PLEG): container finished" podID="c3e2cf07-68ec-4934-a1a7-64d381a0f004" containerID="d141f9be79a2fc29518da61113b6ba848744cd07279b79bf42f2c1e63bc4e4d7" exitCode=0 May 25 13:06:00.859416 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:00.859345 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c2tbd" event={"ID":"c3e2cf07-68ec-4934-a1a7-64d381a0f004","Type":"ContainerDied","Data":"d141f9be79a2fc29518da61113b6ba848744cd07279b79bf42f2c1e63bc4e4d7"} May 25 13:06:00.876688 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:00.876665 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:06:00.876786 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:00.876730 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:06:01.738044 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:01.738008 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xc9t7" May 25 13:06:01.738229 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:01.738119 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xc9t7" podUID="6afe74f8-11aa-4aee-9629-498ec110bc21" May 25 13:06:01.864368 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:01.864290 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvqnb_eeec714b-fedf-44ce-810b-fca091e4364a/ovn-acl-logging/0.log" May 25 13:06:01.864657 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:01.864635 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" event={"ID":"eeec714b-fedf-44ce-810b-fca091e4364a","Type":"ContainerStarted","Data":"9d3b353529c4b71832065fd1c8389b47b6da9e8431af7153ec064cefd6494e97"} May 25 13:06:01.866329 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:01.866305 2568 generic.go:358] "Generic (PLEG): container finished" podID="c3e2cf07-68ec-4934-a1a7-64d381a0f004" containerID="d9f83b5e737d6efd409503e78ae9aaa2f67864b539e547a7e8cfaf68de339406" exitCode=0 May 25 13:06:01.866436 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:01.866346 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c2tbd" event={"ID":"c3e2cf07-68ec-4934-a1a7-64d381a0f004","Type":"ContainerDied","Data":"d9f83b5e737d6efd409503e78ae9aaa2f67864b539e547a7e8cfaf68de339406"} May 25 13:06:01.893911 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:01.893862 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" podStartSLOduration=10.117234618 podStartE2EDuration="27.893846477s" podCreationTimestamp="2026-05-25 13:05:34 +0000 UTC" firstStartedPulling="2026-05-25 13:05:37.362451754 +0000 UTC m=+3.259721367" lastFinishedPulling="2026-05-25 13:05:55.13906361 +0000 UTC m=+21.036333226" observedRunningTime="2026-05-25 13:06:01.893654813 +0000 UTC m=+27.790924445" watchObservedRunningTime="2026-05-25 13:06:01.893846477 +0000 UTC m=+27.791116109" May 25 13:06:02.021353 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:02.021313 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-45rjq"] May 25 13:06:02.021521 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:02.021480 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45rjq" May 25 13:06:02.021671 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:02.021624 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45rjq" podUID="22715e7e-5167-48b9-9c76-70114a0fe045" May 25 13:06:02.024874 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:02.024853 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pq8f8"] May 25 13:06:02.024964 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:02.024938 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pq8f8" May 25 13:06:02.025014 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:02.024999 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pq8f8" podUID="760c3981-3ce6-4b45-af76-a545105d4b0b" May 25 13:06:02.026774 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:02.026753 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xc9t7"] May 25 13:06:02.026850 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:02.026844 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xc9t7" May 25 13:06:02.026935 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:02.026919 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xc9t7" podUID="6afe74f8-11aa-4aee-9629-498ec110bc21" May 25 13:06:02.870052 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:02.869818 2568 generic.go:358] "Generic (PLEG): container finished" podID="c3e2cf07-68ec-4934-a1a7-64d381a0f004" containerID="e68e9abd4f7f42d3b5731e65d0674f5905a7f3e0957e41b63ace63dd2b688bed" exitCode=0 May 25 13:06:02.870052 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:02.869901 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c2tbd" event={"ID":"c3e2cf07-68ec-4934-a1a7-64d381a0f004","Type":"ContainerDied","Data":"e68e9abd4f7f42d3b5731e65d0674f5905a7f3e0957e41b63ace63dd2b688bed"} May 25 13:06:03.035358 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:03.035327 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22715e7e-5167-48b9-9c76-70114a0fe045-original-pull-secret\") pod \"global-pull-secret-syncer-45rjq\" (UID: \"22715e7e-5167-48b9-9c76-70114a0fe045\") " pod="kube-system/global-pull-secret-syncer-45rjq" May 25 13:06:03.035609 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:03.035577 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 25 13:06:03.035753 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:03.035646 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22715e7e-5167-48b9-9c76-70114a0fe045-original-pull-secret podName:22715e7e-5167-48b9-9c76-70114a0fe045 nodeName:}" failed. No retries permitted until 2026-05-25 13:06:19.035627024 +0000 UTC m=+44.932896642 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22715e7e-5167-48b9-9c76-70114a0fe045-original-pull-secret") pod "global-pull-secret-syncer-45rjq" (UID: "22715e7e-5167-48b9-9c76-70114a0fe045") : object "kube-system"/"original-pull-secret" not registered May 25 13:06:03.737678 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:03.737648 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xc9t7" May 25 13:06:03.737678 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:03.737670 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pq8f8" May 25 13:06:03.737927 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:03.737647 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45rjq" May 25 13:06:03.737927 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:03.737765 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xc9t7" podUID="6afe74f8-11aa-4aee-9629-498ec110bc21" May 25 13:06:03.737927 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:03.737846 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45rjq" podUID="22715e7e-5167-48b9-9c76-70114a0fe045" May 25 13:06:03.737927 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:03.737904 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pq8f8" podUID="760c3981-3ce6-4b45-af76-a545105d4b0b" May 25 13:06:05.737515 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:05.737477 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xc9t7" May 25 13:06:05.737515 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:05.737514 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45rjq" May 25 13:06:05.738317 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:05.737482 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pq8f8" May 25 13:06:05.738317 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:05.737621 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xc9t7" podUID="6afe74f8-11aa-4aee-9629-498ec110bc21" May 25 13:06:05.738317 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:05.737684 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pq8f8" podUID="760c3981-3ce6-4b45-af76-a545105d4b0b" May 25 13:06:05.738317 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:05.737803 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45rjq" podUID="22715e7e-5167-48b9-9c76-70114a0fe045" May 25 13:06:07.738233 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:07.738203 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xc9t7" May 25 13:06:07.738712 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:07.738338 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45rjq" May 25 13:06:07.738712 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:07.738347 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xc9t7" podUID="6afe74f8-11aa-4aee-9629-498ec110bc21" May 25 13:06:07.738712 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:07.738386 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pq8f8" May 25 13:06:07.738712 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:07.738466 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45rjq" podUID="22715e7e-5167-48b9-9c76-70114a0fe045" May 25 13:06:07.738712 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:07.738543 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pq8f8" podUID="760c3981-3ce6-4b45-af76-a545105d4b0b" May 25 13:06:07.880023 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:07.879995 2568 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-184.ec2.internal" event="NodeReady" May 25 13:06:07.880188 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:07.880124 2568 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 25 13:06:07.916067 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:07.916032 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-nfjdz"] May 25 13:06:07.933283 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:07.933251 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-67c696b864-h6hp4"] May 25 13:06:07.933502 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:07.933448 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-nfjdz" May 25 13:06:07.936169 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:07.936030 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" May 25 13:06:07.936169 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:07.936141 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-9h7d4\"" May 25 13:06:07.936340 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:07.936281 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" May 25 13:06:07.945186 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:07.945136 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-nfjdz"] May 25 13:06:07.945186 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:07.945182 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-87mfx"] May 25 13:06:07.945355 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:07.945298 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67c696b864-h6hp4" May 25 13:06:07.948120 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:07.948058 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 25 13:06:07.948263 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:07.948239 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 25 13:06:07.948388 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:07.948369 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 25 13:06:07.948738 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:07.948652 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mf8zb\"" May 25 13:06:07.954328 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:07.954310 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 25 13:06:07.959265 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:07.959246 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67c696b864-h6hp4"] May 25 13:06:07.959374 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:07.959271 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-j9lmj"] May 25 13:06:07.959445 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:07.959425 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-87mfx" May 25 13:06:07.962450 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:07.962320 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dnmsw\"" May 25 13:06:07.962450 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:07.962372 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 25 13:06:07.962450 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:07.962387 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 25 13:06:07.971645 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:07.971625 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-87mfx"] May 25 13:06:07.971724 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:07.971653 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j9lmj"] May 25 13:06:07.971771 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:07.971760 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j9lmj" May 25 13:06:07.976864 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:07.976836 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 25 13:06:07.976956 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:07.976890 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 25 13:06:07.977018 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:07.976839 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 25 13:06:07.977090 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:07.977071 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6hqsn\"" May 25 13:06:08.073471 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:08.073382 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a980382d-bbe6-4d7b-9c47-26a68b389c55-image-registry-private-configuration\") pod \"image-registry-67c696b864-h6hp4\" (UID: \"a980382d-bbe6-4d7b-9c47-26a68b389c55\") " pod="openshift-image-registry/image-registry-67c696b864-h6hp4" May 25 13:06:08.073471 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:08.073437 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a980382d-bbe6-4d7b-9c47-26a68b389c55-trusted-ca\") pod \"image-registry-67c696b864-h6hp4\" (UID: \"a980382d-bbe6-4d7b-9c47-26a68b389c55\") " pod="openshift-image-registry/image-registry-67c696b864-h6hp4" May 25 13:06:08.073471 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:08.073467 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a980382d-bbe6-4d7b-9c47-26a68b389c55-registry-tls\") pod \"image-registry-67c696b864-h6hp4\" (UID: \"a980382d-bbe6-4d7b-9c47-26a68b389c55\") " pod="openshift-image-registry/image-registry-67c696b864-h6hp4" May 25 13:06:08.073716 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:08.073510 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a980382d-bbe6-4d7b-9c47-26a68b389c55-ca-trust-extracted\") pod \"image-registry-67c696b864-h6hp4\" (UID: \"a980382d-bbe6-4d7b-9c47-26a68b389c55\") " pod="openshift-image-registry/image-registry-67c696b864-h6hp4" May 25 13:06:08.073716 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:08.073526 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7-tmp-dir\") pod \"dns-default-87mfx\" (UID: \"a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7\") " pod="openshift-dns/dns-default-87mfx" May 25 13:06:08.073716 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:08.073604 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7-config-volume\") pod \"dns-default-87mfx\" (UID: \"a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7\") " pod="openshift-dns/dns-default-87mfx" May 25 13:06:08.073716 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:08.073631 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/700a0947-b3b8-44f1-a79c-4b34fd1d2171-cert\") pod \"ingress-canary-j9lmj\" (UID: \"700a0947-b3b8-44f1-a79c-4b34fd1d2171\") " pod="openshift-ingress-canary/ingress-canary-j9lmj" May 25 13:06:08.073716 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:08.073675 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-877xl\" (UniqueName: \"kubernetes.io/projected/a980382d-bbe6-4d7b-9c47-26a68b389c55-kube-api-access-877xl\") pod \"image-registry-67c696b864-h6hp4\" (UID: \"a980382d-bbe6-4d7b-9c47-26a68b389c55\") " pod="openshift-image-registry/image-registry-67c696b864-h6hp4" May 25 13:06:08.073716 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:08.073698 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mp4t\" (UniqueName: \"kubernetes.io/projected/700a0947-b3b8-44f1-a79c-4b34fd1d2171-kube-api-access-9mp4t\") pod \"ingress-canary-j9lmj\" (UID: \"700a0947-b3b8-44f1-a79c-4b34fd1d2171\") " pod="openshift-ingress-canary/ingress-canary-j9lmj" May 25 13:06:08.073976 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:08.073724 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7-metrics-tls\") pod \"dns-default-87mfx\" (UID: \"a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7\") " pod="openshift-dns/dns-default-87mfx" May 25 13:06:08.073976 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:08.073782 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a980382d-bbe6-4d7b-9c47-26a68b389c55-bound-sa-token\") pod \"image-registry-67c696b864-h6hp4\" (UID: \"a980382d-bbe6-4d7b-9c47-26a68b389c55\") " pod="openshift-image-registry/image-registry-67c696b864-h6hp4" May 25 13:06:08.073976 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:08.073839 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8e7d318b-4ca1-4015-9c2a-1f94373ef66a-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-nfjdz\" (UID: \"8e7d318b-4ca1-4015-9c2a-1f94373ef66a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-nfjdz" May 25 13:06:08.073976 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:08.073861 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkzb7\" (UniqueName: \"kubernetes.io/projected/a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7-kube-api-access-kkzb7\") pod \"dns-default-87mfx\" (UID: \"a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7\") " pod="openshift-dns/dns-default-87mfx" May 25 13:06:08.073976 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:08.073909 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8e7d318b-4ca1-4015-9c2a-1f94373ef66a-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-nfjdz\" (UID: \"8e7d318b-4ca1-4015-9c2a-1f94373ef66a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-nfjdz" May 25 13:06:08.073976 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:08.073944 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a980382d-bbe6-4d7b-9c47-26a68b389c55-registry-certificates\") pod \"image-registry-67c696b864-h6hp4\" (UID: \"a980382d-bbe6-4d7b-9c47-26a68b389c55\") " pod="openshift-image-registry/image-registry-67c696b864-h6hp4" May 25 13:06:08.073976 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:08.073965 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a980382d-bbe6-4d7b-9c47-26a68b389c55-installation-pull-secrets\") pod \"image-registry-67c696b864-h6hp4\" (UID: \"a980382d-bbe6-4d7b-9c47-26a68b389c55\") " pod="openshift-image-registry/image-registry-67c696b864-h6hp4" May 25 13:06:08.174761 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:08.174728 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a980382d-bbe6-4d7b-9c47-26a68b389c55-registry-tls\") pod \"image-registry-67c696b864-h6hp4\" (UID: \"a980382d-bbe6-4d7b-9c47-26a68b389c55\") " pod="openshift-image-registry/image-registry-67c696b864-h6hp4" May 25 13:06:08.174957 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:08.174816 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a980382d-bbe6-4d7b-9c47-26a68b389c55-ca-trust-extracted\") pod \"image-registry-67c696b864-h6hp4\" (UID: \"a980382d-bbe6-4d7b-9c47-26a68b389c55\") " pod="openshift-image-registry/image-registry-67c696b864-h6hp4" May 25 13:06:08.174957 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:08.174848 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7-tmp-dir\") pod \"dns-default-87mfx\" (UID: \"a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7\") " pod="openshift-dns/dns-default-87mfx" May 25 13:06:08.174957 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:08.174876 2568 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 25 13:06:08.174957 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:08.174892 2568 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67c696b864-h6hp4: secret "image-registry-tls" not found May 25 13:06:08.174957 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:08.174952 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a980382d-bbe6-4d7b-9c47-26a68b389c55-registry-tls podName:a980382d-bbe6-4d7b-9c47-26a68b389c55 nodeName:}" failed. No retries permitted until 2026-05-25 13:06:08.67493714 +0000 UTC m=+34.572206756 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a980382d-bbe6-4d7b-9c47-26a68b389c55-registry-tls") pod "image-registry-67c696b864-h6hp4" (UID: "a980382d-bbe6-4d7b-9c47-26a68b389c55") : secret "image-registry-tls" not found May 25 13:06:08.175260 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:08.174879 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7-config-volume\") pod \"dns-default-87mfx\" (UID: \"a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7\") " pod="openshift-dns/dns-default-87mfx" May 25 13:06:08.175260 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:08.175022 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/700a0947-b3b8-44f1-a79c-4b34fd1d2171-cert\") pod \"ingress-canary-j9lmj\" (UID: \"700a0947-b3b8-44f1-a79c-4b34fd1d2171\") " pod="openshift-ingress-canary/ingress-canary-j9lmj" May 25 13:06:08.175260 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:08.175045 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-877xl\" (UniqueName: \"kubernetes.io/projected/a980382d-bbe6-4d7b-9c47-26a68b389c55-kube-api-access-877xl\") pod \"image-registry-67c696b864-h6hp4\" (UID: \"a980382d-bbe6-4d7b-9c47-26a68b389c55\") " pod="openshift-image-registry/image-registry-67c696b864-h6hp4" May 25 13:06:08.175260 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:08.175075 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9mp4t\" (UniqueName: \"kubernetes.io/projected/700a0947-b3b8-44f1-a79c-4b34fd1d2171-kube-api-access-9mp4t\") pod \"ingress-canary-j9lmj\" (UID: \"700a0947-b3b8-44f1-a79c-4b34fd1d2171\") " pod="openshift-ingress-canary/ingress-canary-j9lmj" May 25 13:06:08.175260 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:08.175108 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7-metrics-tls\") pod \"dns-default-87mfx\" (UID: \"a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7\") " pod="openshift-dns/dns-default-87mfx" May 25 13:06:08.175260 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:08.175142 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a980382d-bbe6-4d7b-9c47-26a68b389c55-bound-sa-token\") pod \"image-registry-67c696b864-h6hp4\" (UID: \"a980382d-bbe6-4d7b-9c47-26a68b389c55\") " pod="openshift-image-registry/image-registry-67c696b864-h6hp4" May 25 13:06:08.175260 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:08.175226 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8e7d318b-4ca1-4015-9c2a-1f94373ef66a-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-nfjdz\" (UID: \"8e7d318b-4ca1-4015-9c2a-1f94373ef66a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-nfjdz" May 25 13:06:08.175594 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:08.175251 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7-tmp-dir\") pod \"dns-default-87mfx\" (UID: \"a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7\") " pod="openshift-dns/dns-default-87mfx" May 25 13:06:08.175594 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:08.175293 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 13:06:08.175594 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:08.175337 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/700a0947-b3b8-44f1-a79c-4b34fd1d2171-cert podName:700a0947-b3b8-44f1-a79c-4b34fd1d2171 nodeName:}" failed. No retries permitted until 2026-05-25 13:06:08.675322811 +0000 UTC m=+34.572592425 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/700a0947-b3b8-44f1-a79c-4b34fd1d2171-cert") pod "ingress-canary-j9lmj" (UID: "700a0947-b3b8-44f1-a79c-4b34fd1d2171") : secret "canary-serving-cert" not found May 25 13:06:08.175594 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:08.175256 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kkzb7\" (UniqueName: \"kubernetes.io/projected/a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7-kube-api-access-kkzb7\") pod \"dns-default-87mfx\" (UID: \"a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7\") " pod="openshift-dns/dns-default-87mfx" May 25 13:06:08.175594 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:08.175358 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a980382d-bbe6-4d7b-9c47-26a68b389c55-ca-trust-extracted\") pod \"image-registry-67c696b864-h6hp4\" (UID: \"a980382d-bbe6-4d7b-9c47-26a68b389c55\") " pod="openshift-image-registry/image-registry-67c696b864-h6hp4" May 25 13:06:08.175594 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:08.175382 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8e7d318b-4ca1-4015-9c2a-1f94373ef66a-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-nfjdz\" (UID: \"8e7d318b-4ca1-4015-9c2a-1f94373ef66a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-nfjdz" May 25 13:06:08.175594 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:08.175417 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a980382d-bbe6-4d7b-9c47-26a68b389c55-registry-certificates\") pod \"image-registry-67c696b864-h6hp4\" (UID: \"a980382d-bbe6-4d7b-9c47-26a68b389c55\") " pod="openshift-image-registry/image-registry-67c696b864-h6hp4" May 25 13:06:08.175594 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:08.175444 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a980382d-bbe6-4d7b-9c47-26a68b389c55-installation-pull-secrets\") pod \"image-registry-67c696b864-h6hp4\" (UID: \"a980382d-bbe6-4d7b-9c47-26a68b389c55\") " pod="openshift-image-registry/image-registry-67c696b864-h6hp4" May 25 13:06:08.175594 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:08.175462 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 13:06:08.175594 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:08.175485 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a980382d-bbe6-4d7b-9c47-26a68b389c55-image-registry-private-configuration\") pod \"image-registry-67c696b864-h6hp4\" (UID: \"a980382d-bbe6-4d7b-9c47-26a68b389c55\") " pod="openshift-image-registry/image-registry-67c696b864-h6hp4" May 25 13:06:08.175594 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:08.175498 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7-metrics-tls podName:a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7 nodeName:}" failed. No retries permitted until 2026-05-25 13:06:08.675487547 +0000 UTC m=+34.572757158 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7-metrics-tls") pod "dns-default-87mfx" (UID: "a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7") : secret "dns-default-metrics-tls" not found May 25 13:06:08.175594 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:08.175520 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a980382d-bbe6-4d7b-9c47-26a68b389c55-trusted-ca\") pod \"image-registry-67c696b864-h6hp4\" (UID: \"a980382d-bbe6-4d7b-9c47-26a68b389c55\") " pod="openshift-image-registry/image-registry-67c696b864-h6hp4" May 25 13:06:08.175594 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:08.175534 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7-config-volume\") pod \"dns-default-87mfx\" (UID: \"a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7\") " pod="openshift-dns/dns-default-87mfx" May 25 13:06:08.175594 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:08.175572 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 25 13:06:08.176291 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:08.175644 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e7d318b-4ca1-4015-9c2a-1f94373ef66a-networking-console-plugin-cert podName:8e7d318b-4ca1-4015-9c2a-1f94373ef66a nodeName:}" failed. No retries permitted until 2026-05-25 13:06:08.675626579 +0000 UTC m=+34.572896219 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8e7d318b-4ca1-4015-9c2a-1f94373ef66a-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-nfjdz" (UID: "8e7d318b-4ca1-4015-9c2a-1f94373ef66a") : secret "networking-console-plugin-cert" not found May 25 13:06:08.176291 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:08.176041 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a980382d-bbe6-4d7b-9c47-26a68b389c55-registry-certificates\") pod \"image-registry-67c696b864-h6hp4\" (UID: \"a980382d-bbe6-4d7b-9c47-26a68b389c55\") " pod="openshift-image-registry/image-registry-67c696b864-h6hp4" May 25 13:06:08.176291 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:08.176095 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8e7d318b-4ca1-4015-9c2a-1f94373ef66a-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-nfjdz\" (UID: \"8e7d318b-4ca1-4015-9c2a-1f94373ef66a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-nfjdz" May 25 13:06:08.176408 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:08.176368 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a980382d-bbe6-4d7b-9c47-26a68b389c55-trusted-ca\") pod \"image-registry-67c696b864-h6hp4\" (UID: \"a980382d-bbe6-4d7b-9c47-26a68b389c55\") " pod="openshift-image-registry/image-registry-67c696b864-h6hp4" May 25 13:06:08.180987 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:08.180809 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a980382d-bbe6-4d7b-9c47-26a68b389c55-image-registry-private-configuration\") pod \"image-registry-67c696b864-h6hp4\" (UID: \"a980382d-bbe6-4d7b-9c47-26a68b389c55\") " pod="openshift-image-registry/image-registry-67c696b864-h6hp4" May 25 13:06:08.181119 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:08.180827 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a980382d-bbe6-4d7b-9c47-26a68b389c55-installation-pull-secrets\") pod \"image-registry-67c696b864-h6hp4\" (UID: \"a980382d-bbe6-4d7b-9c47-26a68b389c55\") " pod="openshift-image-registry/image-registry-67c696b864-h6hp4" May 25 13:06:08.202394 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:08.202369 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkzb7\" (UniqueName: \"kubernetes.io/projected/a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7-kube-api-access-kkzb7\") pod \"dns-default-87mfx\" (UID: \"a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7\") " pod="openshift-dns/dns-default-87mfx" May 25 13:06:08.202394 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:08.202388 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a980382d-bbe6-4d7b-9c47-26a68b389c55-bound-sa-token\") pod \"image-registry-67c696b864-h6hp4\" (UID: \"a980382d-bbe6-4d7b-9c47-26a68b389c55\") " pod="openshift-image-registry/image-registry-67c696b864-h6hp4" May 25 13:06:08.203526 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:08.203503 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-877xl\" (UniqueName: \"kubernetes.io/projected/a980382d-bbe6-4d7b-9c47-26a68b389c55-kube-api-access-877xl\") pod \"image-registry-67c696b864-h6hp4\" (UID: \"a980382d-bbe6-4d7b-9c47-26a68b389c55\") " pod="openshift-image-registry/image-registry-67c696b864-h6hp4" May 25 13:06:08.203633 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:08.203569 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mp4t\" (UniqueName: \"kubernetes.io/projected/700a0947-b3b8-44f1-a79c-4b34fd1d2171-kube-api-access-9mp4t\") pod \"ingress-canary-j9lmj\" (UID: \"700a0947-b3b8-44f1-a79c-4b34fd1d2171\") " pod="openshift-ingress-canary/ingress-canary-j9lmj" May 25 13:06:08.376588 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:08.376467 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rf9k4\" (UniqueName: \"kubernetes.io/projected/760c3981-3ce6-4b45-af76-a545105d4b0b-kube-api-access-rf9k4\") pod \"network-check-target-pq8f8\" (UID: \"760c3981-3ce6-4b45-af76-a545105d4b0b\") " pod="openshift-network-diagnostics/network-check-target-pq8f8" May 25 13:06:08.376766 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:08.376646 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 13:06:08.376766 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:08.376670 2568 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 13:06:08.376766 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:08.376683 2568 projected.go:194] Error preparing data for projected volume kube-api-access-rf9k4 for pod openshift-network-diagnostics/network-check-target-pq8f8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 13:06:08.376936 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:08.376759 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/760c3981-3ce6-4b45-af76-a545105d4b0b-kube-api-access-rf9k4 podName:760c3981-3ce6-4b45-af76-a545105d4b0b nodeName:}" failed. No retries permitted until 2026-05-25 13:06:40.376742139 +0000 UTC m=+66.274011762 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rf9k4" (UniqueName: "kubernetes.io/projected/760c3981-3ce6-4b45-af76-a545105d4b0b-kube-api-access-rf9k4") pod "network-check-target-pq8f8" (UID: "760c3981-3ce6-4b45-af76-a545105d4b0b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 13:06:08.478161 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:08.478106 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6afe74f8-11aa-4aee-9629-498ec110bc21-metrics-certs\") pod \"network-metrics-daemon-xc9t7\" (UID: \"6afe74f8-11aa-4aee-9629-498ec110bc21\") " pod="openshift-multus/network-metrics-daemon-xc9t7" May 25 13:06:08.478337 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:08.478274 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 13:06:08.478399 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:08.478361 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6afe74f8-11aa-4aee-9629-498ec110bc21-metrics-certs podName:6afe74f8-11aa-4aee-9629-498ec110bc21 nodeName:}" failed. No retries permitted until 2026-05-25 13:06:40.47833936 +0000 UTC m=+66.375608972 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6afe74f8-11aa-4aee-9629-498ec110bc21-metrics-certs") pod "network-metrics-daemon-xc9t7" (UID: "6afe74f8-11aa-4aee-9629-498ec110bc21") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 13:06:08.679327 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:08.679281 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a980382d-bbe6-4d7b-9c47-26a68b389c55-registry-tls\") pod \"image-registry-67c696b864-h6hp4\" (UID: \"a980382d-bbe6-4d7b-9c47-26a68b389c55\") " pod="openshift-image-registry/image-registry-67c696b864-h6hp4" May 25 13:06:08.679525 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:08.679338 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/700a0947-b3b8-44f1-a79c-4b34fd1d2171-cert\") pod \"ingress-canary-j9lmj\" (UID: \"700a0947-b3b8-44f1-a79c-4b34fd1d2171\") " pod="openshift-ingress-canary/ingress-canary-j9lmj" May 25 13:06:08.679525 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:08.679362 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7-metrics-tls\") pod \"dns-default-87mfx\" (UID: \"a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7\") " pod="openshift-dns/dns-default-87mfx" May 25 13:06:08.679525 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:08.679403 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8e7d318b-4ca1-4015-9c2a-1f94373ef66a-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-nfjdz\" (UID: \"8e7d318b-4ca1-4015-9c2a-1f94373ef66a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-nfjdz" May 25 13:06:08.679525 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:08.679421 2568 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 25 13:06:08.679525 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:08.679446 2568 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67c696b864-h6hp4: secret "image-registry-tls" not found May 25 13:06:08.679525 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:08.679473 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 13:06:08.679798 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:08.679476 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 25 13:06:08.679798 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:08.679779 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/700a0947-b3b8-44f1-a79c-4b34fd1d2171-cert podName:700a0947-b3b8-44f1-a79c-4b34fd1d2171 nodeName:}" failed. No retries permitted until 2026-05-25 13:06:09.679511985 +0000 UTC m=+35.576781595 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/700a0947-b3b8-44f1-a79c-4b34fd1d2171-cert") pod "ingress-canary-j9lmj" (UID: "700a0947-b3b8-44f1-a79c-4b34fd1d2171") : secret "canary-serving-cert" not found May 25 13:06:08.679902 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:08.679805 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 13:06:08.679902 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:08.679839 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a980382d-bbe6-4d7b-9c47-26a68b389c55-registry-tls podName:a980382d-bbe6-4d7b-9c47-26a68b389c55 nodeName:}" failed. No retries permitted until 2026-05-25 13:06:09.679815203 +0000 UTC m=+35.577084873 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a980382d-bbe6-4d7b-9c47-26a68b389c55-registry-tls") pod "image-registry-67c696b864-h6hp4" (UID: "a980382d-bbe6-4d7b-9c47-26a68b389c55") : secret "image-registry-tls" not found May 25 13:06:08.680003 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:08.679968 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7-metrics-tls podName:a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7 nodeName:}" failed. No retries permitted until 2026-05-25 13:06:09.679944469 +0000 UTC m=+35.577214095 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7-metrics-tls") pod "dns-default-87mfx" (UID: "a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7") : secret "dns-default-metrics-tls" not found May 25 13:06:08.680194 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:08.680175 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e7d318b-4ca1-4015-9c2a-1f94373ef66a-networking-console-plugin-cert podName:8e7d318b-4ca1-4015-9c2a-1f94373ef66a nodeName:}" failed. No retries permitted until 2026-05-25 13:06:09.68013056 +0000 UTC m=+35.577400188 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8e7d318b-4ca1-4015-9c2a-1f94373ef66a-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-nfjdz" (UID: "8e7d318b-4ca1-4015-9c2a-1f94373ef66a") : secret "networking-console-plugin-cert" not found May 25 13:06:09.687981 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:09.687942 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a980382d-bbe6-4d7b-9c47-26a68b389c55-registry-tls\") pod \"image-registry-67c696b864-h6hp4\" (UID: \"a980382d-bbe6-4d7b-9c47-26a68b389c55\") " pod="openshift-image-registry/image-registry-67c696b864-h6hp4" May 25 13:06:09.688397 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:09.688002 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/700a0947-b3b8-44f1-a79c-4b34fd1d2171-cert\") pod \"ingress-canary-j9lmj\" (UID: \"700a0947-b3b8-44f1-a79c-4b34fd1d2171\") " pod="openshift-ingress-canary/ingress-canary-j9lmj" May 25 13:06:09.688397 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:09.688026 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7-metrics-tls\") pod \"dns-default-87mfx\" (UID: \"a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7\") " pod="openshift-dns/dns-default-87mfx" May 25 13:06:09.688397 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:09.688078 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8e7d318b-4ca1-4015-9c2a-1f94373ef66a-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-nfjdz\" (UID: \"8e7d318b-4ca1-4015-9c2a-1f94373ef66a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-nfjdz" May 25 13:06:09.688397 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:09.688166 2568 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 25 13:06:09.688397 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:09.688174 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 13:06:09.688397 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:09.688183 2568 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67c696b864-h6hp4: secret "image-registry-tls" not found May 25 13:06:09.688397 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:09.688195 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 25 13:06:09.688397 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:09.688229 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a980382d-bbe6-4d7b-9c47-26a68b389c55-registry-tls podName:a980382d-bbe6-4d7b-9c47-26a68b389c55 nodeName:}" failed. No retries permitted until 2026-05-25 13:06:11.688213067 +0000 UTC m=+37.585482676 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a980382d-bbe6-4d7b-9c47-26a68b389c55-registry-tls") pod "image-registry-67c696b864-h6hp4" (UID: "a980382d-bbe6-4d7b-9c47-26a68b389c55") : secret "image-registry-tls" not found May 25 13:06:09.688397 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:09.688242 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7-metrics-tls podName:a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7 nodeName:}" failed. No retries permitted until 2026-05-25 13:06:11.688235533 +0000 UTC m=+37.585505143 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7-metrics-tls") pod "dns-default-87mfx" (UID: "a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7") : secret "dns-default-metrics-tls" not found May 25 13:06:09.688397 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:09.688245 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 13:06:09.688397 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:09.688252 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e7d318b-4ca1-4015-9c2a-1f94373ef66a-networking-console-plugin-cert podName:8e7d318b-4ca1-4015-9c2a-1f94373ef66a nodeName:}" failed. No retries permitted until 2026-05-25 13:06:11.688246438 +0000 UTC m=+37.585516048 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8e7d318b-4ca1-4015-9c2a-1f94373ef66a-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-nfjdz" (UID: "8e7d318b-4ca1-4015-9c2a-1f94373ef66a") : secret "networking-console-plugin-cert" not found May 25 13:06:09.688397 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:09.688272 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/700a0947-b3b8-44f1-a79c-4b34fd1d2171-cert podName:700a0947-b3b8-44f1-a79c-4b34fd1d2171 nodeName:}" failed. No retries permitted until 2026-05-25 13:06:11.688261224 +0000 UTC m=+37.585530837 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/700a0947-b3b8-44f1-a79c-4b34fd1d2171-cert") pod "ingress-canary-j9lmj" (UID: "700a0947-b3b8-44f1-a79c-4b34fd1d2171") : secret "canary-serving-cert" not found May 25 13:06:09.737811 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:09.737774 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pq8f8" May 25 13:06:09.737954 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:09.737780 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xc9t7" May 25 13:06:09.738028 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:09.737786 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45rjq" May 25 13:06:09.741258 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:09.741235 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 25 13:06:09.741258 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:09.741244 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 25 13:06:09.741444 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:09.741268 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 25 13:06:09.741444 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:09.741238 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 25 13:06:09.741444 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:09.741298 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-stbll\"" May 25 13:06:09.742585 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:09.742570 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xxkxl\"" May 25 13:06:09.886331 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:09.886302 2568 generic.go:358] "Generic (PLEG): container finished" podID="c3e2cf07-68ec-4934-a1a7-64d381a0f004" containerID="a49b0042296ffe6aa3f92adf70d751681ca26e2f6dab746c19ed426fe360c714" exitCode=0 May 25 13:06:09.886512 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:09.886345 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c2tbd" event={"ID":"c3e2cf07-68ec-4934-a1a7-64d381a0f004","Type":"ContainerDied","Data":"a49b0042296ffe6aa3f92adf70d751681ca26e2f6dab746c19ed426fe360c714"} May 25 13:06:10.891920 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:10.891889 2568 generic.go:358] "Generic (PLEG): container finished" podID="c3e2cf07-68ec-4934-a1a7-64d381a0f004" containerID="24910c5be310471d7b8dede1ea4db07775781d564a6664c88a1ac08f9bed5458" exitCode=0 May 25 13:06:10.892427 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:10.891937 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c2tbd" event={"ID":"c3e2cf07-68ec-4934-a1a7-64d381a0f004","Type":"ContainerDied","Data":"24910c5be310471d7b8dede1ea4db07775781d564a6664c88a1ac08f9bed5458"} May 25 13:06:11.706501 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:11.706414 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7-metrics-tls\") pod \"dns-default-87mfx\" (UID: \"a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7\") " pod="openshift-dns/dns-default-87mfx" May 25 13:06:11.706501 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:11.706486 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8e7d318b-4ca1-4015-9c2a-1f94373ef66a-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-nfjdz\" (UID: \"8e7d318b-4ca1-4015-9c2a-1f94373ef66a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-nfjdz" May 25 13:06:11.706688 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:11.706528 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a980382d-bbe6-4d7b-9c47-26a68b389c55-registry-tls\") pod \"image-registry-67c696b864-h6hp4\" (UID: \"a980382d-bbe6-4d7b-9c47-26a68b389c55\") " pod="openshift-image-registry/image-registry-67c696b864-h6hp4" May 25 13:06:11.706688 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:11.706558 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 13:06:11.706688 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:11.706615 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7-metrics-tls podName:a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7 nodeName:}" failed. No retries permitted until 2026-05-25 13:06:15.706599747 +0000 UTC m=+41.603869357 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7-metrics-tls") pod "dns-default-87mfx" (UID: "a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7") : secret "dns-default-metrics-tls" not found May 25 13:06:11.706688 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:11.706638 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 13:06:11.706688 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:11.706644 2568 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 25 13:06:11.706688 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:11.706561 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/700a0947-b3b8-44f1-a79c-4b34fd1d2171-cert\") pod \"ingress-canary-j9lmj\" (UID: \"700a0947-b3b8-44f1-a79c-4b34fd1d2171\") " pod="openshift-ingress-canary/ingress-canary-j9lmj" May 25 13:06:11.706688 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:11.706661 2568 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67c696b864-h6hp4: secret "image-registry-tls" not found May 25 13:06:11.706688 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:11.706679 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/700a0947-b3b8-44f1-a79c-4b34fd1d2171-cert podName:700a0947-b3b8-44f1-a79c-4b34fd1d2171 nodeName:}" failed. No retries permitted until 2026-05-25 13:06:15.706668661 +0000 UTC m=+41.603938271 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/700a0947-b3b8-44f1-a79c-4b34fd1d2171-cert") pod "ingress-canary-j9lmj" (UID: "700a0947-b3b8-44f1-a79c-4b34fd1d2171") : secret "canary-serving-cert" not found May 25 13:06:11.706966 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:11.706732 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a980382d-bbe6-4d7b-9c47-26a68b389c55-registry-tls podName:a980382d-bbe6-4d7b-9c47-26a68b389c55 nodeName:}" failed. No retries permitted until 2026-05-25 13:06:15.706709132 +0000 UTC m=+41.603978759 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a980382d-bbe6-4d7b-9c47-26a68b389c55-registry-tls") pod "image-registry-67c696b864-h6hp4" (UID: "a980382d-bbe6-4d7b-9c47-26a68b389c55") : secret "image-registry-tls" not found May 25 13:06:11.706966 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:11.706638 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 25 13:06:11.706966 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:11.706775 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e7d318b-4ca1-4015-9c2a-1f94373ef66a-networking-console-plugin-cert podName:8e7d318b-4ca1-4015-9c2a-1f94373ef66a nodeName:}" failed. No retries permitted until 2026-05-25 13:06:15.706764306 +0000 UTC m=+41.604033916 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8e7d318b-4ca1-4015-9c2a-1f94373ef66a-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-nfjdz" (UID: "8e7d318b-4ca1-4015-9c2a-1f94373ef66a") : secret "networking-console-plugin-cert" not found May 25 13:06:11.896415 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:11.896375 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c2tbd" event={"ID":"c3e2cf07-68ec-4934-a1a7-64d381a0f004","Type":"ContainerStarted","Data":"681156ecd2e44b9028ee736acd077424691329792ca2cee5068be4775175bc7a"} May 25 13:06:11.922642 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:11.922593 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-c2tbd" podStartSLOduration=6.15476634 podStartE2EDuration="37.922580601s" podCreationTimestamp="2026-05-25 13:05:34 +0000 UTC" firstStartedPulling="2026-05-25 13:05:37.356541869 +0000 UTC m=+3.253811481" lastFinishedPulling="2026-05-25 13:06:09.124356121 +0000 UTC m=+35.021625742" observedRunningTime="2026-05-25 13:06:11.922023837 +0000 UTC m=+37.819293470" watchObservedRunningTime="2026-05-25 13:06:11.922580601 +0000 UTC m=+37.819850233" May 25 13:06:15.737846 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:15.737809 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8e7d318b-4ca1-4015-9c2a-1f94373ef66a-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-nfjdz\" (UID: \"8e7d318b-4ca1-4015-9c2a-1f94373ef66a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-nfjdz" May 25 13:06:15.738302 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:15.737873 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a980382d-bbe6-4d7b-9c47-26a68b389c55-registry-tls\") pod \"image-registry-67c696b864-h6hp4\" (UID: \"a980382d-bbe6-4d7b-9c47-26a68b389c55\") " pod="openshift-image-registry/image-registry-67c696b864-h6hp4" May 25 13:06:15.738302 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:15.737924 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/700a0947-b3b8-44f1-a79c-4b34fd1d2171-cert\") pod \"ingress-canary-j9lmj\" (UID: \"700a0947-b3b8-44f1-a79c-4b34fd1d2171\") " pod="openshift-ingress-canary/ingress-canary-j9lmj" May 25 13:06:15.738302 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:15.737959 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 25 13:06:15.738302 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:15.737986 2568 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 25 13:06:15.738302 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:15.737960 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7-metrics-tls\") pod \"dns-default-87mfx\" (UID: \"a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7\") " pod="openshift-dns/dns-default-87mfx" May 25 13:06:15.738302 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:15.738014 2568 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67c696b864-h6hp4: secret "image-registry-tls" not found May 25 13:06:15.738302 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:15.738016 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 13:06:15.738302 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:15.738022 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e7d318b-4ca1-4015-9c2a-1f94373ef66a-networking-console-plugin-cert podName:8e7d318b-4ca1-4015-9c2a-1f94373ef66a nodeName:}" failed. No retries permitted until 2026-05-25 13:06:23.738004858 +0000 UTC m=+49.635274489 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8e7d318b-4ca1-4015-9c2a-1f94373ef66a-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-nfjdz" (UID: "8e7d318b-4ca1-4015-9c2a-1f94373ef66a") : secret "networking-console-plugin-cert" not found May 25 13:06:15.738302 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:15.738052 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7-metrics-tls podName:a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7 nodeName:}" failed. No retries permitted until 2026-05-25 13:06:23.738041552 +0000 UTC m=+49.635311182 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7-metrics-tls") pod "dns-default-87mfx" (UID: "a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7") : secret "dns-default-metrics-tls" not found May 25 13:06:15.738302 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:15.738050 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 13:06:15.738302 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:15.738104 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a980382d-bbe6-4d7b-9c47-26a68b389c55-registry-tls podName:a980382d-bbe6-4d7b-9c47-26a68b389c55 nodeName:}" failed. No retries permitted until 2026-05-25 13:06:23.738095616 +0000 UTC m=+49.635365226 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a980382d-bbe6-4d7b-9c47-26a68b389c55-registry-tls") pod "image-registry-67c696b864-h6hp4" (UID: "a980382d-bbe6-4d7b-9c47-26a68b389c55") : secret "image-registry-tls" not found May 25 13:06:15.738302 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:15.738126 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/700a0947-b3b8-44f1-a79c-4b34fd1d2171-cert podName:700a0947-b3b8-44f1-a79c-4b34fd1d2171 nodeName:}" failed. No retries permitted until 2026-05-25 13:06:23.738111835 +0000 UTC m=+49.635381444 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/700a0947-b3b8-44f1-a79c-4b34fd1d2171-cert") pod "ingress-canary-j9lmj" (UID: "700a0947-b3b8-44f1-a79c-4b34fd1d2171") : secret "canary-serving-cert" not found May 25 13:06:19.063869 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:19.063830 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22715e7e-5167-48b9-9c76-70114a0fe045-original-pull-secret\") pod \"global-pull-secret-syncer-45rjq\" (UID: \"22715e7e-5167-48b9-9c76-70114a0fe045\") " pod="kube-system/global-pull-secret-syncer-45rjq" May 25 13:06:19.066753 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:19.066719 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22715e7e-5167-48b9-9c76-70114a0fe045-original-pull-secret\") pod \"global-pull-secret-syncer-45rjq\" (UID: \"22715e7e-5167-48b9-9c76-70114a0fe045\") " pod="kube-system/global-pull-secret-syncer-45rjq" May 25 13:06:19.357120 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:19.357034 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45rjq" May 25 13:06:19.521084 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:19.521054 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-45rjq"] May 25 13:06:19.525026 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:06:19.524996 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22715e7e_5167_48b9_9c76_70114a0fe045.slice/crio-3318259c55906a07f7db0e78f34f0e0575b06bb02b3c8d085b038f1de58e42e8 WatchSource:0}: Error finding container 3318259c55906a07f7db0e78f34f0e0575b06bb02b3c8d085b038f1de58e42e8: Status 404 returned error can't find the container with id 3318259c55906a07f7db0e78f34f0e0575b06bb02b3c8d085b038f1de58e42e8 May 25 13:06:19.912617 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:19.912582 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-45rjq" event={"ID":"22715e7e-5167-48b9-9c76-70114a0fe045","Type":"ContainerStarted","Data":"3318259c55906a07f7db0e78f34f0e0575b06bb02b3c8d085b038f1de58e42e8"} May 25 13:06:23.799826 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:23.799789 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a980382d-bbe6-4d7b-9c47-26a68b389c55-registry-tls\") pod \"image-registry-67c696b864-h6hp4\" (UID: \"a980382d-bbe6-4d7b-9c47-26a68b389c55\") " pod="openshift-image-registry/image-registry-67c696b864-h6hp4" May 25 13:06:23.800208 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:23.799836 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/700a0947-b3b8-44f1-a79c-4b34fd1d2171-cert\") pod \"ingress-canary-j9lmj\" (UID: \"700a0947-b3b8-44f1-a79c-4b34fd1d2171\") " pod="openshift-ingress-canary/ingress-canary-j9lmj" May 25 13:06:23.800208 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:23.799859 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7-metrics-tls\") pod \"dns-default-87mfx\" (UID: \"a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7\") " pod="openshift-dns/dns-default-87mfx" May 25 13:06:23.800208 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:23.799893 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8e7d318b-4ca1-4015-9c2a-1f94373ef66a-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-nfjdz\" (UID: \"8e7d318b-4ca1-4015-9c2a-1f94373ef66a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-nfjdz" May 25 13:06:23.800208 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:23.799929 2568 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 25 13:06:23.800208 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:23.799953 2568 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67c696b864-h6hp4: secret "image-registry-tls" not found May 25 13:06:23.800208 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:23.799977 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 25 13:06:23.800208 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:23.799980 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 13:06:23.800208 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:23.800005 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 13:06:23.800208 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:23.800023 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a980382d-bbe6-4d7b-9c47-26a68b389c55-registry-tls podName:a980382d-bbe6-4d7b-9c47-26a68b389c55 nodeName:}" failed. No retries permitted until 2026-05-25 13:06:39.800001485 +0000 UTC m=+65.697271109 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a980382d-bbe6-4d7b-9c47-26a68b389c55-registry-tls") pod "image-registry-67c696b864-h6hp4" (UID: "a980382d-bbe6-4d7b-9c47-26a68b389c55") : secret "image-registry-tls" not found May 25 13:06:23.800208 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:23.800043 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7-metrics-tls podName:a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7 nodeName:}" failed. No retries permitted until 2026-05-25 13:06:39.800031162 +0000 UTC m=+65.697300778 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7-metrics-tls") pod "dns-default-87mfx" (UID: "a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7") : secret "dns-default-metrics-tls" not found May 25 13:06:23.800208 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:23.800058 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/700a0947-b3b8-44f1-a79c-4b34fd1d2171-cert podName:700a0947-b3b8-44f1-a79c-4b34fd1d2171 nodeName:}" failed. No retries permitted until 2026-05-25 13:06:39.800050626 +0000 UTC m=+65.697320258 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/700a0947-b3b8-44f1-a79c-4b34fd1d2171-cert") pod "ingress-canary-j9lmj" (UID: "700a0947-b3b8-44f1-a79c-4b34fd1d2171") : secret "canary-serving-cert" not found May 25 13:06:23.800208 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:23.800071 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e7d318b-4ca1-4015-9c2a-1f94373ef66a-networking-console-plugin-cert podName:8e7d318b-4ca1-4015-9c2a-1f94373ef66a nodeName:}" failed. No retries permitted until 2026-05-25 13:06:39.800063895 +0000 UTC m=+65.697333507 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8e7d318b-4ca1-4015-9c2a-1f94373ef66a-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-nfjdz" (UID: "8e7d318b-4ca1-4015-9c2a-1f94373ef66a") : secret "networking-console-plugin-cert" not found May 25 13:06:24.923499 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:24.923462 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-45rjq" event={"ID":"22715e7e-5167-48b9-9c76-70114a0fe045","Type":"ContainerStarted","Data":"13da7948f3f89f8e14d169264039735d3a39ee0ca315dde2ba05fc50b848a252"} May 25 13:06:24.943243 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:24.943201 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-45rjq" podStartSLOduration=33.261998484 podStartE2EDuration="37.943188345s" podCreationTimestamp="2026-05-25 13:05:47 +0000 UTC" firstStartedPulling="2026-05-25 13:06:19.526830532 +0000 UTC m=+45.424100143" lastFinishedPulling="2026-05-25 13:06:24.208020391 +0000 UTC m=+50.105290004" observedRunningTime="2026-05-25 13:06:24.942052114 +0000 UTC m=+50.839321746" watchObservedRunningTime="2026-05-25 13:06:24.943188345 +0000 UTC m=+50.840457971" May 25 13:06:25.898875 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:25.898845 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-645d94cf5b-whwl7"] May 25 13:06:25.900527 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:25.900512 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-645d94cf5b-whwl7" May 25 13:06:25.903490 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:25.903467 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" May 25 13:06:25.904873 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:25.904856 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" May 25 13:06:25.905224 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:25.905192 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" May 25 13:06:25.905224 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:25.905197 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" May 25 13:06:25.905389 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:25.905199 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-5hfjl\"" May 25 13:06:25.911583 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:25.911564 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-645d94cf5b-whwl7"] May 25 13:06:26.017640 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:26.017592 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lsjv\" (UniqueName: \"kubernetes.io/projected/967a6610-3bdd-47e6-8a13-6a4a5529b6b4-kube-api-access-7lsjv\") pod \"managed-serviceaccount-addon-agent-645d94cf5b-whwl7\" (UID: \"967a6610-3bdd-47e6-8a13-6a4a5529b6b4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-645d94cf5b-whwl7" May 25 13:06:26.017640 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:26.017645 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/967a6610-3bdd-47e6-8a13-6a4a5529b6b4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-645d94cf5b-whwl7\" (UID: \"967a6610-3bdd-47e6-8a13-6a4a5529b6b4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-645d94cf5b-whwl7" May 25 13:06:26.118741 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:26.118711 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7lsjv\" (UniqueName: \"kubernetes.io/projected/967a6610-3bdd-47e6-8a13-6a4a5529b6b4-kube-api-access-7lsjv\") pod \"managed-serviceaccount-addon-agent-645d94cf5b-whwl7\" (UID: \"967a6610-3bdd-47e6-8a13-6a4a5529b6b4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-645d94cf5b-whwl7" May 25 13:06:26.118895 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:26.118743 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/967a6610-3bdd-47e6-8a13-6a4a5529b6b4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-645d94cf5b-whwl7\" (UID: \"967a6610-3bdd-47e6-8a13-6a4a5529b6b4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-645d94cf5b-whwl7" May 25 13:06:26.121109 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:26.121090 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/967a6610-3bdd-47e6-8a13-6a4a5529b6b4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-645d94cf5b-whwl7\" (UID: \"967a6610-3bdd-47e6-8a13-6a4a5529b6b4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-645d94cf5b-whwl7" May 25 13:06:26.127899 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:26.127878 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lsjv\" (UniqueName: \"kubernetes.io/projected/967a6610-3bdd-47e6-8a13-6a4a5529b6b4-kube-api-access-7lsjv\") pod \"managed-serviceaccount-addon-agent-645d94cf5b-whwl7\" (UID: \"967a6610-3bdd-47e6-8a13-6a4a5529b6b4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-645d94cf5b-whwl7" May 25 13:06:26.220208 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:26.220111 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-645d94cf5b-whwl7" May 25 13:06:26.344179 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:26.344137 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-645d94cf5b-whwl7"] May 25 13:06:26.347268 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:06:26.347241 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod967a6610_3bdd_47e6_8a13_6a4a5529b6b4.slice/crio-8947efbc0a7f7a174ff70a18f1f5871226aceb264ec0e48c89e21babcc225637 WatchSource:0}: Error finding container 8947efbc0a7f7a174ff70a18f1f5871226aceb264ec0e48c89e21babcc225637: Status 404 returned error can't find the container with id 8947efbc0a7f7a174ff70a18f1f5871226aceb264ec0e48c89e21babcc225637 May 25 13:06:26.931229 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:26.931188 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-645d94cf5b-whwl7" event={"ID":"967a6610-3bdd-47e6-8a13-6a4a5529b6b4","Type":"ContainerStarted","Data":"8947efbc0a7f7a174ff70a18f1f5871226aceb264ec0e48c89e21babcc225637"} May 25 13:06:28.935643 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:28.935605 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-645d94cf5b-whwl7" event={"ID":"967a6610-3bdd-47e6-8a13-6a4a5529b6b4","Type":"ContainerStarted","Data":"86a443023594d688053ed8145c06a410ea72d33408a5b3cb11d7961ffac5c6f5"} May 25 13:06:28.959570 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:28.959518 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-645d94cf5b-whwl7" podStartSLOduration=1.925022561 podStartE2EDuration="3.959504238s" podCreationTimestamp="2026-05-25 13:06:25 +0000 UTC" firstStartedPulling="2026-05-25 13:06:26.349642037 +0000 UTC m=+52.246911647" lastFinishedPulling="2026-05-25 13:06:28.384123714 +0000 UTC m=+54.281393324" observedRunningTime="2026-05-25 13:06:28.958702653 +0000 UTC m=+54.855972285" watchObservedRunningTime="2026-05-25 13:06:28.959504238 +0000 UTC m=+54.856773869" May 25 13:06:32.880002 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:32.879964 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nvqnb" May 25 13:06:39.826217 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:39.826138 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8e7d318b-4ca1-4015-9c2a-1f94373ef66a-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-nfjdz\" (UID: \"8e7d318b-4ca1-4015-9c2a-1f94373ef66a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-nfjdz" May 25 13:06:39.826735 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:39.826259 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a980382d-bbe6-4d7b-9c47-26a68b389c55-registry-tls\") pod \"image-registry-67c696b864-h6hp4\" (UID: \"a980382d-bbe6-4d7b-9c47-26a68b389c55\") " pod="openshift-image-registry/image-registry-67c696b864-h6hp4" May 25 13:06:39.826735 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:39.826294 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 25 13:06:39.826735 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:39.826306 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/700a0947-b3b8-44f1-a79c-4b34fd1d2171-cert\") pod \"ingress-canary-j9lmj\" (UID: \"700a0947-b3b8-44f1-a79c-4b34fd1d2171\") " pod="openshift-ingress-canary/ingress-canary-j9lmj" May 25 13:06:39.826735 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:39.826344 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7-metrics-tls\") pod \"dns-default-87mfx\" (UID: \"a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7\") " pod="openshift-dns/dns-default-87mfx" May 25 13:06:39.826735 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:39.826370 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e7d318b-4ca1-4015-9c2a-1f94373ef66a-networking-console-plugin-cert podName:8e7d318b-4ca1-4015-9c2a-1f94373ef66a nodeName:}" failed. No retries permitted until 2026-05-25 13:07:11.826350878 +0000 UTC m=+97.723620492 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8e7d318b-4ca1-4015-9c2a-1f94373ef66a-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-nfjdz" (UID: "8e7d318b-4ca1-4015-9c2a-1f94373ef66a") : secret "networking-console-plugin-cert" not found May 25 13:06:39.826735 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:39.826394 2568 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 25 13:06:39.826735 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:39.826408 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 13:06:39.826735 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:39.826414 2568 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67c696b864-h6hp4: secret "image-registry-tls" not found May 25 13:06:39.826735 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:39.826439 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7-metrics-tls podName:a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7 nodeName:}" failed. No retries permitted until 2026-05-25 13:07:11.826431396 +0000 UTC m=+97.723701006 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7-metrics-tls") pod "dns-default-87mfx" (UID: "a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7") : secret "dns-default-metrics-tls" not found May 25 13:06:39.826735 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:39.826471 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a980382d-bbe6-4d7b-9c47-26a68b389c55-registry-tls podName:a980382d-bbe6-4d7b-9c47-26a68b389c55 nodeName:}" failed. No retries permitted until 2026-05-25 13:07:11.826457107 +0000 UTC m=+97.723726733 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a980382d-bbe6-4d7b-9c47-26a68b389c55-registry-tls") pod "image-registry-67c696b864-h6hp4" (UID: "a980382d-bbe6-4d7b-9c47-26a68b389c55") : secret "image-registry-tls" not found May 25 13:06:39.826735 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:39.826481 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 13:06:39.826735 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:39.826550 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/700a0947-b3b8-44f1-a79c-4b34fd1d2171-cert podName:700a0947-b3b8-44f1-a79c-4b34fd1d2171 nodeName:}" failed. No retries permitted until 2026-05-25 13:07:11.826536264 +0000 UTC m=+97.723805893 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/700a0947-b3b8-44f1-a79c-4b34fd1d2171-cert") pod "ingress-canary-j9lmj" (UID: "700a0947-b3b8-44f1-a79c-4b34fd1d2171") : secret "canary-serving-cert" not found May 25 13:06:40.431370 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:40.431331 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rf9k4\" (UniqueName: \"kubernetes.io/projected/760c3981-3ce6-4b45-af76-a545105d4b0b-kube-api-access-rf9k4\") pod \"network-check-target-pq8f8\" (UID: \"760c3981-3ce6-4b45-af76-a545105d4b0b\") " pod="openshift-network-diagnostics/network-check-target-pq8f8" May 25 13:06:40.434631 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:40.434613 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 25 13:06:40.444419 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:40.444399 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 25 13:06:40.454293 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:40.454273 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf9k4\" (UniqueName: \"kubernetes.io/projected/760c3981-3ce6-4b45-af76-a545105d4b0b-kube-api-access-rf9k4\") pod \"network-check-target-pq8f8\" (UID: \"760c3981-3ce6-4b45-af76-a545105d4b0b\") " pod="openshift-network-diagnostics/network-check-target-pq8f8" May 25 13:06:40.532592 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:40.532565 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6afe74f8-11aa-4aee-9629-498ec110bc21-metrics-certs\") pod \"network-metrics-daemon-xc9t7\" (UID: \"6afe74f8-11aa-4aee-9629-498ec110bc21\") " pod="openshift-multus/network-metrics-daemon-xc9t7" May 25 13:06:40.535661 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:40.535645 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 25 13:06:40.543388 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:40.543370 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 25 13:06:40.543447 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:06:40.543434 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6afe74f8-11aa-4aee-9629-498ec110bc21-metrics-certs podName:6afe74f8-11aa-4aee-9629-498ec110bc21 nodeName:}" failed. No retries permitted until 2026-05-25 13:07:44.543418422 +0000 UTC m=+130.440688032 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6afe74f8-11aa-4aee-9629-498ec110bc21-metrics-certs") pod "network-metrics-daemon-xc9t7" (UID: "6afe74f8-11aa-4aee-9629-498ec110bc21") : secret "metrics-daemon-secret" not found May 25 13:06:40.650463 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:40.650429 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-stbll\"" May 25 13:06:40.658256 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:40.658224 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pq8f8" May 25 13:06:40.781576 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:40.781546 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pq8f8"] May 25 13:06:40.784420 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:06:40.784391 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod760c3981_3ce6_4b45_af76_a545105d4b0b.slice/crio-0b0c7b47ef57294e924a59cfbd549374f467cad76646c7e4385165cb508e69d1 WatchSource:0}: Error finding container 0b0c7b47ef57294e924a59cfbd549374f467cad76646c7e4385165cb508e69d1: Status 404 returned error can't find the container with id 0b0c7b47ef57294e924a59cfbd549374f467cad76646c7e4385165cb508e69d1 May 25 13:06:40.958252 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:40.958143 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pq8f8" event={"ID":"760c3981-3ce6-4b45-af76-a545105d4b0b","Type":"ContainerStarted","Data":"0b0c7b47ef57294e924a59cfbd549374f467cad76646c7e4385165cb508e69d1"} May 25 13:06:43.965849 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:43.965756 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pq8f8" event={"ID":"760c3981-3ce6-4b45-af76-a545105d4b0b","Type":"ContainerStarted","Data":"c81885a6872cf43397b2b5ac75c62263bdc591d25b8d7da73cd8a3e87da2690e"} May 25 13:06:43.966305 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:43.965875 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pq8f8" May 25 13:06:43.986383 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:06:43.986334 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-pq8f8" podStartSLOduration=67.118927592 podStartE2EDuration="1m9.98632277s" podCreationTimestamp="2026-05-25 13:05:34 +0000 UTC" firstStartedPulling="2026-05-25 13:06:40.78634754 +0000 UTC m=+66.683617149" lastFinishedPulling="2026-05-25 13:06:43.6537427 +0000 UTC m=+69.551012327" observedRunningTime="2026-05-25 13:06:43.986101629 +0000 UTC m=+69.883371261" watchObservedRunningTime="2026-05-25 13:06:43.98632277 +0000 UTC m=+69.883592402" May 25 13:07:11.860221 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:07:11.860094 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a980382d-bbe6-4d7b-9c47-26a68b389c55-registry-tls\") pod \"image-registry-67c696b864-h6hp4\" (UID: \"a980382d-bbe6-4d7b-9c47-26a68b389c55\") " pod="openshift-image-registry/image-registry-67c696b864-h6hp4" May 25 13:07:11.860221 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:07:11.860169 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/700a0947-b3b8-44f1-a79c-4b34fd1d2171-cert\") pod \"ingress-canary-j9lmj\" (UID: \"700a0947-b3b8-44f1-a79c-4b34fd1d2171\") " pod="openshift-ingress-canary/ingress-canary-j9lmj" May 25 13:07:11.860221 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:07:11.860201 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7-metrics-tls\") pod \"dns-default-87mfx\" (UID: \"a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7\") " pod="openshift-dns/dns-default-87mfx" May 25 13:07:11.860758 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:07:11.860244 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8e7d318b-4ca1-4015-9c2a-1f94373ef66a-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-nfjdz\" (UID: \"8e7d318b-4ca1-4015-9c2a-1f94373ef66a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-nfjdz" May 25 13:07:11.860758 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:07:11.860257 2568 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 25 13:07:11.860758 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:07:11.860278 2568 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67c696b864-h6hp4: secret "image-registry-tls" not found May 25 13:07:11.860758 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:07:11.860339 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 25 13:07:11.860758 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:07:11.860348 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a980382d-bbe6-4d7b-9c47-26a68b389c55-registry-tls podName:a980382d-bbe6-4d7b-9c47-26a68b389c55 nodeName:}" failed. No retries permitted until 2026-05-25 13:08:15.860331308 +0000 UTC m=+161.757600918 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a980382d-bbe6-4d7b-9c47-26a68b389c55-registry-tls") pod "image-registry-67c696b864-h6hp4" (UID: "a980382d-bbe6-4d7b-9c47-26a68b389c55") : secret "image-registry-tls" not found May 25 13:07:11.860758 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:07:11.860392 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e7d318b-4ca1-4015-9c2a-1f94373ef66a-networking-console-plugin-cert podName:8e7d318b-4ca1-4015-9c2a-1f94373ef66a nodeName:}" failed. No retries permitted until 2026-05-25 13:08:15.860380271 +0000 UTC m=+161.757649882 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8e7d318b-4ca1-4015-9c2a-1f94373ef66a-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-nfjdz" (UID: "8e7d318b-4ca1-4015-9c2a-1f94373ef66a") : secret "networking-console-plugin-cert" not found May 25 13:07:11.860758 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:07:11.860339 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 13:07:11.860758 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:07:11.860424 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7-metrics-tls podName:a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7 nodeName:}" failed. No retries permitted until 2026-05-25 13:08:15.860418174 +0000 UTC m=+161.757687784 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7-metrics-tls") pod "dns-default-87mfx" (UID: "a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7") : secret "dns-default-metrics-tls" not found May 25 13:07:11.860758 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:07:11.860339 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 13:07:11.860758 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:07:11.860448 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/700a0947-b3b8-44f1-a79c-4b34fd1d2171-cert podName:700a0947-b3b8-44f1-a79c-4b34fd1d2171 nodeName:}" failed. No retries permitted until 2026-05-25 13:08:15.860442934 +0000 UTC m=+161.757712544 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/700a0947-b3b8-44f1-a79c-4b34fd1d2171-cert") pod "ingress-canary-j9lmj" (UID: "700a0947-b3b8-44f1-a79c-4b34fd1d2171") : secret "canary-serving-cert" not found May 25 13:07:14.970263 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:07:14.970234 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-pq8f8" May 25 13:07:44.584322 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:07:44.584286 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6afe74f8-11aa-4aee-9629-498ec110bc21-metrics-certs\") pod \"network-metrics-daemon-xc9t7\" (UID: \"6afe74f8-11aa-4aee-9629-498ec110bc21\") " pod="openshift-multus/network-metrics-daemon-xc9t7" May 25 13:07:44.584783 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:07:44.584422 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 25 13:07:44.584783 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:07:44.584486 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6afe74f8-11aa-4aee-9629-498ec110bc21-metrics-certs podName:6afe74f8-11aa-4aee-9629-498ec110bc21 nodeName:}" failed. No retries permitted until 2026-05-25 13:09:46.584470467 +0000 UTC m=+252.481740078 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6afe74f8-11aa-4aee-9629-498ec110bc21-metrics-certs") pod "network-metrics-daemon-xc9t7" (UID: "6afe74f8-11aa-4aee-9629-498ec110bc21") : secret "metrics-daemon-secret" not found May 25 13:08:02.755140 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:02.754866 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-759bb5c6c8-v5dhb"] May 25 13:08:02.758361 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:02.758227 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-759bb5c6c8-v5dhb" May 25 13:08:02.762007 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:02.761988 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 25 13:08:02.762172 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:02.762030 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" May 25 13:08:02.762172 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:02.762088 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" May 25 13:08:02.762172 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:02.762100 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" May 25 13:08:02.762690 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:02.762675 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" May 25 13:08:02.762728 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:02.762681 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 25 13:08:02.762728 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:02.762680 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-j5rld\"" May 25 13:08:02.772234 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:02.772207 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-759bb5c6c8-v5dhb"] May 25 13:08:02.814166 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:02.814122 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c2729b4-64b9-46d1-a83a-1da628cd9df6-metrics-certs\") pod \"router-default-759bb5c6c8-v5dhb\" (UID: \"4c2729b4-64b9-46d1-a83a-1da628cd9df6\") " pod="openshift-ingress/router-default-759bb5c6c8-v5dhb" May 25 13:08:02.814316 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:02.814196 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c2729b4-64b9-46d1-a83a-1da628cd9df6-service-ca-bundle\") pod \"router-default-759bb5c6c8-v5dhb\" (UID: \"4c2729b4-64b9-46d1-a83a-1da628cd9df6\") " pod="openshift-ingress/router-default-759bb5c6c8-v5dhb" May 25 13:08:02.814316 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:02.814216 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbtq6\" (UniqueName: \"kubernetes.io/projected/4c2729b4-64b9-46d1-a83a-1da628cd9df6-kube-api-access-wbtq6\") pod \"router-default-759bb5c6c8-v5dhb\" (UID: \"4c2729b4-64b9-46d1-a83a-1da628cd9df6\") " pod="openshift-ingress/router-default-759bb5c6c8-v5dhb" May 25 13:08:02.814316 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:02.814233 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4c2729b4-64b9-46d1-a83a-1da628cd9df6-stats-auth\") pod \"router-default-759bb5c6c8-v5dhb\" (UID: \"4c2729b4-64b9-46d1-a83a-1da628cd9df6\") " pod="openshift-ingress/router-default-759bb5c6c8-v5dhb" May 25 13:08:02.814316 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:02.814293 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4c2729b4-64b9-46d1-a83a-1da628cd9df6-default-certificate\") pod \"router-default-759bb5c6c8-v5dhb\" (UID: \"4c2729b4-64b9-46d1-a83a-1da628cd9df6\") " pod="openshift-ingress/router-default-759bb5c6c8-v5dhb" May 25 13:08:02.915017 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:02.914984 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c2729b4-64b9-46d1-a83a-1da628cd9df6-service-ca-bundle\") pod \"router-default-759bb5c6c8-v5dhb\" (UID: \"4c2729b4-64b9-46d1-a83a-1da628cd9df6\") " pod="openshift-ingress/router-default-759bb5c6c8-v5dhb" May 25 13:08:02.915017 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:02.915017 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wbtq6\" (UniqueName: \"kubernetes.io/projected/4c2729b4-64b9-46d1-a83a-1da628cd9df6-kube-api-access-wbtq6\") pod \"router-default-759bb5c6c8-v5dhb\" (UID: \"4c2729b4-64b9-46d1-a83a-1da628cd9df6\") " pod="openshift-ingress/router-default-759bb5c6c8-v5dhb" May 25 13:08:02.915230 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:02.915039 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4c2729b4-64b9-46d1-a83a-1da628cd9df6-stats-auth\") pod \"router-default-759bb5c6c8-v5dhb\" (UID: \"4c2729b4-64b9-46d1-a83a-1da628cd9df6\") " pod="openshift-ingress/router-default-759bb5c6c8-v5dhb" May 25 13:08:02.915230 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:02.915092 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4c2729b4-64b9-46d1-a83a-1da628cd9df6-default-certificate\") pod \"router-default-759bb5c6c8-v5dhb\" (UID: \"4c2729b4-64b9-46d1-a83a-1da628cd9df6\") " pod="openshift-ingress/router-default-759bb5c6c8-v5dhb" May 25 13:08:02.915230 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:02.915136 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c2729b4-64b9-46d1-a83a-1da628cd9df6-metrics-certs\") pod \"router-default-759bb5c6c8-v5dhb\" (UID: \"4c2729b4-64b9-46d1-a83a-1da628cd9df6\") " pod="openshift-ingress/router-default-759bb5c6c8-v5dhb" May 25 13:08:02.915230 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:08:02.915200 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4c2729b4-64b9-46d1-a83a-1da628cd9df6-service-ca-bundle podName:4c2729b4-64b9-46d1-a83a-1da628cd9df6 nodeName:}" failed. No retries permitted until 2026-05-25 13:08:03.415177529 +0000 UTC m=+149.312447154 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4c2729b4-64b9-46d1-a83a-1da628cd9df6-service-ca-bundle") pod "router-default-759bb5c6c8-v5dhb" (UID: "4c2729b4-64b9-46d1-a83a-1da628cd9df6") : configmap references non-existent config key: service-ca.crt May 25 13:08:02.915374 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:08:02.915247 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 25 13:08:02.915374 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:08:02.915315 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c2729b4-64b9-46d1-a83a-1da628cd9df6-metrics-certs podName:4c2729b4-64b9-46d1-a83a-1da628cd9df6 nodeName:}" failed. No retries permitted until 2026-05-25 13:08:03.415299367 +0000 UTC m=+149.312568984 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4c2729b4-64b9-46d1-a83a-1da628cd9df6-metrics-certs") pod "router-default-759bb5c6c8-v5dhb" (UID: "4c2729b4-64b9-46d1-a83a-1da628cd9df6") : secret "router-metrics-certs-default" not found May 25 13:08:02.917426 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:02.917400 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4c2729b4-64b9-46d1-a83a-1da628cd9df6-default-certificate\") pod \"router-default-759bb5c6c8-v5dhb\" (UID: \"4c2729b4-64b9-46d1-a83a-1da628cd9df6\") " pod="openshift-ingress/router-default-759bb5c6c8-v5dhb" May 25 13:08:02.917521 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:02.917410 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4c2729b4-64b9-46d1-a83a-1da628cd9df6-stats-auth\") pod \"router-default-759bb5c6c8-v5dhb\" (UID: \"4c2729b4-64b9-46d1-a83a-1da628cd9df6\") " pod="openshift-ingress/router-default-759bb5c6c8-v5dhb" May 25 13:08:02.924247 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:02.924225 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbtq6\" (UniqueName: \"kubernetes.io/projected/4c2729b4-64b9-46d1-a83a-1da628cd9df6-kube-api-access-wbtq6\") pod \"router-default-759bb5c6c8-v5dhb\" (UID: \"4c2729b4-64b9-46d1-a83a-1da628cd9df6\") " pod="openshift-ingress/router-default-759bb5c6c8-v5dhb" May 25 13:08:03.420230 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:03.420192 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c2729b4-64b9-46d1-a83a-1da628cd9df6-metrics-certs\") pod \"router-default-759bb5c6c8-v5dhb\" (UID: \"4c2729b4-64b9-46d1-a83a-1da628cd9df6\") " pod="openshift-ingress/router-default-759bb5c6c8-v5dhb" May 25 13:08:03.420424 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:03.420260 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c2729b4-64b9-46d1-a83a-1da628cd9df6-service-ca-bundle\") pod \"router-default-759bb5c6c8-v5dhb\" (UID: \"4c2729b4-64b9-46d1-a83a-1da628cd9df6\") " pod="openshift-ingress/router-default-759bb5c6c8-v5dhb" May 25 13:08:03.420424 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:08:03.420336 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 25 13:08:03.420424 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:08:03.420396 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c2729b4-64b9-46d1-a83a-1da628cd9df6-metrics-certs podName:4c2729b4-64b9-46d1-a83a-1da628cd9df6 nodeName:}" failed. No retries permitted until 2026-05-25 13:08:04.420381236 +0000 UTC m=+150.317650848 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4c2729b4-64b9-46d1-a83a-1da628cd9df6-metrics-certs") pod "router-default-759bb5c6c8-v5dhb" (UID: "4c2729b4-64b9-46d1-a83a-1da628cd9df6") : secret "router-metrics-certs-default" not found May 25 13:08:03.420424 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:08:03.420409 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4c2729b4-64b9-46d1-a83a-1da628cd9df6-service-ca-bundle podName:4c2729b4-64b9-46d1-a83a-1da628cd9df6 nodeName:}" failed. No retries permitted until 2026-05-25 13:08:04.420403412 +0000 UTC m=+150.317673022 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4c2729b4-64b9-46d1-a83a-1da628cd9df6-service-ca-bundle") pod "router-default-759bb5c6c8-v5dhb" (UID: "4c2729b4-64b9-46d1-a83a-1da628cd9df6") : configmap references non-existent config key: service-ca.crt May 25 13:08:04.428695 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:04.428651 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c2729b4-64b9-46d1-a83a-1da628cd9df6-metrics-certs\") pod \"router-default-759bb5c6c8-v5dhb\" (UID: \"4c2729b4-64b9-46d1-a83a-1da628cd9df6\") " pod="openshift-ingress/router-default-759bb5c6c8-v5dhb" May 25 13:08:04.429080 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:04.428719 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c2729b4-64b9-46d1-a83a-1da628cd9df6-service-ca-bundle\") pod \"router-default-759bb5c6c8-v5dhb\" (UID: \"4c2729b4-64b9-46d1-a83a-1da628cd9df6\") " pod="openshift-ingress/router-default-759bb5c6c8-v5dhb" May 25 13:08:04.429080 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:08:04.428790 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 25 13:08:04.429080 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:08:04.428829 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4c2729b4-64b9-46d1-a83a-1da628cd9df6-service-ca-bundle podName:4c2729b4-64b9-46d1-a83a-1da628cd9df6 nodeName:}" failed. No retries permitted until 2026-05-25 13:08:06.428813529 +0000 UTC m=+152.326083139 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4c2729b4-64b9-46d1-a83a-1da628cd9df6-service-ca-bundle") pod "router-default-759bb5c6c8-v5dhb" (UID: "4c2729b4-64b9-46d1-a83a-1da628cd9df6") : configmap references non-existent config key: service-ca.crt May 25 13:08:04.429080 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:08:04.428852 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c2729b4-64b9-46d1-a83a-1da628cd9df6-metrics-certs podName:4c2729b4-64b9-46d1-a83a-1da628cd9df6 nodeName:}" failed. No retries permitted until 2026-05-25 13:08:06.428844105 +0000 UTC m=+152.326113714 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4c2729b4-64b9-46d1-a83a-1da628cd9df6-metrics-certs") pod "router-default-759bb5c6c8-v5dhb" (UID: "4c2729b4-64b9-46d1-a83a-1da628cd9df6") : secret "router-metrics-certs-default" not found May 25 13:08:06.442997 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:06.442961 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c2729b4-64b9-46d1-a83a-1da628cd9df6-metrics-certs\") pod \"router-default-759bb5c6c8-v5dhb\" (UID: \"4c2729b4-64b9-46d1-a83a-1da628cd9df6\") " pod="openshift-ingress/router-default-759bb5c6c8-v5dhb" May 25 13:08:06.443408 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:06.443032 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c2729b4-64b9-46d1-a83a-1da628cd9df6-service-ca-bundle\") pod \"router-default-759bb5c6c8-v5dhb\" (UID: \"4c2729b4-64b9-46d1-a83a-1da628cd9df6\") " pod="openshift-ingress/router-default-759bb5c6c8-v5dhb" May 25 13:08:06.443408 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:08:06.443122 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 25 13:08:06.443408 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:08:06.443194 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4c2729b4-64b9-46d1-a83a-1da628cd9df6-service-ca-bundle podName:4c2729b4-64b9-46d1-a83a-1da628cd9df6 nodeName:}" failed. No retries permitted until 2026-05-25 13:08:10.443173087 +0000 UTC m=+156.340442729 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4c2729b4-64b9-46d1-a83a-1da628cd9df6-service-ca-bundle") pod "router-default-759bb5c6c8-v5dhb" (UID: "4c2729b4-64b9-46d1-a83a-1da628cd9df6") : configmap references non-existent config key: service-ca.crt May 25 13:08:06.443408 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:08:06.443211 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c2729b4-64b9-46d1-a83a-1da628cd9df6-metrics-certs podName:4c2729b4-64b9-46d1-a83a-1da628cd9df6 nodeName:}" failed. No retries permitted until 2026-05-25 13:08:10.443203348 +0000 UTC m=+156.340472958 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4c2729b4-64b9-46d1-a83a-1da628cd9df6-metrics-certs") pod "router-default-759bb5c6c8-v5dhb" (UID: "4c2729b4-64b9-46d1-a83a-1da628cd9df6") : secret "router-metrics-certs-default" not found May 25 13:08:08.614021 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:08.613989 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-q4zcf"] May 25 13:08:08.617122 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:08.617107 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-q4zcf" May 25 13:08:08.620305 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:08.620274 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-l4b9d\"" May 25 13:08:08.625975 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:08.625954 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-q4zcf"] May 25 13:08:08.762392 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:08.762350 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d88vt\" (UniqueName: \"kubernetes.io/projected/c3d65157-4db4-4138-a642-9990b76905dd-kube-api-access-d88vt\") pod \"network-check-source-7f44b6dd87-q4zcf\" (UID: \"c3d65157-4db4-4138-a642-9990b76905dd\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-q4zcf" May 25 13:08:08.863211 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:08.863170 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d88vt\" (UniqueName: \"kubernetes.io/projected/c3d65157-4db4-4138-a642-9990b76905dd-kube-api-access-d88vt\") pod \"network-check-source-7f44b6dd87-q4zcf\" (UID: \"c3d65157-4db4-4138-a642-9990b76905dd\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-q4zcf" May 25 13:08:08.874304 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:08.874246 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d88vt\" (UniqueName: \"kubernetes.io/projected/c3d65157-4db4-4138-a642-9990b76905dd-kube-api-access-d88vt\") pod \"network-check-source-7f44b6dd87-q4zcf\" (UID: \"c3d65157-4db4-4138-a642-9990b76905dd\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-q4zcf" May 25 13:08:08.925128 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:08.925100 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-q4zcf" May 25 13:08:09.040163 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:09.040120 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-q4zcf"] May 25 13:08:09.043112 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:08:09.043084 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3d65157_4db4_4138_a642_9990b76905dd.slice/crio-6b30753c592687d316d598e509198037ac9810d510943268d480a649531f024e WatchSource:0}: Error finding container 6b30753c592687d316d598e509198037ac9810d510943268d480a649531f024e: Status 404 returned error can't find the container with id 6b30753c592687d316d598e509198037ac9810d510943268d480a649531f024e May 25 13:08:09.129811 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:09.129743 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-q4zcf" event={"ID":"c3d65157-4db4-4138-a642-9990b76905dd","Type":"ContainerStarted","Data":"05873754e1608364d0a14e76e2488fa47b1482428f025270dbcff43f123d377a"} May 25 13:08:09.129811 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:09.129780 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-q4zcf" event={"ID":"c3d65157-4db4-4138-a642-9990b76905dd","Type":"ContainerStarted","Data":"6b30753c592687d316d598e509198037ac9810d510943268d480a649531f024e"} May 25 13:08:09.144802 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:09.144762 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-q4zcf" podStartSLOduration=1.144748829 podStartE2EDuration="1.144748829s" podCreationTimestamp="2026-05-25 13:08:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 13:08:09.144396311 +0000 UTC m=+155.041665955" watchObservedRunningTime="2026-05-25 13:08:09.144748829 +0000 UTC m=+155.042018461" May 25 13:08:09.979320 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:09.979286 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-trnzh_8a8b5d2e-cd8d-48a6-8ea3-ce157207fb61/dns-node-resolver/0.log" May 25 13:08:10.454260 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:10.454232 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-rplqk"] May 25 13:08:10.457114 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:10.457099 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-rplqk" May 25 13:08:10.460515 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:10.460495 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" May 25 13:08:10.460634 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:10.460545 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" May 25 13:08:10.461952 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:10.461932 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" May 25 13:08:10.462082 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:10.462054 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-snwbp\"" May 25 13:08:10.462082 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:10.462072 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" May 25 13:08:10.468790 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:10.468763 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-rplqk"] May 25 13:08:10.477459 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:10.477441 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c2729b4-64b9-46d1-a83a-1da628cd9df6-service-ca-bundle\") pod \"router-default-759bb5c6c8-v5dhb\" (UID: \"4c2729b4-64b9-46d1-a83a-1da628cd9df6\") " pod="openshift-ingress/router-default-759bb5c6c8-v5dhb" May 25 13:08:10.477544 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:10.477511 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c2729b4-64b9-46d1-a83a-1da628cd9df6-metrics-certs\") pod \"router-default-759bb5c6c8-v5dhb\" (UID: \"4c2729b4-64b9-46d1-a83a-1da628cd9df6\") " pod="openshift-ingress/router-default-759bb5c6c8-v5dhb" May 25 13:08:10.477615 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:08:10.477599 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4c2729b4-64b9-46d1-a83a-1da628cd9df6-service-ca-bundle podName:4c2729b4-64b9-46d1-a83a-1da628cd9df6 nodeName:}" failed. No retries permitted until 2026-05-25 13:08:18.47758441 +0000 UTC m=+164.374854025 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4c2729b4-64b9-46d1-a83a-1da628cd9df6-service-ca-bundle") pod "router-default-759bb5c6c8-v5dhb" (UID: "4c2729b4-64b9-46d1-a83a-1da628cd9df6") : configmap references non-existent config key: service-ca.crt May 25 13:08:10.477662 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:08:10.477612 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 25 13:08:10.477701 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:08:10.477661 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c2729b4-64b9-46d1-a83a-1da628cd9df6-metrics-certs podName:4c2729b4-64b9-46d1-a83a-1da628cd9df6 nodeName:}" failed. No retries permitted until 2026-05-25 13:08:18.477646632 +0000 UTC m=+164.374916242 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4c2729b4-64b9-46d1-a83a-1da628cd9df6-metrics-certs") pod "router-default-759bb5c6c8-v5dhb" (UID: "4c2729b4-64b9-46d1-a83a-1da628cd9df6") : secret "router-metrics-certs-default" not found May 25 13:08:10.578643 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:10.578607 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2jdl\" (UniqueName: \"kubernetes.io/projected/13f7c0f0-0ab7-4fd4-b9b9-0be75087e4c3-kube-api-access-l2jdl\") pod \"service-ca-67d667c7d-rplqk\" (UID: \"13f7c0f0-0ab7-4fd4-b9b9-0be75087e4c3\") " pod="openshift-service-ca/service-ca-67d667c7d-rplqk" May 25 13:08:10.578792 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:10.578668 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/13f7c0f0-0ab7-4fd4-b9b9-0be75087e4c3-signing-key\") pod \"service-ca-67d667c7d-rplqk\" (UID: \"13f7c0f0-0ab7-4fd4-b9b9-0be75087e4c3\") " pod="openshift-service-ca/service-ca-67d667c7d-rplqk" May 25 13:08:10.578792 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:10.578694 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/13f7c0f0-0ab7-4fd4-b9b9-0be75087e4c3-signing-cabundle\") pod \"service-ca-67d667c7d-rplqk\" (UID: \"13f7c0f0-0ab7-4fd4-b9b9-0be75087e4c3\") " pod="openshift-service-ca/service-ca-67d667c7d-rplqk" May 25 13:08:10.679443 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:10.679391 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l2jdl\" (UniqueName: \"kubernetes.io/projected/13f7c0f0-0ab7-4fd4-b9b9-0be75087e4c3-kube-api-access-l2jdl\") pod \"service-ca-67d667c7d-rplqk\" (UID: \"13f7c0f0-0ab7-4fd4-b9b9-0be75087e4c3\") " pod="openshift-service-ca/service-ca-67d667c7d-rplqk" May 25 13:08:10.679640 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:10.679465 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/13f7c0f0-0ab7-4fd4-b9b9-0be75087e4c3-signing-key\") pod \"service-ca-67d667c7d-rplqk\" (UID: \"13f7c0f0-0ab7-4fd4-b9b9-0be75087e4c3\") " pod="openshift-service-ca/service-ca-67d667c7d-rplqk" May 25 13:08:10.679640 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:10.679489 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/13f7c0f0-0ab7-4fd4-b9b9-0be75087e4c3-signing-cabundle\") pod \"service-ca-67d667c7d-rplqk\" (UID: \"13f7c0f0-0ab7-4fd4-b9b9-0be75087e4c3\") " pod="openshift-service-ca/service-ca-67d667c7d-rplqk" May 25 13:08:10.680198 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:10.680174 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/13f7c0f0-0ab7-4fd4-b9b9-0be75087e4c3-signing-cabundle\") pod \"service-ca-67d667c7d-rplqk\" (UID: \"13f7c0f0-0ab7-4fd4-b9b9-0be75087e4c3\") " pod="openshift-service-ca/service-ca-67d667c7d-rplqk" May 25 13:08:10.681933 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:10.681907 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/13f7c0f0-0ab7-4fd4-b9b9-0be75087e4c3-signing-key\") pod \"service-ca-67d667c7d-rplqk\" (UID: \"13f7c0f0-0ab7-4fd4-b9b9-0be75087e4c3\") " pod="openshift-service-ca/service-ca-67d667c7d-rplqk" May 25 13:08:10.688003 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:10.687983 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2jdl\" (UniqueName: \"kubernetes.io/projected/13f7c0f0-0ab7-4fd4-b9b9-0be75087e4c3-kube-api-access-l2jdl\") pod \"service-ca-67d667c7d-rplqk\" (UID: \"13f7c0f0-0ab7-4fd4-b9b9-0be75087e4c3\") " pod="openshift-service-ca/service-ca-67d667c7d-rplqk" May 25 13:08:10.765278 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:10.765210 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-rplqk" May 25 13:08:10.901679 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:10.901658 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-rplqk"] May 25 13:08:10.903832 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:08:10.903806 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13f7c0f0_0ab7_4fd4_b9b9_0be75087e4c3.slice/crio-b8ed7a1fcda3389e95b010d7a31b35b2f5ea9e57f9d34f06bfaea631a1cfbf2d WatchSource:0}: Error finding container b8ed7a1fcda3389e95b010d7a31b35b2f5ea9e57f9d34f06bfaea631a1cfbf2d: Status 404 returned error can't find the container with id b8ed7a1fcda3389e95b010d7a31b35b2f5ea9e57f9d34f06bfaea631a1cfbf2d May 25 13:08:10.946385 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:08:10.946342 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-nfjdz" podUID="8e7d318b-4ca1-4015-9c2a-1f94373ef66a" May 25 13:08:10.956562 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:08:10.956540 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-67c696b864-h6hp4" podUID="a980382d-bbe6-4d7b-9c47-26a68b389c55" May 25 13:08:10.969652 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:08:10.969627 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-87mfx" podUID="a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7" May 25 13:08:10.970250 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:10.970228 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tp7gs_b658050c-b570-4192-8cf6-d1f3a23fef5f/node-ca/0.log" May 25 13:08:10.980583 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:08:10.980560 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-j9lmj" podUID="700a0947-b3b8-44f1-a79c-4b34fd1d2171" May 25 13:08:11.134365 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:11.134280 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-rplqk" event={"ID":"13f7c0f0-0ab7-4fd4-b9b9-0be75087e4c3","Type":"ContainerStarted","Data":"b8ed7a1fcda3389e95b010d7a31b35b2f5ea9e57f9d34f06bfaea631a1cfbf2d"} May 25 13:08:11.134365 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:11.134314 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67c696b864-h6hp4" May 25 13:08:11.134365 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:11.134323 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-87mfx" May 25 13:08:11.134634 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:11.134314 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-nfjdz" May 25 13:08:12.753485 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:08:12.753449 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-xc9t7" podUID="6afe74f8-11aa-4aee-9629-498ec110bc21" May 25 13:08:13.139955 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:13.139871 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-rplqk" event={"ID":"13f7c0f0-0ab7-4fd4-b9b9-0be75087e4c3","Type":"ContainerStarted","Data":"91e88930cd148dc0ef4b2a643e11d1f9c90a73ed1f2ab8b323274afd8accd4b6"} May 25 13:08:13.159937 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:13.159886 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-rplqk" podStartSLOduration=1.382707829 podStartE2EDuration="3.159872284s" podCreationTimestamp="2026-05-25 13:08:10 +0000 UTC" firstStartedPulling="2026-05-25 13:08:10.905651426 +0000 UTC m=+156.802921035" lastFinishedPulling="2026-05-25 13:08:12.682815862 +0000 UTC m=+158.580085490" observedRunningTime="2026-05-25 13:08:13.159095919 +0000 UTC m=+159.056365529" watchObservedRunningTime="2026-05-25 13:08:13.159872284 +0000 UTC m=+159.057141948" May 25 13:08:15.926366 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:15.926315 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/700a0947-b3b8-44f1-a79c-4b34fd1d2171-cert\") pod \"ingress-canary-j9lmj\" (UID: \"700a0947-b3b8-44f1-a79c-4b34fd1d2171\") " pod="openshift-ingress-canary/ingress-canary-j9lmj" May 25 13:08:15.926927 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:15.926481 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a980382d-bbe6-4d7b-9c47-26a68b389c55-registry-tls\") pod \"image-registry-67c696b864-h6hp4\" (UID: \"a980382d-bbe6-4d7b-9c47-26a68b389c55\") " pod="openshift-image-registry/image-registry-67c696b864-h6hp4" May 25 13:08:15.926927 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:08:15.926498 2568 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 13:08:15.926927 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:15.926526 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7-metrics-tls\") pod \"dns-default-87mfx\" (UID: \"a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7\") " pod="openshift-dns/dns-default-87mfx" May 25 13:08:15.926927 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:08:15.926572 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/700a0947-b3b8-44f1-a79c-4b34fd1d2171-cert podName:700a0947-b3b8-44f1-a79c-4b34fd1d2171 nodeName:}" failed. No retries permitted until 2026-05-25 13:10:17.926551944 +0000 UTC m=+283.823821563 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/700a0947-b3b8-44f1-a79c-4b34fd1d2171-cert") pod "ingress-canary-j9lmj" (UID: "700a0947-b3b8-44f1-a79c-4b34fd1d2171") : secret "canary-serving-cert" not found May 25 13:08:15.926927 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:08:15.926594 2568 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 25 13:08:15.926927 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:08:15.926606 2568 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67c696b864-h6hp4: secret "image-registry-tls" not found May 25 13:08:15.926927 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:08:15.926607 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 13:08:15.926927 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:15.926598 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8e7d318b-4ca1-4015-9c2a-1f94373ef66a-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-nfjdz\" (UID: \"8e7d318b-4ca1-4015-9c2a-1f94373ef66a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-nfjdz" May 25 13:08:15.926927 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:08:15.926662 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a980382d-bbe6-4d7b-9c47-26a68b389c55-registry-tls podName:a980382d-bbe6-4d7b-9c47-26a68b389c55 nodeName:}" failed. No retries permitted until 2026-05-25 13:10:17.926646274 +0000 UTC m=+283.823915884 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a980382d-bbe6-4d7b-9c47-26a68b389c55-registry-tls") pod "image-registry-67c696b864-h6hp4" (UID: "a980382d-bbe6-4d7b-9c47-26a68b389c55") : secret "image-registry-tls" not found May 25 13:08:15.926927 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:08:15.926662 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 25 13:08:15.926927 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:08:15.926679 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7-metrics-tls podName:a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7 nodeName:}" failed. No retries permitted until 2026-05-25 13:10:17.926671269 +0000 UTC m=+283.823940882 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7-metrics-tls") pod "dns-default-87mfx" (UID: "a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7") : secret "dns-default-metrics-tls" not found May 25 13:08:15.926927 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:08:15.926712 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e7d318b-4ca1-4015-9c2a-1f94373ef66a-networking-console-plugin-cert podName:8e7d318b-4ca1-4015-9c2a-1f94373ef66a nodeName:}" failed. No retries permitted until 2026-05-25 13:10:17.926699729 +0000 UTC m=+283.823969340 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8e7d318b-4ca1-4015-9c2a-1f94373ef66a-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-nfjdz" (UID: "8e7d318b-4ca1-4015-9c2a-1f94373ef66a") : secret "networking-console-plugin-cert" not found May 25 13:08:18.546516 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:18.546483 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c2729b4-64b9-46d1-a83a-1da628cd9df6-metrics-certs\") pod \"router-default-759bb5c6c8-v5dhb\" (UID: \"4c2729b4-64b9-46d1-a83a-1da628cd9df6\") " pod="openshift-ingress/router-default-759bb5c6c8-v5dhb" May 25 13:08:18.546516 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:18.546521 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c2729b4-64b9-46d1-a83a-1da628cd9df6-service-ca-bundle\") pod \"router-default-759bb5c6c8-v5dhb\" (UID: \"4c2729b4-64b9-46d1-a83a-1da628cd9df6\") " pod="openshift-ingress/router-default-759bb5c6c8-v5dhb" May 25 13:08:18.546889 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:08:18.546623 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 25 13:08:18.546889 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:08:18.546652 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4c2729b4-64b9-46d1-a83a-1da628cd9df6-service-ca-bundle podName:4c2729b4-64b9-46d1-a83a-1da628cd9df6 nodeName:}" failed. No retries permitted until 2026-05-25 13:08:34.54663836 +0000 UTC m=+180.443907970 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4c2729b4-64b9-46d1-a83a-1da628cd9df6-service-ca-bundle") pod "router-default-759bb5c6c8-v5dhb" (UID: "4c2729b4-64b9-46d1-a83a-1da628cd9df6") : configmap references non-existent config key: service-ca.crt May 25 13:08:18.546889 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:08:18.546674 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c2729b4-64b9-46d1-a83a-1da628cd9df6-metrics-certs podName:4c2729b4-64b9-46d1-a83a-1da628cd9df6 nodeName:}" failed. No retries permitted until 2026-05-25 13:08:34.546661657 +0000 UTC m=+180.443931267 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4c2729b4-64b9-46d1-a83a-1da628cd9df6-metrics-certs") pod "router-default-759bb5c6c8-v5dhb" (UID: "4c2729b4-64b9-46d1-a83a-1da628cd9df6") : secret "router-metrics-certs-default" not found May 25 13:08:24.738572 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:24.738487 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j9lmj" May 25 13:08:27.738035 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:27.737999 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xc9t7" May 25 13:08:29.183613 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:29.183583 2568 generic.go:358] "Generic (PLEG): container finished" podID="967a6610-3bdd-47e6-8a13-6a4a5529b6b4" containerID="86a443023594d688053ed8145c06a410ea72d33408a5b3cb11d7961ffac5c6f5" exitCode=255 May 25 13:08:29.184083 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:29.183631 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-645d94cf5b-whwl7" event={"ID":"967a6610-3bdd-47e6-8a13-6a4a5529b6b4","Type":"ContainerDied","Data":"86a443023594d688053ed8145c06a410ea72d33408a5b3cb11d7961ffac5c6f5"} May 25 13:08:29.189194 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:29.189170 2568 scope.go:117] "RemoveContainer" containerID="86a443023594d688053ed8145c06a410ea72d33408a5b3cb11d7961ffac5c6f5" May 25 13:08:30.187502 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:30.187467 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-645d94cf5b-whwl7" event={"ID":"967a6610-3bdd-47e6-8a13-6a4a5529b6b4","Type":"ContainerStarted","Data":"6daa2cb415f914f94e308d5a8337a58d0224b812aea4d76354858f1f19e89e31"} May 25 13:08:30.576190 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:30.576106 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vcrbl"] May 25 13:08:30.578055 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:30.578039 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vcrbl" May 25 13:08:30.581514 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:30.581495 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 25 13:08:30.582725 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:30.582709 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 25 13:08:30.582819 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:30.582735 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-84t4d\"" May 25 13:08:30.582819 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:30.582750 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 25 13:08:30.582819 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:30.582771 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 25 13:08:30.594401 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:30.594375 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vcrbl"] May 25 13:08:30.643658 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:30.643637 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/adfa7ba3-d80a-47f1-9db7-21fe28eb3958-data-volume\") pod \"insights-runtime-extractor-vcrbl\" (UID: \"adfa7ba3-d80a-47f1-9db7-21fe28eb3958\") " pod="openshift-insights/insights-runtime-extractor-vcrbl" May 25 13:08:30.643769 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:30.643669 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/adfa7ba3-d80a-47f1-9db7-21fe28eb3958-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vcrbl\" (UID: \"adfa7ba3-d80a-47f1-9db7-21fe28eb3958\") " pod="openshift-insights/insights-runtime-extractor-vcrbl" May 25 13:08:30.643769 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:30.643707 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/adfa7ba3-d80a-47f1-9db7-21fe28eb3958-crio-socket\") pod \"insights-runtime-extractor-vcrbl\" (UID: \"adfa7ba3-d80a-47f1-9db7-21fe28eb3958\") " pod="openshift-insights/insights-runtime-extractor-vcrbl" May 25 13:08:30.643853 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:30.643807 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhr4q\" (UniqueName: \"kubernetes.io/projected/adfa7ba3-d80a-47f1-9db7-21fe28eb3958-kube-api-access-dhr4q\") pod \"insights-runtime-extractor-vcrbl\" (UID: \"adfa7ba3-d80a-47f1-9db7-21fe28eb3958\") " pod="openshift-insights/insights-runtime-extractor-vcrbl" May 25 13:08:30.643853 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:30.643843 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/adfa7ba3-d80a-47f1-9db7-21fe28eb3958-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vcrbl\" (UID: \"adfa7ba3-d80a-47f1-9db7-21fe28eb3958\") " pod="openshift-insights/insights-runtime-extractor-vcrbl" May 25 13:08:30.744643 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:30.744616 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/adfa7ba3-d80a-47f1-9db7-21fe28eb3958-data-volume\") pod \"insights-runtime-extractor-vcrbl\" (UID: \"adfa7ba3-d80a-47f1-9db7-21fe28eb3958\") " pod="openshift-insights/insights-runtime-extractor-vcrbl" May 25 13:08:30.744817 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:30.744650 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/adfa7ba3-d80a-47f1-9db7-21fe28eb3958-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vcrbl\" (UID: \"adfa7ba3-d80a-47f1-9db7-21fe28eb3958\") " pod="openshift-insights/insights-runtime-extractor-vcrbl" May 25 13:08:30.744817 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:30.744683 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/adfa7ba3-d80a-47f1-9db7-21fe28eb3958-crio-socket\") pod \"insights-runtime-extractor-vcrbl\" (UID: \"adfa7ba3-d80a-47f1-9db7-21fe28eb3958\") " pod="openshift-insights/insights-runtime-extractor-vcrbl" May 25 13:08:30.744817 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:30.744751 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dhr4q\" (UniqueName: \"kubernetes.io/projected/adfa7ba3-d80a-47f1-9db7-21fe28eb3958-kube-api-access-dhr4q\") pod \"insights-runtime-extractor-vcrbl\" (UID: \"adfa7ba3-d80a-47f1-9db7-21fe28eb3958\") " pod="openshift-insights/insights-runtime-extractor-vcrbl" May 25 13:08:30.744817 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:30.744785 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/adfa7ba3-d80a-47f1-9db7-21fe28eb3958-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vcrbl\" (UID: \"adfa7ba3-d80a-47f1-9db7-21fe28eb3958\") " pod="openshift-insights/insights-runtime-extractor-vcrbl" May 25 13:08:30.744975 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:30.744835 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/adfa7ba3-d80a-47f1-9db7-21fe28eb3958-crio-socket\") pod \"insights-runtime-extractor-vcrbl\" (UID: \"adfa7ba3-d80a-47f1-9db7-21fe28eb3958\") " pod="openshift-insights/insights-runtime-extractor-vcrbl" May 25 13:08:30.745017 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:30.744972 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/adfa7ba3-d80a-47f1-9db7-21fe28eb3958-data-volume\") pod \"insights-runtime-extractor-vcrbl\" (UID: \"adfa7ba3-d80a-47f1-9db7-21fe28eb3958\") " pod="openshift-insights/insights-runtime-extractor-vcrbl" May 25 13:08:30.745335 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:30.745316 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/adfa7ba3-d80a-47f1-9db7-21fe28eb3958-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vcrbl\" (UID: \"adfa7ba3-d80a-47f1-9db7-21fe28eb3958\") " pod="openshift-insights/insights-runtime-extractor-vcrbl" May 25 13:08:30.746966 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:30.746946 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/adfa7ba3-d80a-47f1-9db7-21fe28eb3958-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vcrbl\" (UID: \"adfa7ba3-d80a-47f1-9db7-21fe28eb3958\") " pod="openshift-insights/insights-runtime-extractor-vcrbl" May 25 13:08:30.755239 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:30.755221 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhr4q\" (UniqueName: \"kubernetes.io/projected/adfa7ba3-d80a-47f1-9db7-21fe28eb3958-kube-api-access-dhr4q\") pod \"insights-runtime-extractor-vcrbl\" (UID: \"adfa7ba3-d80a-47f1-9db7-21fe28eb3958\") " pod="openshift-insights/insights-runtime-extractor-vcrbl" May 25 13:08:30.886527 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:30.886456 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vcrbl" May 25 13:08:31.004945 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:31.004916 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vcrbl"] May 25 13:08:31.007763 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:08:31.007736 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadfa7ba3_d80a_47f1_9db7_21fe28eb3958.slice/crio-125c97753cdd9d41fea06604c37fef4a73c982f307887e965fa043b936ac47ac WatchSource:0}: Error finding container 125c97753cdd9d41fea06604c37fef4a73c982f307887e965fa043b936ac47ac: Status 404 returned error can't find the container with id 125c97753cdd9d41fea06604c37fef4a73c982f307887e965fa043b936ac47ac May 25 13:08:31.190756 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:31.190714 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vcrbl" event={"ID":"adfa7ba3-d80a-47f1-9db7-21fe28eb3958","Type":"ContainerStarted","Data":"ddc29675df2dac927e6d04b064a957e492b6d337a17f3364cc7c6a80995f310d"} May 25 13:08:31.190756 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:31.190752 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vcrbl" event={"ID":"adfa7ba3-d80a-47f1-9db7-21fe28eb3958","Type":"ContainerStarted","Data":"125c97753cdd9d41fea06604c37fef4a73c982f307887e965fa043b936ac47ac"} May 25 13:08:32.194485 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:32.194452 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vcrbl" event={"ID":"adfa7ba3-d80a-47f1-9db7-21fe28eb3958","Type":"ContainerStarted","Data":"69a31e0408455cb7a04143a914c893e39e19f65ffa8415be49d48ebc39a5645b"} May 25 13:08:34.201378 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:34.201342 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vcrbl" event={"ID":"adfa7ba3-d80a-47f1-9db7-21fe28eb3958","Type":"ContainerStarted","Data":"b1d06d9ee21271b303862793486f68f4aca4823b3f22ca5301ab0364c6115a5a"} May 25 13:08:34.219314 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:34.219270 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vcrbl" podStartSLOduration=1.9573129439999999 podStartE2EDuration="4.219255811s" podCreationTimestamp="2026-05-25 13:08:30 +0000 UTC" firstStartedPulling="2026-05-25 13:08:31.062645004 +0000 UTC m=+176.959914618" lastFinishedPulling="2026-05-25 13:08:33.324587862 +0000 UTC m=+179.221857485" observedRunningTime="2026-05-25 13:08:34.218699243 +0000 UTC m=+180.115968872" watchObservedRunningTime="2026-05-25 13:08:34.219255811 +0000 UTC m=+180.116525443" May 25 13:08:34.575407 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:34.575328 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c2729b4-64b9-46d1-a83a-1da628cd9df6-metrics-certs\") pod \"router-default-759bb5c6c8-v5dhb\" (UID: \"4c2729b4-64b9-46d1-a83a-1da628cd9df6\") " pod="openshift-ingress/router-default-759bb5c6c8-v5dhb" May 25 13:08:34.575407 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:34.575366 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c2729b4-64b9-46d1-a83a-1da628cd9df6-service-ca-bundle\") pod \"router-default-759bb5c6c8-v5dhb\" (UID: \"4c2729b4-64b9-46d1-a83a-1da628cd9df6\") " pod="openshift-ingress/router-default-759bb5c6c8-v5dhb" May 25 13:08:34.576022 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:34.576004 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c2729b4-64b9-46d1-a83a-1da628cd9df6-service-ca-bundle\") pod \"router-default-759bb5c6c8-v5dhb\" (UID: \"4c2729b4-64b9-46d1-a83a-1da628cd9df6\") " pod="openshift-ingress/router-default-759bb5c6c8-v5dhb" May 25 13:08:34.577645 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:34.577625 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c2729b4-64b9-46d1-a83a-1da628cd9df6-metrics-certs\") pod \"router-default-759bb5c6c8-v5dhb\" (UID: \"4c2729b4-64b9-46d1-a83a-1da628cd9df6\") " pod="openshift-ingress/router-default-759bb5c6c8-v5dhb" May 25 13:08:34.870126 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:34.870054 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-j5rld\"" May 25 13:08:34.877511 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:34.877492 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-759bb5c6c8-v5dhb" May 25 13:08:34.992139 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:34.992111 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-759bb5c6c8-v5dhb"] May 25 13:08:34.995162 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:08:34.995121 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c2729b4_64b9_46d1_a83a_1da628cd9df6.slice/crio-58d1c528ad08f45ac61d48861f0c5212b414067eb100da29a94f62e4de098497 WatchSource:0}: Error finding container 58d1c528ad08f45ac61d48861f0c5212b414067eb100da29a94f62e4de098497: Status 404 returned error can't find the container with id 58d1c528ad08f45ac61d48861f0c5212b414067eb100da29a94f62e4de098497 May 25 13:08:35.205464 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:35.205418 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-759bb5c6c8-v5dhb" event={"ID":"4c2729b4-64b9-46d1-a83a-1da628cd9df6","Type":"ContainerStarted","Data":"20593a2c87e6442635e96ba671d997ff23c187293e914d3bc67c99378b15151a"} May 25 13:08:35.205464 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:35.205457 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-759bb5c6c8-v5dhb" event={"ID":"4c2729b4-64b9-46d1-a83a-1da628cd9df6","Type":"ContainerStarted","Data":"58d1c528ad08f45ac61d48861f0c5212b414067eb100da29a94f62e4de098497"} May 25 13:08:35.224968 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:35.224927 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-759bb5c6c8-v5dhb" podStartSLOduration=33.22491393 podStartE2EDuration="33.22491393s" podCreationTimestamp="2026-05-25 13:08:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 13:08:35.22438183 +0000 UTC m=+181.121651463" watchObservedRunningTime="2026-05-25 13:08:35.22491393 +0000 UTC m=+181.122183561" May 25 13:08:35.878736 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:35.878699 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-759bb5c6c8-v5dhb" May 25 13:08:35.881170 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:35.881133 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-759bb5c6c8-v5dhb" May 25 13:08:36.207919 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:36.207890 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-759bb5c6c8-v5dhb" May 25 13:08:36.209132 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:36.209110 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-759bb5c6c8-v5dhb" May 25 13:08:40.857976 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:40.857917 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-9ssvl"] May 25 13:08:40.860702 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:40.860679 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-9ssvl" May 25 13:08:40.865372 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:40.864925 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 25 13:08:40.865372 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:40.864952 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-csd8h\"" May 25 13:08:40.865372 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:40.865046 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" May 25 13:08:40.865372 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:40.865169 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" May 25 13:08:40.865372 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:40.865242 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 25 13:08:40.865682 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:40.865446 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 25 13:08:40.872105 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:40.872084 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-9ssvl"] May 25 13:08:40.918730 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:40.918707 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5fac806b-6e48-4063-b594-808f96d3835e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-9ssvl\" (UID: \"5fac806b-6e48-4063-b594-808f96d3835e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-9ssvl" May 25 13:08:40.918850 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:40.918754 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttb79\" (UniqueName: \"kubernetes.io/projected/5fac806b-6e48-4063-b594-808f96d3835e-kube-api-access-ttb79\") pod \"prometheus-operator-7779bbdd78-9ssvl\" (UID: \"5fac806b-6e48-4063-b594-808f96d3835e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-9ssvl" May 25 13:08:40.918850 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:40.918793 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5fac806b-6e48-4063-b594-808f96d3835e-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-9ssvl\" (UID: \"5fac806b-6e48-4063-b594-808f96d3835e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-9ssvl" May 25 13:08:40.918850 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:40.918810 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5fac806b-6e48-4063-b594-808f96d3835e-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-9ssvl\" (UID: \"5fac806b-6e48-4063-b594-808f96d3835e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-9ssvl" May 25 13:08:41.019247 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:41.019220 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5fac806b-6e48-4063-b594-808f96d3835e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-9ssvl\" (UID: \"5fac806b-6e48-4063-b594-808f96d3835e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-9ssvl" May 25 13:08:41.019383 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:41.019282 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ttb79\" (UniqueName: \"kubernetes.io/projected/5fac806b-6e48-4063-b594-808f96d3835e-kube-api-access-ttb79\") pod \"prometheus-operator-7779bbdd78-9ssvl\" (UID: \"5fac806b-6e48-4063-b594-808f96d3835e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-9ssvl" May 25 13:08:41.019383 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:41.019326 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5fac806b-6e48-4063-b594-808f96d3835e-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-9ssvl\" (UID: \"5fac806b-6e48-4063-b594-808f96d3835e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-9ssvl" May 25 13:08:41.019383 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:41.019357 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5fac806b-6e48-4063-b594-808f96d3835e-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-9ssvl\" (UID: \"5fac806b-6e48-4063-b594-808f96d3835e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-9ssvl" May 25 13:08:41.019939 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:41.019919 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5fac806b-6e48-4063-b594-808f96d3835e-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-9ssvl\" (UID: \"5fac806b-6e48-4063-b594-808f96d3835e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-9ssvl" May 25 13:08:41.021450 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:41.021429 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5fac806b-6e48-4063-b594-808f96d3835e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-9ssvl\" (UID: \"5fac806b-6e48-4063-b594-808f96d3835e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-9ssvl" May 25 13:08:41.021540 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:41.021496 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5fac806b-6e48-4063-b594-808f96d3835e-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-9ssvl\" (UID: \"5fac806b-6e48-4063-b594-808f96d3835e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-9ssvl" May 25 13:08:41.029254 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:41.029222 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttb79\" (UniqueName: \"kubernetes.io/projected/5fac806b-6e48-4063-b594-808f96d3835e-kube-api-access-ttb79\") pod \"prometheus-operator-7779bbdd78-9ssvl\" (UID: \"5fac806b-6e48-4063-b594-808f96d3835e\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-9ssvl" May 25 13:08:41.171215 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:41.171195 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-9ssvl" May 25 13:08:41.292523 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:41.292390 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-9ssvl"] May 25 13:08:41.295366 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:08:41.295336 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fac806b_6e48_4063_b594_808f96d3835e.slice/crio-28552c4ae63635c36be0329a3583184bd8e2bc1e607ac80b065002b85779a9dd WatchSource:0}: Error finding container 28552c4ae63635c36be0329a3583184bd8e2bc1e607ac80b065002b85779a9dd: Status 404 returned error can't find the container with id 28552c4ae63635c36be0329a3583184bd8e2bc1e607ac80b065002b85779a9dd May 25 13:08:42.222202 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:42.222167 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-9ssvl" event={"ID":"5fac806b-6e48-4063-b594-808f96d3835e","Type":"ContainerStarted","Data":"28552c4ae63635c36be0329a3583184bd8e2bc1e607ac80b065002b85779a9dd"} May 25 13:08:43.225897 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:43.225857 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-9ssvl" event={"ID":"5fac806b-6e48-4063-b594-808f96d3835e","Type":"ContainerStarted","Data":"17c0fe3de52ef8b8f172ebda2bf7a183bc054c7aee12a6a7de0e684904d3b5bd"} May 25 13:08:43.225897 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:43.225901 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-9ssvl" event={"ID":"5fac806b-6e48-4063-b594-808f96d3835e","Type":"ContainerStarted","Data":"3e6325a1e3ede763023693ccdc9f7f93c6a7054207469b5977a0161881175c41"} May 25 13:08:43.247105 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:43.247058 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-9ssvl" podStartSLOduration=1.903417556 podStartE2EDuration="3.247045999s" podCreationTimestamp="2026-05-25 13:08:40 +0000 UTC" firstStartedPulling="2026-05-25 13:08:41.297278116 +0000 UTC m=+187.194547739" lastFinishedPulling="2026-05-25 13:08:42.640906569 +0000 UTC m=+188.538176182" observedRunningTime="2026-05-25 13:08:43.245357492 +0000 UTC m=+189.142627135" watchObservedRunningTime="2026-05-25 13:08:43.247045999 +0000 UTC m=+189.144315630" May 25 13:08:45.251199 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.251136 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-fjjgc"] May 25 13:08:45.253815 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.253792 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-fjjgc" May 25 13:08:45.256882 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.256862 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" May 25 13:08:45.257022 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.257000 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" May 25 13:08:45.258185 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.258168 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-tpdlt\"" May 25 13:08:45.258290 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.258216 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" May 25 13:08:45.265103 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.265081 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-fjjgc"] May 25 13:08:45.271876 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.271857 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gq848"] May 25 13:08:45.274411 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.274396 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gq848" May 25 13:08:45.277415 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.277396 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mwjdt\"" May 25 13:08:45.277617 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.277449 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 25 13:08:45.277730 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.277472 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 25 13:08:45.277828 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.277533 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 25 13:08:45.355130 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.355079 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/431c9701-b644-4609-8b9d-40c2d1c1f008-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-fjjgc\" (UID: \"431c9701-b644-4609-8b9d-40c2d1c1f008\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-fjjgc" May 25 13:08:45.355317 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.355134 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/27289736-acaf-4021-935b-1cf4da9dd70b-node-exporter-accelerators-collector-config\") pod \"node-exporter-gq848\" (UID: \"27289736-acaf-4021-935b-1cf4da9dd70b\") " pod="openshift-monitoring/node-exporter-gq848" May 25 13:08:45.355317 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.355184 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/27289736-acaf-4021-935b-1cf4da9dd70b-sys\") pod \"node-exporter-gq848\" (UID: \"27289736-acaf-4021-935b-1cf4da9dd70b\") " pod="openshift-monitoring/node-exporter-gq848" May 25 13:08:45.355317 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.355214 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/27289736-acaf-4021-935b-1cf4da9dd70b-node-exporter-textfile\") pod \"node-exporter-gq848\" (UID: \"27289736-acaf-4021-935b-1cf4da9dd70b\") " pod="openshift-monitoring/node-exporter-gq848" May 25 13:08:45.355317 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.355300 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/27289736-acaf-4021-935b-1cf4da9dd70b-node-exporter-wtmp\") pod \"node-exporter-gq848\" (UID: \"27289736-acaf-4021-935b-1cf4da9dd70b\") " pod="openshift-monitoring/node-exporter-gq848" May 25 13:08:45.355514 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.355327 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/431c9701-b644-4609-8b9d-40c2d1c1f008-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-fjjgc\" (UID: \"431c9701-b644-4609-8b9d-40c2d1c1f008\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-fjjgc" May 25 13:08:45.355514 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.355377 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4zpp\" (UniqueName: \"kubernetes.io/projected/27289736-acaf-4021-935b-1cf4da9dd70b-kube-api-access-d4zpp\") pod \"node-exporter-gq848\" (UID: \"27289736-acaf-4021-935b-1cf4da9dd70b\") " pod="openshift-monitoring/node-exporter-gq848" May 25 13:08:45.355514 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.355397 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/431c9701-b644-4609-8b9d-40c2d1c1f008-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-fjjgc\" (UID: \"431c9701-b644-4609-8b9d-40c2d1c1f008\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-fjjgc" May 25 13:08:45.355514 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.355421 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/27289736-acaf-4021-935b-1cf4da9dd70b-node-exporter-tls\") pod \"node-exporter-gq848\" (UID: \"27289736-acaf-4021-935b-1cf4da9dd70b\") " pod="openshift-monitoring/node-exporter-gq848" May 25 13:08:45.355514 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.355443 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/431c9701-b644-4609-8b9d-40c2d1c1f008-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-fjjgc\" (UID: \"431c9701-b644-4609-8b9d-40c2d1c1f008\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-fjjgc" May 25 13:08:45.355514 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.355495 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97fqg\" (UniqueName: \"kubernetes.io/projected/431c9701-b644-4609-8b9d-40c2d1c1f008-kube-api-access-97fqg\") pod \"kube-state-metrics-54fd6bc5c4-fjjgc\" (UID: \"431c9701-b644-4609-8b9d-40c2d1c1f008\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-fjjgc" May 25 13:08:45.355858 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.355521 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27289736-acaf-4021-935b-1cf4da9dd70b-metrics-client-ca\") pod \"node-exporter-gq848\" (UID: \"27289736-acaf-4021-935b-1cf4da9dd70b\") " pod="openshift-monitoring/node-exporter-gq848" May 25 13:08:45.355858 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.355594 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/431c9701-b644-4609-8b9d-40c2d1c1f008-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-fjjgc\" (UID: \"431c9701-b644-4609-8b9d-40c2d1c1f008\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-fjjgc" May 25 13:08:45.355858 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.355627 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/27289736-acaf-4021-935b-1cf4da9dd70b-root\") pod \"node-exporter-gq848\" (UID: \"27289736-acaf-4021-935b-1cf4da9dd70b\") " pod="openshift-monitoring/node-exporter-gq848" May 25 13:08:45.355858 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.355650 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27289736-acaf-4021-935b-1cf4da9dd70b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gq848\" (UID: \"27289736-acaf-4021-935b-1cf4da9dd70b\") " pod="openshift-monitoring/node-exporter-gq848" May 25 13:08:45.456383 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.456344 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/27289736-acaf-4021-935b-1cf4da9dd70b-root\") pod \"node-exporter-gq848\" (UID: \"27289736-acaf-4021-935b-1cf4da9dd70b\") " pod="openshift-monitoring/node-exporter-gq848" May 25 13:08:45.456383 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.456388 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27289736-acaf-4021-935b-1cf4da9dd70b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gq848\" (UID: \"27289736-acaf-4021-935b-1cf4da9dd70b\") " pod="openshift-monitoring/node-exporter-gq848" May 25 13:08:45.456608 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.456410 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/431c9701-b644-4609-8b9d-40c2d1c1f008-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-fjjgc\" (UID: \"431c9701-b644-4609-8b9d-40c2d1c1f008\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-fjjgc" May 25 13:08:45.456608 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.456431 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/27289736-acaf-4021-935b-1cf4da9dd70b-node-exporter-accelerators-collector-config\") pod \"node-exporter-gq848\" (UID: \"27289736-acaf-4021-935b-1cf4da9dd70b\") " pod="openshift-monitoring/node-exporter-gq848" May 25 13:08:45.456608 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.456456 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/27289736-acaf-4021-935b-1cf4da9dd70b-sys\") pod \"node-exporter-gq848\" (UID: \"27289736-acaf-4021-935b-1cf4da9dd70b\") " pod="openshift-monitoring/node-exporter-gq848" May 25 13:08:45.456608 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.456458 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/27289736-acaf-4021-935b-1cf4da9dd70b-root\") pod \"node-exporter-gq848\" (UID: \"27289736-acaf-4021-935b-1cf4da9dd70b\") " pod="openshift-monitoring/node-exporter-gq848" May 25 13:08:45.456608 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.456486 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/27289736-acaf-4021-935b-1cf4da9dd70b-node-exporter-textfile\") pod \"node-exporter-gq848\" (UID: \"27289736-acaf-4021-935b-1cf4da9dd70b\") " pod="openshift-monitoring/node-exporter-gq848" May 25 13:08:45.456608 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.456522 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/27289736-acaf-4021-935b-1cf4da9dd70b-sys\") pod \"node-exporter-gq848\" (UID: \"27289736-acaf-4021-935b-1cf4da9dd70b\") " pod="openshift-monitoring/node-exporter-gq848" May 25 13:08:45.456608 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.456536 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/27289736-acaf-4021-935b-1cf4da9dd70b-node-exporter-wtmp\") pod \"node-exporter-gq848\" (UID: \"27289736-acaf-4021-935b-1cf4da9dd70b\") " pod="openshift-monitoring/node-exporter-gq848" May 25 13:08:45.456608 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.456575 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/431c9701-b644-4609-8b9d-40c2d1c1f008-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-fjjgc\" (UID: \"431c9701-b644-4609-8b9d-40c2d1c1f008\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-fjjgc" May 25 13:08:45.456976 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.456619 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d4zpp\" (UniqueName: \"kubernetes.io/projected/27289736-acaf-4021-935b-1cf4da9dd70b-kube-api-access-d4zpp\") pod \"node-exporter-gq848\" (UID: \"27289736-acaf-4021-935b-1cf4da9dd70b\") " pod="openshift-monitoring/node-exporter-gq848" May 25 13:08:45.456976 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.456646 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/431c9701-b644-4609-8b9d-40c2d1c1f008-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-fjjgc\" (UID: \"431c9701-b644-4609-8b9d-40c2d1c1f008\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-fjjgc" May 25 13:08:45.456976 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.456686 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/27289736-acaf-4021-935b-1cf4da9dd70b-node-exporter-tls\") pod \"node-exporter-gq848\" (UID: \"27289736-acaf-4021-935b-1cf4da9dd70b\") " pod="openshift-monitoring/node-exporter-gq848" May 25 13:08:45.456976 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.456712 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/431c9701-b644-4609-8b9d-40c2d1c1f008-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-fjjgc\" (UID: \"431c9701-b644-4609-8b9d-40c2d1c1f008\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-fjjgc" May 25 13:08:45.456976 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.456732 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/27289736-acaf-4021-935b-1cf4da9dd70b-node-exporter-wtmp\") pod \"node-exporter-gq848\" (UID: \"27289736-acaf-4021-935b-1cf4da9dd70b\") " pod="openshift-monitoring/node-exporter-gq848" May 25 13:08:45.456976 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.456745 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-97fqg\" (UniqueName: \"kubernetes.io/projected/431c9701-b644-4609-8b9d-40c2d1c1f008-kube-api-access-97fqg\") pod \"kube-state-metrics-54fd6bc5c4-fjjgc\" (UID: \"431c9701-b644-4609-8b9d-40c2d1c1f008\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-fjjgc" May 25 13:08:45.456976 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.456882 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/27289736-acaf-4021-935b-1cf4da9dd70b-node-exporter-textfile\") pod \"node-exporter-gq848\" (UID: \"27289736-acaf-4021-935b-1cf4da9dd70b\") " pod="openshift-monitoring/node-exporter-gq848" May 25 13:08:45.457357 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.457046 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27289736-acaf-4021-935b-1cf4da9dd70b-metrics-client-ca\") pod \"node-exporter-gq848\" (UID: \"27289736-acaf-4021-935b-1cf4da9dd70b\") " pod="openshift-monitoring/node-exporter-gq848" May 25 13:08:45.457357 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.457064 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/431c9701-b644-4609-8b9d-40c2d1c1f008-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-fjjgc\" (UID: \"431c9701-b644-4609-8b9d-40c2d1c1f008\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-fjjgc" May 25 13:08:45.457357 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.457131 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/431c9701-b644-4609-8b9d-40c2d1c1f008-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-fjjgc\" (UID: \"431c9701-b644-4609-8b9d-40c2d1c1f008\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-fjjgc" May 25 13:08:45.457357 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.457145 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/27289736-acaf-4021-935b-1cf4da9dd70b-node-exporter-accelerators-collector-config\") pod \"node-exporter-gq848\" (UID: \"27289736-acaf-4021-935b-1cf4da9dd70b\") " pod="openshift-monitoring/node-exporter-gq848" May 25 13:08:45.457357 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.457283 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/431c9701-b644-4609-8b9d-40c2d1c1f008-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-fjjgc\" (UID: \"431c9701-b644-4609-8b9d-40c2d1c1f008\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-fjjgc" May 25 13:08:45.457606 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.457588 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27289736-acaf-4021-935b-1cf4da9dd70b-metrics-client-ca\") pod \"node-exporter-gq848\" (UID: \"27289736-acaf-4021-935b-1cf4da9dd70b\") " pod="openshift-monitoring/node-exporter-gq848" May 25 13:08:45.457696 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.457669 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/431c9701-b644-4609-8b9d-40c2d1c1f008-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-fjjgc\" (UID: \"431c9701-b644-4609-8b9d-40c2d1c1f008\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-fjjgc" May 25 13:08:45.458944 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.458916 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27289736-acaf-4021-935b-1cf4da9dd70b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gq848\" (UID: \"27289736-acaf-4021-935b-1cf4da9dd70b\") " pod="openshift-monitoring/node-exporter-gq848" May 25 13:08:45.459217 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.459201 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/27289736-acaf-4021-935b-1cf4da9dd70b-node-exporter-tls\") pod \"node-exporter-gq848\" (UID: \"27289736-acaf-4021-935b-1cf4da9dd70b\") " pod="openshift-monitoring/node-exporter-gq848" May 25 13:08:45.459597 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.459576 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/431c9701-b644-4609-8b9d-40c2d1c1f008-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-fjjgc\" (UID: \"431c9701-b644-4609-8b9d-40c2d1c1f008\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-fjjgc" May 25 13:08:45.459657 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.459558 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/431c9701-b644-4609-8b9d-40c2d1c1f008-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-fjjgc\" (UID: \"431c9701-b644-4609-8b9d-40c2d1c1f008\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-fjjgc" May 25 13:08:45.466298 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.466241 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4zpp\" (UniqueName: \"kubernetes.io/projected/27289736-acaf-4021-935b-1cf4da9dd70b-kube-api-access-d4zpp\") pod \"node-exporter-gq848\" (UID: \"27289736-acaf-4021-935b-1cf4da9dd70b\") " pod="openshift-monitoring/node-exporter-gq848" May 25 13:08:45.467336 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.466909 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97fqg\" (UniqueName: \"kubernetes.io/projected/431c9701-b644-4609-8b9d-40c2d1c1f008-kube-api-access-97fqg\") pod \"kube-state-metrics-54fd6bc5c4-fjjgc\" (UID: \"431c9701-b644-4609-8b9d-40c2d1c1f008\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-fjjgc" May 25 13:08:45.565103 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.565005 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-fjjgc" May 25 13:08:45.585993 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.585970 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gq848" May 25 13:08:45.595903 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:08:45.595875 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27289736_acaf_4021_935b_1cf4da9dd70b.slice/crio-3c6919235d21a1c32c8a0cb5172133329a5b1933389668de46c430c9fd8479ff WatchSource:0}: Error finding container 3c6919235d21a1c32c8a0cb5172133329a5b1933389668de46c430c9fd8479ff: Status 404 returned error can't find the container with id 3c6919235d21a1c32c8a0cb5172133329a5b1933389668de46c430c9fd8479ff May 25 13:08:45.698439 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:45.695959 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-fjjgc"] May 25 13:08:45.700952 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:08:45.700928 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod431c9701_b644_4609_8b9d_40c2d1c1f008.slice/crio-fb0c9c7b72a78c37460ef528211397bfed553fac5fe04b439ab445cba47f47eb WatchSource:0}: Error finding container fb0c9c7b72a78c37460ef528211397bfed553fac5fe04b439ab445cba47f47eb: Status 404 returned error can't find the container with id fb0c9c7b72a78c37460ef528211397bfed553fac5fe04b439ab445cba47f47eb May 25 13:08:46.234865 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:46.234811 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gq848" event={"ID":"27289736-acaf-4021-935b-1cf4da9dd70b","Type":"ContainerStarted","Data":"3c6919235d21a1c32c8a0cb5172133329a5b1933389668de46c430c9fd8479ff"} May 25 13:08:46.235923 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:46.235892 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-fjjgc" event={"ID":"431c9701-b644-4609-8b9d-40c2d1c1f008","Type":"ContainerStarted","Data":"fb0c9c7b72a78c37460ef528211397bfed553fac5fe04b439ab445cba47f47eb"} May 25 13:08:47.240199 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:47.240096 2568 generic.go:358] "Generic (PLEG): container finished" podID="27289736-acaf-4021-935b-1cf4da9dd70b" containerID="d32db6004751a6fa5295d866f78466045efd84cd89f6a2c2e0b3b7006162f7ae" exitCode=0 May 25 13:08:47.240199 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:47.240188 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gq848" event={"ID":"27289736-acaf-4021-935b-1cf4da9dd70b","Type":"ContainerDied","Data":"d32db6004751a6fa5295d866f78466045efd84cd89f6a2c2e0b3b7006162f7ae"} May 25 13:08:47.241988 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:47.241966 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-fjjgc" event={"ID":"431c9701-b644-4609-8b9d-40c2d1c1f008","Type":"ContainerStarted","Data":"9ebe15361097d4c502b564a5f29497dbad6a784f5dfe98c1634d33bcbae40b0c"} May 25 13:08:47.242097 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:47.241989 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-fjjgc" event={"ID":"431c9701-b644-4609-8b9d-40c2d1c1f008","Type":"ContainerStarted","Data":"e5a07867dd12157b73b2ff24beb3003ce89d6b54d759ede7279a1b0e86d4919e"} May 25 13:08:47.242097 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:47.242000 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-fjjgc" event={"ID":"431c9701-b644-4609-8b9d-40c2d1c1f008","Type":"ContainerStarted","Data":"0cf2c3055017d5c9f9cf597f6de9920e765b79ff7d115eb15d8186ee3655281e"} May 25 13:08:48.220076 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:48.220025 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-fjjgc" podStartSLOduration=1.955874103 podStartE2EDuration="3.220008918s" podCreationTimestamp="2026-05-25 13:08:45 +0000 UTC" firstStartedPulling="2026-05-25 13:08:45.702705968 +0000 UTC m=+191.599975583" lastFinishedPulling="2026-05-25 13:08:46.966840788 +0000 UTC m=+192.864110398" observedRunningTime="2026-05-25 13:08:47.280136747 +0000 UTC m=+193.177406381" watchObservedRunningTime="2026-05-25 13:08:48.220008918 +0000 UTC m=+194.117278550" May 25 13:08:48.220515 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:48.220498 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7f5448b88c-p26gz"] May 25 13:08:48.223163 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:48.223137 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7f5448b88c-p26gz" May 25 13:08:48.226129 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:48.226091 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" May 25 13:08:48.226365 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:48.226328 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" May 25 13:08:48.226607 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:48.226588 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-ek2sltbuitit4\"" May 25 13:08:48.226821 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:48.226807 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" May 25 13:08:48.227721 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:48.227702 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-g64vj\"" May 25 13:08:48.227810 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:48.227702 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" May 25 13:08:48.227810 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:48.227705 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" May 25 13:08:48.235661 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:48.235628 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7f5448b88c-p26gz"] May 25 13:08:48.246225 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:48.246197 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gq848" event={"ID":"27289736-acaf-4021-935b-1cf4da9dd70b","Type":"ContainerStarted","Data":"69dfbea69cc5929a51e74199655160291c7e85b7702e8b29cfbdc2a760b35924"} May 25 13:08:48.246554 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:48.246234 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gq848" event={"ID":"27289736-acaf-4021-935b-1cf4da9dd70b","Type":"ContainerStarted","Data":"a914a9a97baaed7dd1691952d5b23f6be89b02e906fe7619195693223d7b96c1"} May 25 13:08:48.271813 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:48.271770 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gq848" podStartSLOduration=2.414432204 podStartE2EDuration="3.271759317s" podCreationTimestamp="2026-05-25 13:08:45 +0000 UTC" firstStartedPulling="2026-05-25 13:08:45.597912369 +0000 UTC m=+191.495181983" lastFinishedPulling="2026-05-25 13:08:46.455239466 +0000 UTC m=+192.352509096" observedRunningTime="2026-05-25 13:08:48.270545824 +0000 UTC m=+194.167815482" watchObservedRunningTime="2026-05-25 13:08:48.271759317 +0000 UTC m=+194.169028965" May 25 13:08:48.281332 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:48.281308 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8168e2ca-7c4f-4183-80f2-601f09430db2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f5448b88c-p26gz\" (UID: \"8168e2ca-7c4f-4183-80f2-601f09430db2\") " pod="openshift-monitoring/thanos-querier-7f5448b88c-p26gz" May 25 13:08:48.281440 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:48.281381 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8168e2ca-7c4f-4183-80f2-601f09430db2-secret-thanos-querier-tls\") pod \"thanos-querier-7f5448b88c-p26gz\" (UID: \"8168e2ca-7c4f-4183-80f2-601f09430db2\") " pod="openshift-monitoring/thanos-querier-7f5448b88c-p26gz" May 25 13:08:48.281440 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:48.281405 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8168e2ca-7c4f-4183-80f2-601f09430db2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f5448b88c-p26gz\" (UID: \"8168e2ca-7c4f-4183-80f2-601f09430db2\") " pod="openshift-monitoring/thanos-querier-7f5448b88c-p26gz" May 25 13:08:48.281440 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:48.281425 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8168e2ca-7c4f-4183-80f2-601f09430db2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f5448b88c-p26gz\" (UID: \"8168e2ca-7c4f-4183-80f2-601f09430db2\") " pod="openshift-monitoring/thanos-querier-7f5448b88c-p26gz" May 25 13:08:48.281594 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:48.281448 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8168e2ca-7c4f-4183-80f2-601f09430db2-metrics-client-ca\") pod \"thanos-querier-7f5448b88c-p26gz\" (UID: \"8168e2ca-7c4f-4183-80f2-601f09430db2\") " pod="openshift-monitoring/thanos-querier-7f5448b88c-p26gz" May 25 13:08:48.281594 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:48.281528 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8168e2ca-7c4f-4183-80f2-601f09430db2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f5448b88c-p26gz\" (UID: \"8168e2ca-7c4f-4183-80f2-601f09430db2\") " pod="openshift-monitoring/thanos-querier-7f5448b88c-p26gz" May 25 13:08:48.281594 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:48.281553 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gknnl\" (UniqueName: \"kubernetes.io/projected/8168e2ca-7c4f-4183-80f2-601f09430db2-kube-api-access-gknnl\") pod \"thanos-querier-7f5448b88c-p26gz\" (UID: \"8168e2ca-7c4f-4183-80f2-601f09430db2\") " pod="openshift-monitoring/thanos-querier-7f5448b88c-p26gz" May 25 13:08:48.281594 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:48.281583 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8168e2ca-7c4f-4183-80f2-601f09430db2-secret-grpc-tls\") pod \"thanos-querier-7f5448b88c-p26gz\" (UID: \"8168e2ca-7c4f-4183-80f2-601f09430db2\") " pod="openshift-monitoring/thanos-querier-7f5448b88c-p26gz" May 25 13:08:48.382498 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:48.382471 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8168e2ca-7c4f-4183-80f2-601f09430db2-secret-grpc-tls\") pod \"thanos-querier-7f5448b88c-p26gz\" (UID: \"8168e2ca-7c4f-4183-80f2-601f09430db2\") " pod="openshift-monitoring/thanos-querier-7f5448b88c-p26gz" May 25 13:08:48.382612 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:48.382531 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8168e2ca-7c4f-4183-80f2-601f09430db2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f5448b88c-p26gz\" (UID: \"8168e2ca-7c4f-4183-80f2-601f09430db2\") " pod="openshift-monitoring/thanos-querier-7f5448b88c-p26gz" May 25 13:08:48.382675 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:48.382665 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8168e2ca-7c4f-4183-80f2-601f09430db2-secret-thanos-querier-tls\") pod \"thanos-querier-7f5448b88c-p26gz\" (UID: \"8168e2ca-7c4f-4183-80f2-601f09430db2\") " pod="openshift-monitoring/thanos-querier-7f5448b88c-p26gz" May 25 13:08:48.382731 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:48.382696 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8168e2ca-7c4f-4183-80f2-601f09430db2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f5448b88c-p26gz\" (UID: \"8168e2ca-7c4f-4183-80f2-601f09430db2\") " pod="openshift-monitoring/thanos-querier-7f5448b88c-p26gz" May 25 13:08:48.382731 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:48.382724 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8168e2ca-7c4f-4183-80f2-601f09430db2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f5448b88c-p26gz\" (UID: \"8168e2ca-7c4f-4183-80f2-601f09430db2\") " pod="openshift-monitoring/thanos-querier-7f5448b88c-p26gz" May 25 13:08:48.382830 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:48.382774 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8168e2ca-7c4f-4183-80f2-601f09430db2-metrics-client-ca\") pod \"thanos-querier-7f5448b88c-p26gz\" (UID: \"8168e2ca-7c4f-4183-80f2-601f09430db2\") " pod="openshift-monitoring/thanos-querier-7f5448b88c-p26gz" May 25 13:08:48.382880 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:48.382857 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8168e2ca-7c4f-4183-80f2-601f09430db2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f5448b88c-p26gz\" (UID: \"8168e2ca-7c4f-4183-80f2-601f09430db2\") " pod="openshift-monitoring/thanos-querier-7f5448b88c-p26gz" May 25 13:08:48.382968 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:48.382887 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gknnl\" (UniqueName: \"kubernetes.io/projected/8168e2ca-7c4f-4183-80f2-601f09430db2-kube-api-access-gknnl\") pod \"thanos-querier-7f5448b88c-p26gz\" (UID: \"8168e2ca-7c4f-4183-80f2-601f09430db2\") " pod="openshift-monitoring/thanos-querier-7f5448b88c-p26gz" May 25 13:08:48.385781 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:48.385657 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8168e2ca-7c4f-4183-80f2-601f09430db2-metrics-client-ca\") pod \"thanos-querier-7f5448b88c-p26gz\" (UID: \"8168e2ca-7c4f-4183-80f2-601f09430db2\") " pod="openshift-monitoring/thanos-querier-7f5448b88c-p26gz" May 25 13:08:48.390647 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:48.387024 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8168e2ca-7c4f-4183-80f2-601f09430db2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f5448b88c-p26gz\" (UID: \"8168e2ca-7c4f-4183-80f2-601f09430db2\") " pod="openshift-monitoring/thanos-querier-7f5448b88c-p26gz" May 25 13:08:48.390647 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:48.387430 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8168e2ca-7c4f-4183-80f2-601f09430db2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f5448b88c-p26gz\" (UID: \"8168e2ca-7c4f-4183-80f2-601f09430db2\") " pod="openshift-monitoring/thanos-querier-7f5448b88c-p26gz" May 25 13:08:48.390647 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:48.387844 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8168e2ca-7c4f-4183-80f2-601f09430db2-secret-grpc-tls\") pod \"thanos-querier-7f5448b88c-p26gz\" (UID: \"8168e2ca-7c4f-4183-80f2-601f09430db2\") " pod="openshift-monitoring/thanos-querier-7f5448b88c-p26gz" May 25 13:08:48.390647 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:48.387881 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8168e2ca-7c4f-4183-80f2-601f09430db2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f5448b88c-p26gz\" (UID: \"8168e2ca-7c4f-4183-80f2-601f09430db2\") " pod="openshift-monitoring/thanos-querier-7f5448b88c-p26gz" May 25 13:08:48.390647 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:48.388842 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8168e2ca-7c4f-4183-80f2-601f09430db2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f5448b88c-p26gz\" (UID: \"8168e2ca-7c4f-4183-80f2-601f09430db2\") " pod="openshift-monitoring/thanos-querier-7f5448b88c-p26gz" May 25 13:08:48.392185 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:48.392144 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8168e2ca-7c4f-4183-80f2-601f09430db2-secret-thanos-querier-tls\") pod \"thanos-querier-7f5448b88c-p26gz\" (UID: \"8168e2ca-7c4f-4183-80f2-601f09430db2\") " pod="openshift-monitoring/thanos-querier-7f5448b88c-p26gz" May 25 13:08:48.393676 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:48.393660 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gknnl\" (UniqueName: \"kubernetes.io/projected/8168e2ca-7c4f-4183-80f2-601f09430db2-kube-api-access-gknnl\") pod \"thanos-querier-7f5448b88c-p26gz\" (UID: \"8168e2ca-7c4f-4183-80f2-601f09430db2\") " pod="openshift-monitoring/thanos-querier-7f5448b88c-p26gz" May 25 13:08:48.533319 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:48.533242 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7f5448b88c-p26gz" May 25 13:08:48.658866 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:48.658841 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7f5448b88c-p26gz"] May 25 13:08:48.660671 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:08:48.660640 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8168e2ca_7c4f_4183_80f2_601f09430db2.slice/crio-7dd0cc239991a514745e836ff81cb2c781e2a20842ef05ec9ef97f9f0e547252 WatchSource:0}: Error finding container 7dd0cc239991a514745e836ff81cb2c781e2a20842ef05ec9ef97f9f0e547252: Status 404 returned error can't find the container with id 7dd0cc239991a514745e836ff81cb2c781e2a20842ef05ec9ef97f9f0e547252 May 25 13:08:49.251243 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:49.251205 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f5448b88c-p26gz" event={"ID":"8168e2ca-7c4f-4183-80f2-601f09430db2","Type":"ContainerStarted","Data":"7dd0cc239991a514745e836ff81cb2c781e2a20842ef05ec9ef97f9f0e547252"} May 25 13:08:51.263048 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.263015 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f5448b88c-p26gz" event={"ID":"8168e2ca-7c4f-4183-80f2-601f09430db2","Type":"ContainerStarted","Data":"31e48f7dd08af0e1865400057c5497a3e26dc0619edac334b3dbd2eb6b5062a1"} May 25 13:08:51.263474 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.263061 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f5448b88c-p26gz" event={"ID":"8168e2ca-7c4f-4183-80f2-601f09430db2","Type":"ContainerStarted","Data":"a696ec4852eccaca2fcfd4447b75039d4e3b0005615b2e5b329358b6e387b174"} May 25 13:08:51.263474 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.263074 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f5448b88c-p26gz" event={"ID":"8168e2ca-7c4f-4183-80f2-601f09430db2","Type":"ContainerStarted","Data":"e5d3c387c1770f49b7a1f9f7f3ec87408235621101a34d9572713b8e89a4a071"} May 25 13:08:51.444121 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.443876 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 13:08:51.447886 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.447801 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.452293 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.452191 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 25 13:08:51.452416 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.452340 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 25 13:08:51.452975 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.452651 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 25 13:08:51.452975 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.452712 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 25 13:08:51.452975 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.452712 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 25 13:08:51.452975 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.452835 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-7c5n5\"" May 25 13:08:51.452975 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.452852 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 25 13:08:51.452975 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.452887 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-dn8cgrm3u4553\"" May 25 13:08:51.452975 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.452925 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 25 13:08:51.453390 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.453033 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 25 13:08:51.453390 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.453081 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 25 13:08:51.453390 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.453108 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 25 13:08:51.453390 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.453234 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 25 13:08:51.453390 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.453308 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 25 13:08:51.455145 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.455126 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 25 13:08:51.466670 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.466524 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 13:08:51.512629 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.512603 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.512835 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.512818 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8d93b814-1dc1-43ff-ad48-341f4fb85112-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.512973 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.512959 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d93b814-1dc1-43ff-ad48-341f4fb85112-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.513123 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.513085 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjnlj\" (UniqueName: \"kubernetes.io/projected/8d93b814-1dc1-43ff-ad48-341f4fb85112-kube-api-access-wjnlj\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.513301 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.513285 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d93b814-1dc1-43ff-ad48-341f4fb85112-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.513431 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.513418 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.513542 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.513531 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.513671 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.513648 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8d93b814-1dc1-43ff-ad48-341f4fb85112-config-out\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.513782 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.513681 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8d93b814-1dc1-43ff-ad48-341f4fb85112-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.513782 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.513730 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-web-config\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.513782 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.513764 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d93b814-1dc1-43ff-ad48-341f4fb85112-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.513928 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.513834 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.513928 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.513859 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.513928 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.513909 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-config\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.514056 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.513938 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8d93b814-1dc1-43ff-ad48-341f4fb85112-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.514056 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.513979 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.514056 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.514007 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d93b814-1dc1-43ff-ad48-341f4fb85112-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.514056 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.514029 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.616101 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.615443 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-web-config\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.616101 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.615492 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d93b814-1dc1-43ff-ad48-341f4fb85112-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.616101 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.615552 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.616101 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.615576 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.616101 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.615622 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-config\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.616101 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.615647 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8d93b814-1dc1-43ff-ad48-341f4fb85112-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.616101 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.615682 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.616101 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.615711 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d93b814-1dc1-43ff-ad48-341f4fb85112-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.616101 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.615733 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.616101 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.615778 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.616101 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.615810 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8d93b814-1dc1-43ff-ad48-341f4fb85112-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.616101 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.615837 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d93b814-1dc1-43ff-ad48-341f4fb85112-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.616101 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.615861 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wjnlj\" (UniqueName: \"kubernetes.io/projected/8d93b814-1dc1-43ff-ad48-341f4fb85112-kube-api-access-wjnlj\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.616101 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.615887 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d93b814-1dc1-43ff-ad48-341f4fb85112-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.616101 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.615925 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.616101 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.615953 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.616101 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.615983 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8d93b814-1dc1-43ff-ad48-341f4fb85112-config-out\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.616987 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.616006 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8d93b814-1dc1-43ff-ad48-341f4fb85112-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.616987 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.616361 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8d93b814-1dc1-43ff-ad48-341f4fb85112-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.616987 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.616628 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d93b814-1dc1-43ff-ad48-341f4fb85112-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.617581 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.617242 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d93b814-1dc1-43ff-ad48-341f4fb85112-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.617696 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.617618 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d93b814-1dc1-43ff-ad48-341f4fb85112-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.619354 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.618947 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.619354 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.619005 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d93b814-1dc1-43ff-ad48-341f4fb85112-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.620726 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.620355 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-web-config\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.620726 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.620674 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8d93b814-1dc1-43ff-ad48-341f4fb85112-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.621364 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.621340 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8d93b814-1dc1-43ff-ad48-341f4fb85112-config-out\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.621905 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.621881 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.622000 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.621917 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.622400 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.622377 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.622988 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.622966 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.623423 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.623401 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8d93b814-1dc1-43ff-ad48-341f4fb85112-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.624063 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.624046 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.624450 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.624409 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-config\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.624996 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.624957 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.627265 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.627242 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjnlj\" (UniqueName: \"kubernetes.io/projected/8d93b814-1dc1-43ff-ad48-341f4fb85112-kube-api-access-wjnlj\") pod \"prometheus-k8s-0\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.759964 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.759925 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 25 13:08:51.910621 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:51.910590 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 13:08:51.912947 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:08:51.912918 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d93b814_1dc1_43ff_ad48_341f4fb85112.slice/crio-afeac6d77ef15ffa84d17af9c89fceea6713def8f47e6eb6b5e4d194b1a8dd46 WatchSource:0}: Error finding container afeac6d77ef15ffa84d17af9c89fceea6713def8f47e6eb6b5e4d194b1a8dd46: Status 404 returned error can't find the container with id afeac6d77ef15ffa84d17af9c89fceea6713def8f47e6eb6b5e4d194b1a8dd46 May 25 13:08:52.266490 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:52.266453 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d93b814-1dc1-43ff-ad48-341f4fb85112","Type":"ContainerStarted","Data":"afeac6d77ef15ffa84d17af9c89fceea6713def8f47e6eb6b5e4d194b1a8dd46"} May 25 13:08:52.268913 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:52.268878 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f5448b88c-p26gz" event={"ID":"8168e2ca-7c4f-4183-80f2-601f09430db2","Type":"ContainerStarted","Data":"bd37ae8c5a421f64200334deaaef227aab99cd981833269d2064f5d8a238a630"} May 25 13:08:52.269055 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:52.268918 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f5448b88c-p26gz" event={"ID":"8168e2ca-7c4f-4183-80f2-601f09430db2","Type":"ContainerStarted","Data":"7a3b75d99b47d1a89e12f4c6f32632e5c44460362a4c0a85d61460ebea6742b5"} May 25 13:08:52.269055 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:52.268933 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f5448b88c-p26gz" event={"ID":"8168e2ca-7c4f-4183-80f2-601f09430db2","Type":"ContainerStarted","Data":"e5903f1d41adb707a5807b29f96e102d309fd17b6813e246a352a516f181336e"} May 25 13:08:52.269194 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:52.269173 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7f5448b88c-p26gz" May 25 13:08:52.296510 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:52.296486 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67c696b864-h6hp4"] May 25 13:08:52.296654 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:52.296620 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7f5448b88c-p26gz" podStartSLOduration=1.512972767 podStartE2EDuration="4.296606758s" podCreationTimestamp="2026-05-25 13:08:48 +0000 UTC" firstStartedPulling="2026-05-25 13:08:48.66250111 +0000 UTC m=+194.559770725" lastFinishedPulling="2026-05-25 13:08:51.446135102 +0000 UTC m=+197.343404716" observedRunningTime="2026-05-25 13:08:52.295304535 +0000 UTC m=+198.192574167" watchObservedRunningTime="2026-05-25 13:08:52.296606758 +0000 UTC m=+198.193876383" May 25 13:08:52.296711 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:08:52.296678 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-67c696b864-h6hp4" podUID="a980382d-bbe6-4d7b-9c47-26a68b389c55" May 25 13:08:53.272672 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:53.272582 2568 generic.go:358] "Generic (PLEG): container finished" podID="8d93b814-1dc1-43ff-ad48-341f4fb85112" containerID="ce2f74bfaeb183adea3500da9baefdc981c3e250daa045216ccb4ebb63a7a9d3" exitCode=0 May 25 13:08:53.273072 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:53.272677 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67c696b864-h6hp4" May 25 13:08:53.273072 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:53.272671 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d93b814-1dc1-43ff-ad48-341f4fb85112","Type":"ContainerDied","Data":"ce2f74bfaeb183adea3500da9baefdc981c3e250daa045216ccb4ebb63a7a9d3"} May 25 13:08:53.276999 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:53.276982 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67c696b864-h6hp4" May 25 13:08:53.333685 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:53.333656 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a980382d-bbe6-4d7b-9c47-26a68b389c55-bound-sa-token\") pod \"a980382d-bbe6-4d7b-9c47-26a68b389c55\" (UID: \"a980382d-bbe6-4d7b-9c47-26a68b389c55\") " May 25 13:08:53.333838 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:53.333700 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a980382d-bbe6-4d7b-9c47-26a68b389c55-image-registry-private-configuration\") pod \"a980382d-bbe6-4d7b-9c47-26a68b389c55\" (UID: \"a980382d-bbe6-4d7b-9c47-26a68b389c55\") " May 25 13:08:53.333838 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:53.333730 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a980382d-bbe6-4d7b-9c47-26a68b389c55-installation-pull-secrets\") pod \"a980382d-bbe6-4d7b-9c47-26a68b389c55\" (UID: \"a980382d-bbe6-4d7b-9c47-26a68b389c55\") " May 25 13:08:53.333838 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:53.333755 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a980382d-bbe6-4d7b-9c47-26a68b389c55-ca-trust-extracted\") pod \"a980382d-bbe6-4d7b-9c47-26a68b389c55\" (UID: \"a980382d-bbe6-4d7b-9c47-26a68b389c55\") " May 25 13:08:53.333838 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:53.333798 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a980382d-bbe6-4d7b-9c47-26a68b389c55-registry-certificates\") pod \"a980382d-bbe6-4d7b-9c47-26a68b389c55\" (UID: \"a980382d-bbe6-4d7b-9c47-26a68b389c55\") " May 25 13:08:53.334039 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:53.333878 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a980382d-bbe6-4d7b-9c47-26a68b389c55-trusted-ca\") pod \"a980382d-bbe6-4d7b-9c47-26a68b389c55\" (UID: \"a980382d-bbe6-4d7b-9c47-26a68b389c55\") " May 25 13:08:53.334039 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:53.333912 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-877xl\" (UniqueName: \"kubernetes.io/projected/a980382d-bbe6-4d7b-9c47-26a68b389c55-kube-api-access-877xl\") pod \"a980382d-bbe6-4d7b-9c47-26a68b389c55\" (UID: \"a980382d-bbe6-4d7b-9c47-26a68b389c55\") " May 25 13:08:53.334138 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:53.334105 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a980382d-bbe6-4d7b-9c47-26a68b389c55-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a980382d-bbe6-4d7b-9c47-26a68b389c55" (UID: "a980382d-bbe6-4d7b-9c47-26a68b389c55"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 25 13:08:53.334740 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:53.334218 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a980382d-bbe6-4d7b-9c47-26a68b389c55-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a980382d-bbe6-4d7b-9c47-26a68b389c55" (UID: "a980382d-bbe6-4d7b-9c47-26a68b389c55"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 13:08:53.334740 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:53.334600 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a980382d-bbe6-4d7b-9c47-26a68b389c55-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a980382d-bbe6-4d7b-9c47-26a68b389c55" (UID: "a980382d-bbe6-4d7b-9c47-26a68b389c55"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 13:08:53.334740 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:53.334705 2568 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a980382d-bbe6-4d7b-9c47-26a68b389c55-ca-trust-extracted\") on node \"ip-10-0-132-184.ec2.internal\" DevicePath \"\"" May 25 13:08:53.334740 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:53.334728 2568 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a980382d-bbe6-4d7b-9c47-26a68b389c55-registry-certificates\") on node \"ip-10-0-132-184.ec2.internal\" DevicePath \"\"" May 25 13:08:53.334740 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:53.334742 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a980382d-bbe6-4d7b-9c47-26a68b389c55-trusted-ca\") on node \"ip-10-0-132-184.ec2.internal\" DevicePath \"\"" May 25 13:08:53.336453 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:53.336430 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a980382d-bbe6-4d7b-9c47-26a68b389c55-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a980382d-bbe6-4d7b-9c47-26a68b389c55" (UID: "a980382d-bbe6-4d7b-9c47-26a68b389c55"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 13:08:53.336541 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:53.336492 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a980382d-bbe6-4d7b-9c47-26a68b389c55-kube-api-access-877xl" (OuterVolumeSpecName: "kube-api-access-877xl") pod "a980382d-bbe6-4d7b-9c47-26a68b389c55" (UID: "a980382d-bbe6-4d7b-9c47-26a68b389c55"). InnerVolumeSpecName "kube-api-access-877xl". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 13:08:53.336541 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:53.336507 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a980382d-bbe6-4d7b-9c47-26a68b389c55-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a980382d-bbe6-4d7b-9c47-26a68b389c55" (UID: "a980382d-bbe6-4d7b-9c47-26a68b389c55"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 13:08:53.336541 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:53.336530 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a980382d-bbe6-4d7b-9c47-26a68b389c55-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a980382d-bbe6-4d7b-9c47-26a68b389c55" (UID: "a980382d-bbe6-4d7b-9c47-26a68b389c55"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 13:08:53.439959 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:53.436562 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-877xl\" (UniqueName: \"kubernetes.io/projected/a980382d-bbe6-4d7b-9c47-26a68b389c55-kube-api-access-877xl\") on node \"ip-10-0-132-184.ec2.internal\" DevicePath \"\"" May 25 13:08:53.439959 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:53.436598 2568 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a980382d-bbe6-4d7b-9c47-26a68b389c55-bound-sa-token\") on node \"ip-10-0-132-184.ec2.internal\" DevicePath \"\"" May 25 13:08:53.439959 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:53.436621 2568 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a980382d-bbe6-4d7b-9c47-26a68b389c55-image-registry-private-configuration\") on node \"ip-10-0-132-184.ec2.internal\" DevicePath \"\"" May 25 13:08:53.439959 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:53.436636 2568 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a980382d-bbe6-4d7b-9c47-26a68b389c55-installation-pull-secrets\") on node \"ip-10-0-132-184.ec2.internal\" DevicePath \"\"" May 25 13:08:54.275323 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:54.275291 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67c696b864-h6hp4" May 25 13:08:54.315783 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:54.315735 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67c696b864-h6hp4"] May 25 13:08:54.317554 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:54.317525 2568 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-67c696b864-h6hp4"] May 25 13:08:54.444755 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:54.444727 2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a980382d-bbe6-4d7b-9c47-26a68b389c55-registry-tls\") on node \"ip-10-0-132-184.ec2.internal\" DevicePath \"\"" May 25 13:08:54.741668 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:54.741634 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a980382d-bbe6-4d7b-9c47-26a68b389c55" path="/var/lib/kubelet/pods/a980382d-bbe6-4d7b-9c47-26a68b389c55/volumes" May 25 13:08:56.284810 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:56.284590 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d93b814-1dc1-43ff-ad48-341f4fb85112","Type":"ContainerStarted","Data":"e942274373f429609560ff61f5189666f98c1a3653fb9c1c1e6c8054257fd387"} May 25 13:08:56.284810 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:56.284631 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d93b814-1dc1-43ff-ad48-341f4fb85112","Type":"ContainerStarted","Data":"877c60effa6c4b0215765883afbfb9e142e722609a2c8c9a88e7ce28640657d0"} May 25 13:08:56.284810 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:56.284646 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d93b814-1dc1-43ff-ad48-341f4fb85112","Type":"ContainerStarted","Data":"7cbe27ab411dbe136a39e39be137813ea697d60af78feba8b3c8a30eb262a3d3"} May 25 13:08:56.284810 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:56.284659 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d93b814-1dc1-43ff-ad48-341f4fb85112","Type":"ContainerStarted","Data":"250ddc0a2946bbe1209245783c5637853fe8776234e61c012a11b987ab5ec9bf"} May 25 13:08:56.284810 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:56.284672 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d93b814-1dc1-43ff-ad48-341f4fb85112","Type":"ContainerStarted","Data":"c7e6966a88401574e720e815a57fb7ec2ee14e14ff27424a2292d840ef2b6e42"} May 25 13:08:57.290035 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:57.289992 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d93b814-1dc1-43ff-ad48-341f4fb85112","Type":"ContainerStarted","Data":"25541d1c326af914cc5e09458261e5352653b531a2fa50c0d686b7d7fcb178e0"} May 25 13:08:57.322737 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:57.322690 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.354211476 podStartE2EDuration="6.322674116s" podCreationTimestamp="2026-05-25 13:08:51 +0000 UTC" firstStartedPulling="2026-05-25 13:08:51.914811509 +0000 UTC m=+197.812081119" lastFinishedPulling="2026-05-25 13:08:55.883274149 +0000 UTC m=+201.780543759" observedRunningTime="2026-05-25 13:08:57.320889238 +0000 UTC m=+203.218158872" watchObservedRunningTime="2026-05-25 13:08:57.322674116 +0000 UTC m=+203.219943747" May 25 13:08:58.280744 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:08:58.280716 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7f5448b88c-p26gz" May 25 13:09:01.760345 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:09:01.760309 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 25 13:09:46.683146 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:09:46.683104 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6afe74f8-11aa-4aee-9629-498ec110bc21-metrics-certs\") pod \"network-metrics-daemon-xc9t7\" (UID: \"6afe74f8-11aa-4aee-9629-498ec110bc21\") " pod="openshift-multus/network-metrics-daemon-xc9t7" May 25 13:09:46.685404 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:09:46.685381 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6afe74f8-11aa-4aee-9629-498ec110bc21-metrics-certs\") pod \"network-metrics-daemon-xc9t7\" (UID: \"6afe74f8-11aa-4aee-9629-498ec110bc21\") " pod="openshift-multus/network-metrics-daemon-xc9t7" May 25 13:09:46.941238 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:09:46.941145 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xxkxl\"" May 25 13:09:46.948611 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:09:46.948595 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xc9t7" May 25 13:09:47.067943 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:09:47.067921 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xc9t7"] May 25 13:09:47.070488 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:09:47.070463 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6afe74f8_11aa_4aee_9629_498ec110bc21.slice/crio-a90528861515f88abf696fa7111dddb1793c88ac07a25cc817a3215050384553 WatchSource:0}: Error finding container a90528861515f88abf696fa7111dddb1793c88ac07a25cc817a3215050384553: Status 404 returned error can't find the container with id a90528861515f88abf696fa7111dddb1793c88ac07a25cc817a3215050384553 May 25 13:09:47.419581 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:09:47.419542 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xc9t7" event={"ID":"6afe74f8-11aa-4aee-9629-498ec110bc21","Type":"ContainerStarted","Data":"a90528861515f88abf696fa7111dddb1793c88ac07a25cc817a3215050384553"} May 25 13:09:48.425901 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:09:48.425867 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xc9t7" event={"ID":"6afe74f8-11aa-4aee-9629-498ec110bc21","Type":"ContainerStarted","Data":"a65db7fb20d16ed57d3eb6dbc11d57d0ef13319f481f22fc4cd4b7ce89c395c2"} May 25 13:09:48.425901 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:09:48.425903 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xc9t7" event={"ID":"6afe74f8-11aa-4aee-9629-498ec110bc21","Type":"ContainerStarted","Data":"84337fbfa4f4f4d8e82b487b092a016c7220825642df5ba3a9c905732da13784"} May 25 13:09:48.444327 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:09:48.444279 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xc9t7" podStartSLOduration=253.573624032 podStartE2EDuration="4m14.444263736s" podCreationTimestamp="2026-05-25 13:05:34 +0000 UTC" firstStartedPulling="2026-05-25 13:09:47.07244285 +0000 UTC m=+252.969712460" lastFinishedPulling="2026-05-25 13:09:47.943082541 +0000 UTC m=+253.840352164" observedRunningTime="2026-05-25 13:09:48.44354163 +0000 UTC m=+254.340811251" watchObservedRunningTime="2026-05-25 13:09:48.444263736 +0000 UTC m=+254.341533369" May 25 13:09:51.760970 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:09:51.760935 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 25 13:09:51.776213 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:09:51.776190 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 25 13:09:52.451732 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:09:52.451704 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:09.860992 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:09.860905 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 13:10:09.861555 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:09.861515 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8d93b814-1dc1-43ff-ad48-341f4fb85112" containerName="kube-rbac-proxy" containerID="cri-o://e942274373f429609560ff61f5189666f98c1a3653fb9c1c1e6c8054257fd387" gracePeriod=600 May 25 13:10:09.861750 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:09.861517 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8d93b814-1dc1-43ff-ad48-341f4fb85112" containerName="config-reloader" containerID="cri-o://250ddc0a2946bbe1209245783c5637853fe8776234e61c012a11b987ab5ec9bf" gracePeriod=600 May 25 13:10:09.861828 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:09.861523 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8d93b814-1dc1-43ff-ad48-341f4fb85112" containerName="thanos-sidecar" containerID="cri-o://7cbe27ab411dbe136a39e39be137813ea697d60af78feba8b3c8a30eb262a3d3" gracePeriod=600 May 25 13:10:09.861883 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:09.861543 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8d93b814-1dc1-43ff-ad48-341f4fb85112" containerName="kube-rbac-proxy-thanos" containerID="cri-o://25541d1c326af914cc5e09458261e5352653b531a2fa50c0d686b7d7fcb178e0" gracePeriod=600 May 25 13:10:09.861937 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:09.861579 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8d93b814-1dc1-43ff-ad48-341f4fb85112" containerName="prometheus" containerID="cri-o://c7e6966a88401574e720e815a57fb7ec2ee14e14ff27424a2292d840ef2b6e42" gracePeriod=600 May 25 13:10:09.861937 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:09.861561 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8d93b814-1dc1-43ff-ad48-341f4fb85112" containerName="kube-rbac-proxy-web" containerID="cri-o://877c60effa6c4b0215765883afbfb9e142e722609a2c8c9a88e7ce28640657d0" gracePeriod=600 May 25 13:10:10.107715 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.107689 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.184606 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.184575 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8d93b814-1dc1-43ff-ad48-341f4fb85112-config-out\") pod \"8d93b814-1dc1-43ff-ad48-341f4fb85112\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " May 25 13:10:10.184787 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.184651 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-thanos-prometheus-http-client-file\") pod \"8d93b814-1dc1-43ff-ad48-341f4fb85112\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " May 25 13:10:10.184787 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.184670 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8d93b814-1dc1-43ff-ad48-341f4fb85112-prometheus-k8s-db\") pod \"8d93b814-1dc1-43ff-ad48-341f4fb85112\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " May 25 13:10:10.184787 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.184689 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"8d93b814-1dc1-43ff-ad48-341f4fb85112\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " May 25 13:10:10.184787 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.184717 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-secret-prometheus-k8s-tls\") pod \"8d93b814-1dc1-43ff-ad48-341f4fb85112\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " May 25 13:10:10.184787 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.184745 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8d93b814-1dc1-43ff-ad48-341f4fb85112-tls-assets\") pod \"8d93b814-1dc1-43ff-ad48-341f4fb85112\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " May 25 13:10:10.185053 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.184786 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d93b814-1dc1-43ff-ad48-341f4fb85112-configmap-metrics-client-ca\") pod \"8d93b814-1dc1-43ff-ad48-341f4fb85112\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " May 25 13:10:10.185053 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.184823 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d93b814-1dc1-43ff-ad48-341f4fb85112-prometheus-trusted-ca-bundle\") pod \"8d93b814-1dc1-43ff-ad48-341f4fb85112\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " May 25 13:10:10.185053 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.184852 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d93b814-1dc1-43ff-ad48-341f4fb85112-configmap-serving-certs-ca-bundle\") pod \"8d93b814-1dc1-43ff-ad48-341f4fb85112\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " May 25 13:10:10.185053 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.184878 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-secret-grpc-tls\") pod \"8d93b814-1dc1-43ff-ad48-341f4fb85112\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " May 25 13:10:10.185053 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.184900 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-web-config\") pod \"8d93b814-1dc1-43ff-ad48-341f4fb85112\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " May 25 13:10:10.185053 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.184944 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wjnlj\" (UniqueName: \"kubernetes.io/projected/8d93b814-1dc1-43ff-ad48-341f4fb85112-kube-api-access-wjnlj\") pod \"8d93b814-1dc1-43ff-ad48-341f4fb85112\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " May 25 13:10:10.185053 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.184971 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-secret-kube-rbac-proxy\") pod \"8d93b814-1dc1-43ff-ad48-341f4fb85112\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " May 25 13:10:10.185053 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.185002 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-secret-metrics-client-certs\") pod \"8d93b814-1dc1-43ff-ad48-341f4fb85112\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " May 25 13:10:10.185455 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.185288 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d93b814-1dc1-43ff-ad48-341f4fb85112-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "8d93b814-1dc1-43ff-ad48-341f4fb85112" (UID: "8d93b814-1dc1-43ff-ad48-341f4fb85112"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 13:10:10.185455 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.185377 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d93b814-1dc1-43ff-ad48-341f4fb85112-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "8d93b814-1dc1-43ff-ad48-341f4fb85112" (UID: "8d93b814-1dc1-43ff-ad48-341f4fb85112"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 13:10:10.185869 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.185612 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d93b814-1dc1-43ff-ad48-341f4fb85112-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "8d93b814-1dc1-43ff-ad48-341f4fb85112" (UID: "8d93b814-1dc1-43ff-ad48-341f4fb85112"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 13:10:10.186605 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.186114 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d93b814-1dc1-43ff-ad48-341f4fb85112-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "8d93b814-1dc1-43ff-ad48-341f4fb85112" (UID: "8d93b814-1dc1-43ff-ad48-341f4fb85112"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 25 13:10:10.187844 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.187812 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "8d93b814-1dc1-43ff-ad48-341f4fb85112" (UID: "8d93b814-1dc1-43ff-ad48-341f4fb85112"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 13:10:10.188050 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.188014 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d93b814-1dc1-43ff-ad48-341f4fb85112-config-out" (OuterVolumeSpecName: "config-out") pod "8d93b814-1dc1-43ff-ad48-341f4fb85112" (UID: "8d93b814-1dc1-43ff-ad48-341f4fb85112"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 25 13:10:10.188050 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.188019 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "8d93b814-1dc1-43ff-ad48-341f4fb85112" (UID: "8d93b814-1dc1-43ff-ad48-341f4fb85112"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 13:10:10.189072 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.189047 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "8d93b814-1dc1-43ff-ad48-341f4fb85112" (UID: "8d93b814-1dc1-43ff-ad48-341f4fb85112"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 13:10:10.189241 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.189221 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d93b814-1dc1-43ff-ad48-341f4fb85112-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8d93b814-1dc1-43ff-ad48-341f4fb85112" (UID: "8d93b814-1dc1-43ff-ad48-341f4fb85112"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 13:10:10.189328 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.189258 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "8d93b814-1dc1-43ff-ad48-341f4fb85112" (UID: "8d93b814-1dc1-43ff-ad48-341f4fb85112"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 13:10:10.189628 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.189606 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "8d93b814-1dc1-43ff-ad48-341f4fb85112" (UID: "8d93b814-1dc1-43ff-ad48-341f4fb85112"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 13:10:10.189819 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.189800 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d93b814-1dc1-43ff-ad48-341f4fb85112-kube-api-access-wjnlj" (OuterVolumeSpecName: "kube-api-access-wjnlj") pod "8d93b814-1dc1-43ff-ad48-341f4fb85112" (UID: "8d93b814-1dc1-43ff-ad48-341f4fb85112"). InnerVolumeSpecName "kube-api-access-wjnlj". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 13:10:10.189967 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.189932 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "8d93b814-1dc1-43ff-ad48-341f4fb85112" (UID: "8d93b814-1dc1-43ff-ad48-341f4fb85112"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 13:10:10.198058 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.198040 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-web-config" (OuterVolumeSpecName: "web-config") pod "8d93b814-1dc1-43ff-ad48-341f4fb85112" (UID: "8d93b814-1dc1-43ff-ad48-341f4fb85112"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 13:10:10.286044 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.286019 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d93b814-1dc1-43ff-ad48-341f4fb85112-configmap-kubelet-serving-ca-bundle\") pod \"8d93b814-1dc1-43ff-ad48-341f4fb85112\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " May 25 13:10:10.286044 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.286055 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-config\") pod \"8d93b814-1dc1-43ff-ad48-341f4fb85112\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " May 25 13:10:10.286290 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.286078 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"8d93b814-1dc1-43ff-ad48-341f4fb85112\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " May 25 13:10:10.286290 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.286226 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8d93b814-1dc1-43ff-ad48-341f4fb85112-prometheus-k8s-rulefiles-0\") pod \"8d93b814-1dc1-43ff-ad48-341f4fb85112\" (UID: \"8d93b814-1dc1-43ff-ad48-341f4fb85112\") " May 25 13:10:10.286515 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.286418 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d93b814-1dc1-43ff-ad48-341f4fb85112-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "8d93b814-1dc1-43ff-ad48-341f4fb85112" (UID: "8d93b814-1dc1-43ff-ad48-341f4fb85112"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 13:10:10.286515 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.286433 2568 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-secret-prometheus-k8s-tls\") on node \"ip-10-0-132-184.ec2.internal\" DevicePath \"\"" May 25 13:10:10.286515 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.286490 2568 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8d93b814-1dc1-43ff-ad48-341f4fb85112-tls-assets\") on node \"ip-10-0-132-184.ec2.internal\" DevicePath \"\"" May 25 13:10:10.286515 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.286507 2568 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d93b814-1dc1-43ff-ad48-341f4fb85112-configmap-metrics-client-ca\") on node \"ip-10-0-132-184.ec2.internal\" DevicePath \"\"" May 25 13:10:10.286753 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.286521 2568 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d93b814-1dc1-43ff-ad48-341f4fb85112-prometheus-trusted-ca-bundle\") on node \"ip-10-0-132-184.ec2.internal\" DevicePath \"\"" May 25 13:10:10.286753 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.286537 2568 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d93b814-1dc1-43ff-ad48-341f4fb85112-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-132-184.ec2.internal\" DevicePath \"\"" May 25 13:10:10.286753 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.286550 2568 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-secret-grpc-tls\") on node \"ip-10-0-132-184.ec2.internal\" DevicePath \"\"" May 25 13:10:10.286753 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.286564 2568 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-web-config\") on node \"ip-10-0-132-184.ec2.internal\" DevicePath \"\"" May 25 13:10:10.286753 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.286576 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wjnlj\" (UniqueName: \"kubernetes.io/projected/8d93b814-1dc1-43ff-ad48-341f4fb85112-kube-api-access-wjnlj\") on node \"ip-10-0-132-184.ec2.internal\" DevicePath \"\"" May 25 13:10:10.286753 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.286588 2568 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-secret-kube-rbac-proxy\") on node \"ip-10-0-132-184.ec2.internal\" DevicePath \"\"" May 25 13:10:10.286753 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.286602 2568 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-secret-metrics-client-certs\") on node \"ip-10-0-132-184.ec2.internal\" DevicePath \"\"" May 25 13:10:10.286753 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.286615 2568 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8d93b814-1dc1-43ff-ad48-341f4fb85112-config-out\") on node \"ip-10-0-132-184.ec2.internal\" DevicePath \"\"" May 25 13:10:10.286753 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.286629 2568 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-thanos-prometheus-http-client-file\") on node \"ip-10-0-132-184.ec2.internal\" DevicePath \"\"" May 25 13:10:10.286753 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.286642 2568 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8d93b814-1dc1-43ff-ad48-341f4fb85112-prometheus-k8s-db\") on node \"ip-10-0-132-184.ec2.internal\" DevicePath \"\"" May 25 13:10:10.286753 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.286657 2568 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-132-184.ec2.internal\" DevicePath \"\"" May 25 13:10:10.287225 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.287204 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d93b814-1dc1-43ff-ad48-341f4fb85112-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "8d93b814-1dc1-43ff-ad48-341f4fb85112" (UID: "8d93b814-1dc1-43ff-ad48-341f4fb85112"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 13:10:10.287966 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.287939 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-config" (OuterVolumeSpecName: "config") pod "8d93b814-1dc1-43ff-ad48-341f4fb85112" (UID: "8d93b814-1dc1-43ff-ad48-341f4fb85112"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 13:10:10.288041 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.288010 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "8d93b814-1dc1-43ff-ad48-341f4fb85112" (UID: "8d93b814-1dc1-43ff-ad48-341f4fb85112"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 13:10:10.387661 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.387631 2568 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8d93b814-1dc1-43ff-ad48-341f4fb85112-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-132-184.ec2.internal\" DevicePath \"\"" May 25 13:10:10.387661 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.387657 2568 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d93b814-1dc1-43ff-ad48-341f4fb85112-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-132-184.ec2.internal\" DevicePath \"\"" May 25 13:10:10.387807 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.387670 2568 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-config\") on node \"ip-10-0-132-184.ec2.internal\" DevicePath \"\"" May 25 13:10:10.387807 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.387681 2568 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8d93b814-1dc1-43ff-ad48-341f4fb85112-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-132-184.ec2.internal\" DevicePath \"\"" May 25 13:10:10.486455 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.486388 2568 generic.go:358] "Generic (PLEG): container finished" podID="8d93b814-1dc1-43ff-ad48-341f4fb85112" containerID="25541d1c326af914cc5e09458261e5352653b531a2fa50c0d686b7d7fcb178e0" exitCode=0 May 25 13:10:10.486455 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.486413 2568 generic.go:358] "Generic (PLEG): container finished" podID="8d93b814-1dc1-43ff-ad48-341f4fb85112" containerID="e942274373f429609560ff61f5189666f98c1a3653fb9c1c1e6c8054257fd387" exitCode=0 May 25 13:10:10.486455 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.486422 2568 generic.go:358] "Generic (PLEG): container finished" podID="8d93b814-1dc1-43ff-ad48-341f4fb85112" containerID="877c60effa6c4b0215765883afbfb9e142e722609a2c8c9a88e7ce28640657d0" exitCode=0 May 25 13:10:10.486455 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.486430 2568 generic.go:358] "Generic (PLEG): container finished" podID="8d93b814-1dc1-43ff-ad48-341f4fb85112" containerID="7cbe27ab411dbe136a39e39be137813ea697d60af78feba8b3c8a30eb262a3d3" exitCode=0 May 25 13:10:10.486455 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.486437 2568 generic.go:358] "Generic (PLEG): container finished" podID="8d93b814-1dc1-43ff-ad48-341f4fb85112" containerID="250ddc0a2946bbe1209245783c5637853fe8776234e61c012a11b987ab5ec9bf" exitCode=0 May 25 13:10:10.486455 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.486444 2568 generic.go:358] "Generic (PLEG): container finished" podID="8d93b814-1dc1-43ff-ad48-341f4fb85112" containerID="c7e6966a88401574e720e815a57fb7ec2ee14e14ff27424a2292d840ef2b6e42" exitCode=0 May 25 13:10:10.486721 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.486462 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d93b814-1dc1-43ff-ad48-341f4fb85112","Type":"ContainerDied","Data":"25541d1c326af914cc5e09458261e5352653b531a2fa50c0d686b7d7fcb178e0"} May 25 13:10:10.486721 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.486497 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d93b814-1dc1-43ff-ad48-341f4fb85112","Type":"ContainerDied","Data":"e942274373f429609560ff61f5189666f98c1a3653fb9c1c1e6c8054257fd387"} May 25 13:10:10.486721 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.486507 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d93b814-1dc1-43ff-ad48-341f4fb85112","Type":"ContainerDied","Data":"877c60effa6c4b0215765883afbfb9e142e722609a2c8c9a88e7ce28640657d0"} May 25 13:10:10.486721 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.486514 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.486721 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.486526 2568 scope.go:117] "RemoveContainer" containerID="25541d1c326af914cc5e09458261e5352653b531a2fa50c0d686b7d7fcb178e0" May 25 13:10:10.486721 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.486517 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d93b814-1dc1-43ff-ad48-341f4fb85112","Type":"ContainerDied","Data":"7cbe27ab411dbe136a39e39be137813ea697d60af78feba8b3c8a30eb262a3d3"} May 25 13:10:10.486721 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.486641 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d93b814-1dc1-43ff-ad48-341f4fb85112","Type":"ContainerDied","Data":"250ddc0a2946bbe1209245783c5637853fe8776234e61c012a11b987ab5ec9bf"} May 25 13:10:10.486721 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.486659 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d93b814-1dc1-43ff-ad48-341f4fb85112","Type":"ContainerDied","Data":"c7e6966a88401574e720e815a57fb7ec2ee14e14ff27424a2292d840ef2b6e42"} May 25 13:10:10.486721 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.486674 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d93b814-1dc1-43ff-ad48-341f4fb85112","Type":"ContainerDied","Data":"afeac6d77ef15ffa84d17af9c89fceea6713def8f47e6eb6b5e4d194b1a8dd46"} May 25 13:10:10.493867 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.493850 2568 scope.go:117] "RemoveContainer" containerID="e942274373f429609560ff61f5189666f98c1a3653fb9c1c1e6c8054257fd387" May 25 13:10:10.500539 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.500520 2568 scope.go:117] "RemoveContainer" containerID="877c60effa6c4b0215765883afbfb9e142e722609a2c8c9a88e7ce28640657d0" May 25 13:10:10.506638 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.506618 2568 scope.go:117] "RemoveContainer" containerID="7cbe27ab411dbe136a39e39be137813ea697d60af78feba8b3c8a30eb262a3d3" May 25 13:10:10.511030 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.511009 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 13:10:10.513195 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.513180 2568 scope.go:117] "RemoveContainer" containerID="250ddc0a2946bbe1209245783c5637853fe8776234e61c012a11b987ab5ec9bf" May 25 13:10:10.516187 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.516166 2568 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 13:10:10.520227 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.520212 2568 scope.go:117] "RemoveContainer" containerID="c7e6966a88401574e720e815a57fb7ec2ee14e14ff27424a2292d840ef2b6e42" May 25 13:10:10.527455 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.527440 2568 scope.go:117] "RemoveContainer" containerID="ce2f74bfaeb183adea3500da9baefdc981c3e250daa045216ccb4ebb63a7a9d3" May 25 13:10:10.534790 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.534773 2568 scope.go:117] "RemoveContainer" containerID="25541d1c326af914cc5e09458261e5352653b531a2fa50c0d686b7d7fcb178e0" May 25 13:10:10.535011 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:10:10.534993 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25541d1c326af914cc5e09458261e5352653b531a2fa50c0d686b7d7fcb178e0\": container with ID starting with 25541d1c326af914cc5e09458261e5352653b531a2fa50c0d686b7d7fcb178e0 not found: ID does not exist" containerID="25541d1c326af914cc5e09458261e5352653b531a2fa50c0d686b7d7fcb178e0" May 25 13:10:10.535060 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.535019 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25541d1c326af914cc5e09458261e5352653b531a2fa50c0d686b7d7fcb178e0"} err="failed to get container status \"25541d1c326af914cc5e09458261e5352653b531a2fa50c0d686b7d7fcb178e0\": rpc error: code = NotFound desc = could not find container \"25541d1c326af914cc5e09458261e5352653b531a2fa50c0d686b7d7fcb178e0\": container with ID starting with 25541d1c326af914cc5e09458261e5352653b531a2fa50c0d686b7d7fcb178e0 not found: ID does not exist" May 25 13:10:10.535060 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.535049 2568 scope.go:117] "RemoveContainer" containerID="e942274373f429609560ff61f5189666f98c1a3653fb9c1c1e6c8054257fd387" May 25 13:10:10.535361 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:10:10.535340 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e942274373f429609560ff61f5189666f98c1a3653fb9c1c1e6c8054257fd387\": container with ID starting with e942274373f429609560ff61f5189666f98c1a3653fb9c1c1e6c8054257fd387 not found: ID does not exist" containerID="e942274373f429609560ff61f5189666f98c1a3653fb9c1c1e6c8054257fd387" May 25 13:10:10.535465 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.535369 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e942274373f429609560ff61f5189666f98c1a3653fb9c1c1e6c8054257fd387"} err="failed to get container status \"e942274373f429609560ff61f5189666f98c1a3653fb9c1c1e6c8054257fd387\": rpc error: code = NotFound desc = could not find container \"e942274373f429609560ff61f5189666f98c1a3653fb9c1c1e6c8054257fd387\": container with ID starting with e942274373f429609560ff61f5189666f98c1a3653fb9c1c1e6c8054257fd387 not found: ID does not exist" May 25 13:10:10.535465 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.535386 2568 scope.go:117] "RemoveContainer" containerID="877c60effa6c4b0215765883afbfb9e142e722609a2c8c9a88e7ce28640657d0" May 25 13:10:10.535625 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:10:10.535608 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"877c60effa6c4b0215765883afbfb9e142e722609a2c8c9a88e7ce28640657d0\": container with ID starting with 877c60effa6c4b0215765883afbfb9e142e722609a2c8c9a88e7ce28640657d0 not found: ID does not exist" containerID="877c60effa6c4b0215765883afbfb9e142e722609a2c8c9a88e7ce28640657d0" May 25 13:10:10.535682 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.535631 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"877c60effa6c4b0215765883afbfb9e142e722609a2c8c9a88e7ce28640657d0"} err="failed to get container status \"877c60effa6c4b0215765883afbfb9e142e722609a2c8c9a88e7ce28640657d0\": rpc error: code = NotFound desc = could not find container \"877c60effa6c4b0215765883afbfb9e142e722609a2c8c9a88e7ce28640657d0\": container with ID starting with 877c60effa6c4b0215765883afbfb9e142e722609a2c8c9a88e7ce28640657d0 not found: ID does not exist" May 25 13:10:10.535682 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.535646 2568 scope.go:117] "RemoveContainer" containerID="7cbe27ab411dbe136a39e39be137813ea697d60af78feba8b3c8a30eb262a3d3" May 25 13:10:10.535871 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:10:10.535855 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cbe27ab411dbe136a39e39be137813ea697d60af78feba8b3c8a30eb262a3d3\": container with ID starting with 7cbe27ab411dbe136a39e39be137813ea697d60af78feba8b3c8a30eb262a3d3 not found: ID does not exist" containerID="7cbe27ab411dbe136a39e39be137813ea697d60af78feba8b3c8a30eb262a3d3" May 25 13:10:10.535928 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.535876 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cbe27ab411dbe136a39e39be137813ea697d60af78feba8b3c8a30eb262a3d3"} err="failed to get container status \"7cbe27ab411dbe136a39e39be137813ea697d60af78feba8b3c8a30eb262a3d3\": rpc error: code = NotFound desc = could not find container \"7cbe27ab411dbe136a39e39be137813ea697d60af78feba8b3c8a30eb262a3d3\": container with ID starting with 7cbe27ab411dbe136a39e39be137813ea697d60af78feba8b3c8a30eb262a3d3 not found: ID does not exist" May 25 13:10:10.535928 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.535900 2568 scope.go:117] "RemoveContainer" containerID="250ddc0a2946bbe1209245783c5637853fe8776234e61c012a11b987ab5ec9bf" May 25 13:10:10.536131 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:10:10.536114 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"250ddc0a2946bbe1209245783c5637853fe8776234e61c012a11b987ab5ec9bf\": container with ID starting with 250ddc0a2946bbe1209245783c5637853fe8776234e61c012a11b987ab5ec9bf not found: ID does not exist" containerID="250ddc0a2946bbe1209245783c5637853fe8776234e61c012a11b987ab5ec9bf" May 25 13:10:10.536256 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.536136 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"250ddc0a2946bbe1209245783c5637853fe8776234e61c012a11b987ab5ec9bf"} err="failed to get container status \"250ddc0a2946bbe1209245783c5637853fe8776234e61c012a11b987ab5ec9bf\": rpc error: code = NotFound desc = could not find container \"250ddc0a2946bbe1209245783c5637853fe8776234e61c012a11b987ab5ec9bf\": container with ID starting with 250ddc0a2946bbe1209245783c5637853fe8776234e61c012a11b987ab5ec9bf not found: ID does not exist" May 25 13:10:10.536256 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.536211 2568 scope.go:117] "RemoveContainer" containerID="c7e6966a88401574e720e815a57fb7ec2ee14e14ff27424a2292d840ef2b6e42" May 25 13:10:10.536437 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:10:10.536420 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7e6966a88401574e720e815a57fb7ec2ee14e14ff27424a2292d840ef2b6e42\": container with ID starting with c7e6966a88401574e720e815a57fb7ec2ee14e14ff27424a2292d840ef2b6e42 not found: ID does not exist" containerID="c7e6966a88401574e720e815a57fb7ec2ee14e14ff27424a2292d840ef2b6e42" May 25 13:10:10.536499 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.536440 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7e6966a88401574e720e815a57fb7ec2ee14e14ff27424a2292d840ef2b6e42"} err="failed to get container status \"c7e6966a88401574e720e815a57fb7ec2ee14e14ff27424a2292d840ef2b6e42\": rpc error: code = NotFound desc = could not find container \"c7e6966a88401574e720e815a57fb7ec2ee14e14ff27424a2292d840ef2b6e42\": container with ID starting with c7e6966a88401574e720e815a57fb7ec2ee14e14ff27424a2292d840ef2b6e42 not found: ID does not exist" May 25 13:10:10.536499 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.536462 2568 scope.go:117] "RemoveContainer" containerID="ce2f74bfaeb183adea3500da9baefdc981c3e250daa045216ccb4ebb63a7a9d3" May 25 13:10:10.536685 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:10:10.536668 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce2f74bfaeb183adea3500da9baefdc981c3e250daa045216ccb4ebb63a7a9d3\": container with ID starting with ce2f74bfaeb183adea3500da9baefdc981c3e250daa045216ccb4ebb63a7a9d3 not found: ID does not exist" containerID="ce2f74bfaeb183adea3500da9baefdc981c3e250daa045216ccb4ebb63a7a9d3" May 25 13:10:10.536746 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.536688 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce2f74bfaeb183adea3500da9baefdc981c3e250daa045216ccb4ebb63a7a9d3"} err="failed to get container status \"ce2f74bfaeb183adea3500da9baefdc981c3e250daa045216ccb4ebb63a7a9d3\": rpc error: code = NotFound desc = could not find container \"ce2f74bfaeb183adea3500da9baefdc981c3e250daa045216ccb4ebb63a7a9d3\": container with ID starting with ce2f74bfaeb183adea3500da9baefdc981c3e250daa045216ccb4ebb63a7a9d3 not found: ID does not exist" May 25 13:10:10.536746 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.536701 2568 scope.go:117] "RemoveContainer" containerID="25541d1c326af914cc5e09458261e5352653b531a2fa50c0d686b7d7fcb178e0" May 25 13:10:10.536920 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.536899 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25541d1c326af914cc5e09458261e5352653b531a2fa50c0d686b7d7fcb178e0"} err="failed to get container status \"25541d1c326af914cc5e09458261e5352653b531a2fa50c0d686b7d7fcb178e0\": rpc error: code = NotFound desc = could not find container \"25541d1c326af914cc5e09458261e5352653b531a2fa50c0d686b7d7fcb178e0\": container with ID starting with 25541d1c326af914cc5e09458261e5352653b531a2fa50c0d686b7d7fcb178e0 not found: ID does not exist" May 25 13:10:10.536985 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.536920 2568 scope.go:117] "RemoveContainer" containerID="e942274373f429609560ff61f5189666f98c1a3653fb9c1c1e6c8054257fd387" May 25 13:10:10.537118 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.537100 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e942274373f429609560ff61f5189666f98c1a3653fb9c1c1e6c8054257fd387"} err="failed to get container status \"e942274373f429609560ff61f5189666f98c1a3653fb9c1c1e6c8054257fd387\": rpc error: code = NotFound desc = could not find container \"e942274373f429609560ff61f5189666f98c1a3653fb9c1c1e6c8054257fd387\": container with ID starting with e942274373f429609560ff61f5189666f98c1a3653fb9c1c1e6c8054257fd387 not found: ID does not exist" May 25 13:10:10.537201 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.537118 2568 scope.go:117] "RemoveContainer" containerID="877c60effa6c4b0215765883afbfb9e142e722609a2c8c9a88e7ce28640657d0" May 25 13:10:10.537389 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.537371 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"877c60effa6c4b0215765883afbfb9e142e722609a2c8c9a88e7ce28640657d0"} err="failed to get container status \"877c60effa6c4b0215765883afbfb9e142e722609a2c8c9a88e7ce28640657d0\": rpc error: code = NotFound desc = could not find container \"877c60effa6c4b0215765883afbfb9e142e722609a2c8c9a88e7ce28640657d0\": container with ID starting with 877c60effa6c4b0215765883afbfb9e142e722609a2c8c9a88e7ce28640657d0 not found: ID does not exist" May 25 13:10:10.537445 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.537391 2568 scope.go:117] "RemoveContainer" containerID="7cbe27ab411dbe136a39e39be137813ea697d60af78feba8b3c8a30eb262a3d3" May 25 13:10:10.537606 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.537587 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cbe27ab411dbe136a39e39be137813ea697d60af78feba8b3c8a30eb262a3d3"} err="failed to get container status \"7cbe27ab411dbe136a39e39be137813ea697d60af78feba8b3c8a30eb262a3d3\": rpc error: code = NotFound desc = could not find container \"7cbe27ab411dbe136a39e39be137813ea697d60af78feba8b3c8a30eb262a3d3\": container with ID starting with 7cbe27ab411dbe136a39e39be137813ea697d60af78feba8b3c8a30eb262a3d3 not found: ID does not exist" May 25 13:10:10.537672 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.537608 2568 scope.go:117] "RemoveContainer" containerID="250ddc0a2946bbe1209245783c5637853fe8776234e61c012a11b987ab5ec9bf" May 25 13:10:10.537788 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.537773 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"250ddc0a2946bbe1209245783c5637853fe8776234e61c012a11b987ab5ec9bf"} err="failed to get container status \"250ddc0a2946bbe1209245783c5637853fe8776234e61c012a11b987ab5ec9bf\": rpc error: code = NotFound desc = could not find container \"250ddc0a2946bbe1209245783c5637853fe8776234e61c012a11b987ab5ec9bf\": container with ID starting with 250ddc0a2946bbe1209245783c5637853fe8776234e61c012a11b987ab5ec9bf not found: ID does not exist" May 25 13:10:10.537788 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.537787 2568 scope.go:117] "RemoveContainer" containerID="c7e6966a88401574e720e815a57fb7ec2ee14e14ff27424a2292d840ef2b6e42" May 25 13:10:10.537990 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.537972 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7e6966a88401574e720e815a57fb7ec2ee14e14ff27424a2292d840ef2b6e42"} err="failed to get container status \"c7e6966a88401574e720e815a57fb7ec2ee14e14ff27424a2292d840ef2b6e42\": rpc error: code = NotFound desc = could not find container \"c7e6966a88401574e720e815a57fb7ec2ee14e14ff27424a2292d840ef2b6e42\": container with ID starting with c7e6966a88401574e720e815a57fb7ec2ee14e14ff27424a2292d840ef2b6e42 not found: ID does not exist" May 25 13:10:10.538053 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.537991 2568 scope.go:117] "RemoveContainer" containerID="ce2f74bfaeb183adea3500da9baefdc981c3e250daa045216ccb4ebb63a7a9d3" May 25 13:10:10.538279 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.538196 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce2f74bfaeb183adea3500da9baefdc981c3e250daa045216ccb4ebb63a7a9d3"} err="failed to get container status \"ce2f74bfaeb183adea3500da9baefdc981c3e250daa045216ccb4ebb63a7a9d3\": rpc error: code = NotFound desc = could not find container \"ce2f74bfaeb183adea3500da9baefdc981c3e250daa045216ccb4ebb63a7a9d3\": container with ID starting with ce2f74bfaeb183adea3500da9baefdc981c3e250daa045216ccb4ebb63a7a9d3 not found: ID does not exist" May 25 13:10:10.538279 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.538212 2568 scope.go:117] "RemoveContainer" containerID="25541d1c326af914cc5e09458261e5352653b531a2fa50c0d686b7d7fcb178e0" May 25 13:10:10.538440 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.538420 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25541d1c326af914cc5e09458261e5352653b531a2fa50c0d686b7d7fcb178e0"} err="failed to get container status \"25541d1c326af914cc5e09458261e5352653b531a2fa50c0d686b7d7fcb178e0\": rpc error: code = NotFound desc = could not find container \"25541d1c326af914cc5e09458261e5352653b531a2fa50c0d686b7d7fcb178e0\": container with ID starting with 25541d1c326af914cc5e09458261e5352653b531a2fa50c0d686b7d7fcb178e0 not found: ID does not exist" May 25 13:10:10.538505 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.538440 2568 scope.go:117] "RemoveContainer" containerID="e942274373f429609560ff61f5189666f98c1a3653fb9c1c1e6c8054257fd387" May 25 13:10:10.538634 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.538618 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e942274373f429609560ff61f5189666f98c1a3653fb9c1c1e6c8054257fd387"} err="failed to get container status \"e942274373f429609560ff61f5189666f98c1a3653fb9c1c1e6c8054257fd387\": rpc error: code = NotFound desc = could not find container \"e942274373f429609560ff61f5189666f98c1a3653fb9c1c1e6c8054257fd387\": container with ID starting with e942274373f429609560ff61f5189666f98c1a3653fb9c1c1e6c8054257fd387 not found: ID does not exist" May 25 13:10:10.538700 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.538634 2568 scope.go:117] "RemoveContainer" containerID="877c60effa6c4b0215765883afbfb9e142e722609a2c8c9a88e7ce28640657d0" May 25 13:10:10.538821 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.538802 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"877c60effa6c4b0215765883afbfb9e142e722609a2c8c9a88e7ce28640657d0"} err="failed to get container status \"877c60effa6c4b0215765883afbfb9e142e722609a2c8c9a88e7ce28640657d0\": rpc error: code = NotFound desc = could not find container \"877c60effa6c4b0215765883afbfb9e142e722609a2c8c9a88e7ce28640657d0\": container with ID starting with 877c60effa6c4b0215765883afbfb9e142e722609a2c8c9a88e7ce28640657d0 not found: ID does not exist" May 25 13:10:10.538821 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.538820 2568 scope.go:117] "RemoveContainer" containerID="7cbe27ab411dbe136a39e39be137813ea697d60af78feba8b3c8a30eb262a3d3" May 25 13:10:10.539026 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.539007 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cbe27ab411dbe136a39e39be137813ea697d60af78feba8b3c8a30eb262a3d3"} err="failed to get container status \"7cbe27ab411dbe136a39e39be137813ea697d60af78feba8b3c8a30eb262a3d3\": rpc error: code = NotFound desc = could not find container \"7cbe27ab411dbe136a39e39be137813ea697d60af78feba8b3c8a30eb262a3d3\": container with ID starting with 7cbe27ab411dbe136a39e39be137813ea697d60af78feba8b3c8a30eb262a3d3 not found: ID does not exist" May 25 13:10:10.539026 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.539024 2568 scope.go:117] "RemoveContainer" containerID="250ddc0a2946bbe1209245783c5637853fe8776234e61c012a11b987ab5ec9bf" May 25 13:10:10.539271 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.539249 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"250ddc0a2946bbe1209245783c5637853fe8776234e61c012a11b987ab5ec9bf"} err="failed to get container status \"250ddc0a2946bbe1209245783c5637853fe8776234e61c012a11b987ab5ec9bf\": rpc error: code = NotFound desc = could not find container \"250ddc0a2946bbe1209245783c5637853fe8776234e61c012a11b987ab5ec9bf\": container with ID starting with 250ddc0a2946bbe1209245783c5637853fe8776234e61c012a11b987ab5ec9bf not found: ID does not exist" May 25 13:10:10.539271 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.539271 2568 scope.go:117] "RemoveContainer" containerID="c7e6966a88401574e720e815a57fb7ec2ee14e14ff27424a2292d840ef2b6e42" May 25 13:10:10.539448 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.539432 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7e6966a88401574e720e815a57fb7ec2ee14e14ff27424a2292d840ef2b6e42"} err="failed to get container status \"c7e6966a88401574e720e815a57fb7ec2ee14e14ff27424a2292d840ef2b6e42\": rpc error: code = NotFound desc = could not find container \"c7e6966a88401574e720e815a57fb7ec2ee14e14ff27424a2292d840ef2b6e42\": container with ID starting with c7e6966a88401574e720e815a57fb7ec2ee14e14ff27424a2292d840ef2b6e42 not found: ID does not exist" May 25 13:10:10.539448 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.539446 2568 scope.go:117] "RemoveContainer" containerID="ce2f74bfaeb183adea3500da9baefdc981c3e250daa045216ccb4ebb63a7a9d3" May 25 13:10:10.539655 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.539605 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce2f74bfaeb183adea3500da9baefdc981c3e250daa045216ccb4ebb63a7a9d3"} err="failed to get container status \"ce2f74bfaeb183adea3500da9baefdc981c3e250daa045216ccb4ebb63a7a9d3\": rpc error: code = NotFound desc = could not find container \"ce2f74bfaeb183adea3500da9baefdc981c3e250daa045216ccb4ebb63a7a9d3\": container with ID starting with ce2f74bfaeb183adea3500da9baefdc981c3e250daa045216ccb4ebb63a7a9d3 not found: ID does not exist" May 25 13:10:10.539655 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.539623 2568 scope.go:117] "RemoveContainer" containerID="25541d1c326af914cc5e09458261e5352653b531a2fa50c0d686b7d7fcb178e0" May 25 13:10:10.539975 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.539925 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25541d1c326af914cc5e09458261e5352653b531a2fa50c0d686b7d7fcb178e0"} err="failed to get container status \"25541d1c326af914cc5e09458261e5352653b531a2fa50c0d686b7d7fcb178e0\": rpc error: code = NotFound desc = could not find container \"25541d1c326af914cc5e09458261e5352653b531a2fa50c0d686b7d7fcb178e0\": container with ID starting with 25541d1c326af914cc5e09458261e5352653b531a2fa50c0d686b7d7fcb178e0 not found: ID does not exist" May 25 13:10:10.540113 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.540092 2568 scope.go:117] "RemoveContainer" containerID="e942274373f429609560ff61f5189666f98c1a3653fb9c1c1e6c8054257fd387" May 25 13:10:10.540493 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.540467 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e942274373f429609560ff61f5189666f98c1a3653fb9c1c1e6c8054257fd387"} err="failed to get container status \"e942274373f429609560ff61f5189666f98c1a3653fb9c1c1e6c8054257fd387\": rpc error: code = NotFound desc = could not find container \"e942274373f429609560ff61f5189666f98c1a3653fb9c1c1e6c8054257fd387\": container with ID starting with e942274373f429609560ff61f5189666f98c1a3653fb9c1c1e6c8054257fd387 not found: ID does not exist" May 25 13:10:10.540493 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.540493 2568 scope.go:117] "RemoveContainer" containerID="877c60effa6c4b0215765883afbfb9e142e722609a2c8c9a88e7ce28640657d0" May 25 13:10:10.540787 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.540757 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"877c60effa6c4b0215765883afbfb9e142e722609a2c8c9a88e7ce28640657d0"} err="failed to get container status \"877c60effa6c4b0215765883afbfb9e142e722609a2c8c9a88e7ce28640657d0\": rpc error: code = NotFound desc = could not find container \"877c60effa6c4b0215765883afbfb9e142e722609a2c8c9a88e7ce28640657d0\": container with ID starting with 877c60effa6c4b0215765883afbfb9e142e722609a2c8c9a88e7ce28640657d0 not found: ID does not exist" May 25 13:10:10.540873 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.540788 2568 scope.go:117] "RemoveContainer" containerID="7cbe27ab411dbe136a39e39be137813ea697d60af78feba8b3c8a30eb262a3d3" May 25 13:10:10.541046 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.541029 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cbe27ab411dbe136a39e39be137813ea697d60af78feba8b3c8a30eb262a3d3"} err="failed to get container status \"7cbe27ab411dbe136a39e39be137813ea697d60af78feba8b3c8a30eb262a3d3\": rpc error: code = NotFound desc = could not find container \"7cbe27ab411dbe136a39e39be137813ea697d60af78feba8b3c8a30eb262a3d3\": container with ID starting with 7cbe27ab411dbe136a39e39be137813ea697d60af78feba8b3c8a30eb262a3d3 not found: ID does not exist" May 25 13:10:10.541107 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.541047 2568 scope.go:117] "RemoveContainer" containerID="250ddc0a2946bbe1209245783c5637853fe8776234e61c012a11b987ab5ec9bf" May 25 13:10:10.541305 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.541286 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"250ddc0a2946bbe1209245783c5637853fe8776234e61c012a11b987ab5ec9bf"} err="failed to get container status \"250ddc0a2946bbe1209245783c5637853fe8776234e61c012a11b987ab5ec9bf\": rpc error: code = NotFound desc = could not find container \"250ddc0a2946bbe1209245783c5637853fe8776234e61c012a11b987ab5ec9bf\": container with ID starting with 250ddc0a2946bbe1209245783c5637853fe8776234e61c012a11b987ab5ec9bf not found: ID does not exist" May 25 13:10:10.541367 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.541305 2568 scope.go:117] "RemoveContainer" containerID="c7e6966a88401574e720e815a57fb7ec2ee14e14ff27424a2292d840ef2b6e42" May 25 13:10:10.541560 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.541541 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7e6966a88401574e720e815a57fb7ec2ee14e14ff27424a2292d840ef2b6e42"} err="failed to get container status \"c7e6966a88401574e720e815a57fb7ec2ee14e14ff27424a2292d840ef2b6e42\": rpc error: code = NotFound desc = could not find container \"c7e6966a88401574e720e815a57fb7ec2ee14e14ff27424a2292d840ef2b6e42\": container with ID starting with c7e6966a88401574e720e815a57fb7ec2ee14e14ff27424a2292d840ef2b6e42 not found: ID does not exist" May 25 13:10:10.541635 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.541562 2568 scope.go:117] "RemoveContainer" containerID="ce2f74bfaeb183adea3500da9baefdc981c3e250daa045216ccb4ebb63a7a9d3" May 25 13:10:10.541807 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.541787 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce2f74bfaeb183adea3500da9baefdc981c3e250daa045216ccb4ebb63a7a9d3"} err="failed to get container status \"ce2f74bfaeb183adea3500da9baefdc981c3e250daa045216ccb4ebb63a7a9d3\": rpc error: code = NotFound desc = could not find container \"ce2f74bfaeb183adea3500da9baefdc981c3e250daa045216ccb4ebb63a7a9d3\": container with ID starting with ce2f74bfaeb183adea3500da9baefdc981c3e250daa045216ccb4ebb63a7a9d3 not found: ID does not exist" May 25 13:10:10.541807 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.541802 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 13:10:10.541922 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.541809 2568 scope.go:117] "RemoveContainer" containerID="25541d1c326af914cc5e09458261e5352653b531a2fa50c0d686b7d7fcb178e0" May 25 13:10:10.542047 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.542027 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25541d1c326af914cc5e09458261e5352653b531a2fa50c0d686b7d7fcb178e0"} err="failed to get container status \"25541d1c326af914cc5e09458261e5352653b531a2fa50c0d686b7d7fcb178e0\": rpc error: code = NotFound desc = could not find container \"25541d1c326af914cc5e09458261e5352653b531a2fa50c0d686b7d7fcb178e0\": container with ID starting with 25541d1c326af914cc5e09458261e5352653b531a2fa50c0d686b7d7fcb178e0 not found: ID does not exist" May 25 13:10:10.542107 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.542049 2568 scope.go:117] "RemoveContainer" containerID="e942274373f429609560ff61f5189666f98c1a3653fb9c1c1e6c8054257fd387" May 25 13:10:10.542173 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.542112 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d93b814-1dc1-43ff-ad48-341f4fb85112" containerName="config-reloader" May 25 13:10:10.542173 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.542128 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d93b814-1dc1-43ff-ad48-341f4fb85112" containerName="config-reloader" May 25 13:10:10.542173 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.542140 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d93b814-1dc1-43ff-ad48-341f4fb85112" containerName="kube-rbac-proxy-web" May 25 13:10:10.542173 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.542165 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d93b814-1dc1-43ff-ad48-341f4fb85112" containerName="kube-rbac-proxy-web" May 25 13:10:10.542324 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.542180 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d93b814-1dc1-43ff-ad48-341f4fb85112" containerName="kube-rbac-proxy-thanos" May 25 13:10:10.542324 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.542188 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d93b814-1dc1-43ff-ad48-341f4fb85112" containerName="kube-rbac-proxy-thanos" May 25 13:10:10.542324 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.542201 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d93b814-1dc1-43ff-ad48-341f4fb85112" containerName="thanos-sidecar" May 25 13:10:10.542324 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.542209 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d93b814-1dc1-43ff-ad48-341f4fb85112" containerName="thanos-sidecar" May 25 13:10:10.542324 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.542228 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d93b814-1dc1-43ff-ad48-341f4fb85112" containerName="kube-rbac-proxy" May 25 13:10:10.542324 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.542238 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d93b814-1dc1-43ff-ad48-341f4fb85112" containerName="kube-rbac-proxy" May 25 13:10:10.542324 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.542248 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d93b814-1dc1-43ff-ad48-341f4fb85112" containerName="prometheus" May 25 13:10:10.542324 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.542256 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d93b814-1dc1-43ff-ad48-341f4fb85112" containerName="prometheus" May 25 13:10:10.542324 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.542264 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d93b814-1dc1-43ff-ad48-341f4fb85112" containerName="init-config-reloader" May 25 13:10:10.542324 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.542259 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e942274373f429609560ff61f5189666f98c1a3653fb9c1c1e6c8054257fd387"} err="failed to get container status \"e942274373f429609560ff61f5189666f98c1a3653fb9c1c1e6c8054257fd387\": rpc error: code = NotFound desc = could not find container \"e942274373f429609560ff61f5189666f98c1a3653fb9c1c1e6c8054257fd387\": container with ID starting with e942274373f429609560ff61f5189666f98c1a3653fb9c1c1e6c8054257fd387 not found: ID does not exist" May 25 13:10:10.542324 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.542279 2568 scope.go:117] "RemoveContainer" containerID="877c60effa6c4b0215765883afbfb9e142e722609a2c8c9a88e7ce28640657d0" May 25 13:10:10.542324 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.542269 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d93b814-1dc1-43ff-ad48-341f4fb85112" containerName="init-config-reloader" May 25 13:10:10.542753 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.542394 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="8d93b814-1dc1-43ff-ad48-341f4fb85112" containerName="kube-rbac-proxy-web" May 25 13:10:10.542753 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.542407 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="8d93b814-1dc1-43ff-ad48-341f4fb85112" containerName="config-reloader" May 25 13:10:10.542753 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.542418 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="8d93b814-1dc1-43ff-ad48-341f4fb85112" containerName="prometheus" May 25 13:10:10.542753 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.542429 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="8d93b814-1dc1-43ff-ad48-341f4fb85112" containerName="kube-rbac-proxy" May 25 13:10:10.542753 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.542440 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="8d93b814-1dc1-43ff-ad48-341f4fb85112" containerName="thanos-sidecar" May 25 13:10:10.542753 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.542447 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="8d93b814-1dc1-43ff-ad48-341f4fb85112" containerName="kube-rbac-proxy-thanos" May 25 13:10:10.542753 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.542551 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"877c60effa6c4b0215765883afbfb9e142e722609a2c8c9a88e7ce28640657d0"} err="failed to get container status \"877c60effa6c4b0215765883afbfb9e142e722609a2c8c9a88e7ce28640657d0\": rpc error: code = NotFound desc = could not find container \"877c60effa6c4b0215765883afbfb9e142e722609a2c8c9a88e7ce28640657d0\": container with ID starting with 877c60effa6c4b0215765883afbfb9e142e722609a2c8c9a88e7ce28640657d0 not found: ID does not exist" May 25 13:10:10.542753 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.542568 2568 scope.go:117] "RemoveContainer" containerID="7cbe27ab411dbe136a39e39be137813ea697d60af78feba8b3c8a30eb262a3d3" May 25 13:10:10.543053 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.542802 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cbe27ab411dbe136a39e39be137813ea697d60af78feba8b3c8a30eb262a3d3"} err="failed to get container status \"7cbe27ab411dbe136a39e39be137813ea697d60af78feba8b3c8a30eb262a3d3\": rpc error: code = NotFound desc = could not find container \"7cbe27ab411dbe136a39e39be137813ea697d60af78feba8b3c8a30eb262a3d3\": container with ID starting with 7cbe27ab411dbe136a39e39be137813ea697d60af78feba8b3c8a30eb262a3d3 not found: ID does not exist" May 25 13:10:10.543053 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.542817 2568 scope.go:117] "RemoveContainer" containerID="250ddc0a2946bbe1209245783c5637853fe8776234e61c012a11b987ab5ec9bf" May 25 13:10:10.543126 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.543057 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"250ddc0a2946bbe1209245783c5637853fe8776234e61c012a11b987ab5ec9bf"} err="failed to get container status \"250ddc0a2946bbe1209245783c5637853fe8776234e61c012a11b987ab5ec9bf\": rpc error: code = NotFound desc = could not find container \"250ddc0a2946bbe1209245783c5637853fe8776234e61c012a11b987ab5ec9bf\": container with ID starting with 250ddc0a2946bbe1209245783c5637853fe8776234e61c012a11b987ab5ec9bf not found: ID does not exist" May 25 13:10:10.543126 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.543071 2568 scope.go:117] "RemoveContainer" containerID="c7e6966a88401574e720e815a57fb7ec2ee14e14ff27424a2292d840ef2b6e42" May 25 13:10:10.543313 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.543294 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7e6966a88401574e720e815a57fb7ec2ee14e14ff27424a2292d840ef2b6e42"} err="failed to get container status \"c7e6966a88401574e720e815a57fb7ec2ee14e14ff27424a2292d840ef2b6e42\": rpc error: code = NotFound desc = could not find container \"c7e6966a88401574e720e815a57fb7ec2ee14e14ff27424a2292d840ef2b6e42\": container with ID starting with c7e6966a88401574e720e815a57fb7ec2ee14e14ff27424a2292d840ef2b6e42 not found: ID does not exist" May 25 13:10:10.543379 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.543316 2568 scope.go:117] "RemoveContainer" containerID="ce2f74bfaeb183adea3500da9baefdc981c3e250daa045216ccb4ebb63a7a9d3" May 25 13:10:10.543564 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.543540 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce2f74bfaeb183adea3500da9baefdc981c3e250daa045216ccb4ebb63a7a9d3"} err="failed to get container status \"ce2f74bfaeb183adea3500da9baefdc981c3e250daa045216ccb4ebb63a7a9d3\": rpc error: code = NotFound desc = could not find container \"ce2f74bfaeb183adea3500da9baefdc981c3e250daa045216ccb4ebb63a7a9d3\": container with ID starting with ce2f74bfaeb183adea3500da9baefdc981c3e250daa045216ccb4ebb63a7a9d3 not found: ID does not exist" May 25 13:10:10.543686 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.543565 2568 scope.go:117] "RemoveContainer" containerID="25541d1c326af914cc5e09458261e5352653b531a2fa50c0d686b7d7fcb178e0" May 25 13:10:10.543831 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.543811 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25541d1c326af914cc5e09458261e5352653b531a2fa50c0d686b7d7fcb178e0"} err="failed to get container status \"25541d1c326af914cc5e09458261e5352653b531a2fa50c0d686b7d7fcb178e0\": rpc error: code = NotFound desc = could not find container \"25541d1c326af914cc5e09458261e5352653b531a2fa50c0d686b7d7fcb178e0\": container with ID starting with 25541d1c326af914cc5e09458261e5352653b531a2fa50c0d686b7d7fcb178e0 not found: ID does not exist" May 25 13:10:10.543831 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.543832 2568 scope.go:117] "RemoveContainer" containerID="e942274373f429609560ff61f5189666f98c1a3653fb9c1c1e6c8054257fd387" May 25 13:10:10.546336 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.544101 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e942274373f429609560ff61f5189666f98c1a3653fb9c1c1e6c8054257fd387"} err="failed to get container status \"e942274373f429609560ff61f5189666f98c1a3653fb9c1c1e6c8054257fd387\": rpc error: code = NotFound desc = could not find container \"e942274373f429609560ff61f5189666f98c1a3653fb9c1c1e6c8054257fd387\": container with ID starting with e942274373f429609560ff61f5189666f98c1a3653fb9c1c1e6c8054257fd387 not found: ID does not exist" May 25 13:10:10.546336 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.544134 2568 scope.go:117] "RemoveContainer" containerID="877c60effa6c4b0215765883afbfb9e142e722609a2c8c9a88e7ce28640657d0" May 25 13:10:10.546495 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.546346 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"877c60effa6c4b0215765883afbfb9e142e722609a2c8c9a88e7ce28640657d0"} err="failed to get container status \"877c60effa6c4b0215765883afbfb9e142e722609a2c8c9a88e7ce28640657d0\": rpc error: code = NotFound desc = could not find container \"877c60effa6c4b0215765883afbfb9e142e722609a2c8c9a88e7ce28640657d0\": container with ID starting with 877c60effa6c4b0215765883afbfb9e142e722609a2c8c9a88e7ce28640657d0 not found: ID does not exist" May 25 13:10:10.546495 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.546369 2568 scope.go:117] "RemoveContainer" containerID="7cbe27ab411dbe136a39e39be137813ea697d60af78feba8b3c8a30eb262a3d3" May 25 13:10:10.546751 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.546729 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cbe27ab411dbe136a39e39be137813ea697d60af78feba8b3c8a30eb262a3d3"} err="failed to get container status \"7cbe27ab411dbe136a39e39be137813ea697d60af78feba8b3c8a30eb262a3d3\": rpc error: code = NotFound desc = could not find container \"7cbe27ab411dbe136a39e39be137813ea697d60af78feba8b3c8a30eb262a3d3\": container with ID starting with 7cbe27ab411dbe136a39e39be137813ea697d60af78feba8b3c8a30eb262a3d3 not found: ID does not exist" May 25 13:10:10.546818 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.546753 2568 scope.go:117] "RemoveContainer" containerID="250ddc0a2946bbe1209245783c5637853fe8776234e61c012a11b987ab5ec9bf" May 25 13:10:10.547005 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.546990 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"250ddc0a2946bbe1209245783c5637853fe8776234e61c012a11b987ab5ec9bf"} err="failed to get container status \"250ddc0a2946bbe1209245783c5637853fe8776234e61c012a11b987ab5ec9bf\": rpc error: code = NotFound desc = could not find container \"250ddc0a2946bbe1209245783c5637853fe8776234e61c012a11b987ab5ec9bf\": container with ID starting with 250ddc0a2946bbe1209245783c5637853fe8776234e61c012a11b987ab5ec9bf not found: ID does not exist" May 25 13:10:10.547050 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.547005 2568 scope.go:117] "RemoveContainer" containerID="c7e6966a88401574e720e815a57fb7ec2ee14e14ff27424a2292d840ef2b6e42" May 25 13:10:10.547236 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.547221 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7e6966a88401574e720e815a57fb7ec2ee14e14ff27424a2292d840ef2b6e42"} err="failed to get container status \"c7e6966a88401574e720e815a57fb7ec2ee14e14ff27424a2292d840ef2b6e42\": rpc error: code = NotFound desc = could not find container \"c7e6966a88401574e720e815a57fb7ec2ee14e14ff27424a2292d840ef2b6e42\": container with ID starting with c7e6966a88401574e720e815a57fb7ec2ee14e14ff27424a2292d840ef2b6e42 not found: ID does not exist" May 25 13:10:10.547236 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.547235 2568 scope.go:117] "RemoveContainer" containerID="ce2f74bfaeb183adea3500da9baefdc981c3e250daa045216ccb4ebb63a7a9d3" May 25 13:10:10.547403 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.547389 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce2f74bfaeb183adea3500da9baefdc981c3e250daa045216ccb4ebb63a7a9d3"} err="failed to get container status \"ce2f74bfaeb183adea3500da9baefdc981c3e250daa045216ccb4ebb63a7a9d3\": rpc error: code = NotFound desc = could not find container \"ce2f74bfaeb183adea3500da9baefdc981c3e250daa045216ccb4ebb63a7a9d3\": container with ID starting with ce2f74bfaeb183adea3500da9baefdc981c3e250daa045216ccb4ebb63a7a9d3 not found: ID does not exist" May 25 13:10:10.549436 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.549419 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.552194 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.552176 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 25 13:10:10.552285 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.552268 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 25 13:10:10.552415 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.552400 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-7c5n5\"" May 25 13:10:10.552487 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.552425 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 25 13:10:10.552723 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.552699 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 25 13:10:10.552723 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.552717 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 25 13:10:10.552889 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.552740 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-dn8cgrm3u4553\"" May 25 13:10:10.552889 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.552797 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 25 13:10:10.552889 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.552820 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 25 13:10:10.553110 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.553093 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 25 13:10:10.553209 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.553111 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 25 13:10:10.553209 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.553111 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 25 13:10:10.553449 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.553430 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 25 13:10:10.559769 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.559647 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 25 13:10:10.560604 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.560579 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 25 13:10:10.560989 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.560967 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 13:10:10.589987 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.589510 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d1c780d7-4381-48a8-8b58-003179ae92b5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.589987 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.589561 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d1c780d7-4381-48a8-8b58-003179ae92b5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.589987 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.589604 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d1c780d7-4381-48a8-8b58-003179ae92b5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.589987 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.589636 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d1c780d7-4381-48a8-8b58-003179ae92b5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.589987 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.589691 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1c780d7-4381-48a8-8b58-003179ae92b5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.589987 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.589736 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1c780d7-4381-48a8-8b58-003179ae92b5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.589987 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.589766 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b9xz\" (UniqueName: \"kubernetes.io/projected/d1c780d7-4381-48a8-8b58-003179ae92b5-kube-api-access-4b9xz\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.589987 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.589824 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d1c780d7-4381-48a8-8b58-003179ae92b5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.589987 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.589863 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d1c780d7-4381-48a8-8b58-003179ae92b5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.589987 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.589905 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d1c780d7-4381-48a8-8b58-003179ae92b5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.589987 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.589940 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d1c780d7-4381-48a8-8b58-003179ae92b5-web-config\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.590552 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.590068 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d1c780d7-4381-48a8-8b58-003179ae92b5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.590770 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.590750 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d1c780d7-4381-48a8-8b58-003179ae92b5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.590808 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.590781 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d1c780d7-4381-48a8-8b58-003179ae92b5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.590808 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.590801 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d1c780d7-4381-48a8-8b58-003179ae92b5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.590872 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.590848 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d1c780d7-4381-48a8-8b58-003179ae92b5-config\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.590938 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.590922 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1c780d7-4381-48a8-8b58-003179ae92b5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.590969 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.590959 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d1c780d7-4381-48a8-8b58-003179ae92b5-config-out\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.692008 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.691986 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d1c780d7-4381-48a8-8b58-003179ae92b5-config-out\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.692108 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.692025 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d1c780d7-4381-48a8-8b58-003179ae92b5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.692108 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.692041 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d1c780d7-4381-48a8-8b58-003179ae92b5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.692108 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.692066 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d1c780d7-4381-48a8-8b58-003179ae92b5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.692235 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.692195 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d1c780d7-4381-48a8-8b58-003179ae92b5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.692282 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.692239 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1c780d7-4381-48a8-8b58-003179ae92b5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.692282 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.692270 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1c780d7-4381-48a8-8b58-003179ae92b5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.692387 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.692287 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4b9xz\" (UniqueName: \"kubernetes.io/projected/d1c780d7-4381-48a8-8b58-003179ae92b5-kube-api-access-4b9xz\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.692387 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.692326 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d1c780d7-4381-48a8-8b58-003179ae92b5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.692387 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.692357 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d1c780d7-4381-48a8-8b58-003179ae92b5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.692533 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.692391 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d1c780d7-4381-48a8-8b58-003179ae92b5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.692533 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.692416 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d1c780d7-4381-48a8-8b58-003179ae92b5-web-config\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.692533 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.692445 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d1c780d7-4381-48a8-8b58-003179ae92b5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.692533 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.692468 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d1c780d7-4381-48a8-8b58-003179ae92b5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.692533 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.692492 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d1c780d7-4381-48a8-8b58-003179ae92b5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.692533 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.692518 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d1c780d7-4381-48a8-8b58-003179ae92b5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.692803 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.692546 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d1c780d7-4381-48a8-8b58-003179ae92b5-config\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.692803 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.692580 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1c780d7-4381-48a8-8b58-003179ae92b5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.692803 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.692584 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d1c780d7-4381-48a8-8b58-003179ae92b5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.693315 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.692974 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1c780d7-4381-48a8-8b58-003179ae92b5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.694960 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.694928 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d1c780d7-4381-48a8-8b58-003179ae92b5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.695064 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.695044 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d1c780d7-4381-48a8-8b58-003179ae92b5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.695421 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.695312 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d1c780d7-4381-48a8-8b58-003179ae92b5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.695520 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.695424 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d1c780d7-4381-48a8-8b58-003179ae92b5-config-out\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.695764 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.695592 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d1c780d7-4381-48a8-8b58-003179ae92b5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.695764 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.695614 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d1c780d7-4381-48a8-8b58-003179ae92b5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.695764 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.695697 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d1c780d7-4381-48a8-8b58-003179ae92b5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.696099 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.696078 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d1c780d7-4381-48a8-8b58-003179ae92b5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.696291 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.696245 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1c780d7-4381-48a8-8b58-003179ae92b5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.696514 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.696490 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d1c780d7-4381-48a8-8b58-003179ae92b5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.696595 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.696502 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1c780d7-4381-48a8-8b58-003179ae92b5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.697321 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.697297 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d1c780d7-4381-48a8-8b58-003179ae92b5-config\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.697410 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.697320 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d1c780d7-4381-48a8-8b58-003179ae92b5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.697651 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.697635 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d1c780d7-4381-48a8-8b58-003179ae92b5-web-config\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.697717 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.697701 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d1c780d7-4381-48a8-8b58-003179ae92b5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.704969 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.704946 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b9xz\" (UniqueName: \"kubernetes.io/projected/d1c780d7-4381-48a8-8b58-003179ae92b5-kube-api-access-4b9xz\") pod \"prometheus-k8s-0\" (UID: \"d1c780d7-4381-48a8-8b58-003179ae92b5\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:10.742029 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.741978 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d93b814-1dc1-43ff-ad48-341f4fb85112" path="/var/lib/kubelet/pods/8d93b814-1dc1-43ff-ad48-341f4fb85112/volumes" May 25 13:10:10.862174 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:10.862127 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:11.007363 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:11.007044 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 13:10:11.007363 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:10:11.007285 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1c780d7_4381_48a8_8b58_003179ae92b5.slice/crio-e7a5a5e78c9a07bbbaefe18cf7125a6963fe4cd045389580d515d740bae7c818 WatchSource:0}: Error finding container e7a5a5e78c9a07bbbaefe18cf7125a6963fe4cd045389580d515d740bae7c818: Status 404 returned error can't find the container with id e7a5a5e78c9a07bbbaefe18cf7125a6963fe4cd045389580d515d740bae7c818 May 25 13:10:11.493617 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:11.493586 2568 generic.go:358] "Generic (PLEG): container finished" podID="d1c780d7-4381-48a8-8b58-003179ae92b5" containerID="c7575fe844d1cdb7d7f03a4c869b21d90d8ca2275a2bb2265b7200d088e2bfe9" exitCode=0 May 25 13:10:11.493784 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:11.493674 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d1c780d7-4381-48a8-8b58-003179ae92b5","Type":"ContainerDied","Data":"c7575fe844d1cdb7d7f03a4c869b21d90d8ca2275a2bb2265b7200d088e2bfe9"} May 25 13:10:11.493784 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:11.493705 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d1c780d7-4381-48a8-8b58-003179ae92b5","Type":"ContainerStarted","Data":"e7a5a5e78c9a07bbbaefe18cf7125a6963fe4cd045389580d515d740bae7c818"} May 25 13:10:12.499220 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:12.499186 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d1c780d7-4381-48a8-8b58-003179ae92b5","Type":"ContainerStarted","Data":"10709dc43aa156957d422ab0a4163da281e277426a2e285f0d8668002b2b3587"} May 25 13:10:12.499220 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:12.499222 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d1c780d7-4381-48a8-8b58-003179ae92b5","Type":"ContainerStarted","Data":"86c61ea4bbd803151d95bda27baca30261c4dbc27a1706bf6ab4ea1b4553bba9"} May 25 13:10:12.499603 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:12.499231 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d1c780d7-4381-48a8-8b58-003179ae92b5","Type":"ContainerStarted","Data":"77eaf72a2fcdb0585d2150dab0058d42a31eacaef15aeaff1978528f0cc09daa"} May 25 13:10:12.499603 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:12.499240 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d1c780d7-4381-48a8-8b58-003179ae92b5","Type":"ContainerStarted","Data":"24242ebca4b9a288209c2d5469e3c1afdde342bcd83067c52af98ddbd94f9a0a"} May 25 13:10:12.499603 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:12.499248 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d1c780d7-4381-48a8-8b58-003179ae92b5","Type":"ContainerStarted","Data":"6ffb2cb96ac6996c1ff0b4c725c40ba54a9343c1f6361ab1e65c27c230cfdd58"} May 25 13:10:12.499603 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:12.499257 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d1c780d7-4381-48a8-8b58-003179ae92b5","Type":"ContainerStarted","Data":"649e0cabe1d2d0f45fd3c65bba6a2c77420f5f8aa3e7f0c83d436013baeb7ff9"} May 25 13:10:12.529196 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:12.529134 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.529120682 podStartE2EDuration="2.529120682s" podCreationTimestamp="2026-05-25 13:10:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 13:10:12.526627531 +0000 UTC m=+278.423897162" watchObservedRunningTime="2026-05-25 13:10:12.529120682 +0000 UTC m=+278.426390313" May 25 13:10:14.135767 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:10:14.135729 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-nfjdz" podUID="8e7d318b-4ca1-4015-9c2a-1f94373ef66a" May 25 13:10:14.135767 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:10:14.135728 2568 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-87mfx" podUID="a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7" May 25 13:10:14.506408 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:14.506375 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-nfjdz" May 25 13:10:14.506567 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:14.506375 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-87mfx" May 25 13:10:15.862384 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:15.862354 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 25 13:10:17.954613 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:17.954577 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7-metrics-tls\") pod \"dns-default-87mfx\" (UID: \"a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7\") " pod="openshift-dns/dns-default-87mfx" May 25 13:10:17.955003 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:17.954624 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8e7d318b-4ca1-4015-9c2a-1f94373ef66a-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-nfjdz\" (UID: \"8e7d318b-4ca1-4015-9c2a-1f94373ef66a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-nfjdz" May 25 13:10:17.955003 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:17.954661 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/700a0947-b3b8-44f1-a79c-4b34fd1d2171-cert\") pod \"ingress-canary-j9lmj\" (UID: \"700a0947-b3b8-44f1-a79c-4b34fd1d2171\") " pod="openshift-ingress-canary/ingress-canary-j9lmj" May 25 13:10:17.957067 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:17.957033 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7-metrics-tls\") pod \"dns-default-87mfx\" (UID: \"a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7\") " pod="openshift-dns/dns-default-87mfx" May 25 13:10:17.957205 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:17.957095 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/700a0947-b3b8-44f1-a79c-4b34fd1d2171-cert\") pod \"ingress-canary-j9lmj\" (UID: \"700a0947-b3b8-44f1-a79c-4b34fd1d2171\") " pod="openshift-ingress-canary/ingress-canary-j9lmj" May 25 13:10:17.957292 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:17.957269 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8e7d318b-4ca1-4015-9c2a-1f94373ef66a-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-nfjdz\" (UID: \"8e7d318b-4ca1-4015-9c2a-1f94373ef66a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-nfjdz" May 25 13:10:18.109830 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:18.109795 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dnmsw\"" May 25 13:10:18.110978 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:18.110961 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-9h7d4\"" May 25 13:10:18.117282 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:18.117265 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-87mfx" May 25 13:10:18.117356 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:18.117320 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-nfjdz" May 25 13:10:18.141698 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:18.141667 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6hqsn\"" May 25 13:10:18.149073 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:18.149044 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j9lmj" May 25 13:10:18.259917 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:18.259889 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-87mfx"] May 25 13:10:18.264025 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:10:18.263996 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0dc0a3c_0386_438c_ac0f_dfa7a043bcb7.slice/crio-cfe8d31f98786e8278bb143c0bbbb51a3cbdf012b5ff05784ec2e05c238e76cf WatchSource:0}: Error finding container cfe8d31f98786e8278bb143c0bbbb51a3cbdf012b5ff05784ec2e05c238e76cf: Status 404 returned error can't find the container with id cfe8d31f98786e8278bb143c0bbbb51a3cbdf012b5ff05784ec2e05c238e76cf May 25 13:10:18.281783 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:18.281761 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-nfjdz"] May 25 13:10:18.283522 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:10:18.283487 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e7d318b_4ca1_4015_9c2a_1f94373ef66a.slice/crio-23d461cf5a16b41b83c01b756ae8c2f1b6aa48a8cfd72cfa04ded639071c998d WatchSource:0}: Error finding container 23d461cf5a16b41b83c01b756ae8c2f1b6aa48a8cfd72cfa04ded639071c998d: Status 404 returned error can't find the container with id 23d461cf5a16b41b83c01b756ae8c2f1b6aa48a8cfd72cfa04ded639071c998d May 25 13:10:18.300659 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:18.300582 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j9lmj"] May 25 13:10:18.302343 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:10:18.302320 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod700a0947_b3b8_44f1_a79c_4b34fd1d2171.slice/crio-79aa44213a3bcd63a3b6e9fe355e79adc58204cc41425311712c93c438dcfcb4 WatchSource:0}: Error finding container 79aa44213a3bcd63a3b6e9fe355e79adc58204cc41425311712c93c438dcfcb4: Status 404 returned error can't find the container with id 79aa44213a3bcd63a3b6e9fe355e79adc58204cc41425311712c93c438dcfcb4 May 25 13:10:18.519405 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:18.519314 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j9lmj" event={"ID":"700a0947-b3b8-44f1-a79c-4b34fd1d2171","Type":"ContainerStarted","Data":"79aa44213a3bcd63a3b6e9fe355e79adc58204cc41425311712c93c438dcfcb4"} May 25 13:10:18.520317 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:18.520294 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-nfjdz" event={"ID":"8e7d318b-4ca1-4015-9c2a-1f94373ef66a","Type":"ContainerStarted","Data":"23d461cf5a16b41b83c01b756ae8c2f1b6aa48a8cfd72cfa04ded639071c998d"} May 25 13:10:18.521176 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:18.521135 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-87mfx" event={"ID":"a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7","Type":"ContainerStarted","Data":"cfe8d31f98786e8278bb143c0bbbb51a3cbdf012b5ff05784ec2e05c238e76cf"} May 25 13:10:21.529490 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:21.529454 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j9lmj" event={"ID":"700a0947-b3b8-44f1-a79c-4b34fd1d2171","Type":"ContainerStarted","Data":"65c63292b2026e93cb9583484da3fdb6338c54a858558700ea0a33c1b226b72d"} May 25 13:10:21.530725 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:21.530697 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-nfjdz" event={"ID":"8e7d318b-4ca1-4015-9c2a-1f94373ef66a","Type":"ContainerStarted","Data":"03cf5457e33029ae388188752a172a4abafe6099e81755508474d874aaa50d70"} May 25 13:10:21.532069 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:21.532043 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-87mfx" event={"ID":"a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7","Type":"ContainerStarted","Data":"7a230b2082b7b69d6bba8e6e456ddf1cc9597141785ada40d89a0a42f231dd7d"} May 25 13:10:21.532191 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:21.532073 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-87mfx" event={"ID":"a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7","Type":"ContainerStarted","Data":"ff48d83a554027d4609f21bbcd90aa19a28351520525aa5c1f3e72f4a04f6af2"} May 25 13:10:21.532191 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:21.532175 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-87mfx" May 25 13:10:21.547179 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:21.547111 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-j9lmj" podStartSLOduration=252.405763117 podStartE2EDuration="4m14.547095019s" podCreationTimestamp="2026-05-25 13:06:07 +0000 UTC" firstStartedPulling="2026-05-25 13:10:18.303979073 +0000 UTC m=+284.201248688" lastFinishedPulling="2026-05-25 13:10:20.445310967 +0000 UTC m=+286.342580590" observedRunningTime="2026-05-25 13:10:21.54677874 +0000 UTC m=+287.444048374" watchObservedRunningTime="2026-05-25 13:10:21.547095019 +0000 UTC m=+287.444364654" May 25 13:10:21.563256 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:21.563207 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-nfjdz" podStartSLOduration=265.408697784 podStartE2EDuration="4m27.563190448s" podCreationTimestamp="2026-05-25 13:05:54 +0000 UTC" firstStartedPulling="2026-05-25 13:10:18.285488626 +0000 UTC m=+284.182758240" lastFinishedPulling="2026-05-25 13:10:20.439981295 +0000 UTC m=+286.337250904" observedRunningTime="2026-05-25 13:10:21.561798514 +0000 UTC m=+287.459068156" watchObservedRunningTime="2026-05-25 13:10:21.563190448 +0000 UTC m=+287.460460102" May 25 13:10:21.578952 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:21.578903 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-87mfx" podStartSLOduration=252.404655986 podStartE2EDuration="4m14.578887644s" podCreationTimestamp="2026-05-25 13:06:07 +0000 UTC" firstStartedPulling="2026-05-25 13:10:18.266386431 +0000 UTC m=+284.163656047" lastFinishedPulling="2026-05-25 13:10:20.440618094 +0000 UTC m=+286.337887705" observedRunningTime="2026-05-25 13:10:21.578050624 +0000 UTC m=+287.475320269" watchObservedRunningTime="2026-05-25 13:10:21.578887644 +0000 UTC m=+287.476157278" May 25 13:10:31.536714 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:31.536684 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-87mfx" May 25 13:10:34.623626 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:34.623599 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvqnb_eeec714b-fedf-44ce-810b-fca091e4364a/ovn-acl-logging/0.log" May 25 13:10:34.624024 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:34.623957 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvqnb_eeec714b-fedf-44ce-810b-fca091e4364a/ovn-acl-logging/0.log" May 25 13:10:34.629898 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:10:34.629880 2568 kubelet.go:1628] "Image garbage collection succeeded" May 25 13:11:10.862304 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:11:10.862272 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 25 13:11:10.879166 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:11:10.879123 2568 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 25 13:11:11.683170 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:11:11.683084 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 25 13:15:34.649891 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:15:34.649866 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvqnb_eeec714b-fedf-44ce-810b-fca091e4364a/ovn-acl-logging/0.log" May 25 13:15:34.651588 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:15:34.651567 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvqnb_eeec714b-fedf-44ce-810b-fca091e4364a/ovn-acl-logging/0.log" May 25 13:19:55.384366 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:19:55.384333 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/s3-init-xrvhs"] May 25 13:19:55.386757 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:19:55.386738 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-xrvhs" May 25 13:19:55.389670 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:19:55.389654 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" May 25 13:19:55.389811 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:19:55.389721 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" May 25 13:19:55.389811 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:19:55.389721 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" May 25 13:19:55.391016 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:19:55.391000 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-jbsqc\"" May 25 13:19:55.395047 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:19:55.395027 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-xrvhs"] May 25 13:19:55.526800 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:19:55.526767 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l66v\" (UniqueName: \"kubernetes.io/projected/79eca206-40c5-4eea-bbb0-dd6b95a71cfa-kube-api-access-6l66v\") pod \"s3-init-xrvhs\" (UID: \"79eca206-40c5-4eea-bbb0-dd6b95a71cfa\") " pod="kserve/s3-init-xrvhs" May 25 13:19:55.628208 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:19:55.628172 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6l66v\" (UniqueName: \"kubernetes.io/projected/79eca206-40c5-4eea-bbb0-dd6b95a71cfa-kube-api-access-6l66v\") pod \"s3-init-xrvhs\" (UID: \"79eca206-40c5-4eea-bbb0-dd6b95a71cfa\") " pod="kserve/s3-init-xrvhs" May 25 13:19:55.637366 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:19:55.637310 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l66v\" (UniqueName: \"kubernetes.io/projected/79eca206-40c5-4eea-bbb0-dd6b95a71cfa-kube-api-access-6l66v\") pod \"s3-init-xrvhs\" (UID: \"79eca206-40c5-4eea-bbb0-dd6b95a71cfa\") " pod="kserve/s3-init-xrvhs" May 25 13:19:55.696728 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:19:55.696703 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-xrvhs" May 25 13:19:55.821364 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:19:55.821339 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-xrvhs"] May 25 13:19:55.823698 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:19:55.823670 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod79eca206_40c5_4eea_bbb0_dd6b95a71cfa.slice/crio-f0887bb921b178648d3e7efa13e08ae67a38354bec55eff2ebf8599a9702db2c WatchSource:0}: Error finding container f0887bb921b178648d3e7efa13e08ae67a38354bec55eff2ebf8599a9702db2c: Status 404 returned error can't find the container with id f0887bb921b178648d3e7efa13e08ae67a38354bec55eff2ebf8599a9702db2c May 25 13:19:55.825398 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:19:55.825380 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 25 13:19:56.091364 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:19:56.091329 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-xrvhs" event={"ID":"79eca206-40c5-4eea-bbb0-dd6b95a71cfa","Type":"ContainerStarted","Data":"f0887bb921b178648d3e7efa13e08ae67a38354bec55eff2ebf8599a9702db2c"} May 25 13:20:01.107864 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:20:01.107829 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-xrvhs" event={"ID":"79eca206-40c5-4eea-bbb0-dd6b95a71cfa","Type":"ContainerStarted","Data":"75063c2d20d8c3e6973c7bcc8e007aebf54aafb53b6308ef8381b1ee5ca96702"} May 25 13:20:04.120062 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:20:04.120028 2568 generic.go:358] "Generic (PLEG): container finished" podID="79eca206-40c5-4eea-bbb0-dd6b95a71cfa" containerID="75063c2d20d8c3e6973c7bcc8e007aebf54aafb53b6308ef8381b1ee5ca96702" exitCode=0 May 25 13:20:04.120486 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:20:04.120101 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-xrvhs" event={"ID":"79eca206-40c5-4eea-bbb0-dd6b95a71cfa","Type":"ContainerDied","Data":"75063c2d20d8c3e6973c7bcc8e007aebf54aafb53b6308ef8381b1ee5ca96702"} May 25 13:20:05.241875 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:20:05.241850 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-xrvhs" May 25 13:20:05.416590 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:20:05.416546 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6l66v\" (UniqueName: \"kubernetes.io/projected/79eca206-40c5-4eea-bbb0-dd6b95a71cfa-kube-api-access-6l66v\") pod \"79eca206-40c5-4eea-bbb0-dd6b95a71cfa\" (UID: \"79eca206-40c5-4eea-bbb0-dd6b95a71cfa\") " May 25 13:20:05.418666 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:20:05.418636 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79eca206-40c5-4eea-bbb0-dd6b95a71cfa-kube-api-access-6l66v" (OuterVolumeSpecName: "kube-api-access-6l66v") pod "79eca206-40c5-4eea-bbb0-dd6b95a71cfa" (UID: "79eca206-40c5-4eea-bbb0-dd6b95a71cfa"). InnerVolumeSpecName "kube-api-access-6l66v". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 13:20:05.517223 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:20:05.517181 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6l66v\" (UniqueName: \"kubernetes.io/projected/79eca206-40c5-4eea-bbb0-dd6b95a71cfa-kube-api-access-6l66v\") on node \"ip-10-0-132-184.ec2.internal\" DevicePath \"\"" May 25 13:20:06.126555 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:20:06.126527 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-xrvhs" May 25 13:20:06.126715 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:20:06.126531 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-xrvhs" event={"ID":"79eca206-40c5-4eea-bbb0-dd6b95a71cfa","Type":"ContainerDied","Data":"f0887bb921b178648d3e7efa13e08ae67a38354bec55eff2ebf8599a9702db2c"} May 25 13:20:06.126715 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:20:06.126629 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f0887bb921b178648d3e7efa13e08ae67a38354bec55eff2ebf8599a9702db2c" May 25 13:20:34.669494 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:20:34.669467 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvqnb_eeec714b-fedf-44ce-810b-fca091e4364a/ovn-acl-logging/0.log" May 25 13:20:34.671330 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:20:34.671312 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvqnb_eeec714b-fedf-44ce-810b-fca091e4364a/ovn-acl-logging/0.log" May 25 13:23:31.582050 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:23:31.581959 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-a698c-fbd59f46f-krj28"] May 25 13:23:31.582614 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:23:31.582289 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79eca206-40c5-4eea-bbb0-dd6b95a71cfa" containerName="s3-init" May 25 13:23:31.582614 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:23:31.582301 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="79eca206-40c5-4eea-bbb0-dd6b95a71cfa" containerName="s3-init" May 25 13:23:31.582614 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:23:31.582351 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="79eca206-40c5-4eea-bbb0-dd6b95a71cfa" containerName="s3-init" May 25 13:23:31.585289 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:23:31.585273 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-a698c-fbd59f46f-krj28" May 25 13:23:31.588314 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:23:31.588293 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-a698c-serving-cert\"" May 25 13:23:31.588314 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:23:31.588305 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" May 25 13:23:31.588527 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:23:31.588389 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-a698c-kube-rbac-proxy-sar-config\"" May 25 13:23:31.589557 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:23:31.589540 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-cmtw7\"" May 25 13:23:31.595134 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:23:31.595114 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-a698c-fbd59f46f-krj28"] May 25 13:23:31.719579 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:23:31.719544 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/71863791-9bd4-4473-b183-f2c8f0fdf2c7-proxy-tls\") pod \"model-chainer-raw-a698c-fbd59f46f-krj28\" (UID: \"71863791-9bd4-4473-b183-f2c8f0fdf2c7\") " pod="kserve-ci-e2e-test/model-chainer-raw-a698c-fbd59f46f-krj28" May 25 13:23:31.719734 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:23:31.719677 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71863791-9bd4-4473-b183-f2c8f0fdf2c7-openshift-service-ca-bundle\") pod \"model-chainer-raw-a698c-fbd59f46f-krj28\" (UID: \"71863791-9bd4-4473-b183-f2c8f0fdf2c7\") " pod="kserve-ci-e2e-test/model-chainer-raw-a698c-fbd59f46f-krj28" May 25 13:23:31.820515 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:23:31.820482 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71863791-9bd4-4473-b183-f2c8f0fdf2c7-openshift-service-ca-bundle\") pod \"model-chainer-raw-a698c-fbd59f46f-krj28\" (UID: \"71863791-9bd4-4473-b183-f2c8f0fdf2c7\") " pod="kserve-ci-e2e-test/model-chainer-raw-a698c-fbd59f46f-krj28" May 25 13:23:31.820663 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:23:31.820538 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/71863791-9bd4-4473-b183-f2c8f0fdf2c7-proxy-tls\") pod \"model-chainer-raw-a698c-fbd59f46f-krj28\" (UID: \"71863791-9bd4-4473-b183-f2c8f0fdf2c7\") " pod="kserve-ci-e2e-test/model-chainer-raw-a698c-fbd59f46f-krj28" May 25 13:23:31.820703 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:23:31.820674 2568 secret.go:189] Couldn't get secret kserve-ci-e2e-test/model-chainer-raw-a698c-serving-cert: secret "model-chainer-raw-a698c-serving-cert" not found May 25 13:23:31.820754 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:23:31.820742 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71863791-9bd4-4473-b183-f2c8f0fdf2c7-proxy-tls podName:71863791-9bd4-4473-b183-f2c8f0fdf2c7 nodeName:}" failed. No retries permitted until 2026-05-25 13:23:32.32072156 +0000 UTC m=+1078.217991172 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/71863791-9bd4-4473-b183-f2c8f0fdf2c7-proxy-tls") pod "model-chainer-raw-a698c-fbd59f46f-krj28" (UID: "71863791-9bd4-4473-b183-f2c8f0fdf2c7") : secret "model-chainer-raw-a698c-serving-cert" not found May 25 13:23:31.821219 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:23:31.821200 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71863791-9bd4-4473-b183-f2c8f0fdf2c7-openshift-service-ca-bundle\") pod \"model-chainer-raw-a698c-fbd59f46f-krj28\" (UID: \"71863791-9bd4-4473-b183-f2c8f0fdf2c7\") " pod="kserve-ci-e2e-test/model-chainer-raw-a698c-fbd59f46f-krj28" May 25 13:23:32.324489 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:23:32.324442 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/71863791-9bd4-4473-b183-f2c8f0fdf2c7-proxy-tls\") pod \"model-chainer-raw-a698c-fbd59f46f-krj28\" (UID: \"71863791-9bd4-4473-b183-f2c8f0fdf2c7\") " pod="kserve-ci-e2e-test/model-chainer-raw-a698c-fbd59f46f-krj28" May 25 13:23:32.326907 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:23:32.326888 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/71863791-9bd4-4473-b183-f2c8f0fdf2c7-proxy-tls\") pod \"model-chainer-raw-a698c-fbd59f46f-krj28\" (UID: \"71863791-9bd4-4473-b183-f2c8f0fdf2c7\") " pod="kserve-ci-e2e-test/model-chainer-raw-a698c-fbd59f46f-krj28" May 25 13:23:32.496449 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:23:32.496417 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-a698c-fbd59f46f-krj28" May 25 13:23:32.617445 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:23:32.617417 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-a698c-fbd59f46f-krj28"] May 25 13:23:32.620200 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:23:32.620171 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71863791_9bd4_4473_b183_f2c8f0fdf2c7.slice/crio-59f40eb979c5529dff88c10aca5450ec9fbe193924f73ba89588040647bb9ed5 WatchSource:0}: Error finding container 59f40eb979c5529dff88c10aca5450ec9fbe193924f73ba89588040647bb9ed5: Status 404 returned error can't find the container with id 59f40eb979c5529dff88c10aca5450ec9fbe193924f73ba89588040647bb9ed5 May 25 13:23:32.724598 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:23:32.724563 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-a698c-fbd59f46f-krj28" event={"ID":"71863791-9bd4-4473-b183-f2c8f0fdf2c7","Type":"ContainerStarted","Data":"59f40eb979c5529dff88c10aca5450ec9fbe193924f73ba89588040647bb9ed5"} May 25 13:23:35.734540 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:23:35.734503 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-a698c-fbd59f46f-krj28" event={"ID":"71863791-9bd4-4473-b183-f2c8f0fdf2c7","Type":"ContainerStarted","Data":"0a17a6731e7c482a0d4d40384a44440053a2368e4c66f33e27c799d0cf739a06"} May 25 13:23:35.734968 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:23:35.734632 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-a698c-fbd59f46f-krj28" May 25 13:23:35.755412 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:23:35.755362 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-a698c-fbd59f46f-krj28" podStartSLOduration=2.524472125 podStartE2EDuration="4.755349505s" podCreationTimestamp="2026-05-25 13:23:31 +0000 UTC" firstStartedPulling="2026-05-25 13:23:32.622316093 +0000 UTC m=+1078.519585703" lastFinishedPulling="2026-05-25 13:23:34.853193467 +0000 UTC m=+1080.750463083" observedRunningTime="2026-05-25 13:23:35.753920464 +0000 UTC m=+1081.651190097" watchObservedRunningTime="2026-05-25 13:23:35.755349505 +0000 UTC m=+1081.652619137" May 25 13:23:41.634029 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:23:41.633995 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-a698c-fbd59f46f-krj28"] May 25 13:23:41.634449 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:23:41.634316 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-a698c-fbd59f46f-krj28" podUID="71863791-9bd4-4473-b183-f2c8f0fdf2c7" containerName="model-chainer-raw-a698c" containerID="cri-o://0a17a6731e7c482a0d4d40384a44440053a2368e4c66f33e27c799d0cf739a06" gracePeriod=30 May 25 13:23:41.641424 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:23:41.641378 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-a698c-fbd59f46f-krj28" podUID="71863791-9bd4-4473-b183-f2c8f0fdf2c7" containerName="model-chainer-raw-a698c" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 25 13:23:46.638177 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:23:46.638113 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-a698c-fbd59f46f-krj28" podUID="71863791-9bd4-4473-b183-f2c8f0fdf2c7" containerName="model-chainer-raw-a698c" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 25 13:23:51.637935 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:23:51.637897 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-a698c-fbd59f46f-krj28" podUID="71863791-9bd4-4473-b183-f2c8f0fdf2c7" containerName="model-chainer-raw-a698c" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 25 13:23:56.638035 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:23:56.637997 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-a698c-fbd59f46f-krj28" podUID="71863791-9bd4-4473-b183-f2c8f0fdf2c7" containerName="model-chainer-raw-a698c" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 25 13:24:01.638327 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:24:01.638285 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-a698c-fbd59f46f-krj28" podUID="71863791-9bd4-4473-b183-f2c8f0fdf2c7" containerName="model-chainer-raw-a698c" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 25 13:24:06.638186 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:24:06.638127 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-a698c-fbd59f46f-krj28" podUID="71863791-9bd4-4473-b183-f2c8f0fdf2c7" containerName="model-chainer-raw-a698c" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 25 13:24:11.638793 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:24:11.638611 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-a698c-fbd59f46f-krj28" podUID="71863791-9bd4-4473-b183-f2c8f0fdf2c7" containerName="model-chainer-raw-a698c" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 25 13:24:11.771840 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:24:11.771813 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-a698c-fbd59f46f-krj28" May 25 13:24:11.823355 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:24:11.823323 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71863791-9bd4-4473-b183-f2c8f0fdf2c7-openshift-service-ca-bundle\") pod \"71863791-9bd4-4473-b183-f2c8f0fdf2c7\" (UID: \"71863791-9bd4-4473-b183-f2c8f0fdf2c7\") " May 25 13:24:11.823518 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:24:11.823419 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/71863791-9bd4-4473-b183-f2c8f0fdf2c7-proxy-tls\") pod \"71863791-9bd4-4473-b183-f2c8f0fdf2c7\" (UID: \"71863791-9bd4-4473-b183-f2c8f0fdf2c7\") " May 25 13:24:11.823708 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:24:11.823683 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71863791-9bd4-4473-b183-f2c8f0fdf2c7-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "71863791-9bd4-4473-b183-f2c8f0fdf2c7" (UID: "71863791-9bd4-4473-b183-f2c8f0fdf2c7"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 13:24:11.825530 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:24:11.825509 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71863791-9bd4-4473-b183-f2c8f0fdf2c7-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "71863791-9bd4-4473-b183-f2c8f0fdf2c7" (UID: "71863791-9bd4-4473-b183-f2c8f0fdf2c7"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 13:24:11.833086 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:24:11.833061 2568 generic.go:358] "Generic (PLEG): container finished" podID="71863791-9bd4-4473-b183-f2c8f0fdf2c7" containerID="0a17a6731e7c482a0d4d40384a44440053a2368e4c66f33e27c799d0cf739a06" exitCode=0 May 25 13:24:11.833205 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:24:11.833093 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-a698c-fbd59f46f-krj28" event={"ID":"71863791-9bd4-4473-b183-f2c8f0fdf2c7","Type":"ContainerDied","Data":"0a17a6731e7c482a0d4d40384a44440053a2368e4c66f33e27c799d0cf739a06"} May 25 13:24:11.833205 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:24:11.833115 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-a698c-fbd59f46f-krj28" event={"ID":"71863791-9bd4-4473-b183-f2c8f0fdf2c7","Type":"ContainerDied","Data":"59f40eb979c5529dff88c10aca5450ec9fbe193924f73ba89588040647bb9ed5"} May 25 13:24:11.833205 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:24:11.833129 2568 scope.go:117] "RemoveContainer" containerID="0a17a6731e7c482a0d4d40384a44440053a2368e4c66f33e27c799d0cf739a06" May 25 13:24:11.833205 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:24:11.833128 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-a698c-fbd59f46f-krj28" May 25 13:24:11.843357 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:24:11.843340 2568 scope.go:117] "RemoveContainer" containerID="0a17a6731e7c482a0d4d40384a44440053a2368e4c66f33e27c799d0cf739a06" May 25 13:24:11.843607 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:24:11.843589 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a17a6731e7c482a0d4d40384a44440053a2368e4c66f33e27c799d0cf739a06\": container with ID starting with 0a17a6731e7c482a0d4d40384a44440053a2368e4c66f33e27c799d0cf739a06 not found: ID does not exist" containerID="0a17a6731e7c482a0d4d40384a44440053a2368e4c66f33e27c799d0cf739a06" May 25 13:24:11.843666 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:24:11.843614 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a17a6731e7c482a0d4d40384a44440053a2368e4c66f33e27c799d0cf739a06"} err="failed to get container status \"0a17a6731e7c482a0d4d40384a44440053a2368e4c66f33e27c799d0cf739a06\": rpc error: code = NotFound desc = could not find container \"0a17a6731e7c482a0d4d40384a44440053a2368e4c66f33e27c799d0cf739a06\": container with ID starting with 0a17a6731e7c482a0d4d40384a44440053a2368e4c66f33e27c799d0cf739a06 not found: ID does not exist" May 25 13:24:11.855498 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:24:11.855476 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-a698c-fbd59f46f-krj28"] May 25 13:24:11.859194 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:24:11.859173 2568 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-a698c-fbd59f46f-krj28"] May 25 13:24:11.924853 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:24:11.924826 2568 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/71863791-9bd4-4473-b183-f2c8f0fdf2c7-proxy-tls\") on node \"ip-10-0-132-184.ec2.internal\" DevicePath \"\"" May 25 13:24:11.924853 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:24:11.924851 2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71863791-9bd4-4473-b183-f2c8f0fdf2c7-openshift-service-ca-bundle\") on node \"ip-10-0-132-184.ec2.internal\" DevicePath \"\"" May 25 13:24:12.741139 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:24:12.741106 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71863791-9bd4-4473-b183-f2c8f0fdf2c7" path="/var/lib/kubelet/pods/71863791-9bd4-4473-b183-f2c8f0fdf2c7/volumes" May 25 13:25:11.890242 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:11.890209 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-12a34-d8b844d8f-jr5lg"] May 25 13:25:11.890644 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:11.890484 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71863791-9bd4-4473-b183-f2c8f0fdf2c7" containerName="model-chainer-raw-a698c" May 25 13:25:11.890644 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:11.890495 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="71863791-9bd4-4473-b183-f2c8f0fdf2c7" containerName="model-chainer-raw-a698c" May 25 13:25:11.890644 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:11.890554 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="71863791-9bd4-4473-b183-f2c8f0fdf2c7" containerName="model-chainer-raw-a698c" May 25 13:25:11.893366 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:11.893347 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-12a34-d8b844d8f-jr5lg" May 25 13:25:11.896397 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:11.896371 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-12a34-kube-rbac-proxy-sar-config\"" May 25 13:25:11.896397 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:11.896374 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" May 25 13:25:11.896397 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:11.896404 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-cmtw7\"" May 25 13:25:11.896632 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:11.896374 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-12a34-serving-cert\"" May 25 13:25:11.902853 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:11.902831 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-12a34-d8b844d8f-jr5lg"] May 25 13:25:11.994831 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:11.994797 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b0fb1c3-cc9d-450a-9e06-2e16053a58e9-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-12a34-d8b844d8f-jr5lg\" (UID: \"2b0fb1c3-cc9d-450a-9e06-2e16053a58e9\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-12a34-d8b844d8f-jr5lg" May 25 13:25:11.994991 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:11.994854 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2b0fb1c3-cc9d-450a-9e06-2e16053a58e9-proxy-tls\") pod \"model-chainer-raw-hpa-12a34-d8b844d8f-jr5lg\" (UID: \"2b0fb1c3-cc9d-450a-9e06-2e16053a58e9\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-12a34-d8b844d8f-jr5lg" May 25 13:25:12.095649 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:12.095618 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b0fb1c3-cc9d-450a-9e06-2e16053a58e9-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-12a34-d8b844d8f-jr5lg\" (UID: \"2b0fb1c3-cc9d-450a-9e06-2e16053a58e9\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-12a34-d8b844d8f-jr5lg" May 25 13:25:12.095818 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:12.095697 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2b0fb1c3-cc9d-450a-9e06-2e16053a58e9-proxy-tls\") pod \"model-chainer-raw-hpa-12a34-d8b844d8f-jr5lg\" (UID: \"2b0fb1c3-cc9d-450a-9e06-2e16053a58e9\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-12a34-d8b844d8f-jr5lg" May 25 13:25:12.096376 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:12.096358 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b0fb1c3-cc9d-450a-9e06-2e16053a58e9-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-12a34-d8b844d8f-jr5lg\" (UID: \"2b0fb1c3-cc9d-450a-9e06-2e16053a58e9\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-12a34-d8b844d8f-jr5lg" May 25 13:25:12.098013 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:12.097993 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2b0fb1c3-cc9d-450a-9e06-2e16053a58e9-proxy-tls\") pod \"model-chainer-raw-hpa-12a34-d8b844d8f-jr5lg\" (UID: \"2b0fb1c3-cc9d-450a-9e06-2e16053a58e9\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-12a34-d8b844d8f-jr5lg" May 25 13:25:12.203766 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:12.203736 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-12a34-d8b844d8f-jr5lg" May 25 13:25:12.328447 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:12.328398 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-12a34-d8b844d8f-jr5lg"] May 25 13:25:12.330539 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:25:12.330507 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b0fb1c3_cc9d_450a_9e06_2e16053a58e9.slice/crio-d2deb31ccf82d819733d123f34ec7c9da0244bd4e651e40248b2af3b8602fcca WatchSource:0}: Error finding container d2deb31ccf82d819733d123f34ec7c9da0244bd4e651e40248b2af3b8602fcca: Status 404 returned error can't find the container with id d2deb31ccf82d819733d123f34ec7c9da0244bd4e651e40248b2af3b8602fcca May 25 13:25:12.332300 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:12.332284 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 25 13:25:13.008848 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:13.008813 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-12a34-d8b844d8f-jr5lg" event={"ID":"2b0fb1c3-cc9d-450a-9e06-2e16053a58e9","Type":"ContainerStarted","Data":"3e3ea91847141d1472971364fad90ad0714aededa8337c2238ba82824fd24945"} May 25 13:25:13.008848 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:13.008850 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-12a34-d8b844d8f-jr5lg" event={"ID":"2b0fb1c3-cc9d-450a-9e06-2e16053a58e9","Type":"ContainerStarted","Data":"d2deb31ccf82d819733d123f34ec7c9da0244bd4e651e40248b2af3b8602fcca"} May 25 13:25:13.009261 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:13.008968 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-12a34-d8b844d8f-jr5lg" May 25 13:25:13.028920 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:13.028877 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-12a34-d8b844d8f-jr5lg" podStartSLOduration=2.028865945 podStartE2EDuration="2.028865945s" podCreationTimestamp="2026-05-25 13:25:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 13:25:13.028249708 +0000 UTC m=+1178.925519340" watchObservedRunningTime="2026-05-25 13:25:13.028865945 +0000 UTC m=+1178.926135576" May 25 13:25:19.018903 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:19.018874 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-12a34-d8b844d8f-jr5lg" May 25 13:25:21.932916 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:21.932886 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-12a34-d8b844d8f-jr5lg"] May 25 13:25:21.933321 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:21.933164 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-12a34-d8b844d8f-jr5lg" podUID="2b0fb1c3-cc9d-450a-9e06-2e16053a58e9" containerName="model-chainer-raw-hpa-12a34" containerID="cri-o://3e3ea91847141d1472971364fad90ad0714aededa8337c2238ba82824fd24945" gracePeriod=30 May 25 13:25:24.016840 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:24.016802 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-12a34-d8b844d8f-jr5lg" podUID="2b0fb1c3-cc9d-450a-9e06-2e16053a58e9" containerName="model-chainer-raw-hpa-12a34" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 25 13:25:29.016800 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:29.016753 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-12a34-d8b844d8f-jr5lg" podUID="2b0fb1c3-cc9d-450a-9e06-2e16053a58e9" containerName="model-chainer-raw-hpa-12a34" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 25 13:25:34.016573 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:34.016535 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-12a34-d8b844d8f-jr5lg" podUID="2b0fb1c3-cc9d-450a-9e06-2e16053a58e9" containerName="model-chainer-raw-hpa-12a34" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 25 13:25:34.016948 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:34.016636 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-12a34-d8b844d8f-jr5lg" May 25 13:25:34.690654 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:34.690617 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvqnb_eeec714b-fedf-44ce-810b-fca091e4364a/ovn-acl-logging/0.log" May 25 13:25:34.693030 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:34.693010 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvqnb_eeec714b-fedf-44ce-810b-fca091e4364a/ovn-acl-logging/0.log" May 25 13:25:39.016970 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:39.016923 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-12a34-d8b844d8f-jr5lg" podUID="2b0fb1c3-cc9d-450a-9e06-2e16053a58e9" containerName="model-chainer-raw-hpa-12a34" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 25 13:25:44.016629 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:44.016590 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-12a34-d8b844d8f-jr5lg" podUID="2b0fb1c3-cc9d-450a-9e06-2e16053a58e9" containerName="model-chainer-raw-hpa-12a34" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 25 13:25:49.016117 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:49.016077 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-12a34-d8b844d8f-jr5lg" podUID="2b0fb1c3-cc9d-450a-9e06-2e16053a58e9" containerName="model-chainer-raw-hpa-12a34" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 25 13:25:51.954623 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:25:51.954591 2568 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b0fb1c3_cc9d_450a_9e06_2e16053a58e9.slice/crio-3e3ea91847141d1472971364fad90ad0714aededa8337c2238ba82824fd24945.scope\": RecentStats: unable to find data in memory cache]" May 25 13:25:51.954971 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:25:51.954766 2568 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b0fb1c3_cc9d_450a_9e06_2e16053a58e9.slice/crio-3e3ea91847141d1472971364fad90ad0714aededa8337c2238ba82824fd24945.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b0fb1c3_cc9d_450a_9e06_2e16053a58e9.slice/crio-conmon-3e3ea91847141d1472971364fad90ad0714aededa8337c2238ba82824fd24945.scope\": RecentStats: unable to find data in memory cache]" May 25 13:25:51.954971 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:25:51.954830 2568 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b0fb1c3_cc9d_450a_9e06_2e16053a58e9.slice/crio-conmon-3e3ea91847141d1472971364fad90ad0714aededa8337c2238ba82824fd24945.scope\": RecentStats: unable to find data in memory cache]" May 25 13:25:51.954971 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:25:51.954868 2568 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b0fb1c3_cc9d_450a_9e06_2e16053a58e9.slice/crio-3e3ea91847141d1472971364fad90ad0714aededa8337c2238ba82824fd24945.scope\": RecentStats: unable to find data in memory cache]" May 25 13:25:52.084163 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:52.084122 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-12a34-d8b844d8f-jr5lg" May 25 13:25:52.126113 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:52.126086 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b0fb1c3-cc9d-450a-9e06-2e16053a58e9-openshift-service-ca-bundle\") pod \"2b0fb1c3-cc9d-450a-9e06-2e16053a58e9\" (UID: \"2b0fb1c3-cc9d-450a-9e06-2e16053a58e9\") " May 25 13:25:52.126269 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:52.126241 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2b0fb1c3-cc9d-450a-9e06-2e16053a58e9-proxy-tls\") pod \"2b0fb1c3-cc9d-450a-9e06-2e16053a58e9\" (UID: \"2b0fb1c3-cc9d-450a-9e06-2e16053a58e9\") " May 25 13:25:52.126487 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:52.126463 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b0fb1c3-cc9d-450a-9e06-2e16053a58e9-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "2b0fb1c3-cc9d-450a-9e06-2e16053a58e9" (UID: "2b0fb1c3-cc9d-450a-9e06-2e16053a58e9"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 13:25:52.126981 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:52.126947 2568 generic.go:358] "Generic (PLEG): container finished" podID="2b0fb1c3-cc9d-450a-9e06-2e16053a58e9" containerID="3e3ea91847141d1472971364fad90ad0714aededa8337c2238ba82824fd24945" exitCode=0 May 25 13:25:52.127093 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:52.126990 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-12a34-d8b844d8f-jr5lg" event={"ID":"2b0fb1c3-cc9d-450a-9e06-2e16053a58e9","Type":"ContainerDied","Data":"3e3ea91847141d1472971364fad90ad0714aededa8337c2238ba82824fd24945"} May 25 13:25:52.127093 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:52.127014 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-12a34-d8b844d8f-jr5lg" May 25 13:25:52.127093 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:52.127035 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-12a34-d8b844d8f-jr5lg" event={"ID":"2b0fb1c3-cc9d-450a-9e06-2e16053a58e9","Type":"ContainerDied","Data":"d2deb31ccf82d819733d123f34ec7c9da0244bd4e651e40248b2af3b8602fcca"} May 25 13:25:52.127093 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:52.127057 2568 scope.go:117] "RemoveContainer" containerID="3e3ea91847141d1472971364fad90ad0714aededa8337c2238ba82824fd24945" May 25 13:25:52.128537 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:52.128514 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b0fb1c3-cc9d-450a-9e06-2e16053a58e9-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "2b0fb1c3-cc9d-450a-9e06-2e16053a58e9" (UID: "2b0fb1c3-cc9d-450a-9e06-2e16053a58e9"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 13:25:52.137871 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:52.137850 2568 scope.go:117] "RemoveContainer" containerID="3e3ea91847141d1472971364fad90ad0714aededa8337c2238ba82824fd24945" May 25 13:25:52.138125 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:25:52.138107 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e3ea91847141d1472971364fad90ad0714aededa8337c2238ba82824fd24945\": container with ID starting with 3e3ea91847141d1472971364fad90ad0714aededa8337c2238ba82824fd24945 not found: ID does not exist" containerID="3e3ea91847141d1472971364fad90ad0714aededa8337c2238ba82824fd24945" May 25 13:25:52.138193 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:52.138134 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e3ea91847141d1472971364fad90ad0714aededa8337c2238ba82824fd24945"} err="failed to get container status \"3e3ea91847141d1472971364fad90ad0714aededa8337c2238ba82824fd24945\": rpc error: code = NotFound desc = could not find container \"3e3ea91847141d1472971364fad90ad0714aededa8337c2238ba82824fd24945\": container with ID starting with 3e3ea91847141d1472971364fad90ad0714aededa8337c2238ba82824fd24945 not found: ID does not exist" May 25 13:25:52.227414 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:52.227349 2568 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2b0fb1c3-cc9d-450a-9e06-2e16053a58e9-proxy-tls\") on node \"ip-10-0-132-184.ec2.internal\" DevicePath \"\"" May 25 13:25:52.227414 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:52.227373 2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b0fb1c3-cc9d-450a-9e06-2e16053a58e9-openshift-service-ca-bundle\") on node \"ip-10-0-132-184.ec2.internal\" DevicePath \"\"" May 25 13:25:52.449636 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:52.449604 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-12a34-d8b844d8f-jr5lg"] May 25 13:25:52.453061 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:52.453038 2568 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-12a34-d8b844d8f-jr5lg"] May 25 13:25:52.741696 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:25:52.741663 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b0fb1c3-cc9d-450a-9e06-2e16053a58e9" path="/var/lib/kubelet/pods/2b0fb1c3-cc9d-450a-9e06-2e16053a58e9/volumes" May 25 13:30:34.713046 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:30:34.713017 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvqnb_eeec714b-fedf-44ce-810b-fca091e4364a/ovn-acl-logging/0.log" May 25 13:30:34.717645 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:30:34.717622 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvqnb_eeec714b-fedf-44ce-810b-fca091e4364a/ovn-acl-logging/0.log" May 25 13:33:52.630375 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:33:52.630335 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vxf44/must-gather-92fq2"] May 25 13:33:52.632864 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:33:52.630836 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b0fb1c3-cc9d-450a-9e06-2e16053a58e9" containerName="model-chainer-raw-hpa-12a34" May 25 13:33:52.632864 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:33:52.630852 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b0fb1c3-cc9d-450a-9e06-2e16053a58e9" containerName="model-chainer-raw-hpa-12a34" May 25 13:33:52.632864 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:33:52.630906 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="2b0fb1c3-cc9d-450a-9e06-2e16053a58e9" containerName="model-chainer-raw-hpa-12a34" May 25 13:33:52.633667 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:33:52.633649 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vxf44/must-gather-92fq2" May 25 13:33:52.636654 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:33:52.636635 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vxf44\"/\"kube-root-ca.crt\"" May 25 13:33:52.636731 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:33:52.636715 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vxf44\"/\"openshift-service-ca.crt\"" May 25 13:33:52.637956 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:33:52.637938 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vxf44\"/\"default-dockercfg-ncspl\"" May 25 13:33:52.641458 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:33:52.641436 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vxf44/must-gather-92fq2"] May 25 13:33:52.757878 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:33:52.757846 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qjsc\" (UniqueName: \"kubernetes.io/projected/0982c456-88b1-4c6d-a4dc-06d0ff7a3bc7-kube-api-access-9qjsc\") pod \"must-gather-92fq2\" (UID: \"0982c456-88b1-4c6d-a4dc-06d0ff7a3bc7\") " pod="openshift-must-gather-vxf44/must-gather-92fq2" May 25 13:33:52.757878 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:33:52.757881 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0982c456-88b1-4c6d-a4dc-06d0ff7a3bc7-must-gather-output\") pod \"must-gather-92fq2\" (UID: \"0982c456-88b1-4c6d-a4dc-06d0ff7a3bc7\") " pod="openshift-must-gather-vxf44/must-gather-92fq2" May 25 13:33:52.859204 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:33:52.859144 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9qjsc\" (UniqueName: \"kubernetes.io/projected/0982c456-88b1-4c6d-a4dc-06d0ff7a3bc7-kube-api-access-9qjsc\") pod \"must-gather-92fq2\" (UID: \"0982c456-88b1-4c6d-a4dc-06d0ff7a3bc7\") " pod="openshift-must-gather-vxf44/must-gather-92fq2" May 25 13:33:52.859387 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:33:52.859212 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0982c456-88b1-4c6d-a4dc-06d0ff7a3bc7-must-gather-output\") pod \"must-gather-92fq2\" (UID: \"0982c456-88b1-4c6d-a4dc-06d0ff7a3bc7\") " pod="openshift-must-gather-vxf44/must-gather-92fq2" May 25 13:33:52.859561 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:33:52.859541 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0982c456-88b1-4c6d-a4dc-06d0ff7a3bc7-must-gather-output\") pod \"must-gather-92fq2\" (UID: \"0982c456-88b1-4c6d-a4dc-06d0ff7a3bc7\") " pod="openshift-must-gather-vxf44/must-gather-92fq2" May 25 13:33:52.868694 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:33:52.868665 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qjsc\" (UniqueName: \"kubernetes.io/projected/0982c456-88b1-4c6d-a4dc-06d0ff7a3bc7-kube-api-access-9qjsc\") pod \"must-gather-92fq2\" (UID: \"0982c456-88b1-4c6d-a4dc-06d0ff7a3bc7\") " pod="openshift-must-gather-vxf44/must-gather-92fq2" May 25 13:33:52.942911 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:33:52.942864 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vxf44/must-gather-92fq2" May 25 13:33:53.068079 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:33:53.068031 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vxf44/must-gather-92fq2"] May 25 13:33:53.070340 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:33:53.070304 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0982c456_88b1_4c6d_a4dc_06d0ff7a3bc7.slice/crio-3df6826183e0c891bb4670113c660895775016a8803c0aab6834c52616cbf501 WatchSource:0}: Error finding container 3df6826183e0c891bb4670113c660895775016a8803c0aab6834c52616cbf501: Status 404 returned error can't find the container with id 3df6826183e0c891bb4670113c660895775016a8803c0aab6834c52616cbf501 May 25 13:33:53.072051 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:33:53.072036 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 25 13:33:53.463225 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:33:53.463180 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vxf44/must-gather-92fq2" event={"ID":"0982c456-88b1-4c6d-a4dc-06d0ff7a3bc7","Type":"ContainerStarted","Data":"3df6826183e0c891bb4670113c660895775016a8803c0aab6834c52616cbf501"} May 25 13:33:59.489555 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:33:59.489516 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vxf44/must-gather-92fq2" event={"ID":"0982c456-88b1-4c6d-a4dc-06d0ff7a3bc7","Type":"ContainerStarted","Data":"41e0905ee328d171975888421df413d949d719780c1ed6831bb153cc9742f26b"} May 25 13:33:59.489555 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:33:59.489558 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vxf44/must-gather-92fq2" event={"ID":"0982c456-88b1-4c6d-a4dc-06d0ff7a3bc7","Type":"ContainerStarted","Data":"6a91c38dee1bca2c1f8b1adea190a900de4dd2ee70af82194fc99c6738d37d3d"} May 25 13:33:59.508037 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:33:59.507976 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-vxf44/must-gather-92fq2" podStartSLOduration=1.593631114 podStartE2EDuration="7.507959203s" podCreationTimestamp="2026-05-25 13:33:52 +0000 UTC" firstStartedPulling="2026-05-25 13:33:53.072181604 +0000 UTC m=+1698.969451218" lastFinishedPulling="2026-05-25 13:33:58.986509684 +0000 UTC m=+1704.883779307" observedRunningTime="2026-05-25 13:33:59.506139581 +0000 UTC m=+1705.403409214" watchObservedRunningTime="2026-05-25 13:33:59.507959203 +0000 UTC m=+1705.405228837" May 25 13:34:17.548958 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:17.548921 2568 generic.go:358] "Generic (PLEG): container finished" podID="0982c456-88b1-4c6d-a4dc-06d0ff7a3bc7" containerID="6a91c38dee1bca2c1f8b1adea190a900de4dd2ee70af82194fc99c6738d37d3d" exitCode=0 May 25 13:34:17.549398 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:17.549000 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vxf44/must-gather-92fq2" event={"ID":"0982c456-88b1-4c6d-a4dc-06d0ff7a3bc7","Type":"ContainerDied","Data":"6a91c38dee1bca2c1f8b1adea190a900de4dd2ee70af82194fc99c6738d37d3d"} May 25 13:34:17.549398 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:17.549322 2568 scope.go:117] "RemoveContainer" containerID="6a91c38dee1bca2c1f8b1adea190a900de4dd2ee70af82194fc99c6738d37d3d" May 25 13:34:18.454125 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:18.454096 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-vxf44_must-gather-92fq2_0982c456-88b1-4c6d-a4dc-06d0ff7a3bc7/gather/0.log" May 25 13:34:21.647452 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:21.647425 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-45rjq_22715e7e-5167-48b9-9c76-70114a0fe045/global-pull-secret-syncer/0.log" May 25 13:34:21.811944 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:21.811908 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5qhzs_5e42b4e6-e70c-466b-a6c9-9bb52af69a67/konnectivity-agent/0.log" May 25 13:34:21.895227 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:21.895193 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-184.ec2.internal_b64d94a369cdbb899d57a84157c70d6c/haproxy/0.log" May 25 13:34:23.851172 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:23.846830 2568 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-vxf44/must-gather-92fq2"] May 25 13:34:23.851172 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:23.847220 2568 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-must-gather-vxf44/must-gather-92fq2" podUID="0982c456-88b1-4c6d-a4dc-06d0ff7a3bc7" containerName="copy" containerID="cri-o://41e0905ee328d171975888421df413d949d719780c1ed6831bb153cc9742f26b" gracePeriod=2 May 25 13:34:23.854104 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:23.854080 2568 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-vxf44/must-gather-92fq2"] May 25 13:34:24.076800 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:24.076781 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-vxf44_must-gather-92fq2_0982c456-88b1-4c6d-a4dc-06d0ff7a3bc7/copy/0.log" May 25 13:34:24.077111 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:24.077095 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vxf44/must-gather-92fq2" May 25 13:34:24.079635 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:24.079609 2568 status_manager.go:895] "Failed to get status for pod" podUID="0982c456-88b1-4c6d-a4dc-06d0ff7a3bc7" pod="openshift-must-gather-vxf44/must-gather-92fq2" err="pods \"must-gather-92fq2\" is forbidden: User \"system:node:ip-10-0-132-184.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-vxf44\": no relationship found between node 'ip-10-0-132-184.ec2.internal' and this object" May 25 13:34:24.232184 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:24.232135 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0982c456-88b1-4c6d-a4dc-06d0ff7a3bc7-must-gather-output\") pod \"0982c456-88b1-4c6d-a4dc-06d0ff7a3bc7\" (UID: \"0982c456-88b1-4c6d-a4dc-06d0ff7a3bc7\") " May 25 13:34:24.232337 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:24.232260 2568 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qjsc\" (UniqueName: \"kubernetes.io/projected/0982c456-88b1-4c6d-a4dc-06d0ff7a3bc7-kube-api-access-9qjsc\") pod \"0982c456-88b1-4c6d-a4dc-06d0ff7a3bc7\" (UID: \"0982c456-88b1-4c6d-a4dc-06d0ff7a3bc7\") " May 25 13:34:24.233573 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:24.233544 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0982c456-88b1-4c6d-a4dc-06d0ff7a3bc7-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "0982c456-88b1-4c6d-a4dc-06d0ff7a3bc7" (UID: "0982c456-88b1-4c6d-a4dc-06d0ff7a3bc7"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 25 13:34:24.234348 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:24.234325 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0982c456-88b1-4c6d-a4dc-06d0ff7a3bc7-kube-api-access-9qjsc" (OuterVolumeSpecName: "kube-api-access-9qjsc") pod "0982c456-88b1-4c6d-a4dc-06d0ff7a3bc7" (UID: "0982c456-88b1-4c6d-a4dc-06d0ff7a3bc7"). InnerVolumeSpecName "kube-api-access-9qjsc". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 13:34:24.332783 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:24.332759 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qjsc\" (UniqueName: \"kubernetes.io/projected/0982c456-88b1-4c6d-a4dc-06d0ff7a3bc7-kube-api-access-9qjsc\") on node \"ip-10-0-132-184.ec2.internal\" DevicePath \"\"" May 25 13:34:24.332783 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:24.332781 2568 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0982c456-88b1-4c6d-a4dc-06d0ff7a3bc7-must-gather-output\") on node \"ip-10-0-132-184.ec2.internal\" DevicePath \"\"" May 25 13:34:24.570897 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:24.570818 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-vxf44_must-gather-92fq2_0982c456-88b1-4c6d-a4dc-06d0ff7a3bc7/copy/0.log" May 25 13:34:24.571178 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:24.571135 2568 generic.go:358] "Generic (PLEG): container finished" podID="0982c456-88b1-4c6d-a4dc-06d0ff7a3bc7" containerID="41e0905ee328d171975888421df413d949d719780c1ed6831bb153cc9742f26b" exitCode=143 May 25 13:34:24.571236 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:24.571198 2568 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vxf44/must-gather-92fq2" May 25 13:34:24.571267 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:24.571236 2568 scope.go:117] "RemoveContainer" containerID="41e0905ee328d171975888421df413d949d719780c1ed6831bb153cc9742f26b" May 25 13:34:24.573922 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:24.573884 2568 status_manager.go:895] "Failed to get status for pod" podUID="0982c456-88b1-4c6d-a4dc-06d0ff7a3bc7" pod="openshift-must-gather-vxf44/must-gather-92fq2" err="pods \"must-gather-92fq2\" is forbidden: User \"system:node:ip-10-0-132-184.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-vxf44\": no relationship found between node 'ip-10-0-132-184.ec2.internal' and this object" May 25 13:34:24.580359 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:24.579587 2568 scope.go:117] "RemoveContainer" containerID="6a91c38dee1bca2c1f8b1adea190a900de4dd2ee70af82194fc99c6738d37d3d" May 25 13:34:24.581849 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:24.581819 2568 status_manager.go:895] "Failed to get status for pod" podUID="0982c456-88b1-4c6d-a4dc-06d0ff7a3bc7" pod="openshift-must-gather-vxf44/must-gather-92fq2" err="pods \"must-gather-92fq2\" is forbidden: User \"system:node:ip-10-0-132-184.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-vxf44\": no relationship found between node 'ip-10-0-132-184.ec2.internal' and this object" May 25 13:34:24.590719 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:24.590702 2568 scope.go:117] "RemoveContainer" containerID="41e0905ee328d171975888421df413d949d719780c1ed6831bb153cc9742f26b" May 25 13:34:24.590957 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:34:24.590942 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41e0905ee328d171975888421df413d949d719780c1ed6831bb153cc9742f26b\": container with ID starting with 41e0905ee328d171975888421df413d949d719780c1ed6831bb153cc9742f26b not found: ID does not exist" containerID="41e0905ee328d171975888421df413d949d719780c1ed6831bb153cc9742f26b" May 25 13:34:24.591000 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:24.590964 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41e0905ee328d171975888421df413d949d719780c1ed6831bb153cc9742f26b"} err="failed to get container status \"41e0905ee328d171975888421df413d949d719780c1ed6831bb153cc9742f26b\": rpc error: code = NotFound desc = could not find container \"41e0905ee328d171975888421df413d949d719780c1ed6831bb153cc9742f26b\": container with ID starting with 41e0905ee328d171975888421df413d949d719780c1ed6831bb153cc9742f26b not found: ID does not exist" May 25 13:34:24.591000 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:24.590981 2568 scope.go:117] "RemoveContainer" containerID="6a91c38dee1bca2c1f8b1adea190a900de4dd2ee70af82194fc99c6738d37d3d" May 25 13:34:24.591233 ip-10-0-132-184 kubenswrapper[2568]: E0525 13:34:24.591215 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a91c38dee1bca2c1f8b1adea190a900de4dd2ee70af82194fc99c6738d37d3d\": container with ID starting with 6a91c38dee1bca2c1f8b1adea190a900de4dd2ee70af82194fc99c6738d37d3d not found: ID does not exist" containerID="6a91c38dee1bca2c1f8b1adea190a900de4dd2ee70af82194fc99c6738d37d3d" May 25 13:34:24.591276 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:24.591240 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a91c38dee1bca2c1f8b1adea190a900de4dd2ee70af82194fc99c6738d37d3d"} err="failed to get container status \"6a91c38dee1bca2c1f8b1adea190a900de4dd2ee70af82194fc99c6738d37d3d\": rpc error: code = NotFound desc = could not find container \"6a91c38dee1bca2c1f8b1adea190a900de4dd2ee70af82194fc99c6738d37d3d\": container with ID starting with 6a91c38dee1bca2c1f8b1adea190a900de4dd2ee70af82194fc99c6738d37d3d not found: ID does not exist" May 25 13:34:24.741570 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:24.741531 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0982c456-88b1-4c6d-a4dc-06d0ff7a3bc7" path="/var/lib/kubelet/pods/0982c456-88b1-4c6d-a4dc-06d0ff7a3bc7/volumes" May 25 13:34:24.741929 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:24.741896 2568 status_manager.go:895] "Failed to get status for pod" podUID="0982c456-88b1-4c6d-a4dc-06d0ff7a3bc7" pod="openshift-must-gather-vxf44/must-gather-92fq2" err="pods \"must-gather-92fq2\" is forbidden: User \"system:node:ip-10-0-132-184.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-vxf44\": no relationship found between node 'ip-10-0-132-184.ec2.internal' and this object" May 25 13:34:25.477532 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:25.477499 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-fjjgc_431c9701-b644-4609-8b9d-40c2d1c1f008/kube-state-metrics/0.log" May 25 13:34:25.498828 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:25.498802 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-fjjgc_431c9701-b644-4609-8b9d-40c2d1c1f008/kube-rbac-proxy-main/0.log" May 25 13:34:25.519132 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:25.519107 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-fjjgc_431c9701-b644-4609-8b9d-40c2d1c1f008/kube-rbac-proxy-self/0.log" May 25 13:34:25.607490 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:25.607465 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gq848_27289736-acaf-4021-935b-1cf4da9dd70b/node-exporter/0.log" May 25 13:34:25.631045 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:25.631026 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gq848_27289736-acaf-4021-935b-1cf4da9dd70b/kube-rbac-proxy/0.log" May 25 13:34:25.653240 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:25.653221 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gq848_27289736-acaf-4021-935b-1cf4da9dd70b/init-textfile/0.log" May 25 13:34:25.919478 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:25.919447 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d1c780d7-4381-48a8-8b58-003179ae92b5/prometheus/0.log" May 25 13:34:25.938988 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:25.938971 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d1c780d7-4381-48a8-8b58-003179ae92b5/config-reloader/0.log" May 25 13:34:25.963072 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:25.963045 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d1c780d7-4381-48a8-8b58-003179ae92b5/thanos-sidecar/0.log" May 25 13:34:25.985252 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:25.985230 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d1c780d7-4381-48a8-8b58-003179ae92b5/kube-rbac-proxy-web/0.log" May 25 13:34:26.012052 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:26.012032 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d1c780d7-4381-48a8-8b58-003179ae92b5/kube-rbac-proxy/0.log" May 25 13:34:26.036287 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:26.036264 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d1c780d7-4381-48a8-8b58-003179ae92b5/kube-rbac-proxy-thanos/0.log" May 25 13:34:26.058920 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:26.058905 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d1c780d7-4381-48a8-8b58-003179ae92b5/init-config-reloader/0.log" May 25 13:34:26.090920 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:26.090897 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-9ssvl_5fac806b-6e48-4063-b594-808f96d3835e/prometheus-operator/0.log" May 25 13:34:26.110732 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:26.110711 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-9ssvl_5fac806b-6e48-4063-b594-808f96d3835e/kube-rbac-proxy/0.log" May 25 13:34:26.261647 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:26.261561 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f5448b88c-p26gz_8168e2ca-7c4f-4183-80f2-601f09430db2/thanos-query/0.log" May 25 13:34:26.284339 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:26.284313 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f5448b88c-p26gz_8168e2ca-7c4f-4183-80f2-601f09430db2/kube-rbac-proxy-web/0.log" May 25 13:34:26.307620 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:26.307598 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f5448b88c-p26gz_8168e2ca-7c4f-4183-80f2-601f09430db2/kube-rbac-proxy/0.log" May 25 13:34:26.328898 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:26.328878 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f5448b88c-p26gz_8168e2ca-7c4f-4183-80f2-601f09430db2/prom-label-proxy/0.log" May 25 13:34:26.351026 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:26.351006 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f5448b88c-p26gz_8168e2ca-7c4f-4183-80f2-601f09430db2/kube-rbac-proxy-rules/0.log" May 25 13:34:26.374454 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:26.374433 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f5448b88c-p26gz_8168e2ca-7c4f-4183-80f2-601f09430db2/kube-rbac-proxy-metrics/0.log" May 25 13:34:27.512175 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:27.512129 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-nfjdz_8e7d318b-4ca1-4015-9c2a-1f94373ef66a/networking-console-plugin/0.log" May 25 13:34:28.661814 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:28.661780 2568 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kt9b5/perf-node-gather-daemonset-bdwdm"] May 25 13:34:28.662185 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:28.662086 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0982c456-88b1-4c6d-a4dc-06d0ff7a3bc7" containerName="copy" May 25 13:34:28.662185 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:28.662097 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0982c456-88b1-4c6d-a4dc-06d0ff7a3bc7" containerName="copy" May 25 13:34:28.662185 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:28.662106 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0982c456-88b1-4c6d-a4dc-06d0ff7a3bc7" containerName="gather" May 25 13:34:28.662185 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:28.662112 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0982c456-88b1-4c6d-a4dc-06d0ff7a3bc7" containerName="gather" May 25 13:34:28.662185 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:28.662183 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="0982c456-88b1-4c6d-a4dc-06d0ff7a3bc7" containerName="copy" May 25 13:34:28.662343 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:28.662192 2568 memory_manager.go:356] "RemoveStaleState removing state" podUID="0982c456-88b1-4c6d-a4dc-06d0ff7a3bc7" containerName="gather" May 25 13:34:28.665999 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:28.665971 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kt9b5/perf-node-gather-daemonset-bdwdm" May 25 13:34:28.668288 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:28.668261 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bd14c81f-c236-497c-ab54-f8b2d88fd2c0-proc\") pod \"perf-node-gather-daemonset-bdwdm\" (UID: \"bd14c81f-c236-497c-ab54-f8b2d88fd2c0\") " pod="openshift-must-gather-kt9b5/perf-node-gather-daemonset-bdwdm" May 25 13:34:28.668412 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:28.668314 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd14c81f-c236-497c-ab54-f8b2d88fd2c0-sys\") pod \"perf-node-gather-daemonset-bdwdm\" (UID: \"bd14c81f-c236-497c-ab54-f8b2d88fd2c0\") " pod="openshift-must-gather-kt9b5/perf-node-gather-daemonset-bdwdm" May 25 13:34:28.668412 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:28.668361 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bd14c81f-c236-497c-ab54-f8b2d88fd2c0-podres\") pod \"perf-node-gather-daemonset-bdwdm\" (UID: \"bd14c81f-c236-497c-ab54-f8b2d88fd2c0\") " pod="openshift-must-gather-kt9b5/perf-node-gather-daemonset-bdwdm" May 25 13:34:28.668412 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:28.668393 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd4hp\" (UniqueName: \"kubernetes.io/projected/bd14c81f-c236-497c-ab54-f8b2d88fd2c0-kube-api-access-kd4hp\") pod \"perf-node-gather-daemonset-bdwdm\" (UID: \"bd14c81f-c236-497c-ab54-f8b2d88fd2c0\") " pod="openshift-must-gather-kt9b5/perf-node-gather-daemonset-bdwdm" May 25 13:34:28.668557 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:28.668473 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bd14c81f-c236-497c-ab54-f8b2d88fd2c0-lib-modules\") pod \"perf-node-gather-daemonset-bdwdm\" (UID: \"bd14c81f-c236-497c-ab54-f8b2d88fd2c0\") " pod="openshift-must-gather-kt9b5/perf-node-gather-daemonset-bdwdm" May 25 13:34:28.671297 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:28.671273 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kt9b5\"/\"openshift-service-ca.crt\"" May 25 13:34:28.671420 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:28.671318 2568 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kt9b5\"/\"default-dockercfg-hkc44\"" May 25 13:34:28.672330 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:28.672314 2568 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kt9b5\"/\"kube-root-ca.crt\"" May 25 13:34:28.676954 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:28.676767 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kt9b5/perf-node-gather-daemonset-bdwdm"] May 25 13:34:28.769396 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:28.769367 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bd14c81f-c236-497c-ab54-f8b2d88fd2c0-lib-modules\") pod \"perf-node-gather-daemonset-bdwdm\" (UID: \"bd14c81f-c236-497c-ab54-f8b2d88fd2c0\") " pod="openshift-must-gather-kt9b5/perf-node-gather-daemonset-bdwdm" May 25 13:34:28.769528 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:28.769404 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bd14c81f-c236-497c-ab54-f8b2d88fd2c0-proc\") pod \"perf-node-gather-daemonset-bdwdm\" (UID: \"bd14c81f-c236-497c-ab54-f8b2d88fd2c0\") " pod="openshift-must-gather-kt9b5/perf-node-gather-daemonset-bdwdm" May 25 13:34:28.769528 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:28.769434 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd14c81f-c236-497c-ab54-f8b2d88fd2c0-sys\") pod \"perf-node-gather-daemonset-bdwdm\" (UID: \"bd14c81f-c236-497c-ab54-f8b2d88fd2c0\") " pod="openshift-must-gather-kt9b5/perf-node-gather-daemonset-bdwdm" May 25 13:34:28.769528 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:28.769469 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bd14c81f-c236-497c-ab54-f8b2d88fd2c0-podres\") pod \"perf-node-gather-daemonset-bdwdm\" (UID: \"bd14c81f-c236-497c-ab54-f8b2d88fd2c0\") " pod="openshift-must-gather-kt9b5/perf-node-gather-daemonset-bdwdm" May 25 13:34:28.769528 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:28.769489 2568 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kd4hp\" (UniqueName: \"kubernetes.io/projected/bd14c81f-c236-497c-ab54-f8b2d88fd2c0-kube-api-access-kd4hp\") pod \"perf-node-gather-daemonset-bdwdm\" (UID: \"bd14c81f-c236-497c-ab54-f8b2d88fd2c0\") " pod="openshift-must-gather-kt9b5/perf-node-gather-daemonset-bdwdm" May 25 13:34:28.769528 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:28.769499 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bd14c81f-c236-497c-ab54-f8b2d88fd2c0-proc\") pod \"perf-node-gather-daemonset-bdwdm\" (UID: \"bd14c81f-c236-497c-ab54-f8b2d88fd2c0\") " pod="openshift-must-gather-kt9b5/perf-node-gather-daemonset-bdwdm" May 25 13:34:28.769754 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:28.769543 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bd14c81f-c236-497c-ab54-f8b2d88fd2c0-lib-modules\") pod \"perf-node-gather-daemonset-bdwdm\" (UID: \"bd14c81f-c236-497c-ab54-f8b2d88fd2c0\") " pod="openshift-must-gather-kt9b5/perf-node-gather-daemonset-bdwdm" May 25 13:34:28.769754 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:28.769627 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd14c81f-c236-497c-ab54-f8b2d88fd2c0-sys\") pod \"perf-node-gather-daemonset-bdwdm\" (UID: \"bd14c81f-c236-497c-ab54-f8b2d88fd2c0\") " pod="openshift-must-gather-kt9b5/perf-node-gather-daemonset-bdwdm" May 25 13:34:28.769754 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:28.769696 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bd14c81f-c236-497c-ab54-f8b2d88fd2c0-podres\") pod \"perf-node-gather-daemonset-bdwdm\" (UID: \"bd14c81f-c236-497c-ab54-f8b2d88fd2c0\") " pod="openshift-must-gather-kt9b5/perf-node-gather-daemonset-bdwdm" May 25 13:34:28.778460 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:28.778432 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd4hp\" (UniqueName: \"kubernetes.io/projected/bd14c81f-c236-497c-ab54-f8b2d88fd2c0-kube-api-access-kd4hp\") pod \"perf-node-gather-daemonset-bdwdm\" (UID: \"bd14c81f-c236-497c-ab54-f8b2d88fd2c0\") " pod="openshift-must-gather-kt9b5/perf-node-gather-daemonset-bdwdm" May 25 13:34:28.979963 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:28.979877 2568 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kt9b5/perf-node-gather-daemonset-bdwdm" May 25 13:34:29.106772 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:29.106738 2568 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kt9b5/perf-node-gather-daemonset-bdwdm"] May 25 13:34:29.109602 ip-10-0-132-184 kubenswrapper[2568]: W0525 13:34:29.109577 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbd14c81f_c236_497c_ab54_f8b2d88fd2c0.slice/crio-6dbf3a4f62c7add0805bc7e9a9990826f4e737b5b37f93bba4e3f6cb5b1685b0 WatchSource:0}: Error finding container 6dbf3a4f62c7add0805bc7e9a9990826f4e737b5b37f93bba4e3f6cb5b1685b0: Status 404 returned error can't find the container with id 6dbf3a4f62c7add0805bc7e9a9990826f4e737b5b37f93bba4e3f6cb5b1685b0 May 25 13:34:29.433212 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:29.433182 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-87mfx_a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7/dns/0.log" May 25 13:34:29.453242 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:29.453210 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-87mfx_a0dc0a3c-0386-438c-ac0f-dfa7a043bcb7/kube-rbac-proxy/0.log" May 25 13:34:29.586013 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:29.585982 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kt9b5/perf-node-gather-daemonset-bdwdm" event={"ID":"bd14c81f-c236-497c-ab54-f8b2d88fd2c0","Type":"ContainerStarted","Data":"aa9d367708dd0f0ce77a371964b7f7c6cd9b2bbc3bbd4dac801fbf96d929f411"} May 25 13:34:29.586180 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:29.586017 2568 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kt9b5/perf-node-gather-daemonset-bdwdm" event={"ID":"bd14c81f-c236-497c-ab54-f8b2d88fd2c0","Type":"ContainerStarted","Data":"6dbf3a4f62c7add0805bc7e9a9990826f4e737b5b37f93bba4e3f6cb5b1685b0"} May 25 13:34:29.586180 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:29.586042 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-kt9b5/perf-node-gather-daemonset-bdwdm" May 25 13:34:29.604410 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:29.604368 2568 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-kt9b5/perf-node-gather-daemonset-bdwdm" podStartSLOduration=1.604354686 podStartE2EDuration="1.604354686s" podCreationTimestamp="2026-05-25 13:34:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 13:34:29.602551032 +0000 UTC m=+1735.499820683" watchObservedRunningTime="2026-05-25 13:34:29.604354686 +0000 UTC m=+1735.501624341" May 25 13:34:29.610342 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:29.610318 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-trnzh_8a8b5d2e-cd8d-48a6-8ea3-ce157207fb61/dns-node-resolver/0.log" May 25 13:34:30.163124 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:30.163080 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tp7gs_b658050c-b570-4192-8cf6-d1f3a23fef5f/node-ca/0.log" May 25 13:34:30.891781 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:30.891754 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-759bb5c6c8-v5dhb_4c2729b4-64b9-46d1-a83a-1da628cd9df6/router/0.log" May 25 13:34:31.274708 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:31.274631 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-j9lmj_700a0947-b3b8-44f1-a79c-4b34fd1d2171/serve-healthcheck-canary/0.log" May 25 13:34:31.778061 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:31.778034 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vcrbl_adfa7ba3-d80a-47f1-9db7-21fe28eb3958/kube-rbac-proxy/0.log" May 25 13:34:31.799629 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:31.799605 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vcrbl_adfa7ba3-d80a-47f1-9db7-21fe28eb3958/exporter/0.log" May 25 13:34:31.822222 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:31.822199 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vcrbl_adfa7ba3-d80a-47f1-9db7-21fe28eb3958/extractor/0.log" May 25 13:34:33.971170 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:33.971130 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-xrvhs_79eca206-40c5-4eea-bbb0-dd6b95a71cfa/s3-init/0.log" May 25 13:34:35.599190 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:35.599144 2568 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-kt9b5/perf-node-gather-daemonset-bdwdm" May 25 13:34:39.394954 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:39.394928 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c2tbd_c3e2cf07-68ec-4934-a1a7-64d381a0f004/kube-multus-additional-cni-plugins/0.log" May 25 13:34:39.417119 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:39.417090 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c2tbd_c3e2cf07-68ec-4934-a1a7-64d381a0f004/egress-router-binary-copy/0.log" May 25 13:34:39.445463 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:39.445442 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c2tbd_c3e2cf07-68ec-4934-a1a7-64d381a0f004/cni-plugins/0.log" May 25 13:34:39.468257 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:39.468237 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c2tbd_c3e2cf07-68ec-4934-a1a7-64d381a0f004/bond-cni-plugin/0.log" May 25 13:34:39.490618 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:39.490599 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c2tbd_c3e2cf07-68ec-4934-a1a7-64d381a0f004/routeoverride-cni/0.log" May 25 13:34:39.513956 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:39.513935 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c2tbd_c3e2cf07-68ec-4934-a1a7-64d381a0f004/whereabouts-cni-bincopy/0.log" May 25 13:34:39.538870 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:39.538849 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c2tbd_c3e2cf07-68ec-4934-a1a7-64d381a0f004/whereabouts-cni/0.log" May 25 13:34:39.768572 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:39.768545 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jbqmt_4895aab1-2ec5-43d8-a7ac-536ae4e3e442/kube-multus/0.log" May 25 13:34:39.934054 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:39.934027 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xc9t7_6afe74f8-11aa-4aee-9629-498ec110bc21/network-metrics-daemon/0.log" May 25 13:34:39.955408 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:39.955379 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xc9t7_6afe74f8-11aa-4aee-9629-498ec110bc21/kube-rbac-proxy/0.log" May 25 13:34:41.255067 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:41.255036 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvqnb_eeec714b-fedf-44ce-810b-fca091e4364a/ovn-controller/0.log" May 25 13:34:41.275303 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:41.275277 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvqnb_eeec714b-fedf-44ce-810b-fca091e4364a/ovn-acl-logging/0.log" May 25 13:34:41.292792 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:41.292764 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvqnb_eeec714b-fedf-44ce-810b-fca091e4364a/ovn-acl-logging/1.log" May 25 13:34:41.315995 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:41.315958 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvqnb_eeec714b-fedf-44ce-810b-fca091e4364a/kube-rbac-proxy-node/0.log" May 25 13:34:41.338597 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:41.338574 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvqnb_eeec714b-fedf-44ce-810b-fca091e4364a/kube-rbac-proxy-ovn-metrics/0.log" May 25 13:34:41.358507 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:41.358490 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvqnb_eeec714b-fedf-44ce-810b-fca091e4364a/northd/0.log" May 25 13:34:41.385146 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:41.385121 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvqnb_eeec714b-fedf-44ce-810b-fca091e4364a/nbdb/0.log" May 25 13:34:41.407631 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:41.407615 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvqnb_eeec714b-fedf-44ce-810b-fca091e4364a/sbdb/0.log" May 25 13:34:41.554192 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:41.554108 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvqnb_eeec714b-fedf-44ce-810b-fca091e4364a/ovnkube-controller/0.log" May 25 13:34:42.533512 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:42.533479 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7f44b6dd87-q4zcf_c3d65157-4db4-4138-a642-9990b76905dd/check-endpoints/0.log" May 25 13:34:42.657219 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:42.657191 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-pq8f8_760c3981-3ce6-4b45-af76-a545105d4b0b/network-check-target-container/0.log" May 25 13:34:43.655947 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:43.655918 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-qlrrq_7b18b763-4588-4019-b55a-649ec6f90d8b/iptables-alerter/0.log" May 25 13:34:44.311732 ip-10-0-132-184 kubenswrapper[2568]: I0525 13:34:44.311702 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-5qj29_8ea4404f-9c9f-48c0-8bfc-109fcd43b4dd/tuned/0.log"