Sep 19 08:20:48.784501 ip-10-0-143-96 systemd[1]: Starting Kubernetes Kubelet... Sep 19 08:20:52.383139 ip-10-0-143-96 kubenswrapper[2584]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 19 08:20:52.383139 ip-10-0-143-96 kubenswrapper[2584]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 19 08:20:52.383139 ip-10-0-143-96 kubenswrapper[2584]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 19 08:20:52.383139 ip-10-0-143-96 kubenswrapper[2584]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 19 08:20:52.383921 ip-10-0-143-96 kubenswrapper[2584]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 19 08:20:52.383921 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.383231 2584 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 19 08:20:52.387926 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.387909 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 19 08:20:52.387926 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.387926 2584 feature_gate.go:328] unrecognized feature gate: Example2 Sep 19 08:20:52.387994 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.387930 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 19 08:20:52.387994 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.387934 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 19 08:20:52.387994 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.387937 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 19 08:20:52.387994 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.387940 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 19 08:20:52.387994 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.387944 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 19 08:20:52.387994 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.387947 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 19 08:20:52.387994 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.387950 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 19 08:20:52.387994 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.387953 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 19 08:20:52.387994 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.387958 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 19 08:20:52.387994 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.387962 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 19 08:20:52.387994 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.387966 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 19 08:20:52.387994 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.387971 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 19 08:20:52.387994 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.387974 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 19 08:20:52.387994 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.387977 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 19 08:20:52.387994 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.387980 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 19 08:20:52.387994 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.387983 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 19 08:20:52.387994 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.387985 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 19 08:20:52.387994 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.387988 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 19 08:20:52.387994 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.387991 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 19 08:20:52.387994 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.387994 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 19 08:20:52.388624 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.387997 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 19 08:20:52.388624 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388000 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 19 08:20:52.388624 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388004 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 19 08:20:52.388624 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388007 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 19 08:20:52.388624 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388010 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 19 08:20:52.388624 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388013 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 19 08:20:52.388624 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388016 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 19 08:20:52.388624 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388018 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 19 08:20:52.388624 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388021 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 19 08:20:52.388624 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388024 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 19 08:20:52.388624 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388027 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 19 08:20:52.388624 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388029 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 19 08:20:52.388624 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388032 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 19 08:20:52.388624 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388035 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 19 08:20:52.388624 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388038 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 19 08:20:52.388624 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388040 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 19 08:20:52.388624 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388043 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 19 08:20:52.388624 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388046 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 19 08:20:52.388624 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388049 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 19 08:20:52.388624 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388051 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 19 08:20:52.389193 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388054 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 19 08:20:52.389193 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388057 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 19 08:20:52.389193 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388060 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 19 08:20:52.389193 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388063 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 19 08:20:52.389193 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388066 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 19 08:20:52.389193 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388068 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 19 08:20:52.389193 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388071 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 19 08:20:52.389193 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388074 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 19 08:20:52.389193 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388077 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 19 08:20:52.389193 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388079 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 19 08:20:52.389193 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388082 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 19 08:20:52.389193 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388085 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 19 08:20:52.389193 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388087 2584 feature_gate.go:328] unrecognized feature gate: Example Sep 19 08:20:52.389193 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388091 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 19 08:20:52.389193 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388095 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 19 08:20:52.389193 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388098 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 19 08:20:52.389193 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388101 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 19 08:20:52.389193 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388105 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 19 08:20:52.389193 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388108 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 19 08:20:52.389193 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388110 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 19 08:20:52.389722 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388113 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 19 08:20:52.389722 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388116 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 19 08:20:52.389722 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388119 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 19 08:20:52.389722 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388122 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 19 08:20:52.389722 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388125 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 19 08:20:52.389722 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388127 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 19 08:20:52.389722 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388131 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 19 08:20:52.389722 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388133 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 19 08:20:52.389722 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388136 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 19 08:20:52.389722 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388139 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 19 08:20:52.389722 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388143 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 19 08:20:52.389722 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388160 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 19 08:20:52.389722 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388165 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 19 08:20:52.389722 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388168 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 19 08:20:52.389722 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388171 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 19 08:20:52.389722 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388174 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 19 08:20:52.389722 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388177 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 19 08:20:52.389722 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388180 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 19 08:20:52.389722 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388183 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 19 08:20:52.390224 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388186 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 19 08:20:52.390224 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388189 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 19 08:20:52.390224 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388192 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 19 08:20:52.390224 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388195 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 19 08:20:52.390224 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388199 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 19 08:20:52.390224 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388202 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 19 08:20:52.390224 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388206 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 19 08:20:52.390224 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388209 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 19 08:20:52.390224 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388212 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 19 08:20:52.390224 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388215 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 19 08:20:52.390224 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388218 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 19 08:20:52.390224 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388222 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 19 08:20:52.390224 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388226 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 19 08:20:52.390224 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388229 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 19 08:20:52.390224 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388232 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 19 08:20:52.390224 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388235 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 19 08:20:52.390224 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388239 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 19 08:20:52.390224 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.388242 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 19 08:20:52.390224 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389005 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 19 08:20:52.390723 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389012 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 19 08:20:52.390723 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389016 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 19 08:20:52.390723 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389019 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 19 08:20:52.390723 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389022 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 19 08:20:52.390723 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389026 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 19 08:20:52.390723 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389029 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 19 08:20:52.390723 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389033 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 19 08:20:52.390723 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389036 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 19 08:20:52.390723 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389039 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 19 08:20:52.390723 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389042 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 19 08:20:52.390723 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389045 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 19 08:20:52.390723 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389048 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 19 08:20:52.390723 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389052 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 19 08:20:52.390723 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389055 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 19 08:20:52.390723 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389057 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 19 08:20:52.390723 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389060 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 19 08:20:52.390723 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389063 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 19 08:20:52.390723 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389066 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 19 08:20:52.390723 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389069 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 19 08:20:52.390723 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389073 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 19 08:20:52.391306 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389077 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 19 08:20:52.391306 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389081 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 19 08:20:52.391306 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389084 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 19 08:20:52.391306 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389087 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 19 08:20:52.391306 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389090 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 19 08:20:52.391306 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389094 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 19 08:20:52.391306 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389097 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 19 08:20:52.391306 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389100 2584 feature_gate.go:328] unrecognized feature gate: Example2 Sep 19 08:20:52.391306 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389102 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 19 08:20:52.391306 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389105 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 19 08:20:52.391306 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389108 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 19 08:20:52.391306 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389111 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 19 08:20:52.391306 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389113 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 19 08:20:52.391306 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389116 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 19 08:20:52.391306 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389119 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 19 08:20:52.391306 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389122 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 19 08:20:52.391306 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389124 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 19 08:20:52.391306 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389127 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 19 08:20:52.391306 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389130 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 19 08:20:52.391812 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389133 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 19 08:20:52.391812 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389135 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 19 08:20:52.391812 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389138 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 19 08:20:52.391812 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389141 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 19 08:20:52.391812 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389144 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 19 08:20:52.391812 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389165 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 19 08:20:52.391812 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389168 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 19 08:20:52.391812 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389171 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 19 08:20:52.391812 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389174 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 19 08:20:52.391812 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389177 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 19 08:20:52.391812 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389181 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 19 08:20:52.391812 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389183 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 19 08:20:52.391812 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389187 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 19 08:20:52.391812 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389191 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 19 08:20:52.391812 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389195 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 19 08:20:52.391812 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389198 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 19 08:20:52.391812 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389202 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 19 08:20:52.391812 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389206 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 19 08:20:52.391812 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389209 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 19 08:20:52.391812 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389212 2584 feature_gate.go:328] unrecognized feature gate: Example Sep 19 08:20:52.392365 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389215 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 19 08:20:52.392365 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389218 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 19 08:20:52.392365 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389221 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 19 08:20:52.392365 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389224 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 19 08:20:52.392365 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389227 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 19 08:20:52.392365 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389229 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 19 08:20:52.392365 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389232 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 19 08:20:52.392365 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389235 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 19 08:20:52.392365 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389238 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 19 08:20:52.392365 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389241 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 19 08:20:52.392365 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389244 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 19 08:20:52.392365 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389253 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 19 08:20:52.392365 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389258 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 19 08:20:52.392365 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389261 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 19 08:20:52.392365 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389265 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 19 08:20:52.392365 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389268 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 19 08:20:52.392365 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389270 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 19 08:20:52.392365 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389273 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 19 08:20:52.392365 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389276 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 19 08:20:52.392865 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389279 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 19 08:20:52.392865 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389282 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 19 08:20:52.392865 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389286 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 19 08:20:52.392865 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389289 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 19 08:20:52.392865 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389292 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 19 08:20:52.392865 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389295 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 19 08:20:52.392865 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389297 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 19 08:20:52.392865 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389300 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 19 08:20:52.392865 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389303 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 19 08:20:52.392865 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389306 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 19 08:20:52.392865 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389308 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 19 08:20:52.392865 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389311 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 19 08:20:52.392865 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389314 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 19 08:20:52.392865 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389317 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 19 08:20:52.392865 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389320 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 19 08:20:52.392865 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389323 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 19 08:20:52.392865 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389325 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 19 08:20:52.392865 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389328 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 19 08:20:52.392865 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389331 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 19 08:20:52.392865 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389334 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 19 08:20:52.393419 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389783 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 19 08:20:52.393419 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389789 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 19 08:20:52.393419 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389793 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 19 08:20:52.393419 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389796 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 19 08:20:52.393419 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389802 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 19 08:20:52.393419 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389806 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 19 08:20:52.393419 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389810 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 19 08:20:52.393419 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389813 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 19 08:20:52.393419 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389816 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 19 08:20:52.393419 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389819 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 19 08:20:52.393419 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389822 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 19 08:20:52.393419 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389824 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 19 08:20:52.393419 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389827 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 19 08:20:52.393419 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389830 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 19 08:20:52.393419 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389832 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 19 08:20:52.393419 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389835 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 19 08:20:52.393419 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389839 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 19 08:20:52.393419 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389843 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 19 08:20:52.393419 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389846 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 19 08:20:52.393419 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389849 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 19 08:20:52.393940 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389851 2584 feature_gate.go:328] unrecognized feature gate: Example Sep 19 08:20:52.393940 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389854 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 19 08:20:52.393940 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389857 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 19 08:20:52.393940 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389860 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 19 08:20:52.393940 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389863 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 19 08:20:52.393940 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389866 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 19 08:20:52.393940 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389869 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 19 08:20:52.393940 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389871 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 19 08:20:52.393940 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389874 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 19 08:20:52.393940 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389877 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 19 08:20:52.393940 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389879 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 19 08:20:52.393940 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389882 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 19 08:20:52.393940 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389887 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 19 08:20:52.393940 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389890 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 19 08:20:52.393940 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389892 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 19 08:20:52.393940 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389895 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 19 08:20:52.393940 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389898 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 19 08:20:52.393940 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389901 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 19 08:20:52.393940 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389904 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 19 08:20:52.393940 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389907 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 19 08:20:52.394477 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389910 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 19 08:20:52.394477 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389913 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 19 08:20:52.394477 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389916 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 19 08:20:52.394477 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389919 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 19 08:20:52.394477 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389921 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 19 08:20:52.394477 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389924 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 19 08:20:52.394477 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389927 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 19 08:20:52.394477 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389930 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 19 08:20:52.394477 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389933 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 19 08:20:52.394477 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389936 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 19 08:20:52.394477 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389938 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 19 08:20:52.394477 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389941 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 19 08:20:52.394477 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389944 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 19 08:20:52.394477 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389946 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 19 08:20:52.394477 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389949 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 19 08:20:52.394477 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389952 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 19 08:20:52.394477 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389955 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 19 08:20:52.394477 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389958 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 19 08:20:52.394477 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389960 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 19 08:20:52.394477 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389963 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 19 08:20:52.395000 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389966 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 19 08:20:52.395000 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389969 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 19 08:20:52.395000 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389972 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 19 08:20:52.395000 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389974 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 19 08:20:52.395000 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389979 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 19 08:20:52.395000 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389982 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 19 08:20:52.395000 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389984 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 19 08:20:52.395000 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389988 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 19 08:20:52.395000 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389992 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 19 08:20:52.395000 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389995 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 19 08:20:52.395000 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.389999 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 19 08:20:52.395000 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390003 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 19 08:20:52.395000 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390006 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 19 08:20:52.395000 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390009 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 19 08:20:52.395000 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390013 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 19 08:20:52.395000 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390015 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 19 08:20:52.395000 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390018 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 19 08:20:52.395000 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390021 2584 feature_gate.go:328] unrecognized feature gate: Example2 Sep 19 08:20:52.395000 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390024 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 19 08:20:52.395000 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390028 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 19 08:20:52.395545 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390031 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 19 08:20:52.395545 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390033 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 19 08:20:52.395545 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390036 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 19 08:20:52.395545 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390039 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 19 08:20:52.395545 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390042 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 19 08:20:52.395545 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390044 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 19 08:20:52.395545 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390047 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 19 08:20:52.395545 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390050 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 19 08:20:52.395545 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390052 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 19 08:20:52.395545 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390055 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 19 08:20:52.395545 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390058 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 19 08:20:52.395545 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390061 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 19 08:20:52.395545 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390063 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 19 08:20:52.395545 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390066 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 19 08:20:52.395545 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390069 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 19 08:20:52.395545 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390072 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 19 08:20:52.395545 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390076 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 19 08:20:52.395545 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390079 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 19 08:20:52.395545 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390083 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 19 08:20:52.396050 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390167 2584 flags.go:64] FLAG: --address="0.0.0.0" Sep 19 08:20:52.396050 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390213 2584 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 19 08:20:52.396050 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390222 2584 flags.go:64] FLAG: --anonymous-auth="true" Sep 19 08:20:52.396050 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390227 2584 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 19 08:20:52.396050 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390238 2584 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 19 08:20:52.396050 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390242 2584 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 19 08:20:52.396050 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390247 2584 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 19 08:20:52.396050 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390252 2584 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 19 08:20:52.396050 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390255 2584 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 19 08:20:52.396050 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390259 2584 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 19 08:20:52.396050 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390262 2584 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 19 08:20:52.396050 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390266 2584 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 19 08:20:52.396050 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390270 2584 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 19 08:20:52.396050 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390273 2584 flags.go:64] FLAG: --cgroup-root="" Sep 19 08:20:52.396050 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390276 2584 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 19 08:20:52.396050 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390279 2584 flags.go:64] FLAG: --client-ca-file="" Sep 19 08:20:52.396050 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390283 2584 flags.go:64] FLAG: --cloud-provider="external" Sep 19 08:20:52.396050 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390287 2584 flags.go:64] FLAG: --cluster-dns="[]" Sep 19 08:20:52.396050 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390291 2584 flags.go:64] FLAG: --cluster-domain="" Sep 19 08:20:52.396050 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390294 2584 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 19 08:20:52.396050 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390297 2584 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 19 08:20:52.396050 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390301 2584 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 19 08:20:52.396050 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390305 2584 flags.go:64] FLAG: --container-log-max-files="5" Sep 19 08:20:52.396050 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390309 2584 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 19 08:20:52.396735 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390312 2584 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 19 08:20:52.396735 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390316 2584 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 19 08:20:52.396735 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390320 2584 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 19 08:20:52.396735 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390323 2584 flags.go:64] FLAG: --contention-profiling="false" Sep 19 08:20:52.396735 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390326 2584 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 19 08:20:52.396735 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390332 2584 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 19 08:20:52.396735 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390336 2584 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 19 08:20:52.396735 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390340 2584 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 19 08:20:52.396735 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390344 2584 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 19 08:20:52.396735 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390348 2584 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 19 08:20:52.396735 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390351 2584 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 19 08:20:52.396735 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390358 2584 flags.go:64] FLAG: --enable-load-reader="false" Sep 19 08:20:52.396735 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390362 2584 flags.go:64] FLAG: --enable-server="true" Sep 19 08:20:52.396735 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390366 2584 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 19 08:20:52.396735 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390371 2584 flags.go:64] FLAG: --event-burst="100" Sep 19 08:20:52.396735 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390374 2584 flags.go:64] FLAG: --event-qps="50" Sep 19 08:20:52.396735 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390378 2584 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 19 08:20:52.396735 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390381 2584 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 19 08:20:52.396735 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390384 2584 flags.go:64] FLAG: --eviction-hard="" Sep 19 08:20:52.396735 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390388 2584 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 19 08:20:52.396735 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390392 2584 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 19 08:20:52.396735 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390395 2584 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 19 08:20:52.396735 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390398 2584 flags.go:64] FLAG: --eviction-soft="" Sep 19 08:20:52.396735 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390401 2584 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 19 08:20:52.396735 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390404 2584 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 19 08:20:52.397415 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390408 2584 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 19 08:20:52.397415 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390411 2584 flags.go:64] FLAG: --experimental-mounter-path="" Sep 19 08:20:52.397415 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390414 2584 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 19 08:20:52.397415 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390418 2584 flags.go:64] FLAG: --fail-swap-on="true" Sep 19 08:20:52.397415 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390422 2584 flags.go:64] FLAG: --feature-gates="" Sep 19 08:20:52.397415 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390426 2584 flags.go:64] FLAG: --file-check-frequency="20s" Sep 19 08:20:52.397415 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390430 2584 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 19 08:20:52.397415 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390433 2584 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 19 08:20:52.397415 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390436 2584 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 19 08:20:52.397415 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390440 2584 flags.go:64] FLAG: --healthz-port="10248" Sep 19 08:20:52.397415 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390443 2584 flags.go:64] FLAG: --help="false" Sep 19 08:20:52.397415 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390447 2584 flags.go:64] FLAG: --hostname-override="ip-10-0-143-96.ec2.internal" Sep 19 08:20:52.397415 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390452 2584 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 19 08:20:52.397415 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390455 2584 flags.go:64] FLAG: --http-check-frequency="20s" Sep 19 08:20:52.397415 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390458 2584 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 19 08:20:52.397415 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390462 2584 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 19 08:20:52.397415 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390465 2584 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 19 08:20:52.397415 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390469 2584 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 19 08:20:52.397415 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390474 2584 flags.go:64] FLAG: --image-service-endpoint="" Sep 19 08:20:52.397415 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390477 2584 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 19 08:20:52.397415 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390480 2584 flags.go:64] FLAG: --kube-api-burst="100" Sep 19 08:20:52.397415 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390484 2584 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 19 08:20:52.397415 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390488 2584 flags.go:64] FLAG: --kube-api-qps="50" Sep 19 08:20:52.397415 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390491 2584 flags.go:64] FLAG: --kube-reserved="" Sep 19 08:20:52.398094 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390495 2584 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 19 08:20:52.398094 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390498 2584 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 19 08:20:52.398094 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390502 2584 flags.go:64] FLAG: --kubelet-cgroups="" Sep 19 08:20:52.398094 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390505 2584 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 19 08:20:52.398094 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390508 2584 flags.go:64] FLAG: --lock-file="" Sep 19 08:20:52.398094 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390511 2584 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 19 08:20:52.398094 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390514 2584 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 19 08:20:52.398094 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390517 2584 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 19 08:20:52.398094 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390523 2584 flags.go:64] FLAG: --log-json-split-stream="false" Sep 19 08:20:52.398094 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390526 2584 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 19 08:20:52.398094 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390530 2584 flags.go:64] FLAG: --log-text-split-stream="false" Sep 19 08:20:52.398094 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390533 2584 flags.go:64] FLAG: --logging-format="text" Sep 19 08:20:52.398094 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390536 2584 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 19 08:20:52.398094 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390540 2584 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 19 08:20:52.398094 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390543 2584 flags.go:64] FLAG: --manifest-url="" Sep 19 08:20:52.398094 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390546 2584 flags.go:64] FLAG: --manifest-url-header="" Sep 19 08:20:52.398094 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390551 2584 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 19 08:20:52.398094 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390554 2584 flags.go:64] FLAG: --max-open-files="1000000" Sep 19 08:20:52.398094 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390558 2584 flags.go:64] FLAG: --max-pods="110" Sep 19 08:20:52.398094 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390561 2584 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 19 08:20:52.398094 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390566 2584 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 19 08:20:52.398094 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390570 2584 flags.go:64] FLAG: --memory-manager-policy="None" Sep 19 08:20:52.398094 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390573 2584 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 19 08:20:52.398094 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390577 2584 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 19 08:20:52.398094 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390580 2584 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 19 08:20:52.398776 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390583 2584 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 19 08:20:52.398776 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390592 2584 flags.go:64] FLAG: --node-status-max-images="50" Sep 19 08:20:52.398776 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390596 2584 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 19 08:20:52.398776 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390599 2584 flags.go:64] FLAG: --oom-score-adj="-999" Sep 19 08:20:52.398776 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390602 2584 flags.go:64] FLAG: --pod-cidr="" Sep 19 08:20:52.398776 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390606 2584 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc" Sep 19 08:20:52.398776 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390612 2584 flags.go:64] FLAG: --pod-manifest-path="" Sep 19 08:20:52.398776 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390615 2584 flags.go:64] FLAG: --pod-max-pids="-1" Sep 19 08:20:52.398776 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390619 2584 flags.go:64] FLAG: --pods-per-core="0" Sep 19 08:20:52.398776 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390622 2584 flags.go:64] FLAG: --port="10250" Sep 19 08:20:52.398776 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390625 2584 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 19 08:20:52.398776 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390629 2584 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a36438d3296b3741" Sep 19 08:20:52.398776 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390632 2584 flags.go:64] FLAG: --qos-reserved="" Sep 19 08:20:52.398776 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390635 2584 flags.go:64] FLAG: --read-only-port="10255" Sep 19 08:20:52.398776 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390639 2584 flags.go:64] FLAG: --register-node="true" Sep 19 08:20:52.398776 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390642 2584 flags.go:64] FLAG: --register-with-taints="" Sep 19 08:20:52.398776 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390645 2584 flags.go:64] FLAG: --registry-burst="10" Sep 19 08:20:52.398776 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390649 2584 flags.go:64] FLAG: --registry-qps="5" Sep 19 08:20:52.398776 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390652 2584 flags.go:64] FLAG: --reserved-cpus="" Sep 19 08:20:52.398776 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390655 2584 flags.go:64] FLAG: --reserved-memory="" Sep 19 08:20:52.398776 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390659 2584 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 19 08:20:52.398776 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390662 2584 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 19 08:20:52.398776 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390665 2584 flags.go:64] FLAG: --rotate-certificates="false" Sep 19 08:20:52.398776 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390669 2584 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 19 08:20:52.398776 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390672 2584 flags.go:64] FLAG: --runonce="false" Sep 19 08:20:52.399445 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390675 2584 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 19 08:20:52.399445 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390678 2584 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 19 08:20:52.399445 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390683 2584 flags.go:64] FLAG: --seccomp-default="false" Sep 19 08:20:52.399445 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390686 2584 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 19 08:20:52.399445 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390689 2584 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 19 08:20:52.399445 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390692 2584 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 19 08:20:52.399445 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390695 2584 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 19 08:20:52.399445 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390698 2584 flags.go:64] FLAG: --storage-driver-password="root" Sep 19 08:20:52.399445 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390702 2584 flags.go:64] FLAG: --storage-driver-secure="false" Sep 19 08:20:52.399445 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390706 2584 flags.go:64] FLAG: --storage-driver-table="stats" Sep 19 08:20:52.399445 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390709 2584 flags.go:64] FLAG: --storage-driver-user="root" Sep 19 08:20:52.399445 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390712 2584 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 19 08:20:52.399445 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390715 2584 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 19 08:20:52.399445 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390719 2584 flags.go:64] FLAG: --system-cgroups="" Sep 19 08:20:52.399445 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390722 2584 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 19 08:20:52.399445 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390728 2584 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 19 08:20:52.399445 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390731 2584 flags.go:64] FLAG: --tls-cert-file="" Sep 19 08:20:52.399445 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390735 2584 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 19 08:20:52.399445 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390739 2584 flags.go:64] FLAG: --tls-min-version="" Sep 19 08:20:52.399445 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390742 2584 flags.go:64] FLAG: --tls-private-key-file="" Sep 19 08:20:52.399445 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390746 2584 flags.go:64] FLAG: --topology-manager-policy="none" Sep 19 08:20:52.399445 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390749 2584 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 19 08:20:52.399445 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390752 2584 flags.go:64] FLAG: --topology-manager-scope="container" Sep 19 08:20:52.399445 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390756 2584 flags.go:64] FLAG: --v="2" Sep 19 08:20:52.399445 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390760 2584 flags.go:64] FLAG: --version="false" Sep 19 08:20:52.400108 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390764 2584 flags.go:64] FLAG: --vmodule="" Sep 19 08:20:52.400108 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390769 2584 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 19 08:20:52.400108 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.390772 2584 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 19 08:20:52.400108 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390912 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 19 08:20:52.400108 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390916 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 19 08:20:52.400108 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390920 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 19 08:20:52.400108 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390924 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 19 08:20:52.400108 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390928 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 19 08:20:52.400108 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390930 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 19 08:20:52.400108 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390934 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 19 08:20:52.400108 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390937 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 19 08:20:52.400108 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390940 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 19 08:20:52.400108 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390943 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 19 08:20:52.400108 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390946 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 19 08:20:52.400108 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390949 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 19 08:20:52.400108 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390952 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 19 08:20:52.400108 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390956 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 19 08:20:52.400108 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390959 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 19 08:20:52.400108 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390962 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 19 08:20:52.400108 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390965 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 19 08:20:52.400676 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390968 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 19 08:20:52.400676 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390971 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 19 08:20:52.400676 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390975 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 19 08:20:52.400676 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390978 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 19 08:20:52.400676 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390981 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 19 08:20:52.400676 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390984 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 19 08:20:52.400676 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390987 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 19 08:20:52.400676 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390990 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 19 08:20:52.400676 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390993 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 19 08:20:52.400676 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390996 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 19 08:20:52.400676 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.390999 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 19 08:20:52.400676 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391002 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 19 08:20:52.400676 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391006 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 19 08:20:52.400676 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391010 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 19 08:20:52.400676 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391014 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 19 08:20:52.400676 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391017 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 19 08:20:52.400676 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391020 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 19 08:20:52.400676 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391023 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 19 08:20:52.400676 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391026 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 19 08:20:52.401235 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391029 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 19 08:20:52.401235 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391032 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 19 08:20:52.401235 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391035 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 19 08:20:52.401235 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391038 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 19 08:20:52.401235 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391041 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 19 08:20:52.401235 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391044 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 19 08:20:52.401235 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391047 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 19 08:20:52.401235 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391050 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 19 08:20:52.401235 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391053 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 19 08:20:52.401235 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391057 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 19 08:20:52.401235 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391060 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 19 08:20:52.401235 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391063 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 19 08:20:52.401235 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391066 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 19 08:20:52.401235 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391069 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 19 08:20:52.401235 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391072 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 19 08:20:52.401235 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391075 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 19 08:20:52.401235 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391079 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 19 08:20:52.401235 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391082 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 19 08:20:52.401235 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391085 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 19 08:20:52.401235 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391087 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 19 08:20:52.401759 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391090 2584 feature_gate.go:328] unrecognized feature gate: Example2 Sep 19 08:20:52.401759 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391093 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 19 08:20:52.401759 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391096 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 19 08:20:52.401759 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391099 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 19 08:20:52.401759 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391102 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 19 08:20:52.401759 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391105 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 19 08:20:52.401759 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391108 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 19 08:20:52.401759 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391111 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 19 08:20:52.401759 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391113 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 19 08:20:52.401759 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391116 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 19 08:20:52.401759 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391119 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 19 08:20:52.401759 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391122 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 19 08:20:52.401759 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391125 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 19 08:20:52.401759 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391128 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 19 08:20:52.401759 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391132 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 19 08:20:52.401759 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391137 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 19 08:20:52.401759 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391141 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 19 08:20:52.401759 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391158 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 19 08:20:52.401759 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391162 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 19 08:20:52.402299 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391165 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 19 08:20:52.402299 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391168 2584 feature_gate.go:328] unrecognized feature gate: Example Sep 19 08:20:52.402299 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391173 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 19 08:20:52.402299 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391176 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 19 08:20:52.402299 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391179 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 19 08:20:52.402299 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391183 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 19 08:20:52.402299 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391186 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 19 08:20:52.402299 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391189 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 19 08:20:52.402299 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391191 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 19 08:20:52.402299 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391195 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 19 08:20:52.402299 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391198 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 19 08:20:52.402299 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391201 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 19 08:20:52.402299 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391204 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 19 08:20:52.402299 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391207 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 19 08:20:52.402299 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391210 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 19 08:20:52.402299 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391213 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 19 08:20:52.402299 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391216 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 19 08:20:52.402299 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391219 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 19 08:20:52.402299 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391221 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 19 08:20:52.402299 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391225 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 19 08:20:52.402851 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391228 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 19 08:20:52.402851 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391230 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 19 08:20:52.402851 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391233 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 19 08:20:52.402851 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.391236 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 19 08:20:52.402851 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.391924 2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 19 08:20:52.402851 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.399115 2584 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 19 08:20:52.402851 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.399130 2584 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 19 08:20:52.402851 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.399167 2584 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 19 08:20:52.402851 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.399178 2584 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 19 08:20:52.402851 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399251 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 19 08:20:52.402851 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399257 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 19 08:20:52.402851 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399261 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 19 08:20:52.402851 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399264 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 19 08:20:52.402851 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399267 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 19 08:20:52.402851 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399270 2584 feature_gate.go:328] unrecognized feature gate: Example Sep 19 08:20:52.403290 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399273 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 19 08:20:52.403290 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399276 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 19 08:20:52.403290 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399279 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 19 08:20:52.403290 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399282 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 19 08:20:52.403290 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399284 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 19 08:20:52.403290 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399287 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 19 08:20:52.403290 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399290 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 19 08:20:52.403290 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399293 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 19 08:20:52.403290 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399296 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 19 08:20:52.403290 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399299 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 19 08:20:52.403290 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399302 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 19 08:20:52.403290 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399305 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 19 08:20:52.403290 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399307 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 19 08:20:52.403290 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399310 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 19 08:20:52.403290 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399313 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 19 08:20:52.403290 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399316 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 19 08:20:52.403290 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399319 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 19 08:20:52.403290 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399322 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 19 08:20:52.403290 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399325 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 19 08:20:52.403786 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399328 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 19 08:20:52.403786 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399331 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 19 08:20:52.403786 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399333 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 19 08:20:52.403786 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399336 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 19 08:20:52.403786 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399341 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 19 08:20:52.403786 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399344 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 19 08:20:52.403786 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399347 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 19 08:20:52.403786 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399350 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 19 08:20:52.403786 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399352 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 19 08:20:52.403786 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399355 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 19 08:20:52.403786 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399358 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 19 08:20:52.403786 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399361 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 19 08:20:52.403786 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399364 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 19 08:20:52.403786 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399366 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 19 08:20:52.403786 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399369 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 19 08:20:52.403786 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399374 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 19 08:20:52.403786 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399377 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 19 08:20:52.403786 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399380 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 19 08:20:52.403786 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399383 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 19 08:20:52.404351 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399386 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 19 08:20:52.404351 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399389 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 19 08:20:52.404351 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399391 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 19 08:20:52.404351 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399394 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 19 08:20:52.404351 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399397 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 19 08:20:52.404351 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399399 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 19 08:20:52.404351 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399402 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 19 08:20:52.404351 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399405 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 19 08:20:52.404351 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399408 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 19 08:20:52.404351 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399411 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 19 08:20:52.404351 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399414 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 19 08:20:52.404351 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399417 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 19 08:20:52.404351 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399420 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 19 08:20:52.404351 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399422 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 19 08:20:52.404351 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399425 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 19 08:20:52.404351 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399428 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 19 08:20:52.404351 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399431 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 19 08:20:52.404351 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399435 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 19 08:20:52.404351 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399438 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 19 08:20:52.404351 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399441 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 19 08:20:52.404883 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399444 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 19 08:20:52.404883 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399447 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 19 08:20:52.404883 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399450 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 19 08:20:52.404883 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399452 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 19 08:20:52.404883 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399456 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 19 08:20:52.404883 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399459 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 19 08:20:52.404883 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399462 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 19 08:20:52.404883 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399465 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 19 08:20:52.404883 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399468 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 19 08:20:52.404883 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399471 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 19 08:20:52.404883 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399474 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 19 08:20:52.404883 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399476 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 19 08:20:52.404883 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399479 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 19 08:20:52.404883 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399482 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 19 08:20:52.404883 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399485 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 19 08:20:52.404883 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399488 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 19 08:20:52.404883 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399491 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 19 08:20:52.404883 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399493 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 19 08:20:52.404883 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399496 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 19 08:20:52.404883 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399499 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 19 08:20:52.405445 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399502 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 19 08:20:52.405445 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399505 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 19 08:20:52.405445 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399508 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 19 08:20:52.405445 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399511 2584 feature_gate.go:328] unrecognized feature gate: Example2 Sep 19 08:20:52.405445 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399514 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 19 08:20:52.405445 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399518 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 19 08:20:52.405445 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399522 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 19 08:20:52.405445 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399533 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 19 08:20:52.405445 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399537 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 19 08:20:52.405445 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399541 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 19 08:20:52.405445 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399544 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 19 08:20:52.405445 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399548 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 19 08:20:52.405445 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399551 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 19 08:20:52.405445 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399554 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 19 08:20:52.405445 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399557 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 19 08:20:52.405849 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.399563 2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 19 08:20:52.405849 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399681 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 19 08:20:52.405849 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399686 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 19 08:20:52.405849 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399691 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 19 08:20:52.405849 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399695 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 19 08:20:52.405849 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399698 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 19 08:20:52.405849 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399701 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 19 08:20:52.405849 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399704 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 19 08:20:52.405849 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399707 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 19 08:20:52.405849 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399710 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 19 08:20:52.405849 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399713 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 19 08:20:52.405849 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399716 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 19 08:20:52.405849 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399718 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 19 08:20:52.405849 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399721 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 19 08:20:52.405849 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399724 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 19 08:20:52.406254 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399727 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 19 08:20:52.406254 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399730 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 19 08:20:52.406254 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399732 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 19 08:20:52.406254 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399735 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 19 08:20:52.406254 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399738 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 19 08:20:52.406254 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399740 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 19 08:20:52.406254 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399743 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 19 08:20:52.406254 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399746 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 19 08:20:52.406254 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399748 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 19 08:20:52.406254 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399751 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 19 08:20:52.406254 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399754 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 19 08:20:52.406254 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399757 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 19 08:20:52.406254 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399760 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 19 08:20:52.406254 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399762 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 19 08:20:52.406254 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399766 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 19 08:20:52.406254 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399768 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 19 08:20:52.406254 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399771 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 19 08:20:52.406254 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399774 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 19 08:20:52.406254 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399777 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 19 08:20:52.406834 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399779 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 19 08:20:52.406834 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399782 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 19 08:20:52.406834 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399785 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 19 08:20:52.406834 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399788 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 19 08:20:52.406834 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399790 2584 feature_gate.go:328] unrecognized feature gate: Example Sep 19 08:20:52.406834 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399793 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 19 08:20:52.406834 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399796 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 19 08:20:52.406834 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399799 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 19 08:20:52.406834 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399802 2584 feature_gate.go:328] unrecognized feature gate: Example2 Sep 19 08:20:52.406834 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399806 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 19 08:20:52.406834 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399810 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 19 08:20:52.406834 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399813 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 19 08:20:52.406834 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399816 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 19 08:20:52.406834 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399820 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 19 08:20:52.406834 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399824 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 19 08:20:52.406834 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399827 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 19 08:20:52.406834 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399830 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 19 08:20:52.406834 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399834 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 19 08:20:52.406834 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399837 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 19 08:20:52.407445 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399839 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 19 08:20:52.407445 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399843 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 19 08:20:52.407445 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399845 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 19 08:20:52.407445 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399848 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 19 08:20:52.407445 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399851 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 19 08:20:52.407445 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399854 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 19 08:20:52.407445 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399857 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 19 08:20:52.407445 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399860 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 19 08:20:52.407445 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399863 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 19 08:20:52.407445 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399866 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 19 08:20:52.407445 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399869 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 19 08:20:52.407445 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399871 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 19 08:20:52.407445 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399874 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 19 08:20:52.407445 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399877 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 19 08:20:52.407445 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399880 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 19 08:20:52.407445 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399882 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 19 08:20:52.407445 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399885 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 19 08:20:52.407445 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399888 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 19 08:20:52.407445 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399891 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 19 08:20:52.407445 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399893 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 19 08:20:52.408421 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399896 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 19 08:20:52.408421 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399899 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 19 08:20:52.408421 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399902 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 19 08:20:52.408421 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399905 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 19 08:20:52.408421 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399908 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 19 08:20:52.408421 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399910 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 19 08:20:52.408421 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399913 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 19 08:20:52.408421 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399916 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 19 08:20:52.408421 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399918 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 19 08:20:52.408421 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399921 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 19 08:20:52.408421 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399924 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 19 08:20:52.408421 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399927 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 19 08:20:52.408421 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399929 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 19 08:20:52.408421 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399932 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 19 08:20:52.408421 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399935 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 19 08:20:52.408421 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399937 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 19 08:20:52.408421 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399940 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 19 08:20:52.408421 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399943 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 19 08:20:52.408421 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399945 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 19 08:20:52.408421 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399948 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 19 08:20:52.408970 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399951 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 19 08:20:52.408970 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399954 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 19 08:20:52.408970 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399957 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 19 08:20:52.408970 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399960 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 19 08:20:52.408970 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399963 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 19 08:20:52.408970 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399965 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 19 08:20:52.408970 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:52.399968 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 19 08:20:52.408970 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.399973 2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 19 08:20:52.408970 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.400080 2584 server.go:962] "Client rotation is on, will bootstrap in background" Sep 19 08:20:52.408970 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.402193 2584 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 19 08:20:52.408970 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.403046 2584 server.go:1019] "Starting client certificate rotation" Sep 19 08:20:52.408970 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.403153 2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 19 08:20:52.408970 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.403192 2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 19 08:20:52.408970 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.405507 2584 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 19 08:20:52.409484 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.409004 2584 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 19 08:20:52.413199 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.413178 2584 log.go:25] "Validated CRI v1 runtime API" Sep 19 08:20:52.414839 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.414825 2584 log.go:25] "Validated CRI v1 image API" Sep 19 08:20:52.415581 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.415565 2584 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 19 08:20:52.419027 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.419005 2584 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 bab7c695-8018-4389-b85b-5cf46e02c9eb:/dev/nvme0n1p4 bed7cd53-a050-4c31-9c22-0f369d47c684:/dev/nvme0n1p3] Sep 19 08:20:52.419101 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.419026 2584 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 19 08:20:52.423950 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.423834 2584 manager.go:216] Machine: {Timestamp:2026-09-19 08:20:52.423326402 +0000 UTC m=+2.153422998 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099905 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2269cdff2446d4cdfc4eb7a64180bd SystemUUID:ec2269cd-ff24-46d4-cdfc-4eb7a64180bd BootID:a167f51b-c3db-4534-866d-379cc38c2dcc Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:ca:f0:9c:09 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:ca:f0:9c:09 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5e:96:cb:c9:f9:7e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 19 08:20:52.423950 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.423945 2584 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 19 08:20:52.424066 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.424049 2584 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 19 08:20:52.425612 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.425583 2584 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 19 08:20:52.425766 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.425616 2584 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-96.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 19 08:20:52.426775 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.426763 2584 topology_manager.go:138] "Creating topology manager with none policy" Sep 19 08:20:52.426812 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.426779 2584 container_manager_linux.go:309] "Creating device plugin manager" Sep 19 08:20:52.426812 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.426787 2584 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 19 08:20:52.426812 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.426799 2584 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 19 08:20:52.426902 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.426874 2584 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 19 08:20:52.431354 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.431341 2584 state_mem.go:36] "Initialized new in-memory state store" Sep 19 08:20:52.431482 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.431471 2584 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 19 08:20:52.431527 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.431508 2584 kubelet.go:486] "Attempting to sync node with API server" Sep 19 08:20:52.431527 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.431522 2584 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 19 08:20:52.431583 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.431545 2584 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 19 08:20:52.431583 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.431556 2584 kubelet.go:398] "Adding apiserver pod source" Sep 19 08:20:52.431583 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.431575 2584 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 19 08:20:52.431961 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.431949 2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 19 08:20:52.432005 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.431970 2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 19 08:20:52.433946 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.433929 2584 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1" Sep 19 08:20:52.436714 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.436700 2584 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 19 08:20:52.436767 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.436732 2584 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 19 08:20:52.437767 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.437755 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 19 08:20:52.437814 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.437771 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 19 08:20:52.437814 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.437779 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 19 08:20:52.437814 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.437785 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 19 08:20:52.437814 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.437794 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 19 08:20:52.437814 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.437800 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 19 08:20:52.437814 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.437814 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 19 08:20:52.437985 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.437819 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 19 08:20:52.437985 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.437828 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 19 08:20:52.437985 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.437834 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 19 08:20:52.437985 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.437848 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 19 08:20:52.437985 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.437854 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 19 08:20:52.437985 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.437877 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 19 08:20:52.437985 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.437882 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 19 08:20:52.441709 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.441689 2584 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-96.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 19 08:20:52.443008 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.442968 2584 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 19 08:20:52.443104 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.443022 2584 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 19 08:20:52.444389 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.444348 2584 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 19 08:20:52.446902 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.446885 2584 server.go:310] "Adding debug handlers to kubelet server" Sep 19 08:20:52.448450 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.442854 2584 server.go:1268] "Started kubelet" Sep 19 08:20:52.449434 ip-10-0-143-96 systemd[1]: Started Kubernetes Kubelet. Sep 19 08:20:52.451321 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.451297 2584 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 19 08:20:52.453394 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.453372 2584 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 19 08:20:52.476554 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.476323 2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 19 08:20:52.477135 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.477116 2584 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 19 08:20:52.477135 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.477137 2584 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 19 08:20:52.479719 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:52.479677 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-96.ec2.internal\" not found" Sep 19 08:20:52.480021 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.480000 2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 19 08:20:52.480021 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:52.480012 2584 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 19 08:20:52.480332 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.480199 2584 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 19 08:20:52.480596 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.480576 2584 factory.go:55] Registering systemd factory Sep 19 08:20:52.480596 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.480598 2584 factory.go:223] Registration of the systemd container factory successfully Sep 19 08:20:52.480755 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:52.480654 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 19 08:20:52.480755 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.480664 2584 reconstruct.go:97] "Volume reconstruction finished" Sep 19 08:20:52.480755 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.480686 2584 reconciler.go:29] "Reconciler: start to sync state" Sep 19 08:20:52.480755 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:52.480656 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-96.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 19 08:20:52.480932 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.480885 2584 factory.go:153] Registering CRI-O factory Sep 19 08:20:52.480932 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.480902 2584 factory.go:223] Registration of the crio container factory successfully Sep 19 08:20:52.481038 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.481007 2584 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 19 08:20:52.481038 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.481030 2584 factory.go:103] Registering Raw factory Sep 19 08:20:52.481156 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.481047 2584 manager.go:1196] Started watching for new ooms in manager Sep 19 08:20:52.481473 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.481459 2584 manager.go:349] Starting recovery of all containers Sep 19 08:20:52.482731 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.482704 2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rjzst" Sep 19 08:20:52.482967 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:52.481720 2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-96.ec2.internal.18d6ab1f34af6672 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-96.ec2.internal,UID:ip-10-0-143-96.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-96.ec2.internal,},FirstTimestamp:2026-09-19 08:20:52.442596978 +0000 UTC m=+2.172693574,LastTimestamp:2026-09-19 08:20:52.442596978 +0000 UTC m=+2.172693574,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-96.ec2.internal,}" Sep 19 08:20:52.490671 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.490645 2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rjzst" Sep 19 08:20:52.491061 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:52.491040 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 19 08:20:52.491176 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.491142 2584 manager.go:354] Recovery completed Sep 19 08:20:52.495760 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.495746 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 19 08:20:52.497810 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.497792 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-96.ec2.internal" event="NodeHasSufficientMemory" Sep 19 08:20:52.497887 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.497823 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-96.ec2.internal" event="NodeHasNoDiskPressure" Sep 19 08:20:52.497887 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.497837 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-96.ec2.internal" event="NodeHasSufficientPID" Sep 19 08:20:52.498428 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.498412 2584 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 19 08:20:52.498428 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.498427 2584 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 19 08:20:52.498532 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.498455 2584 state_mem.go:36] "Initialized new in-memory state store" Sep 19 08:20:52.498532 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.498422 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 19 08:20:52.499327 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.499313 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-96.ec2.internal" event="NodeHasSufficientMemory" Sep 19 08:20:52.499392 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.499340 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-96.ec2.internal" event="NodeHasNoDiskPressure" Sep 19 08:20:52.499392 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.499353 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-96.ec2.internal" event="NodeHasSufficientPID" Sep 19 08:20:52.499736 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:52.499654 2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-96.ec2.internal.18d6ab1f37f9d999 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-96.ec2.internal,UID:ip-10-0-143-96.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-96.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-96.ec2.internal,},FirstTimestamp:2026-09-19 08:20:52.497807769 +0000 UTC m=+2.227904364,LastTimestamp:2026-09-19 08:20:52.497807769 +0000 UTC m=+2.227904364,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-96.ec2.internal,}" Sep 19 08:20:52.500594 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.500580 2584 policy_none.go:49] "None policy: Start" Sep 19 08:20:52.500648 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.500597 2584 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 19 08:20:52.500648 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.500611 2584 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 19 08:20:52.502698 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.502686 2584 policy_none.go:47] "Start" Sep 19 08:20:52.570810 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.570791 2584 manager.go:337] "Starting Device Plugin manager" Sep 19 08:20:52.570960 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:52.570904 2584 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 19 08:20:52.570960 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.570920 2584 server.go:87] "Starting device plugin registration server" Sep 19 08:20:52.571217 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.571203 2584 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 19 08:20:52.571288 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.571230 2584 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 19 08:20:52.571351 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.571328 2584 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 19 08:20:52.571440 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.571419 2584 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 19 08:20:52.571440 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.571433 2584 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 19 08:20:52.571971 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:52.571949 2584 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 19 08:20:52.572061 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:52.571999 2584 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-96.ec2.internal\" not found" Sep 19 08:20:52.603964 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.603936 2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 19 08:20:52.605212 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.605196 2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 19 08:20:52.605292 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.605245 2584 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 19 08:20:52.605292 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.605272 2584 kubelet.go:2448] "Starting kubelet main sync loop" Sep 19 08:20:52.605383 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:52.605314 2584 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 19 08:20:52.607689 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.607663 2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 19 08:20:52.673471 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.673369 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 19 08:20:52.674648 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.674630 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-96.ec2.internal" event="NodeHasSufficientMemory" Sep 19 08:20:52.674743 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.674669 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-96.ec2.internal" event="NodeHasNoDiskPressure" Sep 19 08:20:52.674743 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.674687 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-96.ec2.internal" event="NodeHasSufficientPID" Sep 19 08:20:52.674743 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.674718 2584 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-96.ec2.internal" Sep 19 08:20:52.684005 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.683977 2584 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-96.ec2.internal" Sep 19 08:20:52.684114 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:52.684015 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-96.ec2.internal\": node \"ip-10-0-143-96.ec2.internal\" not found" Sep 19 08:20:52.700827 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:52.700804 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-96.ec2.internal\" not found" Sep 19 08:20:52.706312 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.706294 2584 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-96.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-96.ec2.internal"] Sep 19 08:20:52.706373 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.706363 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 19 08:20:52.707782 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.707765 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-96.ec2.internal" event="NodeHasSufficientMemory" Sep 19 08:20:52.707876 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.707799 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-96.ec2.internal" event="NodeHasNoDiskPressure" Sep 19 08:20:52.707876 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.707813 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-96.ec2.internal" event="NodeHasSufficientPID" Sep 19 08:20:52.710302 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.710285 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 19 08:20:52.710416 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.710398 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-96.ec2.internal" Sep 19 08:20:52.710468 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.710434 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 19 08:20:52.711014 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.710997 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-96.ec2.internal" event="NodeHasSufficientMemory" Sep 19 08:20:52.711077 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.711020 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-96.ec2.internal" event="NodeHasNoDiskPressure" Sep 19 08:20:52.711077 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.711021 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-96.ec2.internal" event="NodeHasSufficientMemory" Sep 19 08:20:52.711077 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.711034 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-96.ec2.internal" event="NodeHasSufficientPID" Sep 19 08:20:52.711077 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.711044 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-96.ec2.internal" event="NodeHasNoDiskPressure" Sep 19 08:20:52.711077 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.711054 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-96.ec2.internal" event="NodeHasSufficientPID" Sep 19 08:20:52.713435 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.713418 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-96.ec2.internal" Sep 19 08:20:52.713506 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.713451 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 19 08:20:52.714171 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.714141 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-96.ec2.internal" event="NodeHasSufficientMemory" Sep 19 08:20:52.714257 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.714180 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-96.ec2.internal" event="NodeHasNoDiskPressure" Sep 19 08:20:52.714257 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.714190 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-96.ec2.internal" event="NodeHasSufficientPID" Sep 19 08:20:52.727727 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:52.727705 2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-96.ec2.internal\" not found" node="ip-10-0-143-96.ec2.internal" Sep 19 08:20:52.731312 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:52.731296 2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-96.ec2.internal\" not found" node="ip-10-0-143-96.ec2.internal" Sep 19 08:20:52.782849 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.782818 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ad2de051a5bf26d24a7aa54eba31ddad-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-96.ec2.internal\" (UID: \"ad2de051a5bf26d24a7aa54eba31ddad\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-96.ec2.internal" Sep 19 08:20:52.782950 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.782858 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad2de051a5bf26d24a7aa54eba31ddad-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-96.ec2.internal\" (UID: \"ad2de051a5bf26d24a7aa54eba31ddad\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-96.ec2.internal" Sep 19 08:20:52.782950 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.782885 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bb1f3dcffd05d522e85d0257d7561dec-config\") pod \"kube-apiserver-proxy-ip-10-0-143-96.ec2.internal\" (UID: \"bb1f3dcffd05d522e85d0257d7561dec\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-96.ec2.internal" Sep 19 08:20:52.801682 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:52.801659 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-96.ec2.internal\" not found" Sep 19 08:20:52.883842 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.883815 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ad2de051a5bf26d24a7aa54eba31ddad-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-96.ec2.internal\" (UID: \"ad2de051a5bf26d24a7aa54eba31ddad\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-96.ec2.internal" Sep 19 08:20:52.883924 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.883877 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ad2de051a5bf26d24a7aa54eba31ddad-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-96.ec2.internal\" (UID: \"ad2de051a5bf26d24a7aa54eba31ddad\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-96.ec2.internal" Sep 19 08:20:52.883969 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.883920 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad2de051a5bf26d24a7aa54eba31ddad-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-96.ec2.internal\" (UID: \"ad2de051a5bf26d24a7aa54eba31ddad\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-96.ec2.internal" Sep 19 08:20:52.883969 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.883946 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bb1f3dcffd05d522e85d0257d7561dec-config\") pod \"kube-apiserver-proxy-ip-10-0-143-96.ec2.internal\" (UID: \"bb1f3dcffd05d522e85d0257d7561dec\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-96.ec2.internal" Sep 19 08:20:52.884046 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.883986 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bb1f3dcffd05d522e85d0257d7561dec-config\") pod \"kube-apiserver-proxy-ip-10-0-143-96.ec2.internal\" (UID: \"bb1f3dcffd05d522e85d0257d7561dec\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-96.ec2.internal" Sep 19 08:20:52.884046 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:52.884006 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad2de051a5bf26d24a7aa54eba31ddad-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-96.ec2.internal\" (UID: \"ad2de051a5bf26d24a7aa54eba31ddad\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-96.ec2.internal" Sep 19 08:20:52.901929 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:52.901893 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-96.ec2.internal\" not found" Sep 19 08:20:53.002974 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:53.002903 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-96.ec2.internal\" not found" Sep 19 08:20:53.031723 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:53.031699 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-96.ec2.internal" Sep 19 08:20:53.035112 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:53.035095 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-96.ec2.internal" Sep 19 08:20:53.103276 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:53.103242 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-96.ec2.internal\" not found" Sep 19 08:20:53.203860 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:53.203834 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-96.ec2.internal\" not found" Sep 19 08:20:53.304320 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:53.304244 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-96.ec2.internal\" not found" Sep 19 08:20:53.402919 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:53.402886 2584 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 19 08:20:53.403574 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:53.403031 2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 19 08:20:53.405186 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:53.405165 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-96.ec2.internal\" not found" Sep 19 08:20:53.422224 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:53.422201 2584 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 19 08:20:53.496274 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:53.496233 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-18 08:15:52 +0000 UTC" deadline="2028-02-24 08:20:30.277129039 +0000 UTC" Sep 19 08:20:53.496274 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:53.496264 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12551h59m36.780868149s" Sep 19 08:20:53.505249 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:53.505224 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-96.ec2.internal\" not found" Sep 19 08:20:53.577872 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:53.577843 2584 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 19 08:20:53.606677 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:53.606647 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-96.ec2.internal\" not found" Sep 19 08:20:53.707180 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:53.707151 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-96.ec2.internal\" not found" Sep 19 08:20:53.750378 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:53.750341 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb1f3dcffd05d522e85d0257d7561dec.slice/crio-27947633b47ad7ec27b7e845b239a2cffee31461ac7c405f04e1e0c279e1fd32 WatchSource:0}: Error finding container 27947633b47ad7ec27b7e845b239a2cffee31461ac7c405f04e1e0c279e1fd32: Status 404 returned error can't find the container with id 27947633b47ad7ec27b7e845b239a2cffee31461ac7c405f04e1e0c279e1fd32 Sep 19 08:20:53.750564 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:53.750550 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad2de051a5bf26d24a7aa54eba31ddad.slice/crio-c5ba167e9919d04ad0ccb3545433c4fe18fa45bdd07509c41f5cde42b3be7add WatchSource:0}: Error finding container c5ba167e9919d04ad0ccb3545433c4fe18fa45bdd07509c41f5cde42b3be7add: Status 404 returned error can't find the container with id c5ba167e9919d04ad0ccb3545433c4fe18fa45bdd07509c41f5cde42b3be7add Sep 19 08:20:53.755345 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:53.755326 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 19 08:20:53.801292 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:53.801273 2584 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 19 08:20:53.877213 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:53.877122 2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-96.ec2.internal" Sep 19 08:20:53.890600 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:53.890578 2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 19 08:20:53.891480 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:53.891464 2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-96.ec2.internal" Sep 19 08:20:53.900435 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:53.900421 2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 19 08:20:54.432615 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.432588 2584 apiserver.go:52] "Watching apiserver" Sep 19 08:20:54.444041 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.443568 2584 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 19 08:20:54.444215 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.444066 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-h2qgv","openshift-ovn-kubernetes/ovnkube-node-l2hqv","kube-system/global-pull-secret-syncer-xgprw","kube-system/kube-apiserver-proxy-ip-10-0-143-96.ec2.internal","openshift-dns/node-resolver-7mwjp","openshift-multus/multus-x9knk","openshift-multus/network-metrics-daemon-kqz5p","openshift-network-operator/iptables-alerter-hmhmw","kube-system/konnectivity-agent-qw5l5","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89kkh","openshift-cluster-node-tuning-operator/tuned-lndpt","openshift-image-registry/node-ca-vlbrv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-96.ec2.internal","openshift-multus/multus-additional-cni-plugins-jgn8b"] Sep 19 08:20:54.446741 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.446721 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hmhmw" Sep 19 08:20:54.449361 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.449329 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.451428 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.450572 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 19 08:20:54.451428 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.450795 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 19 08:20:54.451428 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.451035 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-djbpz\"" Sep 19 08:20:54.451428 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.451248 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 19 08:20:54.453096 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.451780 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 19 08:20:54.453096 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.451986 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jg9qf\"" Sep 19 08:20:54.453096 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.452084 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 19 08:20:54.453096 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.452196 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 19 08:20:54.453096 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.452218 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 19 08:20:54.453096 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.452388 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 19 08:20:54.453096 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.452395 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jgn8b" Sep 19 08:20:54.453096 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.452675 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 19 08:20:54.454467 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.454064 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vlbrv" Sep 19 08:20:54.454558 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.454521 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 19 08:20:54.455961 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.455939 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 19 08:20:54.456274 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.456256 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 19 08:20:54.456461 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.456443 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 19 08:20:54.456660 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.456643 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 19 08:20:54.456851 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.456829 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qlwpn\"" Sep 19 08:20:54.458247 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.457233 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 19 08:20:54.458247 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.457282 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-kgl4c\"" Sep 19 08:20:54.458247 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.457408 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 19 08:20:54.458247 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.457640 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lndpt" Sep 19 08:20:54.458247 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.458157 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 19 08:20:54.460113 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.459850 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 19 08:20:54.460205 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.460162 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 19 08:20:54.460442 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.460376 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8dkdg\"" Sep 19 08:20:54.460971 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.460659 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-x9knk" Sep 19 08:20:54.462939 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.462921 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 19 08:20:54.463230 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.463206 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vfnl4\"" Sep 19 08:20:54.466162 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.465847 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2qgv" Sep 19 08:20:54.466162 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:54.465924 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2qgv" podUID="1f40898d-6f69-48bc-8af6-3224a163f776" Sep 19 08:20:54.470782 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.470764 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqz5p" Sep 19 08:20:54.470858 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:54.470838 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqz5p" podUID="35c26dae-8ddc-4ea9-b6d7-6de02274508c" Sep 19 08:20:54.473491 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.473469 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qw5l5" Sep 19 08:20:54.476199 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.476181 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 19 08:20:54.476286 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.476222 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89kkh" Sep 19 08:20:54.476405 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.476389 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 19 08:20:54.476864 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.476848 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-svqc2\"" Sep 19 08:20:54.478673 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.478645 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 19 08:20:54.478750 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.478735 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 19 08:20:54.478908 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.478873 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 19 08:20:54.479100 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.479061 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7mwjp" Sep 19 08:20:54.483712 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.483692 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gwm5c\"" Sep 19 08:20:54.485179 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.485157 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgprw" Sep 19 08:20:54.485270 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:54.485240 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgprw" podUID="06d9bb1e-838b-4f04-9ff4-f668714c7877" Sep 19 08:20:54.485490 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.485470 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 19 08:20:54.485557 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.485495 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mtzfs\"" Sep 19 08:20:54.485652 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.485623 2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 19 08:20:54.485767 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.485732 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 19 08:20:54.493003 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.492979 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/06d9bb1e-838b-4f04-9ff4-f668714c7877-kubelet-config\") pod \"global-pull-secret-syncer-xgprw\" (UID: \"06d9bb1e-838b-4f04-9ff4-f668714c7877\") " pod="kube-system/global-pull-secret-syncer-xgprw" Sep 19 08:20:54.493116 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.493014 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/06d9bb1e-838b-4f04-9ff4-f668714c7877-dbus\") pod \"global-pull-secret-syncer-xgprw\" (UID: \"06d9bb1e-838b-4f04-9ff4-f668714c7877\") " pod="kube-system/global-pull-secret-syncer-xgprw" Sep 19 08:20:54.493116 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.493037 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqw8z\" (UniqueName: \"kubernetes.io/projected/35c26dae-8ddc-4ea9-b6d7-6de02274508c-kube-api-access-tqw8z\") pod \"network-metrics-daemon-kqz5p\" (UID: \"35c26dae-8ddc-4ea9-b6d7-6de02274508c\") " pod="openshift-multus/network-metrics-daemon-kqz5p" Sep 19 08:20:54.493233 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.493159 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e3a2c7d3-39cd-48fe-b472-cc9bb9cac54e-hosts-file\") pod \"node-resolver-7mwjp\" (UID: \"e3a2c7d3-39cd-48fe-b472-cc9bb9cac54e\") " pod="openshift-dns/node-resolver-7mwjp" Sep 19 08:20:54.493233 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.493206 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-host-run-ovn-kubernetes\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.493328 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.493232 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdvjv\" (UniqueName: \"kubernetes.io/projected/1caf055c-966a-4aaf-92b0-22fe9332e753-kube-api-access-bdvjv\") pod \"aws-ebs-csi-driver-node-89kkh\" (UID: \"1caf055c-966a-4aaf-92b0-22fe9332e753\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89kkh" Sep 19 08:20:54.493328 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.493256 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-run-systemd\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.493328 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.493320 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-node-log\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.493463 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.493367 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e4d94997-9978-4be2-b81c-3a610fd1b54e-serviceca\") pod \"node-ca-vlbrv\" (UID: \"e4d94997-9978-4be2-b81c-3a610fd1b54e\") " pod="openshift-image-registry/node-ca-vlbrv" Sep 19 08:20:54.493463 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.493401 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/51eaaa01-f96a-4933-a1c3-54b7c1ac2a72-etc-tuned\") pod \"tuned-lndpt\" (UID: \"51eaaa01-f96a-4933-a1c3-54b7c1ac2a72\") " pod="openshift-cluster-node-tuning-operator/tuned-lndpt" Sep 19 08:20:54.493463 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.493425 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1caf055c-966a-4aaf-92b0-22fe9332e753-device-dir\") pod \"aws-ebs-csi-driver-node-89kkh\" (UID: \"1caf055c-966a-4aaf-92b0-22fe9332e753\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89kkh" Sep 19 08:20:54.493463 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.493455 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/55c84c99-604b-49d6-8ba9-01e04e3accda-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jgn8b\" (UID: \"55c84c99-604b-49d6-8ba9-01e04e3accda\") " pod="openshift-multus/multus-additional-cni-plugins-jgn8b" Sep 19 08:20:54.493641 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.493479 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mrtz\" (UniqueName: \"kubernetes.io/projected/55c84c99-604b-49d6-8ba9-01e04e3accda-kube-api-access-4mrtz\") pod \"multus-additional-cni-plugins-jgn8b\" (UID: \"55c84c99-604b-49d6-8ba9-01e04e3accda\") " pod="openshift-multus/multus-additional-cni-plugins-jgn8b" Sep 19 08:20:54.493641 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.493499 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e4d94997-9978-4be2-b81c-3a610fd1b54e-host\") pod \"node-ca-vlbrv\" (UID: \"e4d94997-9978-4be2-b81c-3a610fd1b54e\") " pod="openshift-image-registry/node-ca-vlbrv" Sep 19 08:20:54.493641 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.493513 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51eaaa01-f96a-4933-a1c3-54b7c1ac2a72-etc-kubernetes\") pod \"tuned-lndpt\" (UID: \"51eaaa01-f96a-4933-a1c3-54b7c1ac2a72\") " pod="openshift-cluster-node-tuning-operator/tuned-lndpt" Sep 19 08:20:54.493641 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.493552 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/51eaaa01-f96a-4933-a1c3-54b7c1ac2a72-etc-sysctl-d\") pod \"tuned-lndpt\" (UID: \"51eaaa01-f96a-4933-a1c3-54b7c1ac2a72\") " pod="openshift-cluster-node-tuning-operator/tuned-lndpt" Sep 19 08:20:54.493641 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.493571 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/51eaaa01-f96a-4933-a1c3-54b7c1ac2a72-sys\") pod \"tuned-lndpt\" (UID: \"51eaaa01-f96a-4933-a1c3-54b7c1ac2a72\") " pod="openshift-cluster-node-tuning-operator/tuned-lndpt" Sep 19 08:20:54.493641 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.493631 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/55c84c99-604b-49d6-8ba9-01e04e3accda-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jgn8b\" (UID: \"55c84c99-604b-49d6-8ba9-01e04e3accda\") " pod="openshift-multus/multus-additional-cni-plugins-jgn8b" Sep 19 08:20:54.494027 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.493675 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee-cnibin\") pod \"multus-x9knk\" (UID: \"dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee\") " pod="openshift-multus/multus-x9knk" Sep 19 08:20:54.494027 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.493702 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee-multus-conf-dir\") pod \"multus-x9knk\" (UID: \"dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee\") " pod="openshift-multus/multus-x9knk" Sep 19 08:20:54.494027 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.493728 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee-multus-daemon-config\") pod \"multus-x9knk\" (UID: \"dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee\") " pod="openshift-multus/multus-x9knk" Sep 19 08:20:54.494027 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.493752 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-var-lib-openvswitch\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.494027 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.493779 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/51eaaa01-f96a-4933-a1c3-54b7c1ac2a72-etc-sysctl-conf\") pod \"tuned-lndpt\" (UID: \"51eaaa01-f96a-4933-a1c3-54b7c1ac2a72\") " pod="openshift-cluster-node-tuning-operator/tuned-lndpt" Sep 19 08:20:54.494027 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.493799 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/51eaaa01-f96a-4933-a1c3-54b7c1ac2a72-run\") pod \"tuned-lndpt\" (UID: \"51eaaa01-f96a-4933-a1c3-54b7c1ac2a72\") " pod="openshift-cluster-node-tuning-operator/tuned-lndpt" Sep 19 08:20:54.494027 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.493824 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06d9bb1e-838b-4f04-9ff4-f668714c7877-original-pull-secret\") pod \"global-pull-secret-syncer-xgprw\" (UID: \"06d9bb1e-838b-4f04-9ff4-f668714c7877\") " pod="kube-system/global-pull-secret-syncer-xgprw" Sep 19 08:20:54.494027 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.493846 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/340df34f-ef23-43c5-a79a-aa7bd01f7fda-iptables-alerter-script\") pod \"iptables-alerter-hmhmw\" (UID: \"340df34f-ef23-43c5-a79a-aa7bd01f7fda\") " pod="openshift-network-operator/iptables-alerter-hmhmw" Sep 19 08:20:54.494027 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.493869 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee-host-run-k8s-cni-cncf-io\") pod \"multus-x9knk\" (UID: \"dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee\") " pod="openshift-multus/multus-x9knk" Sep 19 08:20:54.494027 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.493892 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-host-cni-netd\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.494027 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.493915 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-ovnkube-config\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.494027 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.493938 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/51eaaa01-f96a-4933-a1c3-54b7c1ac2a72-etc-modprobe-d\") pod \"tuned-lndpt\" (UID: \"51eaaa01-f96a-4933-a1c3-54b7c1ac2a72\") " pod="openshift-cluster-node-tuning-operator/tuned-lndpt" Sep 19 08:20:54.494027 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.493962 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nnvq\" (UniqueName: \"kubernetes.io/projected/51eaaa01-f96a-4933-a1c3-54b7c1ac2a72-kube-api-access-8nnvq\") pod \"tuned-lndpt\" (UID: \"51eaaa01-f96a-4933-a1c3-54b7c1ac2a72\") " pod="openshift-cluster-node-tuning-operator/tuned-lndpt" Sep 19 08:20:54.494027 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.493985 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee-cni-binary-copy\") pod \"multus-x9knk\" (UID: \"dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee\") " pod="openshift-multus/multus-x9knk" Sep 19 08:20:54.494027 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.494007 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee-host-var-lib-cni-multus\") pod \"multus-x9knk\" (UID: \"dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee\") " pod="openshift-multus/multus-x9knk" Sep 19 08:20:54.494027 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.494030 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-systemd-units\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.494744 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.494060 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ppk9\" (UniqueName: \"kubernetes.io/projected/e4d94997-9978-4be2-b81c-3a610fd1b54e-kube-api-access-6ppk9\") pod \"node-ca-vlbrv\" (UID: \"e4d94997-9978-4be2-b81c-3a610fd1b54e\") " pod="openshift-image-registry/node-ca-vlbrv" Sep 19 08:20:54.494744 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.494116 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtrgm\" (UniqueName: \"kubernetes.io/projected/1f40898d-6f69-48bc-8af6-3224a163f776-kube-api-access-xtrgm\") pod \"network-check-target-h2qgv\" (UID: \"1f40898d-6f69-48bc-8af6-3224a163f776\") " pod="openshift-network-diagnostics/network-check-target-h2qgv" Sep 19 08:20:54.494744 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.494144 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1caf055c-966a-4aaf-92b0-22fe9332e753-registration-dir\") pod \"aws-ebs-csi-driver-node-89kkh\" (UID: \"1caf055c-966a-4aaf-92b0-22fe9332e753\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89kkh" Sep 19 08:20:54.494744 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.494165 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55c84c99-604b-49d6-8ba9-01e04e3accda-cni-binary-copy\") pod \"multus-additional-cni-plugins-jgn8b\" (UID: \"55c84c99-604b-49d6-8ba9-01e04e3accda\") " pod="openshift-multus/multus-additional-cni-plugins-jgn8b" Sep 19 08:20:54.494744 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.494181 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee-system-cni-dir\") pod \"multus-x9knk\" (UID: \"dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee\") " pod="openshift-multus/multus-x9knk" Sep 19 08:20:54.494744 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.494195 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-host-cni-bin\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.494744 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.494217 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4khrw\" (UniqueName: \"kubernetes.io/projected/e3a2c7d3-39cd-48fe-b472-cc9bb9cac54e-kube-api-access-4khrw\") pod \"node-resolver-7mwjp\" (UID: \"e3a2c7d3-39cd-48fe-b472-cc9bb9cac54e\") " pod="openshift-dns/node-resolver-7mwjp" Sep 19 08:20:54.494744 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.494240 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-host-slash\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.494744 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.494254 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-run-ovn\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.494744 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.494268 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/51eaaa01-f96a-4933-a1c3-54b7c1ac2a72-lib-modules\") pod \"tuned-lndpt\" (UID: \"51eaaa01-f96a-4933-a1c3-54b7c1ac2a72\") " pod="openshift-cluster-node-tuning-operator/tuned-lndpt" Sep 19 08:20:54.494744 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.494286 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee-host-var-lib-cni-bin\") pod \"multus-x9knk\" (UID: \"dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee\") " pod="openshift-multus/multus-x9knk" Sep 19 08:20:54.494744 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.494304 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vlx9\" (UniqueName: \"kubernetes.io/projected/dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee-kube-api-access-6vlx9\") pod \"multus-x9knk\" (UID: \"dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee\") " pod="openshift-multus/multus-x9knk" Sep 19 08:20:54.494744 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.494322 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35c26dae-8ddc-4ea9-b6d7-6de02274508c-metrics-certs\") pod \"network-metrics-daemon-kqz5p\" (UID: \"35c26dae-8ddc-4ea9-b6d7-6de02274508c\") " pod="openshift-multus/network-metrics-daemon-kqz5p" Sep 19 08:20:54.494744 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.494351 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-ovnkube-script-lib\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.494744 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.494379 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/51eaaa01-f96a-4933-a1c3-54b7c1ac2a72-etc-sysconfig\") pod \"tuned-lndpt\" (UID: \"51eaaa01-f96a-4933-a1c3-54b7c1ac2a72\") " pod="openshift-cluster-node-tuning-operator/tuned-lndpt" Sep 19 08:20:54.494744 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.494407 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/51eaaa01-f96a-4933-a1c3-54b7c1ac2a72-var-lib-kubelet\") pod \"tuned-lndpt\" (UID: \"51eaaa01-f96a-4933-a1c3-54b7c1ac2a72\") " pod="openshift-cluster-node-tuning-operator/tuned-lndpt" Sep 19 08:20:54.495510 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.494435 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-host-kubelet\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.495510 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.494462 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.495510 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.494485 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-env-overrides\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.495510 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.494506 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/51eaaa01-f96a-4933-a1c3-54b7c1ac2a72-etc-systemd\") pod \"tuned-lndpt\" (UID: \"51eaaa01-f96a-4933-a1c3-54b7c1ac2a72\") " pod="openshift-cluster-node-tuning-operator/tuned-lndpt" Sep 19 08:20:54.495510 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.494532 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-host-run-netns\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.495510 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.494555 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-run-openvswitch\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.495510 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.494576 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/51eaaa01-f96a-4933-a1c3-54b7c1ac2a72-host\") pod \"tuned-lndpt\" (UID: \"51eaaa01-f96a-4933-a1c3-54b7c1ac2a72\") " pod="openshift-cluster-node-tuning-operator/tuned-lndpt" Sep 19 08:20:54.495510 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.494726 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1caf055c-966a-4aaf-92b0-22fe9332e753-socket-dir\") pod \"aws-ebs-csi-driver-node-89kkh\" (UID: \"1caf055c-966a-4aaf-92b0-22fe9332e753\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89kkh" Sep 19 08:20:54.495510 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.494789 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1caf055c-966a-4aaf-92b0-22fe9332e753-etc-selinux\") pod \"aws-ebs-csi-driver-node-89kkh\" (UID: \"1caf055c-966a-4aaf-92b0-22fe9332e753\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89kkh" Sep 19 08:20:54.495510 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.494832 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1caf055c-966a-4aaf-92b0-22fe9332e753-sys-fs\") pod \"aws-ebs-csi-driver-node-89kkh\" (UID: \"1caf055c-966a-4aaf-92b0-22fe9332e753\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89kkh" Sep 19 08:20:54.495510 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.494872 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/92a2d024-eab7-44e8-9886-867fe54981d0-agent-certs\") pod \"konnectivity-agent-qw5l5\" (UID: \"92a2d024-eab7-44e8-9886-867fe54981d0\") " pod="kube-system/konnectivity-agent-qw5l5" Sep 19 08:20:54.495510 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.494897 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/92a2d024-eab7-44e8-9886-867fe54981d0-konnectivity-ca\") pod \"konnectivity-agent-qw5l5\" (UID: \"92a2d024-eab7-44e8-9886-867fe54981d0\") " pod="kube-system/konnectivity-agent-qw5l5" Sep 19 08:20:54.495510 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.494934 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/340df34f-ef23-43c5-a79a-aa7bd01f7fda-host-slash\") pod \"iptables-alerter-hmhmw\" (UID: \"340df34f-ef23-43c5-a79a-aa7bd01f7fda\") " pod="openshift-network-operator/iptables-alerter-hmhmw" Sep 19 08:20:54.495510 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.494956 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55c84c99-604b-49d6-8ba9-01e04e3accda-cnibin\") pod \"multus-additional-cni-plugins-jgn8b\" (UID: \"55c84c99-604b-49d6-8ba9-01e04e3accda\") " pod="openshift-multus/multus-additional-cni-plugins-jgn8b" Sep 19 08:20:54.495510 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.495003 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee-host-var-lib-kubelet\") pod \"multus-x9knk\" (UID: \"dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee\") " pod="openshift-multus/multus-x9knk" Sep 19 08:20:54.495510 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.495044 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/51eaaa01-f96a-4933-a1c3-54b7c1ac2a72-tmp\") pod \"tuned-lndpt\" (UID: \"51eaaa01-f96a-4933-a1c3-54b7c1ac2a72\") " pod="openshift-cluster-node-tuning-operator/tuned-lndpt" Sep 19 08:20:54.496365 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.495088 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55c84c99-604b-49d6-8ba9-01e04e3accda-system-cni-dir\") pod \"multus-additional-cni-plugins-jgn8b\" (UID: \"55c84c99-604b-49d6-8ba9-01e04e3accda\") " pod="openshift-multus/multus-additional-cni-plugins-jgn8b" Sep 19 08:20:54.496365 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.495112 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee-host-run-multus-certs\") pod \"multus-x9knk\" (UID: \"dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee\") " pod="openshift-multus/multus-x9knk" Sep 19 08:20:54.496365 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.495166 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3a2c7d3-39cd-48fe-b472-cc9bb9cac54e-tmp-dir\") pod \"node-resolver-7mwjp\" (UID: \"e3a2c7d3-39cd-48fe-b472-cc9bb9cac54e\") " pod="openshift-dns/node-resolver-7mwjp" Sep 19 08:20:54.496365 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.495197 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-etc-openvswitch\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.496365 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.495220 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-log-socket\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.496365 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.495243 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55c84c99-604b-49d6-8ba9-01e04e3accda-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jgn8b\" (UID: \"55c84c99-604b-49d6-8ba9-01e04e3accda\") " pod="openshift-multus/multus-additional-cni-plugins-jgn8b" Sep 19 08:20:54.496365 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.495560 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee-multus-cni-dir\") pod \"multus-x9knk\" (UID: \"dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee\") " pod="openshift-multus/multus-x9knk" Sep 19 08:20:54.496365 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.495581 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee-multus-socket-dir-parent\") pod \"multus-x9knk\" (UID: \"dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee\") " pod="openshift-multus/multus-x9knk" Sep 19 08:20:54.496365 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.495594 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee-hostroot\") pod \"multus-x9knk\" (UID: \"dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee\") " pod="openshift-multus/multus-x9knk" Sep 19 08:20:54.496365 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.495606 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee-etc-kubernetes\") pod \"multus-x9knk\" (UID: \"dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee\") " pod="openshift-multus/multus-x9knk" Sep 19 08:20:54.496365 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.495620 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1caf055c-966a-4aaf-92b0-22fe9332e753-kubelet-dir\") pod \"aws-ebs-csi-driver-node-89kkh\" (UID: \"1caf055c-966a-4aaf-92b0-22fe9332e753\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89kkh" Sep 19 08:20:54.496365 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.495632 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bfdt\" (UniqueName: \"kubernetes.io/projected/340df34f-ef23-43c5-a79a-aa7bd01f7fda-kube-api-access-6bfdt\") pod \"iptables-alerter-hmhmw\" (UID: \"340df34f-ef23-43c5-a79a-aa7bd01f7fda\") " pod="openshift-network-operator/iptables-alerter-hmhmw" Sep 19 08:20:54.496365 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.495645 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee-host-run-netns\") pod \"multus-x9knk\" (UID: \"dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee\") " pod="openshift-multus/multus-x9knk" Sep 19 08:20:54.496365 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.495660 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-ovn-node-metrics-cert\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.496365 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.495675 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58jd8\" (UniqueName: \"kubernetes.io/projected/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-kube-api-access-58jd8\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.497217 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.497198 2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 19 08:20:54.520794 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.520768 2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zv74f" Sep 19 08:20:54.530066 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.529541 2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zv74f" Sep 19 08:20:54.581012 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.580942 2584 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 19 08:20:54.596218 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.596169 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/51eaaa01-f96a-4933-a1c3-54b7c1ac2a72-tmp\") pod \"tuned-lndpt\" (UID: \"51eaaa01-f96a-4933-a1c3-54b7c1ac2a72\") " pod="openshift-cluster-node-tuning-operator/tuned-lndpt" Sep 19 08:20:54.596360 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.596231 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55c84c99-604b-49d6-8ba9-01e04e3accda-system-cni-dir\") pod \"multus-additional-cni-plugins-jgn8b\" (UID: \"55c84c99-604b-49d6-8ba9-01e04e3accda\") " pod="openshift-multus/multus-additional-cni-plugins-jgn8b" Sep 19 08:20:54.596360 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.596278 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee-host-run-multus-certs\") pod \"multus-x9knk\" (UID: \"dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee\") " pod="openshift-multus/multus-x9knk" Sep 19 08:20:54.596360 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.596307 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3a2c7d3-39cd-48fe-b472-cc9bb9cac54e-tmp-dir\") pod \"node-resolver-7mwjp\" (UID: \"e3a2c7d3-39cd-48fe-b472-cc9bb9cac54e\") " pod="openshift-dns/node-resolver-7mwjp" Sep 19 08:20:54.596360 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.596331 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-etc-openvswitch\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.596360 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.596354 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-log-socket\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.596623 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.596378 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55c84c99-604b-49d6-8ba9-01e04e3accda-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jgn8b\" (UID: \"55c84c99-604b-49d6-8ba9-01e04e3accda\") " pod="openshift-multus/multus-additional-cni-plugins-jgn8b" Sep 19 08:20:54.596623 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.596403 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee-multus-cni-dir\") pod \"multus-x9knk\" (UID: \"dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee\") " pod="openshift-multus/multus-x9knk" Sep 19 08:20:54.596623 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.596425 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee-multus-socket-dir-parent\") pod \"multus-x9knk\" (UID: \"dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee\") " pod="openshift-multus/multus-x9knk" Sep 19 08:20:54.596623 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.596493 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee-hostroot\") pod \"multus-x9knk\" (UID: \"dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee\") " pod="openshift-multus/multus-x9knk" Sep 19 08:20:54.596623 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.596531 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee-etc-kubernetes\") pod \"multus-x9knk\" (UID: \"dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee\") " pod="openshift-multus/multus-x9knk" Sep 19 08:20:54.596623 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.596551 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1caf055c-966a-4aaf-92b0-22fe9332e753-kubelet-dir\") pod \"aws-ebs-csi-driver-node-89kkh\" (UID: \"1caf055c-966a-4aaf-92b0-22fe9332e753\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89kkh" Sep 19 08:20:54.596623 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.596566 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bfdt\" (UniqueName: \"kubernetes.io/projected/340df34f-ef23-43c5-a79a-aa7bd01f7fda-kube-api-access-6bfdt\") pod \"iptables-alerter-hmhmw\" (UID: \"340df34f-ef23-43c5-a79a-aa7bd01f7fda\") " pod="openshift-network-operator/iptables-alerter-hmhmw" Sep 19 08:20:54.596623 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.596583 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee-host-run-netns\") pod \"multus-x9knk\" (UID: \"dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee\") " pod="openshift-multus/multus-x9knk" Sep 19 08:20:54.596623 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.596611 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-ovn-node-metrics-cert\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.597062 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.596631 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58jd8\" (UniqueName: \"kubernetes.io/projected/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-kube-api-access-58jd8\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.597062 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.596657 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/06d9bb1e-838b-4f04-9ff4-f668714c7877-kubelet-config\") pod \"global-pull-secret-syncer-xgprw\" (UID: \"06d9bb1e-838b-4f04-9ff4-f668714c7877\") " pod="kube-system/global-pull-secret-syncer-xgprw" Sep 19 08:20:54.597062 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.596663 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55c84c99-604b-49d6-8ba9-01e04e3accda-system-cni-dir\") pod \"multus-additional-cni-plugins-jgn8b\" (UID: \"55c84c99-604b-49d6-8ba9-01e04e3accda\") " pod="openshift-multus/multus-additional-cni-plugins-jgn8b" Sep 19 08:20:54.597062 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.596682 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/06d9bb1e-838b-4f04-9ff4-f668714c7877-dbus\") pod \"global-pull-secret-syncer-xgprw\" (UID: \"06d9bb1e-838b-4f04-9ff4-f668714c7877\") " pod="kube-system/global-pull-secret-syncer-xgprw" Sep 19 08:20:54.597062 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.596707 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqw8z\" (UniqueName: \"kubernetes.io/projected/35c26dae-8ddc-4ea9-b6d7-6de02274508c-kube-api-access-tqw8z\") pod \"network-metrics-daemon-kqz5p\" (UID: \"35c26dae-8ddc-4ea9-b6d7-6de02274508c\") " pod="openshift-multus/network-metrics-daemon-kqz5p" Sep 19 08:20:54.597062 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.596730 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e3a2c7d3-39cd-48fe-b472-cc9bb9cac54e-hosts-file\") pod \"node-resolver-7mwjp\" (UID: \"e3a2c7d3-39cd-48fe-b472-cc9bb9cac54e\") " pod="openshift-dns/node-resolver-7mwjp" Sep 19 08:20:54.597062 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.596745 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-host-run-ovn-kubernetes\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.597062 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.596836 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdvjv\" (UniqueName: \"kubernetes.io/projected/1caf055c-966a-4aaf-92b0-22fe9332e753-kube-api-access-bdvjv\") pod \"aws-ebs-csi-driver-node-89kkh\" (UID: \"1caf055c-966a-4aaf-92b0-22fe9332e753\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89kkh" Sep 19 08:20:54.597062 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.596869 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-run-systemd\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.597062 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.596894 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-node-log\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.597062 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.596917 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e4d94997-9978-4be2-b81c-3a610fd1b54e-serviceca\") pod \"node-ca-vlbrv\" (UID: \"e4d94997-9978-4be2-b81c-3a610fd1b54e\") " pod="openshift-image-registry/node-ca-vlbrv" Sep 19 08:20:54.597062 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.596938 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/51eaaa01-f96a-4933-a1c3-54b7c1ac2a72-etc-tuned\") pod \"tuned-lndpt\" (UID: \"51eaaa01-f96a-4933-a1c3-54b7c1ac2a72\") " pod="openshift-cluster-node-tuning-operator/tuned-lndpt" Sep 19 08:20:54.597062 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.596974 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1caf055c-966a-4aaf-92b0-22fe9332e753-device-dir\") pod \"aws-ebs-csi-driver-node-89kkh\" (UID: \"1caf055c-966a-4aaf-92b0-22fe9332e753\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89kkh" Sep 19 08:20:54.597062 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.596999 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/55c84c99-604b-49d6-8ba9-01e04e3accda-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jgn8b\" (UID: \"55c84c99-604b-49d6-8ba9-01e04e3accda\") " pod="openshift-multus/multus-additional-cni-plugins-jgn8b" Sep 19 08:20:54.597062 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.597011 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-etc-openvswitch\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.597062 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.597024 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mrtz\" (UniqueName: \"kubernetes.io/projected/55c84c99-604b-49d6-8ba9-01e04e3accda-kube-api-access-4mrtz\") pod \"multus-additional-cni-plugins-jgn8b\" (UID: \"55c84c99-604b-49d6-8ba9-01e04e3accda\") " pod="openshift-multus/multus-additional-cni-plugins-jgn8b" Sep 19 08:20:54.597062 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.597058 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-log-socket\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.597866 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.597101 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e4d94997-9978-4be2-b81c-3a610fd1b54e-host\") pod \"node-ca-vlbrv\" (UID: \"e4d94997-9978-4be2-b81c-3a610fd1b54e\") " pod="openshift-image-registry/node-ca-vlbrv" Sep 19 08:20:54.597866 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.597149 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51eaaa01-f96a-4933-a1c3-54b7c1ac2a72-etc-kubernetes\") pod \"tuned-lndpt\" (UID: \"51eaaa01-f96a-4933-a1c3-54b7c1ac2a72\") " pod="openshift-cluster-node-tuning-operator/tuned-lndpt" Sep 19 08:20:54.597866 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.597199 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/51eaaa01-f96a-4933-a1c3-54b7c1ac2a72-etc-sysctl-d\") pod \"tuned-lndpt\" (UID: \"51eaaa01-f96a-4933-a1c3-54b7c1ac2a72\") " pod="openshift-cluster-node-tuning-operator/tuned-lndpt" Sep 19 08:20:54.597866 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.597221 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/51eaaa01-f96a-4933-a1c3-54b7c1ac2a72-sys\") pod \"tuned-lndpt\" (UID: \"51eaaa01-f96a-4933-a1c3-54b7c1ac2a72\") " pod="openshift-cluster-node-tuning-operator/tuned-lndpt" Sep 19 08:20:54.597866 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.597224 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55c84c99-604b-49d6-8ba9-01e04e3accda-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jgn8b\" (UID: \"55c84c99-604b-49d6-8ba9-01e04e3accda\") " pod="openshift-multus/multus-additional-cni-plugins-jgn8b" Sep 19 08:20:54.597866 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.597249 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/55c84c99-604b-49d6-8ba9-01e04e3accda-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jgn8b\" (UID: \"55c84c99-604b-49d6-8ba9-01e04e3accda\") " pod="openshift-multus/multus-additional-cni-plugins-jgn8b" Sep 19 08:20:54.597866 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.597272 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee-cnibin\") pod \"multus-x9knk\" (UID: \"dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee\") " pod="openshift-multus/multus-x9knk" Sep 19 08:20:54.597866 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.597275 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee-etc-kubernetes\") pod \"multus-x9knk\" (UID: \"dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee\") " pod="openshift-multus/multus-x9knk" Sep 19 08:20:54.597866 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.597310 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee-multus-conf-dir\") pod \"multus-x9knk\" (UID: \"dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee\") " pod="openshift-multus/multus-x9knk" Sep 19 08:20:54.597866 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.597336 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee-cnibin\") pod \"multus-x9knk\" (UID: \"dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee\") " pod="openshift-multus/multus-x9knk" Sep 19 08:20:54.597866 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.597336 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee-multus-daemon-config\") pod \"multus-x9knk\" (UID: \"dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee\") " pod="openshift-multus/multus-x9knk" Sep 19 08:20:54.597866 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.596728 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee-host-run-multus-certs\") pod \"multus-x9knk\" (UID: \"dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee\") " pod="openshift-multus/multus-x9knk" Sep 19 08:20:54.597866 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.597362 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-var-lib-openvswitch\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.597866 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.597376 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-host-run-ovn-kubernetes\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.597866 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.597389 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/51eaaa01-f96a-4933-a1c3-54b7c1ac2a72-etc-sysctl-conf\") pod \"tuned-lndpt\" (UID: \"51eaaa01-f96a-4933-a1c3-54b7c1ac2a72\") " pod="openshift-cluster-node-tuning-operator/tuned-lndpt" Sep 19 08:20:54.597866 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.597413 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/51eaaa01-f96a-4933-a1c3-54b7c1ac2a72-run\") pod \"tuned-lndpt\" (UID: \"51eaaa01-f96a-4933-a1c3-54b7c1ac2a72\") " pod="openshift-cluster-node-tuning-operator/tuned-lndpt" Sep 19 08:20:54.597866 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.597440 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06d9bb1e-838b-4f04-9ff4-f668714c7877-original-pull-secret\") pod \"global-pull-secret-syncer-xgprw\" (UID: \"06d9bb1e-838b-4f04-9ff4-f668714c7877\") " pod="kube-system/global-pull-secret-syncer-xgprw" Sep 19 08:20:54.597866 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.597465 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/340df34f-ef23-43c5-a79a-aa7bd01f7fda-iptables-alerter-script\") pod \"iptables-alerter-hmhmw\" (UID: \"340df34f-ef23-43c5-a79a-aa7bd01f7fda\") " pod="openshift-network-operator/iptables-alerter-hmhmw" Sep 19 08:20:54.598742 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.597494 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee-host-run-k8s-cni-cncf-io\") pod \"multus-x9knk\" (UID: \"dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee\") " pod="openshift-multus/multus-x9knk" Sep 19 08:20:54.598742 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.597518 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-host-cni-netd\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.598742 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.597547 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee-hostroot\") pod \"multus-x9knk\" (UID: \"dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee\") " pod="openshift-multus/multus-x9knk" Sep 19 08:20:54.598742 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.597552 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-ovnkube-config\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.598742 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.597584 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-run-systemd\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.598742 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.597591 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/51eaaa01-f96a-4933-a1c3-54b7c1ac2a72-etc-modprobe-d\") pod \"tuned-lndpt\" (UID: \"51eaaa01-f96a-4933-a1c3-54b7c1ac2a72\") " pod="openshift-cluster-node-tuning-operator/tuned-lndpt" Sep 19 08:20:54.598742 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.597611 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-node-log\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.598742 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.597617 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nnvq\" (UniqueName: \"kubernetes.io/projected/51eaaa01-f96a-4933-a1c3-54b7c1ac2a72-kube-api-access-8nnvq\") pod \"tuned-lndpt\" (UID: \"51eaaa01-f96a-4933-a1c3-54b7c1ac2a72\") " pod="openshift-cluster-node-tuning-operator/tuned-lndpt" Sep 19 08:20:54.598742 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.597655 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee-cni-binary-copy\") pod \"multus-x9knk\" (UID: \"dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee\") " pod="openshift-multus/multus-x9knk" Sep 19 08:20:54.598742 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.597681 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee-host-var-lib-cni-multus\") pod \"multus-x9knk\" (UID: \"dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee\") " pod="openshift-multus/multus-x9knk" Sep 19 08:20:54.598742 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.597705 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-systemd-units\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.598742 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.597729 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ppk9\" (UniqueName: \"kubernetes.io/projected/e4d94997-9978-4be2-b81c-3a610fd1b54e-kube-api-access-6ppk9\") pod \"node-ca-vlbrv\" (UID: \"e4d94997-9978-4be2-b81c-3a610fd1b54e\") " pod="openshift-image-registry/node-ca-vlbrv" Sep 19 08:20:54.598742 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.597756 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtrgm\" (UniqueName: \"kubernetes.io/projected/1f40898d-6f69-48bc-8af6-3224a163f776-kube-api-access-xtrgm\") pod \"network-check-target-h2qgv\" (UID: \"1f40898d-6f69-48bc-8af6-3224a163f776\") " pod="openshift-network-diagnostics/network-check-target-h2qgv" Sep 19 08:20:54.598742 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.597790 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1caf055c-966a-4aaf-92b0-22fe9332e753-registration-dir\") pod \"aws-ebs-csi-driver-node-89kkh\" (UID: \"1caf055c-966a-4aaf-92b0-22fe9332e753\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89kkh" Sep 19 08:20:54.598742 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.597816 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55c84c99-604b-49d6-8ba9-01e04e3accda-cni-binary-copy\") pod \"multus-additional-cni-plugins-jgn8b\" (UID: \"55c84c99-604b-49d6-8ba9-01e04e3accda\") " pod="openshift-multus/multus-additional-cni-plugins-jgn8b" Sep 19 08:20:54.598742 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.597843 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee-system-cni-dir\") pod \"multus-x9knk\" (UID: \"dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee\") " pod="openshift-multus/multus-x9knk" Sep 19 08:20:54.598742 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.597865 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-host-cni-bin\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.599541 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.597890 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4khrw\" (UniqueName: \"kubernetes.io/projected/e3a2c7d3-39cd-48fe-b472-cc9bb9cac54e-kube-api-access-4khrw\") pod \"node-resolver-7mwjp\" (UID: \"e3a2c7d3-39cd-48fe-b472-cc9bb9cac54e\") " pod="openshift-dns/node-resolver-7mwjp" Sep 19 08:20:54.599541 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.597913 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-host-slash\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.599541 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.596606 2584 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 19 08:20:54.599541 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.597937 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-run-ovn\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.599541 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.597961 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/51eaaa01-f96a-4933-a1c3-54b7c1ac2a72-lib-modules\") pod \"tuned-lndpt\" (UID: \"51eaaa01-f96a-4933-a1c3-54b7c1ac2a72\") " pod="openshift-cluster-node-tuning-operator/tuned-lndpt" Sep 19 08:20:54.599541 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.597988 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee-host-var-lib-cni-bin\") pod \"multus-x9knk\" (UID: \"dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee\") " pod="openshift-multus/multus-x9knk" Sep 19 08:20:54.599541 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.598012 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vlx9\" (UniqueName: \"kubernetes.io/projected/dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee-kube-api-access-6vlx9\") pod \"multus-x9knk\" (UID: \"dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee\") " pod="openshift-multus/multus-x9knk" Sep 19 08:20:54.599541 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.598025 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e4d94997-9978-4be2-b81c-3a610fd1b54e-serviceca\") pod \"node-ca-vlbrv\" (UID: \"e4d94997-9978-4be2-b81c-3a610fd1b54e\") " pod="openshift-image-registry/node-ca-vlbrv" Sep 19 08:20:54.599541 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.598046 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35c26dae-8ddc-4ea9-b6d7-6de02274508c-metrics-certs\") pod \"network-metrics-daemon-kqz5p\" (UID: \"35c26dae-8ddc-4ea9-b6d7-6de02274508c\") " pod="openshift-multus/network-metrics-daemon-kqz5p" Sep 19 08:20:54.599541 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.598089 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-ovnkube-script-lib\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.599541 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.598114 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-ovnkube-config\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.599541 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.598141 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1caf055c-966a-4aaf-92b0-22fe9332e753-device-dir\") pod \"aws-ebs-csi-driver-node-89kkh\" (UID: \"1caf055c-966a-4aaf-92b0-22fe9332e753\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89kkh" Sep 19 08:20:54.599541 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.596973 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3a2c7d3-39cd-48fe-b472-cc9bb9cac54e-tmp-dir\") pod \"node-resolver-7mwjp\" (UID: \"e3a2c7d3-39cd-48fe-b472-cc9bb9cac54e\") " pod="openshift-dns/node-resolver-7mwjp" Sep 19 08:20:54.599541 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.598381 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1caf055c-966a-4aaf-92b0-22fe9332e753-kubelet-dir\") pod \"aws-ebs-csi-driver-node-89kkh\" (UID: \"1caf055c-966a-4aaf-92b0-22fe9332e753\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89kkh" Sep 19 08:20:54.599541 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.598598 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee-host-run-netns\") pod \"multus-x9knk\" (UID: \"dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee\") " pod="openshift-multus/multus-x9knk" Sep 19 08:20:54.599541 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.598656 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee-cni-binary-copy\") pod \"multus-x9knk\" (UID: \"dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee\") " pod="openshift-multus/multus-x9knk" Sep 19 08:20:54.599541 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.598661 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee-multus-socket-dir-parent\") pod \"multus-x9knk\" (UID: \"dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee\") " pod="openshift-multus/multus-x9knk" Sep 19 08:20:54.599541 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.598699 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/55c84c99-604b-49d6-8ba9-01e04e3accda-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jgn8b\" (UID: \"55c84c99-604b-49d6-8ba9-01e04e3accda\") " pod="openshift-multus/multus-additional-cni-plugins-jgn8b" Sep 19 08:20:54.600430 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.598722 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee-host-var-lib-cni-multus\") pod \"multus-x9knk\" (UID: \"dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee\") " pod="openshift-multus/multus-x9knk" Sep 19 08:20:54.600430 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.598702 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee-multus-conf-dir\") pod \"multus-x9knk\" (UID: \"dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee\") " pod="openshift-multus/multus-x9knk" Sep 19 08:20:54.600430 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.598774 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-systemd-units\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.600430 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.598936 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee-multus-cni-dir\") pod \"multus-x9knk\" (UID: \"dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee\") " pod="openshift-multus/multus-x9knk" Sep 19 08:20:54.600430 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.599023 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee-host-var-lib-cni-bin\") pod \"multus-x9knk\" (UID: \"dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee\") " pod="openshift-multus/multus-x9knk" Sep 19 08:20:54.600430 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.599067 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/51eaaa01-f96a-4933-a1c3-54b7c1ac2a72-lib-modules\") pod \"tuned-lndpt\" (UID: \"51eaaa01-f96a-4933-a1c3-54b7c1ac2a72\") " pod="openshift-cluster-node-tuning-operator/tuned-lndpt" Sep 19 08:20:54.600430 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.599137 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-host-cni-bin\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.600430 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.599139 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51eaaa01-f96a-4933-a1c3-54b7c1ac2a72-etc-kubernetes\") pod \"tuned-lndpt\" (UID: \"51eaaa01-f96a-4933-a1c3-54b7c1ac2a72\") " pod="openshift-cluster-node-tuning-operator/tuned-lndpt" Sep 19 08:20:54.600430 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.599166 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/51eaaa01-f96a-4933-a1c3-54b7c1ac2a72-sys\") pod \"tuned-lndpt\" (UID: \"51eaaa01-f96a-4933-a1c3-54b7c1ac2a72\") " pod="openshift-cluster-node-tuning-operator/tuned-lndpt" Sep 19 08:20:54.600430 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.599209 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1caf055c-966a-4aaf-92b0-22fe9332e753-registration-dir\") pod \"aws-ebs-csi-driver-node-89kkh\" (UID: \"1caf055c-966a-4aaf-92b0-22fe9332e753\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89kkh" Sep 19 08:20:54.600430 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.599252 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-var-lib-openvswitch\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.600430 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:54.599293 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 08:20:54.600430 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.599302 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/51eaaa01-f96a-4933-a1c3-54b7c1ac2a72-etc-sysctl-conf\") pod \"tuned-lndpt\" (UID: \"51eaaa01-f96a-4933-a1c3-54b7c1ac2a72\") " pod="openshift-cluster-node-tuning-operator/tuned-lndpt" Sep 19 08:20:54.600430 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.599311 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-host-slash\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.600430 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.599364 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/51eaaa01-f96a-4933-a1c3-54b7c1ac2a72-run\") pod \"tuned-lndpt\" (UID: \"51eaaa01-f96a-4933-a1c3-54b7c1ac2a72\") " pod="openshift-cluster-node-tuning-operator/tuned-lndpt" Sep 19 08:20:54.600430 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:54.599404 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35c26dae-8ddc-4ea9-b6d7-6de02274508c-metrics-certs podName:35c26dae-8ddc-4ea9-b6d7-6de02274508c nodeName:}" failed. No retries permitted until 2026-09-19 08:20:55.099341508 +0000 UTC m=+4.829438091 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35c26dae-8ddc-4ea9-b6d7-6de02274508c-metrics-certs") pod "network-metrics-daemon-kqz5p" (UID: "35c26dae-8ddc-4ea9-b6d7-6de02274508c") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 08:20:54.600430 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:54.599423 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 19 08:20:54.601246 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:54.599465 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06d9bb1e-838b-4f04-9ff4-f668714c7877-original-pull-secret podName:06d9bb1e-838b-4f04-9ff4-f668714c7877 nodeName:}" failed. No retries permitted until 2026-09-19 08:20:55.099450032 +0000 UTC m=+4.829546638 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/06d9bb1e-838b-4f04-9ff4-f668714c7877-original-pull-secret") pod "global-pull-secret-syncer-xgprw" (UID: "06d9bb1e-838b-4f04-9ff4-f668714c7877") : object "kube-system"/"original-pull-secret" not registered Sep 19 08:20:54.601246 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.599507 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-run-ovn\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.601246 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.599088 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/51eaaa01-f96a-4933-a1c3-54b7c1ac2a72-etc-sysctl-d\") pod \"tuned-lndpt\" (UID: \"51eaaa01-f96a-4933-a1c3-54b7c1ac2a72\") " pod="openshift-cluster-node-tuning-operator/tuned-lndpt" Sep 19 08:20:54.601246 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.599553 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e4d94997-9978-4be2-b81c-3a610fd1b54e-host\") pod \"node-ca-vlbrv\" (UID: \"e4d94997-9978-4be2-b81c-3a610fd1b54e\") " pod="openshift-image-registry/node-ca-vlbrv" Sep 19 08:20:54.601246 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.597517 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e3a2c7d3-39cd-48fe-b472-cc9bb9cac54e-hosts-file\") pod \"node-resolver-7mwjp\" (UID: \"e3a2c7d3-39cd-48fe-b472-cc9bb9cac54e\") " pod="openshift-dns/node-resolver-7mwjp" Sep 19 08:20:54.601246 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.599599 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee-host-run-k8s-cni-cncf-io\") pod \"multus-x9knk\" (UID: \"dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee\") " pod="openshift-multus/multus-x9knk" Sep 19 08:20:54.601246 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.599641 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-host-cni-netd\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.601246 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.599756 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/340df34f-ef23-43c5-a79a-aa7bd01f7fda-iptables-alerter-script\") pod \"iptables-alerter-hmhmw\" (UID: \"340df34f-ef23-43c5-a79a-aa7bd01f7fda\") " pod="openshift-network-operator/iptables-alerter-hmhmw" Sep 19 08:20:54.601246 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.598116 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/51eaaa01-f96a-4933-a1c3-54b7c1ac2a72-etc-sysconfig\") pod \"tuned-lndpt\" (UID: \"51eaaa01-f96a-4933-a1c3-54b7c1ac2a72\") " pod="openshift-cluster-node-tuning-operator/tuned-lndpt" Sep 19 08:20:54.601246 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.599799 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/51eaaa01-f96a-4933-a1c3-54b7c1ac2a72-var-lib-kubelet\") pod \"tuned-lndpt\" (UID: \"51eaaa01-f96a-4933-a1c3-54b7c1ac2a72\") " pod="openshift-cluster-node-tuning-operator/tuned-lndpt" Sep 19 08:20:54.601246 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.599815 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-host-kubelet\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.601246 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.599823 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55c84c99-604b-49d6-8ba9-01e04e3accda-cni-binary-copy\") pod \"multus-additional-cni-plugins-jgn8b\" (UID: \"55c84c99-604b-49d6-8ba9-01e04e3accda\") " pod="openshift-multus/multus-additional-cni-plugins-jgn8b" Sep 19 08:20:54.601246 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.599838 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.601246 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.599840 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/55c84c99-604b-49d6-8ba9-01e04e3accda-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jgn8b\" (UID: \"55c84c99-604b-49d6-8ba9-01e04e3accda\") " pod="openshift-multus/multus-additional-cni-plugins-jgn8b" Sep 19 08:20:54.601246 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.599866 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.601246 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.599887 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-env-overrides\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.601991 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.599905 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee-system-cni-dir\") pod \"multus-x9knk\" (UID: \"dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee\") " pod="openshift-multus/multus-x9knk" Sep 19 08:20:54.601991 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.599913 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/51eaaa01-f96a-4933-a1c3-54b7c1ac2a72-etc-systemd\") pod \"tuned-lndpt\" (UID: \"51eaaa01-f96a-4933-a1c3-54b7c1ac2a72\") " pod="openshift-cluster-node-tuning-operator/tuned-lndpt" Sep 19 08:20:54.601991 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.599952 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/51eaaa01-f96a-4933-a1c3-54b7c1ac2a72-var-lib-kubelet\") pod \"tuned-lndpt\" (UID: \"51eaaa01-f96a-4933-a1c3-54b7c1ac2a72\") " pod="openshift-cluster-node-tuning-operator/tuned-lndpt" Sep 19 08:20:54.601991 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.599213 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee-multus-daemon-config\") pod \"multus-x9knk\" (UID: \"dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee\") " pod="openshift-multus/multus-x9knk" Sep 19 08:20:54.601991 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.599966 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-host-run-netns\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.601991 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.600004 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-host-kubelet\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.601991 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.599991 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-ovnkube-script-lib\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.601991 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.600016 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-run-openvswitch\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.601991 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.600042 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/51eaaa01-f96a-4933-a1c3-54b7c1ac2a72-host\") pod \"tuned-lndpt\" (UID: \"51eaaa01-f96a-4933-a1c3-54b7c1ac2a72\") " pod="openshift-cluster-node-tuning-operator/tuned-lndpt" Sep 19 08:20:54.601991 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.600098 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1caf055c-966a-4aaf-92b0-22fe9332e753-socket-dir\") pod \"aws-ebs-csi-driver-node-89kkh\" (UID: \"1caf055c-966a-4aaf-92b0-22fe9332e753\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89kkh" Sep 19 08:20:54.601991 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.600104 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/51eaaa01-f96a-4933-a1c3-54b7c1ac2a72-etc-modprobe-d\") pod \"tuned-lndpt\" (UID: \"51eaaa01-f96a-4933-a1c3-54b7c1ac2a72\") " pod="openshift-cluster-node-tuning-operator/tuned-lndpt" Sep 19 08:20:54.601991 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.600127 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1caf055c-966a-4aaf-92b0-22fe9332e753-etc-selinux\") pod \"aws-ebs-csi-driver-node-89kkh\" (UID: \"1caf055c-966a-4aaf-92b0-22fe9332e753\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89kkh" Sep 19 08:20:54.601991 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.600153 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1caf055c-966a-4aaf-92b0-22fe9332e753-sys-fs\") pod \"aws-ebs-csi-driver-node-89kkh\" (UID: \"1caf055c-966a-4aaf-92b0-22fe9332e753\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89kkh" Sep 19 08:20:54.601991 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.600177 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/92a2d024-eab7-44e8-9886-867fe54981d0-agent-certs\") pod \"konnectivity-agent-qw5l5\" (UID: \"92a2d024-eab7-44e8-9886-867fe54981d0\") " pod="kube-system/konnectivity-agent-qw5l5" Sep 19 08:20:54.601991 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.600202 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/92a2d024-eab7-44e8-9886-867fe54981d0-konnectivity-ca\") pod \"konnectivity-agent-qw5l5\" (UID: \"92a2d024-eab7-44e8-9886-867fe54981d0\") " pod="kube-system/konnectivity-agent-qw5l5" Sep 19 08:20:54.601991 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.599917 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/51eaaa01-f96a-4933-a1c3-54b7c1ac2a72-etc-sysconfig\") pod \"tuned-lndpt\" (UID: \"51eaaa01-f96a-4933-a1c3-54b7c1ac2a72\") " pod="openshift-cluster-node-tuning-operator/tuned-lndpt" Sep 19 08:20:54.601991 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.600254 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/340df34f-ef23-43c5-a79a-aa7bd01f7fda-host-slash\") pod \"iptables-alerter-hmhmw\" (UID: \"340df34f-ef23-43c5-a79a-aa7bd01f7fda\") " pod="openshift-network-operator/iptables-alerter-hmhmw" Sep 19 08:20:54.602847 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.600257 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1caf055c-966a-4aaf-92b0-22fe9332e753-etc-selinux\") pod \"aws-ebs-csi-driver-node-89kkh\" (UID: \"1caf055c-966a-4aaf-92b0-22fe9332e753\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89kkh" Sep 19 08:20:54.602847 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.600255 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/06d9bb1e-838b-4f04-9ff4-f668714c7877-kubelet-config\") pod \"global-pull-secret-syncer-xgprw\" (UID: \"06d9bb1e-838b-4f04-9ff4-f668714c7877\") " pod="kube-system/global-pull-secret-syncer-xgprw" Sep 19 08:20:54.602847 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.600266 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-env-overrides\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.602847 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.600187 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/51eaaa01-f96a-4933-a1c3-54b7c1ac2a72-etc-systemd\") pod \"tuned-lndpt\" (UID: \"51eaaa01-f96a-4933-a1c3-54b7c1ac2a72\") " pod="openshift-cluster-node-tuning-operator/tuned-lndpt" Sep 19 08:20:54.602847 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.600298 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/06d9bb1e-838b-4f04-9ff4-f668714c7877-dbus\") pod \"global-pull-secret-syncer-xgprw\" (UID: \"06d9bb1e-838b-4f04-9ff4-f668714c7877\") " pod="kube-system/global-pull-secret-syncer-xgprw" Sep 19 08:20:54.602847 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.600155 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-host-run-netns\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.602847 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.600330 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1caf055c-966a-4aaf-92b0-22fe9332e753-sys-fs\") pod \"aws-ebs-csi-driver-node-89kkh\" (UID: \"1caf055c-966a-4aaf-92b0-22fe9332e753\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89kkh" Sep 19 08:20:54.602847 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.600340 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55c84c99-604b-49d6-8ba9-01e04e3accda-cnibin\") pod \"multus-additional-cni-plugins-jgn8b\" (UID: \"55c84c99-604b-49d6-8ba9-01e04e3accda\") " pod="openshift-multus/multus-additional-cni-plugins-jgn8b" Sep 19 08:20:54.602847 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.600363 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee-host-var-lib-kubelet\") pod \"multus-x9knk\" (UID: \"dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee\") " pod="openshift-multus/multus-x9knk" Sep 19 08:20:54.602847 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.600377 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/340df34f-ef23-43c5-a79a-aa7bd01f7fda-host-slash\") pod \"iptables-alerter-hmhmw\" (UID: \"340df34f-ef23-43c5-a79a-aa7bd01f7fda\") " pod="openshift-network-operator/iptables-alerter-hmhmw" Sep 19 08:20:54.602847 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.600326 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-run-openvswitch\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.602847 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.600395 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/51eaaa01-f96a-4933-a1c3-54b7c1ac2a72-host\") pod \"tuned-lndpt\" (UID: \"51eaaa01-f96a-4933-a1c3-54b7c1ac2a72\") " pod="openshift-cluster-node-tuning-operator/tuned-lndpt" Sep 19 08:20:54.602847 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.600437 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1caf055c-966a-4aaf-92b0-22fe9332e753-socket-dir\") pod \"aws-ebs-csi-driver-node-89kkh\" (UID: \"1caf055c-966a-4aaf-92b0-22fe9332e753\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89kkh" Sep 19 08:20:54.602847 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.600517 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55c84c99-604b-49d6-8ba9-01e04e3accda-cnibin\") pod \"multus-additional-cni-plugins-jgn8b\" (UID: \"55c84c99-604b-49d6-8ba9-01e04e3accda\") " pod="openshift-multus/multus-additional-cni-plugins-jgn8b" Sep 19 08:20:54.602847 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.600515 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee-host-var-lib-kubelet\") pod \"multus-x9knk\" (UID: \"dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee\") " pod="openshift-multus/multus-x9knk" Sep 19 08:20:54.602847 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.600845 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/92a2d024-eab7-44e8-9886-867fe54981d0-konnectivity-ca\") pod \"konnectivity-agent-qw5l5\" (UID: \"92a2d024-eab7-44e8-9886-867fe54981d0\") " pod="kube-system/konnectivity-agent-qw5l5" Sep 19 08:20:54.603615 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.603475 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/51eaaa01-f96a-4933-a1c3-54b7c1ac2a72-etc-tuned\") pod \"tuned-lndpt\" (UID: \"51eaaa01-f96a-4933-a1c3-54b7c1ac2a72\") " pod="openshift-cluster-node-tuning-operator/tuned-lndpt" Sep 19 08:20:54.604696 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.604673 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/92a2d024-eab7-44e8-9886-867fe54981d0-agent-certs\") pod \"konnectivity-agent-qw5l5\" (UID: \"92a2d024-eab7-44e8-9886-867fe54981d0\") " pod="kube-system/konnectivity-agent-qw5l5" Sep 19 08:20:54.607342 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.607319 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-ovn-node-metrics-cert\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.609441 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.607887 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdvjv\" (UniqueName: \"kubernetes.io/projected/1caf055c-966a-4aaf-92b0-22fe9332e753-kube-api-access-bdvjv\") pod \"aws-ebs-csi-driver-node-89kkh\" (UID: \"1caf055c-966a-4aaf-92b0-22fe9332e753\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89kkh" Sep 19 08:20:54.609441 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.608166 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nnvq\" (UniqueName: \"kubernetes.io/projected/51eaaa01-f96a-4933-a1c3-54b7c1ac2a72-kube-api-access-8nnvq\") pod \"tuned-lndpt\" (UID: \"51eaaa01-f96a-4933-a1c3-54b7c1ac2a72\") " pod="openshift-cluster-node-tuning-operator/tuned-lndpt" Sep 19 08:20:54.611129 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.610663 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqw8z\" (UniqueName: \"kubernetes.io/projected/35c26dae-8ddc-4ea9-b6d7-6de02274508c-kube-api-access-tqw8z\") pod \"network-metrics-daemon-kqz5p\" (UID: \"35c26dae-8ddc-4ea9-b6d7-6de02274508c\") " pod="openshift-multus/network-metrics-daemon-kqz5p" Sep 19 08:20:54.612557 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.612271 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bfdt\" (UniqueName: \"kubernetes.io/projected/340df34f-ef23-43c5-a79a-aa7bd01f7fda-kube-api-access-6bfdt\") pod \"iptables-alerter-hmhmw\" (UID: \"340df34f-ef23-43c5-a79a-aa7bd01f7fda\") " pod="openshift-network-operator/iptables-alerter-hmhmw" Sep 19 08:20:54.613693 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:54.613372 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 19 08:20:54.613693 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:54.613401 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 19 08:20:54.613693 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:54.613421 2584 projected.go:196] Error preparing data for projected volume kube-api-access-xtrgm for pod openshift-network-diagnostics/network-check-target-h2qgv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 08:20:54.613693 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:54.613652 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f40898d-6f69-48bc-8af6-3224a163f776-kube-api-access-xtrgm podName:1f40898d-6f69-48bc-8af6-3224a163f776 nodeName:}" failed. No retries permitted until 2026-09-19 08:20:55.113611989 +0000 UTC m=+4.843708593 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xtrgm" (UniqueName: "kubernetes.io/projected/1f40898d-6f69-48bc-8af6-3224a163f776-kube-api-access-xtrgm") pod "network-check-target-h2qgv" (UID: "1f40898d-6f69-48bc-8af6-3224a163f776") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 08:20:54.615669 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.615650 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/51eaaa01-f96a-4933-a1c3-54b7c1ac2a72-tmp\") pod \"tuned-lndpt\" (UID: \"51eaaa01-f96a-4933-a1c3-54b7c1ac2a72\") " pod="openshift-cluster-node-tuning-operator/tuned-lndpt" Sep 19 08:20:54.616803 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.616749 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-96.ec2.internal" event={"ID":"ad2de051a5bf26d24a7aa54eba31ddad","Type":"ContainerStarted","Data":"c5ba167e9919d04ad0ccb3545433c4fe18fa45bdd07509c41f5cde42b3be7add"} Sep 19 08:20:54.617916 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.617893 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vlx9\" (UniqueName: \"kubernetes.io/projected/dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee-kube-api-access-6vlx9\") pod \"multus-x9knk\" (UID: \"dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee\") " pod="openshift-multus/multus-x9knk" Sep 19 08:20:54.618914 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.618886 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-96.ec2.internal" event={"ID":"bb1f3dcffd05d522e85d0257d7561dec","Type":"ContainerStarted","Data":"27947633b47ad7ec27b7e845b239a2cffee31461ac7c405f04e1e0c279e1fd32"} Sep 19 08:20:54.620052 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.619806 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58jd8\" (UniqueName: \"kubernetes.io/projected/3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136-kube-api-access-58jd8\") pod \"ovnkube-node-l2hqv\" (UID: \"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136\") " pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.620661 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.620605 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ppk9\" (UniqueName: \"kubernetes.io/projected/e4d94997-9978-4be2-b81c-3a610fd1b54e-kube-api-access-6ppk9\") pod \"node-ca-vlbrv\" (UID: \"e4d94997-9978-4be2-b81c-3a610fd1b54e\") " pod="openshift-image-registry/node-ca-vlbrv" Sep 19 08:20:54.621241 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.621218 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mrtz\" (UniqueName: \"kubernetes.io/projected/55c84c99-604b-49d6-8ba9-01e04e3accda-kube-api-access-4mrtz\") pod \"multus-additional-cni-plugins-jgn8b\" (UID: \"55c84c99-604b-49d6-8ba9-01e04e3accda\") " pod="openshift-multus/multus-additional-cni-plugins-jgn8b" Sep 19 08:20:54.622585 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.622564 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4khrw\" (UniqueName: \"kubernetes.io/projected/e3a2c7d3-39cd-48fe-b472-cc9bb9cac54e-kube-api-access-4khrw\") pod \"node-resolver-7mwjp\" (UID: \"e3a2c7d3-39cd-48fe-b472-cc9bb9cac54e\") " pod="openshift-dns/node-resolver-7mwjp" Sep 19 08:20:54.765411 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.765332 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hmhmw" Sep 19 08:20:54.774439 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.774411 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:20:54.791392 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.791365 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jgn8b" Sep 19 08:20:54.799215 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.799193 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vlbrv" Sep 19 08:20:54.808004 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.807984 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lndpt" Sep 19 08:20:54.817758 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.817741 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-x9knk" Sep 19 08:20:54.825147 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.825120 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qw5l5" Sep 19 08:20:54.841726 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.841704 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89kkh" Sep 19 08:20:54.848407 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.848389 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7mwjp" Sep 19 08:20:54.884258 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:54.884226 2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 19 08:20:55.103661 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:55.103623 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06d9bb1e-838b-4f04-9ff4-f668714c7877-original-pull-secret\") pod \"global-pull-secret-syncer-xgprw\" (UID: \"06d9bb1e-838b-4f04-9ff4-f668714c7877\") " pod="kube-system/global-pull-secret-syncer-xgprw" Sep 19 08:20:55.103836 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:55.103694 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35c26dae-8ddc-4ea9-b6d7-6de02274508c-metrics-certs\") pod \"network-metrics-daemon-kqz5p\" (UID: \"35c26dae-8ddc-4ea9-b6d7-6de02274508c\") " pod="openshift-multus/network-metrics-daemon-kqz5p" Sep 19 08:20:55.103836 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:55.103749 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 19 08:20:55.103836 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:55.103802 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 08:20:55.103836 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:55.103827 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06d9bb1e-838b-4f04-9ff4-f668714c7877-original-pull-secret podName:06d9bb1e-838b-4f04-9ff4-f668714c7877 nodeName:}" failed. No retries permitted until 2026-09-19 08:20:56.103812085 +0000 UTC m=+5.833908665 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/06d9bb1e-838b-4f04-9ff4-f668714c7877-original-pull-secret") pod "global-pull-secret-syncer-xgprw" (UID: "06d9bb1e-838b-4f04-9ff4-f668714c7877") : object "kube-system"/"original-pull-secret" not registered Sep 19 08:20:55.104035 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:55.103853 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35c26dae-8ddc-4ea9-b6d7-6de02274508c-metrics-certs podName:35c26dae-8ddc-4ea9-b6d7-6de02274508c nodeName:}" failed. No retries permitted until 2026-09-19 08:20:56.103836517 +0000 UTC m=+5.833933098 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35c26dae-8ddc-4ea9-b6d7-6de02274508c-metrics-certs") pod "network-metrics-daemon-kqz5p" (UID: "35c26dae-8ddc-4ea9-b6d7-6de02274508c") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 08:20:55.204978 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:55.204937 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtrgm\" (UniqueName: \"kubernetes.io/projected/1f40898d-6f69-48bc-8af6-3224a163f776-kube-api-access-xtrgm\") pod \"network-check-target-h2qgv\" (UID: \"1f40898d-6f69-48bc-8af6-3224a163f776\") " pod="openshift-network-diagnostics/network-check-target-h2qgv" Sep 19 08:20:55.205185 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:55.205141 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 19 08:20:55.205185 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:55.205171 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 19 08:20:55.205185 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:55.205183 2584 projected.go:196] Error preparing data for projected volume kube-api-access-xtrgm for pod openshift-network-diagnostics/network-check-target-h2qgv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 08:20:55.205342 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:55.205244 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f40898d-6f69-48bc-8af6-3224a163f776-kube-api-access-xtrgm podName:1f40898d-6f69-48bc-8af6-3224a163f776 nodeName:}" failed. No retries permitted until 2026-09-19 08:20:56.20522534 +0000 UTC m=+5.935321928 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xtrgm" (UniqueName: "kubernetes.io/projected/1f40898d-6f69-48bc-8af6-3224a163f776-kube-api-access-xtrgm") pod "network-check-target-h2qgv" (UID: "1f40898d-6f69-48bc-8af6-3224a163f776") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 08:20:55.542452 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:55.542378 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-18 08:15:54 +0000 UTC" deadline="2028-05-13 00:40:24.797196603 +0000 UTC" Sep 19 08:20:55.542452 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:55.542408 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14440h19m29.254792454s" Sep 19 08:20:55.605932 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:55.605900 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2qgv" Sep 19 08:20:55.606104 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:55.606025 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2qgv" podUID="1f40898d-6f69-48bc-8af6-3224a163f776" Sep 19 08:20:55.646550 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:55.646516 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92a2d024_eab7_44e8_9886_867fe54981d0.slice/crio-3a5f819fc559b7bc01c3a112c10c8f9a4b59c0ddbff4522a3af722e32e09c156 WatchSource:0}: Error finding container 3a5f819fc559b7bc01c3a112c10c8f9a4b59c0ddbff4522a3af722e32e09c156: Status 404 returned error can't find the container with id 3a5f819fc559b7bc01c3a112c10c8f9a4b59c0ddbff4522a3af722e32e09c156 Sep 19 08:20:55.647270 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:55.647244 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod340df34f_ef23_43c5_a79a_aa7bd01f7fda.slice/crio-a79ef93ea337550f6fea5035f0936457f7e29769f9c52441858af060e3ddc89e WatchSource:0}: Error finding container a79ef93ea337550f6fea5035f0936457f7e29769f9c52441858af060e3ddc89e: Status 404 returned error can't find the container with id a79ef93ea337550f6fea5035f0936457f7e29769f9c52441858af060e3ddc89e Sep 19 08:20:55.649482 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:55.649461 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51eaaa01_f96a_4933_a1c3_54b7c1ac2a72.slice/crio-e1132bef1032de505ac370fd71a4ebd81b3ada81eed67898344c4f68d94be919 WatchSource:0}: Error finding container e1132bef1032de505ac370fd71a4ebd81b3ada81eed67898344c4f68d94be919: Status 404 returned error can't find the container with id e1132bef1032de505ac370fd71a4ebd81b3ada81eed67898344c4f68d94be919 Sep 19 08:20:55.649823 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:55.649802 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3a2c7d3_39cd_48fe_b472_cc9bb9cac54e.slice/crio-0d4460a61aab05edf418662ff8834513402649d30e6bc45f6d05fe27bdf3a6c1 WatchSource:0}: Error finding container 0d4460a61aab05edf418662ff8834513402649d30e6bc45f6d05fe27bdf3a6c1: Status 404 returned error can't find the container with id 0d4460a61aab05edf418662ff8834513402649d30e6bc45f6d05fe27bdf3a6c1 Sep 19 08:20:55.651387 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:55.651364 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbe6e4ed_b0e6_4b36_b569_8fdef3f6d4ee.slice/crio-92adc16e9f56559998d1d57e29b097b1e0d8ab5dd5a37da89b6043815d2f6474 WatchSource:0}: Error finding container 92adc16e9f56559998d1d57e29b097b1e0d8ab5dd5a37da89b6043815d2f6474: Status 404 returned error can't find the container with id 92adc16e9f56559998d1d57e29b097b1e0d8ab5dd5a37da89b6043815d2f6474 Sep 19 08:20:55.652016 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:55.651823 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1caf055c_966a_4aaf_92b0_22fe9332e753.slice/crio-96fc947303f2203637650f843dd9a6caa254e17b4474b9eeee7ddf8a4bdb7daa WatchSource:0}: Error finding container 96fc947303f2203637650f843dd9a6caa254e17b4474b9eeee7ddf8a4bdb7daa: Status 404 returned error can't find the container with id 96fc947303f2203637650f843dd9a6caa254e17b4474b9eeee7ddf8a4bdb7daa Sep 19 08:20:55.652418 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:55.652295 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55c84c99_604b_49d6_8ba9_01e04e3accda.slice/crio-bf2d0047877facc4fde36a8a7c07ff6611fc85b5f1515ee5f082fa0b780241ba WatchSource:0}: Error finding container bf2d0047877facc4fde36a8a7c07ff6611fc85b5f1515ee5f082fa0b780241ba: Status 404 returned error can't find the container with id bf2d0047877facc4fde36a8a7c07ff6611fc85b5f1515ee5f082fa0b780241ba Sep 19 08:20:55.672962 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:55.672929 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b1aa1b2_0b64_4fa5_be7d_8325bf0c5136.slice/crio-f42c104fddfeab8fb0494740eec9ea632087d5db568df55f2d0f60c080fbec2b WatchSource:0}: Error finding container f42c104fddfeab8fb0494740eec9ea632087d5db568df55f2d0f60c080fbec2b: Status 404 returned error can't find the container with id f42c104fddfeab8fb0494740eec9ea632087d5db568df55f2d0f60c080fbec2b Sep 19 08:20:55.673718 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:20:55.673658 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4d94997_9978_4be2_b81c_3a610fd1b54e.slice/crio-85a39f7c165f907d35e79541bc918f59f1d9b901f1aa2d88fb4f8b1cacf63998 WatchSource:0}: Error finding container 85a39f7c165f907d35e79541bc918f59f1d9b901f1aa2d88fb4f8b1cacf63998: Status 404 returned error can't find the container with id 85a39f7c165f907d35e79541bc918f59f1d9b901f1aa2d88fb4f8b1cacf63998 Sep 19 08:20:56.113253 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:56.112065 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35c26dae-8ddc-4ea9-b6d7-6de02274508c-metrics-certs\") pod \"network-metrics-daemon-kqz5p\" (UID: \"35c26dae-8ddc-4ea9-b6d7-6de02274508c\") " pod="openshift-multus/network-metrics-daemon-kqz5p" Sep 19 08:20:56.113253 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:56.112408 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06d9bb1e-838b-4f04-9ff4-f668714c7877-original-pull-secret\") pod \"global-pull-secret-syncer-xgprw\" (UID: \"06d9bb1e-838b-4f04-9ff4-f668714c7877\") " pod="kube-system/global-pull-secret-syncer-xgprw" Sep 19 08:20:56.113253 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:56.112563 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 19 08:20:56.113253 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:56.112627 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06d9bb1e-838b-4f04-9ff4-f668714c7877-original-pull-secret podName:06d9bb1e-838b-4f04-9ff4-f668714c7877 nodeName:}" failed. No retries permitted until 2026-09-19 08:20:58.112609153 +0000 UTC m=+7.842705737 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/06d9bb1e-838b-4f04-9ff4-f668714c7877-original-pull-secret") pod "global-pull-secret-syncer-xgprw" (UID: "06d9bb1e-838b-4f04-9ff4-f668714c7877") : object "kube-system"/"original-pull-secret" not registered Sep 19 08:20:56.113253 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:56.113052 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 08:20:56.113253 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:56.113123 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35c26dae-8ddc-4ea9-b6d7-6de02274508c-metrics-certs podName:35c26dae-8ddc-4ea9-b6d7-6de02274508c nodeName:}" failed. No retries permitted until 2026-09-19 08:20:58.113104295 +0000 UTC m=+7.843200875 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35c26dae-8ddc-4ea9-b6d7-6de02274508c-metrics-certs") pod "network-metrics-daemon-kqz5p" (UID: "35c26dae-8ddc-4ea9-b6d7-6de02274508c") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 08:20:56.213020 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:56.212980 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtrgm\" (UniqueName: \"kubernetes.io/projected/1f40898d-6f69-48bc-8af6-3224a163f776-kube-api-access-xtrgm\") pod \"network-check-target-h2qgv\" (UID: \"1f40898d-6f69-48bc-8af6-3224a163f776\") " pod="openshift-network-diagnostics/network-check-target-h2qgv" Sep 19 08:20:56.213231 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:56.213212 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 19 08:20:56.213297 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:56.213238 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 19 08:20:56.213297 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:56.213250 2584 projected.go:196] Error preparing data for projected volume kube-api-access-xtrgm for pod openshift-network-diagnostics/network-check-target-h2qgv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 08:20:56.213402 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:56.213315 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f40898d-6f69-48bc-8af6-3224a163f776-kube-api-access-xtrgm podName:1f40898d-6f69-48bc-8af6-3224a163f776 nodeName:}" failed. No retries permitted until 2026-09-19 08:20:58.213296897 +0000 UTC m=+7.943393500 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xtrgm" (UniqueName: "kubernetes.io/projected/1f40898d-6f69-48bc-8af6-3224a163f776-kube-api-access-xtrgm") pod "network-check-target-h2qgv" (UID: "1f40898d-6f69-48bc-8af6-3224a163f776") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 08:20:56.543500 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:56.543390 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-18 08:15:54 +0000 UTC" deadline="2028-03-22 16:57:31.268139538 +0000 UTC" Sep 19 08:20:56.543500 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:56.543428 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13208h36m34.724715863s" Sep 19 08:20:56.607054 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:56.606463 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgprw" Sep 19 08:20:56.607054 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:56.606626 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgprw" podUID="06d9bb1e-838b-4f04-9ff4-f668714c7877" Sep 19 08:20:56.607328 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:56.607270 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqz5p" Sep 19 08:20:56.607443 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:56.607402 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqz5p" podUID="35c26dae-8ddc-4ea9-b6d7-6de02274508c" Sep 19 08:20:56.643378 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:56.643189 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" event={"ID":"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136","Type":"ContainerStarted","Data":"f42c104fddfeab8fb0494740eec9ea632087d5db568df55f2d0f60c080fbec2b"} Sep 19 08:20:56.655745 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:56.655709 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89kkh" event={"ID":"1caf055c-966a-4aaf-92b0-22fe9332e753","Type":"ContainerStarted","Data":"96fc947303f2203637650f843dd9a6caa254e17b4474b9eeee7ddf8a4bdb7daa"} Sep 19 08:20:56.666218 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:56.666117 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lndpt" event={"ID":"51eaaa01-f96a-4933-a1c3-54b7c1ac2a72","Type":"ContainerStarted","Data":"e1132bef1032de505ac370fd71a4ebd81b3ada81eed67898344c4f68d94be919"} Sep 19 08:20:56.673660 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:56.673574 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hmhmw" event={"ID":"340df34f-ef23-43c5-a79a-aa7bd01f7fda","Type":"ContainerStarted","Data":"a79ef93ea337550f6fea5035f0936457f7e29769f9c52441858af060e3ddc89e"} Sep 19 08:20:56.688395 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:56.688363 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qw5l5" event={"ID":"92a2d024-eab7-44e8-9886-867fe54981d0","Type":"ContainerStarted","Data":"3a5f819fc559b7bc01c3a112c10c8f9a4b59c0ddbff4522a3af722e32e09c156"} Sep 19 08:20:56.717411 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:56.717367 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-96.ec2.internal" event={"ID":"bb1f3dcffd05d522e85d0257d7561dec","Type":"ContainerStarted","Data":"83523efd824b0f47fe4da56dfb1f34cfbe50183ece244e078998f0aa99767b31"} Sep 19 08:20:56.730730 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:56.729977 2584 generic.go:356] "Generic (PLEG): container finished" podID="ad2de051a5bf26d24a7aa54eba31ddad" containerID="7ad2db268e87086e80ec1bffd9ea8e0ab2d011d9c77d1c576b70a6100e8ab4b5" exitCode=0 Sep 19 08:20:56.730730 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:56.730634 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-96.ec2.internal" event={"ID":"ad2de051a5bf26d24a7aa54eba31ddad","Type":"ContainerDied","Data":"7ad2db268e87086e80ec1bffd9ea8e0ab2d011d9c77d1c576b70a6100e8ab4b5"} Sep 19 08:20:56.732047 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:56.731994 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-96.ec2.internal" podStartSLOduration=3.7319696589999998 podStartE2EDuration="3.731969659s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 08:20:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 08:20:56.73141247 +0000 UTC m=+6.461509073" watchObservedRunningTime="2026-09-19 08:20:56.731969659 +0000 UTC m=+6.462066264" Sep 19 08:20:56.751030 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:56.750949 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jgn8b" event={"ID":"55c84c99-604b-49d6-8ba9-01e04e3accda","Type":"ContainerStarted","Data":"bf2d0047877facc4fde36a8a7c07ff6611fc85b5f1515ee5f082fa0b780241ba"} Sep 19 08:20:56.761293 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:56.761264 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-x9knk" event={"ID":"dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee","Type":"ContainerStarted","Data":"92adc16e9f56559998d1d57e29b097b1e0d8ab5dd5a37da89b6043815d2f6474"} Sep 19 08:20:56.774958 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:56.774874 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7mwjp" event={"ID":"e3a2c7d3-39cd-48fe-b472-cc9bb9cac54e","Type":"ContainerStarted","Data":"0d4460a61aab05edf418662ff8834513402649d30e6bc45f6d05fe27bdf3a6c1"} Sep 19 08:20:56.794537 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:56.794422 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vlbrv" event={"ID":"e4d94997-9978-4be2-b81c-3a610fd1b54e","Type":"ContainerStarted","Data":"85a39f7c165f907d35e79541bc918f59f1d9b901f1aa2d88fb4f8b1cacf63998"} Sep 19 08:20:57.606228 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:57.605739 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2qgv" Sep 19 08:20:57.606228 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:57.605862 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2qgv" podUID="1f40898d-6f69-48bc-8af6-3224a163f776" Sep 19 08:20:57.811307 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:57.811271 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-96.ec2.internal" event={"ID":"ad2de051a5bf26d24a7aa54eba31ddad","Type":"ContainerStarted","Data":"162505e5ef97c99710e375b35d48018d2b35375564fd0ac5d26f8a07902f729c"} Sep 19 08:20:58.129016 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:58.128977 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35c26dae-8ddc-4ea9-b6d7-6de02274508c-metrics-certs\") pod \"network-metrics-daemon-kqz5p\" (UID: \"35c26dae-8ddc-4ea9-b6d7-6de02274508c\") " pod="openshift-multus/network-metrics-daemon-kqz5p" Sep 19 08:20:58.129216 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:58.129064 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06d9bb1e-838b-4f04-9ff4-f668714c7877-original-pull-secret\") pod \"global-pull-secret-syncer-xgprw\" (UID: \"06d9bb1e-838b-4f04-9ff4-f668714c7877\") " pod="kube-system/global-pull-secret-syncer-xgprw" Sep 19 08:20:58.129283 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:58.129216 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 19 08:20:58.129283 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:58.129276 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06d9bb1e-838b-4f04-9ff4-f668714c7877-original-pull-secret podName:06d9bb1e-838b-4f04-9ff4-f668714c7877 nodeName:}" failed. No retries permitted until 2026-09-19 08:21:02.129258636 +0000 UTC m=+11.859355220 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/06d9bb1e-838b-4f04-9ff4-f668714c7877-original-pull-secret") pod "global-pull-secret-syncer-xgprw" (UID: "06d9bb1e-838b-4f04-9ff4-f668714c7877") : object "kube-system"/"original-pull-secret" not registered Sep 19 08:20:58.129671 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:58.129647 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 08:20:58.129758 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:58.129706 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35c26dae-8ddc-4ea9-b6d7-6de02274508c-metrics-certs podName:35c26dae-8ddc-4ea9-b6d7-6de02274508c nodeName:}" failed. No retries permitted until 2026-09-19 08:21:02.129690966 +0000 UTC m=+11.859787549 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35c26dae-8ddc-4ea9-b6d7-6de02274508c-metrics-certs") pod "network-metrics-daemon-kqz5p" (UID: "35c26dae-8ddc-4ea9-b6d7-6de02274508c") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 08:20:58.230020 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:58.229983 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtrgm\" (UniqueName: \"kubernetes.io/projected/1f40898d-6f69-48bc-8af6-3224a163f776-kube-api-access-xtrgm\") pod \"network-check-target-h2qgv\" (UID: \"1f40898d-6f69-48bc-8af6-3224a163f776\") " pod="openshift-network-diagnostics/network-check-target-h2qgv" Sep 19 08:20:58.230733 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:58.230272 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 19 08:20:58.230733 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:58.230300 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 19 08:20:58.230733 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:58.230313 2584 projected.go:196] Error preparing data for projected volume kube-api-access-xtrgm for pod openshift-network-diagnostics/network-check-target-h2qgv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 08:20:58.230733 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:58.230380 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f40898d-6f69-48bc-8af6-3224a163f776-kube-api-access-xtrgm podName:1f40898d-6f69-48bc-8af6-3224a163f776 nodeName:}" failed. No retries permitted until 2026-09-19 08:21:02.230361078 +0000 UTC m=+11.960457662 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xtrgm" (UniqueName: "kubernetes.io/projected/1f40898d-6f69-48bc-8af6-3224a163f776-kube-api-access-xtrgm") pod "network-check-target-h2qgv" (UID: "1f40898d-6f69-48bc-8af6-3224a163f776") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 08:20:58.608206 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:58.608176 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqz5p" Sep 19 08:20:58.608752 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:58.608315 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqz5p" podUID="35c26dae-8ddc-4ea9-b6d7-6de02274508c" Sep 19 08:20:58.608810 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:58.608762 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgprw" Sep 19 08:20:58.608929 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:58.608862 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgprw" podUID="06d9bb1e-838b-4f04-9ff4-f668714c7877" Sep 19 08:20:59.606326 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:20:59.606291 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2qgv" Sep 19 08:20:59.606513 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:20:59.606424 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2qgv" podUID="1f40898d-6f69-48bc-8af6-3224a163f776" Sep 19 08:21:00.606052 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:00.606013 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgprw" Sep 19 08:21:00.606052 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:00.606044 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqz5p" Sep 19 08:21:00.606657 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:00.606170 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgprw" podUID="06d9bb1e-838b-4f04-9ff4-f668714c7877" Sep 19 08:21:00.606657 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:00.606294 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqz5p" podUID="35c26dae-8ddc-4ea9-b6d7-6de02274508c" Sep 19 08:21:01.605530 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:01.605493 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2qgv" Sep 19 08:21:01.605720 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:01.605631 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2qgv" podUID="1f40898d-6f69-48bc-8af6-3224a163f776" Sep 19 08:21:02.161149 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:02.161115 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06d9bb1e-838b-4f04-9ff4-f668714c7877-original-pull-secret\") pod \"global-pull-secret-syncer-xgprw\" (UID: \"06d9bb1e-838b-4f04-9ff4-f668714c7877\") " pod="kube-system/global-pull-secret-syncer-xgprw" Sep 19 08:21:02.161605 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:02.161183 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35c26dae-8ddc-4ea9-b6d7-6de02274508c-metrics-certs\") pod \"network-metrics-daemon-kqz5p\" (UID: \"35c26dae-8ddc-4ea9-b6d7-6de02274508c\") " pod="openshift-multus/network-metrics-daemon-kqz5p" Sep 19 08:21:02.161605 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:02.161271 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 19 08:21:02.161605 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:02.161289 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 08:21:02.161605 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:02.161350 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06d9bb1e-838b-4f04-9ff4-f668714c7877-original-pull-secret podName:06d9bb1e-838b-4f04-9ff4-f668714c7877 nodeName:}" failed. No retries permitted until 2026-09-19 08:21:10.161326687 +0000 UTC m=+19.891423271 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/06d9bb1e-838b-4f04-9ff4-f668714c7877-original-pull-secret") pod "global-pull-secret-syncer-xgprw" (UID: "06d9bb1e-838b-4f04-9ff4-f668714c7877") : object "kube-system"/"original-pull-secret" not registered Sep 19 08:21:02.161605 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:02.161372 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35c26dae-8ddc-4ea9-b6d7-6de02274508c-metrics-certs podName:35c26dae-8ddc-4ea9-b6d7-6de02274508c nodeName:}" failed. No retries permitted until 2026-09-19 08:21:10.161362008 +0000 UTC m=+19.891458591 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35c26dae-8ddc-4ea9-b6d7-6de02274508c-metrics-certs") pod "network-metrics-daemon-kqz5p" (UID: "35c26dae-8ddc-4ea9-b6d7-6de02274508c") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 08:21:02.261891 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:02.261850 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtrgm\" (UniqueName: \"kubernetes.io/projected/1f40898d-6f69-48bc-8af6-3224a163f776-kube-api-access-xtrgm\") pod \"network-check-target-h2qgv\" (UID: \"1f40898d-6f69-48bc-8af6-3224a163f776\") " pod="openshift-network-diagnostics/network-check-target-h2qgv" Sep 19 08:21:02.262066 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:02.262041 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 19 08:21:02.262162 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:02.262093 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 19 08:21:02.262162 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:02.262107 2584 projected.go:196] Error preparing data for projected volume kube-api-access-xtrgm for pod openshift-network-diagnostics/network-check-target-h2qgv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 08:21:02.262262 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:02.262167 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f40898d-6f69-48bc-8af6-3224a163f776-kube-api-access-xtrgm podName:1f40898d-6f69-48bc-8af6-3224a163f776 nodeName:}" failed. No retries permitted until 2026-09-19 08:21:10.262151374 +0000 UTC m=+19.992247954 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xtrgm" (UniqueName: "kubernetes.io/projected/1f40898d-6f69-48bc-8af6-3224a163f776-kube-api-access-xtrgm") pod "network-check-target-h2qgv" (UID: "1f40898d-6f69-48bc-8af6-3224a163f776") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 08:21:02.605786 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:02.605722 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgprw" Sep 19 08:21:02.605950 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:02.605845 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgprw" podUID="06d9bb1e-838b-4f04-9ff4-f668714c7877" Sep 19 08:21:02.607299 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:02.607275 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqz5p" Sep 19 08:21:02.607401 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:02.607387 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqz5p" podUID="35c26dae-8ddc-4ea9-b6d7-6de02274508c" Sep 19 08:21:03.605830 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:03.605797 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2qgv" Sep 19 08:21:03.606268 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:03.605939 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2qgv" podUID="1f40898d-6f69-48bc-8af6-3224a163f776" Sep 19 08:21:04.606277 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:04.606186 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqz5p" Sep 19 08:21:04.606742 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:04.606324 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqz5p" podUID="35c26dae-8ddc-4ea9-b6d7-6de02274508c" Sep 19 08:21:04.606807 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:04.606777 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgprw" Sep 19 08:21:04.606915 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:04.606886 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgprw" podUID="06d9bb1e-838b-4f04-9ff4-f668714c7877" Sep 19 08:21:05.605821 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:05.605791 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2qgv" Sep 19 08:21:05.606038 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:05.605886 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2qgv" podUID="1f40898d-6f69-48bc-8af6-3224a163f776" Sep 19 08:21:06.606311 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:06.606275 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgprw" Sep 19 08:21:06.606766 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:06.606413 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgprw" podUID="06d9bb1e-838b-4f04-9ff4-f668714c7877" Sep 19 08:21:06.606766 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:06.606481 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqz5p" Sep 19 08:21:06.606766 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:06.606612 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqz5p" podUID="35c26dae-8ddc-4ea9-b6d7-6de02274508c" Sep 19 08:21:07.605711 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:07.605681 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2qgv" Sep 19 08:21:07.605894 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:07.605798 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2qgv" podUID="1f40898d-6f69-48bc-8af6-3224a163f776" Sep 19 08:21:08.606192 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:08.606159 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgprw" Sep 19 08:21:08.606596 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:08.606159 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqz5p" Sep 19 08:21:08.606596 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:08.606278 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgprw" podUID="06d9bb1e-838b-4f04-9ff4-f668714c7877" Sep 19 08:21:08.606596 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:08.606401 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqz5p" podUID="35c26dae-8ddc-4ea9-b6d7-6de02274508c" Sep 19 08:21:09.606051 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:09.606015 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2qgv" Sep 19 08:21:09.606237 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:09.606152 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2qgv" podUID="1f40898d-6f69-48bc-8af6-3224a163f776" Sep 19 08:21:10.224152 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:10.224113 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06d9bb1e-838b-4f04-9ff4-f668714c7877-original-pull-secret\") pod \"global-pull-secret-syncer-xgprw\" (UID: \"06d9bb1e-838b-4f04-9ff4-f668714c7877\") " pod="kube-system/global-pull-secret-syncer-xgprw" Sep 19 08:21:10.224334 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:10.224183 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35c26dae-8ddc-4ea9-b6d7-6de02274508c-metrics-certs\") pod \"network-metrics-daemon-kqz5p\" (UID: \"35c26dae-8ddc-4ea9-b6d7-6de02274508c\") " pod="openshift-multus/network-metrics-daemon-kqz5p" Sep 19 08:21:10.224334 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:10.224274 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 19 08:21:10.224334 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:10.224301 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 08:21:10.224470 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:10.224343 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06d9bb1e-838b-4f04-9ff4-f668714c7877-original-pull-secret podName:06d9bb1e-838b-4f04-9ff4-f668714c7877 nodeName:}" failed. No retries permitted until 2026-09-19 08:21:26.224324955 +0000 UTC m=+35.954421536 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/06d9bb1e-838b-4f04-9ff4-f668714c7877-original-pull-secret") pod "global-pull-secret-syncer-xgprw" (UID: "06d9bb1e-838b-4f04-9ff4-f668714c7877") : object "kube-system"/"original-pull-secret" not registered Sep 19 08:21:10.224470 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:10.224359 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35c26dae-8ddc-4ea9-b6d7-6de02274508c-metrics-certs podName:35c26dae-8ddc-4ea9-b6d7-6de02274508c nodeName:}" failed. No retries permitted until 2026-09-19 08:21:26.224352022 +0000 UTC m=+35.954448602 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35c26dae-8ddc-4ea9-b6d7-6de02274508c-metrics-certs") pod "network-metrics-daemon-kqz5p" (UID: "35c26dae-8ddc-4ea9-b6d7-6de02274508c") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 08:21:10.325530 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:10.325503 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtrgm\" (UniqueName: \"kubernetes.io/projected/1f40898d-6f69-48bc-8af6-3224a163f776-kube-api-access-xtrgm\") pod \"network-check-target-h2qgv\" (UID: \"1f40898d-6f69-48bc-8af6-3224a163f776\") " pod="openshift-network-diagnostics/network-check-target-h2qgv" Sep 19 08:21:10.325700 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:10.325642 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 19 08:21:10.325700 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:10.325662 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 19 08:21:10.325700 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:10.325670 2584 projected.go:196] Error preparing data for projected volume kube-api-access-xtrgm for pod openshift-network-diagnostics/network-check-target-h2qgv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 08:21:10.325814 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:10.325718 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f40898d-6f69-48bc-8af6-3224a163f776-kube-api-access-xtrgm podName:1f40898d-6f69-48bc-8af6-3224a163f776 nodeName:}" failed. No retries permitted until 2026-09-19 08:21:26.325705181 +0000 UTC m=+36.055801761 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xtrgm" (UniqueName: "kubernetes.io/projected/1f40898d-6f69-48bc-8af6-3224a163f776-kube-api-access-xtrgm") pod "network-check-target-h2qgv" (UID: "1f40898d-6f69-48bc-8af6-3224a163f776") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 08:21:10.606128 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:10.606090 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqz5p" Sep 19 08:21:10.606312 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:10.606226 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqz5p" podUID="35c26dae-8ddc-4ea9-b6d7-6de02274508c" Sep 19 08:21:10.606312 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:10.606282 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgprw" Sep 19 08:21:10.606677 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:10.606419 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgprw" podUID="06d9bb1e-838b-4f04-9ff4-f668714c7877" Sep 19 08:21:11.605700 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:11.605662 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2qgv" Sep 19 08:21:11.605875 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:11.605787 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2qgv" podUID="1f40898d-6f69-48bc-8af6-3224a163f776" Sep 19 08:21:12.606811 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:12.606768 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgprw" Sep 19 08:21:12.607279 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:12.606881 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgprw" podUID="06d9bb1e-838b-4f04-9ff4-f668714c7877" Sep 19 08:21:12.607279 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:12.606936 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqz5p" Sep 19 08:21:12.607279 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:12.607041 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqz5p" podUID="35c26dae-8ddc-4ea9-b6d7-6de02274508c" Sep 19 08:21:13.605761 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:13.605613 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2qgv" Sep 19 08:21:13.605850 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:13.605833 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2qgv" podUID="1f40898d-6f69-48bc-8af6-3224a163f776" Sep 19 08:21:13.845777 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:13.845513 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qw5l5" event={"ID":"92a2d024-eab7-44e8-9886-867fe54981d0","Type":"ContainerStarted","Data":"57840a94ab58137bdaa1bb0068e98bd87ca790bfec4f001f6f8df0aaf0a79613"} Sep 19 08:21:13.847210 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:13.847179 2584 generic.go:356] "Generic (PLEG): container finished" podID="55c84c99-604b-49d6-8ba9-01e04e3accda" containerID="b75afc174f61c3487e134bf188e07cdf652b48e95e5e5505e0e377ea3b11def3" exitCode=0 Sep 19 08:21:13.847313 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:13.847256 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jgn8b" event={"ID":"55c84c99-604b-49d6-8ba9-01e04e3accda","Type":"ContainerDied","Data":"b75afc174f61c3487e134bf188e07cdf652b48e95e5e5505e0e377ea3b11def3"} Sep 19 08:21:13.848883 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:13.848839 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-x9knk" event={"ID":"dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee","Type":"ContainerStarted","Data":"0f5d1a3feeb8b12bb6f14c5f15c341df128ea3bf187255a1c3f9929520dfc7da"} Sep 19 08:21:13.850469 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:13.850444 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7mwjp" event={"ID":"e3a2c7d3-39cd-48fe-b472-cc9bb9cac54e","Type":"ContainerStarted","Data":"04cd5699c061a71d2453e5ba20c44afe373c70e7d29131443b2c88a0b415ad57"} Sep 19 08:21:13.852288 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:13.852163 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vlbrv" event={"ID":"e4d94997-9978-4be2-b81c-3a610fd1b54e","Type":"ContainerStarted","Data":"d0b1141e836bfda206296d400cbf5ab577eb62b3b86466d66e4fbef60d36deb1"} Sep 19 08:21:13.855225 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:13.855205 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2hqv_3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136/ovn-acl-logging/0.log" Sep 19 08:21:13.855632 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:13.855607 2584 generic.go:356] "Generic (PLEG): container finished" podID="3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136" containerID="8c8bd5029481e0a2bd11594a19f5ed7fc3c494322c3fe2942067e6e9cb183dec" exitCode=1 Sep 19 08:21:13.855705 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:13.855674 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" event={"ID":"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136","Type":"ContainerStarted","Data":"ecb12379c7a23756061bc750f59433e2efdc1efabcab0c7f2cd1474da65052b4"} Sep 19 08:21:13.855758 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:13.855742 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" event={"ID":"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136","Type":"ContainerStarted","Data":"acadcc5dc2c6ecc577d9c255ecd9008224eccaafcf892266bc9ded1ef74f1414"} Sep 19 08:21:13.855815 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:13.855794 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" event={"ID":"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136","Type":"ContainerStarted","Data":"ac9aaed7c073dcd791c5a1b968ffcdacb3e7202b76c509a02c11e51387cb3276"} Sep 19 08:21:13.855864 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:13.855837 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" event={"ID":"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136","Type":"ContainerStarted","Data":"f00693cb2553ee27c8e8a3a527f114bb7cfaa4eaf593d80d6001577c793f5ba3"} Sep 19 08:21:13.855912 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:13.855882 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" event={"ID":"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136","Type":"ContainerDied","Data":"8c8bd5029481e0a2bd11594a19f5ed7fc3c494322c3fe2942067e6e9cb183dec"} Sep 19 08:21:13.855965 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:13.855931 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" event={"ID":"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136","Type":"ContainerStarted","Data":"84409c17eecf670062433cafac548d0fa59c77b162ad5a8b3a144c6f7b4c7954"} Sep 19 08:21:13.857335 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:13.857311 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89kkh" event={"ID":"1caf055c-966a-4aaf-92b0-22fe9332e753","Type":"ContainerStarted","Data":"57a20b1bc23ed57ef780a60d97d8fece6b88346904d5365fea39252e94974665"} Sep 19 08:21:13.858927 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:13.858904 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lndpt" event={"ID":"51eaaa01-f96a-4933-a1c3-54b7c1ac2a72","Type":"ContainerStarted","Data":"bfe704bf68969ed83ff9f7e1bf87555e5a0ee0aa80633e614e3677623692b773"} Sep 19 08:21:13.859673 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:13.859635 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-96.ec2.internal" podStartSLOduration=20.859624174 podStartE2EDuration="20.859624174s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 08:20:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 08:20:57.827315016 +0000 UTC m=+7.557411621" watchObservedRunningTime="2026-09-19 08:21:13.859624174 +0000 UTC m=+23.589720776" Sep 19 08:21:13.860335 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:13.860294 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qw5l5" podStartSLOduration=3.573121802 podStartE2EDuration="20.860286819s" totalImagesPullingTime="17.287165017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 08:20:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 08:21:13.859594964 +0000 UTC m=+23.589691566" watchObservedRunningTime="2026-09-19 08:21:13.860286819 +0000 UTC m=+23.590383421" Sep 19 08:21:13.894600 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:13.894553 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vlbrv" podStartSLOduration=4.565961819 podStartE2EDuration="21.894536097s" totalImagesPullingTime="17.328574278s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 08:20:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 08:21:13.89421536 +0000 UTC m=+23.624311968" watchObservedRunningTime="2026-09-19 08:21:13.894536097 +0000 UTC m=+23.624632701" Sep 19 08:21:13.915985 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:13.915943 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lndpt" podStartSLOduration=4.56022515 podStartE2EDuration="21.915928324s" totalImagesPullingTime="17.355703174s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 08:20:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 08:21:13.915380352 +0000 UTC m=+23.645476954" watchObservedRunningTime="2026-09-19 08:21:13.915928324 +0000 UTC m=+23.646024925" Sep 19 08:21:13.936258 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:13.936200 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-x9knk" podStartSLOduration=4.585305868 podStartE2EDuration="21.936180684s" totalImagesPullingTime="17.350874816s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 08:20:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 08:21:13.93611077 +0000 UTC m=+23.666207371" watchObservedRunningTime="2026-09-19 08:21:13.936180684 +0000 UTC m=+23.666277287" Sep 19 08:21:13.954857 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:13.953433 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7mwjp" podStartSLOduration=3.614100491 podStartE2EDuration="20.953415701s" totalImagesPullingTime="17.33931521s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 08:20:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 08:21:13.952654784 +0000 UTC m=+23.682751381" watchObservedRunningTime="2026-09-19 08:21:13.953415701 +0000 UTC m=+23.683512304" Sep 19 08:21:14.189209 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:14.189188 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vlbrv_e4d94997-9978-4be2-b81c-3a610fd1b54e/node-ca/0.log" Sep 19 08:21:14.311146 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:14.311125 2584 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 19 08:21:14.580816 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:14.580718 2584 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-19T08:21:14.311141181Z","UUID":"84dd67e8-8dcf-433b-9278-400c1907af94","Handler":null,"Name":"","Endpoint":""} Sep 19 08:21:14.582301 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:14.582279 2584 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 19 08:21:14.582427 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:14.582309 2584 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 19 08:21:14.606467 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:14.606444 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqz5p" Sep 19 08:21:14.606598 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:14.606571 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqz5p" podUID="35c26dae-8ddc-4ea9-b6d7-6de02274508c" Sep 19 08:21:14.606598 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:14.606588 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgprw" Sep 19 08:21:14.606713 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:14.606696 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgprw" podUID="06d9bb1e-838b-4f04-9ff4-f668714c7877" Sep 19 08:21:14.863657 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:14.863353 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hmhmw" event={"ID":"340df34f-ef23-43c5-a79a-aa7bd01f7fda","Type":"ContainerStarted","Data":"13d65bf3bbd1456b25c96d682780ef444707e4ea296eec2b50d72991290d8574"} Sep 19 08:21:14.865481 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:14.865452 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89kkh" event={"ID":"1caf055c-966a-4aaf-92b0-22fe9332e753","Type":"ContainerStarted","Data":"d060a4fc786558e5eda01e0849ea75576ce294ebb0d6684f50ef828abd8686bd"} Sep 19 08:21:14.877603 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:14.877558 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hmhmw" podStartSLOduration=5.590906071 podStartE2EDuration="22.877544362s" totalImagesPullingTime="17.286638291s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 08:20:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 08:21:14.877192135 +0000 UTC m=+24.607288762" watchObservedRunningTime="2026-09-19 08:21:14.877544362 +0000 UTC m=+24.607640964" Sep 19 08:21:15.606084 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:15.606045 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2qgv" Sep 19 08:21:15.606258 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:15.606171 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2qgv" podUID="1f40898d-6f69-48bc-8af6-3224a163f776" Sep 19 08:21:15.870586 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:15.870512 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89kkh" event={"ID":"1caf055c-966a-4aaf-92b0-22fe9332e753","Type":"ContainerStarted","Data":"637919d7562e4edea34d5889997e90d8cd88b86bceba0d0a504d0ad446c66ca1"} Sep 19 08:21:15.888106 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:15.887861 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89kkh" podStartSLOduration=3.7877384640000002 podStartE2EDuration="22.887842034s" totalImagesPullingTime="19.10010357s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 08:20:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 08:21:15.887630783 +0000 UTC m=+25.617727388" watchObservedRunningTime="2026-09-19 08:21:15.887842034 +0000 UTC m=+25.617938640" Sep 19 08:21:16.609354 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:16.609327 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgprw" Sep 19 08:21:16.609514 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:16.609336 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqz5p" Sep 19 08:21:16.609514 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:16.609432 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgprw" podUID="06d9bb1e-838b-4f04-9ff4-f668714c7877" Sep 19 08:21:16.609514 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:16.609500 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqz5p" podUID="35c26dae-8ddc-4ea9-b6d7-6de02274508c" Sep 19 08:21:16.876641 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:16.876566 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2hqv_3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136/ovn-acl-logging/0.log" Sep 19 08:21:16.877180 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:16.877027 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" event={"ID":"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136","Type":"ContainerStarted","Data":"024aa491499aad0e2effebd11d864e11641d9984e3f60fcf3bcc4bbd6ec76b7c"} Sep 19 08:21:17.606004 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:17.605972 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2qgv" Sep 19 08:21:17.606191 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:17.606098 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2qgv" podUID="1f40898d-6f69-48bc-8af6-3224a163f776" Sep 19 08:21:18.609538 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:18.609374 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqz5p" Sep 19 08:21:18.610138 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:18.609423 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgprw" Sep 19 08:21:18.610138 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:18.609613 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqz5p" podUID="35c26dae-8ddc-4ea9-b6d7-6de02274508c" Sep 19 08:21:18.610138 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:18.609690 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgprw" podUID="06d9bb1e-838b-4f04-9ff4-f668714c7877" Sep 19 08:21:18.669949 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:18.669915 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qw5l5" Sep 19 08:21:18.670538 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:18.670521 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qw5l5" Sep 19 08:21:18.885289 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:18.885201 2584 generic.go:356] "Generic (PLEG): container finished" podID="55c84c99-604b-49d6-8ba9-01e04e3accda" containerID="82c5857a985180b08c0f559017776f5ae0aa29b3bdb805cee2a71acd67277023" exitCode=0 Sep 19 08:21:18.885289 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:18.885278 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jgn8b" event={"ID":"55c84c99-604b-49d6-8ba9-01e04e3accda","Type":"ContainerDied","Data":"82c5857a985180b08c0f559017776f5ae0aa29b3bdb805cee2a71acd67277023"} Sep 19 08:21:18.889204 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:18.889188 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2hqv_3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136/ovn-acl-logging/0.log" Sep 19 08:21:18.889606 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:18.889585 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" event={"ID":"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136","Type":"ContainerStarted","Data":"940b384b4c038a64235da18c294c12d29e4bdaeb250fd21e89716323f2376cb9"} Sep 19 08:21:18.890245 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:18.889803 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qw5l5" Sep 19 08:21:18.890245 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:18.889840 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:21:18.890245 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:18.889891 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:21:18.890245 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:18.889952 2584 scope.go:117] "RemoveContainer" containerID="8c8bd5029481e0a2bd11594a19f5ed7fc3c494322c3fe2942067e6e9cb183dec" Sep 19 08:21:18.890245 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:18.890170 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qw5l5" Sep 19 08:21:18.905576 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:18.905556 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:21:18.905675 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:18.905656 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:21:19.605904 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:19.605870 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2qgv" Sep 19 08:21:19.606136 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:19.606003 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2qgv" podUID="1f40898d-6f69-48bc-8af6-3224a163f776" Sep 19 08:21:19.897291 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:19.897264 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2hqv_3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136/ovn-acl-logging/0.log" Sep 19 08:21:19.898064 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:19.898024 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" event={"ID":"3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136","Type":"ContainerStarted","Data":"bd92d356f4c1a9c5749aecf05fdf9693b583f3a1721c85b86041a4a1969a287b"} Sep 19 08:21:19.898223 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:19.898195 2584 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 19 08:21:19.949337 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:19.949174 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" podStartSLOduration=10.406260194 podStartE2EDuration="27.949156646s" totalImagesPullingTime="17.542896452s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 08:20:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 08:21:19.948688639 +0000 UTC m=+29.678785241" watchObservedRunningTime="2026-09-19 08:21:19.949156646 +0000 UTC m=+29.679253249" Sep 19 08:21:19.984864 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:19.984836 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xgprw"] Sep 19 08:21:19.985051 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:19.984978 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgprw" Sep 19 08:21:19.985172 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:19.985099 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgprw" podUID="06d9bb1e-838b-4f04-9ff4-f668714c7877" Sep 19 08:21:19.988396 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:19.988375 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-h2qgv"] Sep 19 08:21:19.988473 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:19.988465 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2qgv" Sep 19 08:21:19.988585 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:19.988566 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2qgv" podUID="1f40898d-6f69-48bc-8af6-3224a163f776" Sep 19 08:21:19.989122 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:19.989099 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kqz5p"] Sep 19 08:21:19.989217 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:19.989205 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqz5p" Sep 19 08:21:19.989331 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:19.989310 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqz5p" podUID="35c26dae-8ddc-4ea9-b6d7-6de02274508c" Sep 19 08:21:20.901982 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:20.901952 2584 generic.go:356] "Generic (PLEG): container finished" podID="55c84c99-604b-49d6-8ba9-01e04e3accda" containerID="67ee3cf1586e5f521cb414f62181b908a9e5b1d418bcc9da39743d4d8c2ec0ad" exitCode=0 Sep 19 08:21:20.902365 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:20.902008 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jgn8b" event={"ID":"55c84c99-604b-49d6-8ba9-01e04e3accda","Type":"ContainerDied","Data":"67ee3cf1586e5f521cb414f62181b908a9e5b1d418bcc9da39743d4d8c2ec0ad"} Sep 19 08:21:20.902365 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:20.902088 2584 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 19 08:21:21.606427 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:21.606381 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2qgv" Sep 19 08:21:21.606427 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:21.606423 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgprw" Sep 19 08:21:21.606665 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:21.606509 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2qgv" podUID="1f40898d-6f69-48bc-8af6-3224a163f776" Sep 19 08:21:21.606665 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:21.606558 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqz5p" Sep 19 08:21:21.606665 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:21.606631 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgprw" podUID="06d9bb1e-838b-4f04-9ff4-f668714c7877" Sep 19 08:21:21.606796 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:21.606703 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqz5p" podUID="35c26dae-8ddc-4ea9-b6d7-6de02274508c" Sep 19 08:21:22.907892 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:22.907863 2584 generic.go:356] "Generic (PLEG): container finished" podID="55c84c99-604b-49d6-8ba9-01e04e3accda" containerID="99b7cdadef2a14f0e831ed658c406b684be2de3e4cc4334f1017426cdc17257b" exitCode=0 Sep 19 08:21:22.908427 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:22.907917 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jgn8b" event={"ID":"55c84c99-604b-49d6-8ba9-01e04e3accda","Type":"ContainerDied","Data":"99b7cdadef2a14f0e831ed658c406b684be2de3e4cc4334f1017426cdc17257b"} Sep 19 08:21:23.556402 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:23.556364 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:21:23.556629 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:23.556615 2584 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 19 08:21:23.570864 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:23.570821 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" podUID="3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136" containerName="ovnkube-controller" probeResult="failure" output="" Sep 19 08:21:23.580518 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:23.580485 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" podUID="3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136" containerName="ovnkube-controller" probeResult="failure" output="" Sep 19 08:21:23.606279 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:23.606253 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgprw" Sep 19 08:21:23.606410 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:23.606253 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2qgv" Sep 19 08:21:23.606410 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:23.606372 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgprw" podUID="06d9bb1e-838b-4f04-9ff4-f668714c7877" Sep 19 08:21:23.606511 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:23.606253 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqz5p" Sep 19 08:21:23.606511 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:23.606443 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2qgv" podUID="1f40898d-6f69-48bc-8af6-3224a163f776" Sep 19 08:21:23.606633 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:23.606554 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqz5p" podUID="35c26dae-8ddc-4ea9-b6d7-6de02274508c" Sep 19 08:21:25.605603 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:25.605567 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2qgv" Sep 19 08:21:25.606114 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:25.605655 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqz5p" Sep 19 08:21:25.606114 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:25.605767 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgprw" Sep 19 08:21:25.606114 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:25.605783 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2qgv" podUID="1f40898d-6f69-48bc-8af6-3224a163f776" Sep 19 08:21:25.606114 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:25.605867 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgprw" podUID="06d9bb1e-838b-4f04-9ff4-f668714c7877" Sep 19 08:21:25.606114 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:25.605958 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqz5p" podUID="35c26dae-8ddc-4ea9-b6d7-6de02274508c" Sep 19 08:21:26.239120 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:26.239085 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35c26dae-8ddc-4ea9-b6d7-6de02274508c-metrics-certs\") pod \"network-metrics-daemon-kqz5p\" (UID: \"35c26dae-8ddc-4ea9-b6d7-6de02274508c\") " pod="openshift-multus/network-metrics-daemon-kqz5p" Sep 19 08:21:26.239369 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:26.239147 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06d9bb1e-838b-4f04-9ff4-f668714c7877-original-pull-secret\") pod \"global-pull-secret-syncer-xgprw\" (UID: \"06d9bb1e-838b-4f04-9ff4-f668714c7877\") " pod="kube-system/global-pull-secret-syncer-xgprw" Sep 19 08:21:26.239369 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:26.239199 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 08:21:26.239369 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:26.239229 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 19 08:21:26.239369 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:26.239294 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35c26dae-8ddc-4ea9-b6d7-6de02274508c-metrics-certs podName:35c26dae-8ddc-4ea9-b6d7-6de02274508c nodeName:}" failed. No retries permitted until 2026-09-19 08:21:58.239270925 +0000 UTC m=+67.969367508 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35c26dae-8ddc-4ea9-b6d7-6de02274508c-metrics-certs") pod "network-metrics-daemon-kqz5p" (UID: "35c26dae-8ddc-4ea9-b6d7-6de02274508c") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 08:21:26.239369 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:26.239312 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06d9bb1e-838b-4f04-9ff4-f668714c7877-original-pull-secret podName:06d9bb1e-838b-4f04-9ff4-f668714c7877 nodeName:}" failed. No retries permitted until 2026-09-19 08:21:58.239305057 +0000 UTC m=+67.969401636 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/06d9bb1e-838b-4f04-9ff4-f668714c7877-original-pull-secret") pod "global-pull-secret-syncer-xgprw" (UID: "06d9bb1e-838b-4f04-9ff4-f668714c7877") : object "kube-system"/"original-pull-secret" not registered Sep 19 08:21:26.339622 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:26.339586 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtrgm\" (UniqueName: \"kubernetes.io/projected/1f40898d-6f69-48bc-8af6-3224a163f776-kube-api-access-xtrgm\") pod \"network-check-target-h2qgv\" (UID: \"1f40898d-6f69-48bc-8af6-3224a163f776\") " pod="openshift-network-diagnostics/network-check-target-h2qgv" Sep 19 08:21:26.339810 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:26.339784 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 19 08:21:26.339869 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:26.339816 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 19 08:21:26.339869 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:26.339830 2584 projected.go:196] Error preparing data for projected volume kube-api-access-xtrgm for pod openshift-network-diagnostics/network-check-target-h2qgv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 08:21:26.339934 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:26.339893 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f40898d-6f69-48bc-8af6-3224a163f776-kube-api-access-xtrgm podName:1f40898d-6f69-48bc-8af6-3224a163f776 nodeName:}" failed. No retries permitted until 2026-09-19 08:21:58.339875015 +0000 UTC m=+68.069971598 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xtrgm" (UniqueName: "kubernetes.io/projected/1f40898d-6f69-48bc-8af6-3224a163f776-kube-api-access-xtrgm") pod "network-check-target-h2qgv" (UID: "1f40898d-6f69-48bc-8af6-3224a163f776") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 08:21:27.605597 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:27.605568 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqz5p" Sep 19 08:21:27.605941 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:27.605610 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgprw" Sep 19 08:21:27.605941 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:27.605576 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2qgv" Sep 19 08:21:27.605941 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:27.605684 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqz5p" podUID="35c26dae-8ddc-4ea9-b6d7-6de02274508c" Sep 19 08:21:27.605941 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:27.605736 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2qgv" podUID="1f40898d-6f69-48bc-8af6-3224a163f776" Sep 19 08:21:27.605941 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:27.605784 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgprw" podUID="06d9bb1e-838b-4f04-9ff4-f668714c7877" Sep 19 08:21:27.921656 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:27.921575 2584 generic.go:356] "Generic (PLEG): container finished" podID="55c84c99-604b-49d6-8ba9-01e04e3accda" containerID="b92a30f84ab5bcf73ee00d5233c9b5545b881ac691115a352a7c65be6d31f7e8" exitCode=0 Sep 19 08:21:27.921656 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:27.921624 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jgn8b" event={"ID":"55c84c99-604b-49d6-8ba9-01e04e3accda","Type":"ContainerDied","Data":"b92a30f84ab5bcf73ee00d5233c9b5545b881ac691115a352a7c65be6d31f7e8"} Sep 19 08:21:28.930097 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:28.930051 2584 generic.go:356] "Generic (PLEG): container finished" podID="55c84c99-604b-49d6-8ba9-01e04e3accda" containerID="43aa30f735ef9d9bf83a60ffceef173a7a502763c3b34b50d8a1f744e00fcd5a" exitCode=0 Sep 19 08:21:28.930438 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:28.930107 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jgn8b" event={"ID":"55c84c99-604b-49d6-8ba9-01e04e3accda","Type":"ContainerDied","Data":"43aa30f735ef9d9bf83a60ffceef173a7a502763c3b34b50d8a1f744e00fcd5a"} Sep 19 08:21:29.605609 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:29.605441 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgprw" Sep 19 08:21:29.605737 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:29.605476 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2qgv" Sep 19 08:21:29.605737 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:29.605681 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgprw" podUID="06d9bb1e-838b-4f04-9ff4-f668714c7877" Sep 19 08:21:29.605826 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:29.605476 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqz5p" Sep 19 08:21:29.605826 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:29.605748 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2qgv" podUID="1f40898d-6f69-48bc-8af6-3224a163f776" Sep 19 08:21:29.605888 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:29.605820 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqz5p" podUID="35c26dae-8ddc-4ea9-b6d7-6de02274508c" Sep 19 08:21:29.938066 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:29.938030 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jgn8b" event={"ID":"55c84c99-604b-49d6-8ba9-01e04e3accda","Type":"ContainerStarted","Data":"c97ce657a0d4fab38c09b441dce980779e13dc101ffb512b6409aea5733f1377"} Sep 19 08:21:29.992484 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:29.992437 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jgn8b" podStartSLOduration=10.067168944 podStartE2EDuration="37.992424006s" totalImagesPullingTime="27.925255062s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 08:20:52 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 08:21:29.98527361 +0000 UTC m=+39.715370212" watchObservedRunningTime="2026-09-19 08:21:29.992424006 +0000 UTC m=+39.722520607" Sep 19 08:21:31.605943 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:31.605907 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgprw" Sep 19 08:21:31.606380 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:31.606014 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2qgv" Sep 19 08:21:31.606380 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:31.606031 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgprw" podUID="06d9bb1e-838b-4f04-9ff4-f668714c7877" Sep 19 08:21:31.606380 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:31.606044 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqz5p" Sep 19 08:21:31.606380 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:31.606123 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2qgv" podUID="1f40898d-6f69-48bc-8af6-3224a163f776" Sep 19 08:21:31.606380 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:31.606218 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqz5p" podUID="35c26dae-8ddc-4ea9-b6d7-6de02274508c" Sep 19 08:21:33.605933 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:33.605902 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgprw" Sep 19 08:21:33.605933 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:33.605933 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqz5p" Sep 19 08:21:33.606328 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:33.606051 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2qgv" Sep 19 08:21:33.606328 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:33.606053 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgprw" podUID="06d9bb1e-838b-4f04-9ff4-f668714c7877" Sep 19 08:21:33.606328 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:33.606153 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqz5p" podUID="35c26dae-8ddc-4ea9-b6d7-6de02274508c" Sep 19 08:21:33.606328 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:33.606227 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2qgv" podUID="1f40898d-6f69-48bc-8af6-3224a163f776" Sep 19 08:21:35.606290 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:35.606262 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqz5p" Sep 19 08:21:35.606808 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:35.606370 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgprw" Sep 19 08:21:35.606808 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:35.606393 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2qgv" Sep 19 08:21:35.606808 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:35.606385 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqz5p" podUID="35c26dae-8ddc-4ea9-b6d7-6de02274508c" Sep 19 08:21:35.606808 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:35.606458 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgprw" podUID="06d9bb1e-838b-4f04-9ff4-f668714c7877" Sep 19 08:21:35.606808 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:35.606526 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2qgv" podUID="1f40898d-6f69-48bc-8af6-3224a163f776" Sep 19 08:21:37.606468 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:37.606426 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2qgv" Sep 19 08:21:37.606927 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:37.606533 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgprw" Sep 19 08:21:37.606927 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:37.606545 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2qgv" podUID="1f40898d-6f69-48bc-8af6-3224a163f776" Sep 19 08:21:37.606927 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:37.606567 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqz5p" Sep 19 08:21:37.606927 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:37.606663 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgprw" podUID="06d9bb1e-838b-4f04-9ff4-f668714c7877" Sep 19 08:21:37.606927 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:37.606755 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqz5p" podUID="35c26dae-8ddc-4ea9-b6d7-6de02274508c" Sep 19 08:21:39.605513 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:39.605479 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqz5p" Sep 19 08:21:39.605513 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:39.605489 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2qgv" Sep 19 08:21:39.605904 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:39.605596 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgprw" Sep 19 08:21:39.605904 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:39.605639 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2qgv" podUID="1f40898d-6f69-48bc-8af6-3224a163f776" Sep 19 08:21:39.605904 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:39.605648 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqz5p" podUID="35c26dae-8ddc-4ea9-b6d7-6de02274508c" Sep 19 08:21:39.605904 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:39.605693 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgprw" podUID="06d9bb1e-838b-4f04-9ff4-f668714c7877" Sep 19 08:21:41.605579 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:41.605546 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgprw" Sep 19 08:21:41.605579 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:41.605581 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqz5p" Sep 19 08:21:41.605996 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:41.605661 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgprw" podUID="06d9bb1e-838b-4f04-9ff4-f668714c7877" Sep 19 08:21:41.605996 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:41.605716 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2qgv" Sep 19 08:21:41.605996 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:41.605798 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqz5p" podUID="35c26dae-8ddc-4ea9-b6d7-6de02274508c" Sep 19 08:21:41.605996 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:41.605898 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2qgv" podUID="1f40898d-6f69-48bc-8af6-3224a163f776" Sep 19 08:21:43.605839 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:43.605806 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgprw" Sep 19 08:21:43.605839 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:43.605837 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqz5p" Sep 19 08:21:43.606311 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:43.605933 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgprw" podUID="06d9bb1e-838b-4f04-9ff4-f668714c7877" Sep 19 08:21:43.606311 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:43.605980 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2qgv" Sep 19 08:21:43.606311 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:43.606084 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kqz5p" podUID="35c26dae-8ddc-4ea9-b6d7-6de02274508c" Sep 19 08:21:43.606311 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:43.606126 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2qgv" podUID="1f40898d-6f69-48bc-8af6-3224a163f776" Sep 19 08:21:45.136842 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.136811 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-96.ec2.internal" event="NodeReady" Sep 19 08:21:45.137219 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.136931 2584 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 19 08:21:45.201710 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.201678 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-j2brr"] Sep 19 08:21:45.222737 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.222706 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2z6p9"] Sep 19 08:21:45.222911 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.222857 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-j2brr" Sep 19 08:21:45.226714 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.226689 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 19 08:21:45.226968 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.226948 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jw55w\"" Sep 19 08:21:45.227155 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.227138 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 19 08:21:45.227240 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.227230 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 19 08:21:45.227461 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.227441 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 19 08:21:45.246825 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.246795 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2z6p9"] Sep 19 08:21:45.246825 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.246811 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2z6p9" Sep 19 08:21:45.246943 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.246838 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-j2brr"] Sep 19 08:21:45.249674 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.249653 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 19 08:21:45.249779 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.249751 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 19 08:21:45.249779 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.249758 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 19 08:21:45.249993 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.249978 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2fzkh\"" Sep 19 08:21:45.280987 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.280964 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dcd59d2f-1e60-44da-9855-685123b5ea73-data-volume\") pod \"insights-runtime-extractor-j2brr\" (UID: \"dcd59d2f-1e60-44da-9855-685123b5ea73\") " pod="openshift-insights/insights-runtime-extractor-j2brr" Sep 19 08:21:45.281111 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.281003 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dcd59d2f-1e60-44da-9855-685123b5ea73-crio-socket\") pod \"insights-runtime-extractor-j2brr\" (UID: \"dcd59d2f-1e60-44da-9855-685123b5ea73\") " pod="openshift-insights/insights-runtime-extractor-j2brr" Sep 19 08:21:45.281111 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.281020 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dcd59d2f-1e60-44da-9855-685123b5ea73-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j2brr\" (UID: \"dcd59d2f-1e60-44da-9855-685123b5ea73\") " pod="openshift-insights/insights-runtime-extractor-j2brr" Sep 19 08:21:45.281111 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.281038 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dcd59d2f-1e60-44da-9855-685123b5ea73-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j2brr\" (UID: \"dcd59d2f-1e60-44da-9855-685123b5ea73\") " pod="openshift-insights/insights-runtime-extractor-j2brr" Sep 19 08:21:45.281111 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.281105 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86b5ce2f-cf90-4c06-8692-7041dee6196d-cert\") pod \"ingress-canary-2z6p9\" (UID: \"86b5ce2f-cf90-4c06-8692-7041dee6196d\") " pod="openshift-ingress-canary/ingress-canary-2z6p9" Sep 19 08:21:45.281239 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.281122 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm22m\" (UniqueName: \"kubernetes.io/projected/86b5ce2f-cf90-4c06-8692-7041dee6196d-kube-api-access-zm22m\") pod \"ingress-canary-2z6p9\" (UID: \"86b5ce2f-cf90-4c06-8692-7041dee6196d\") " pod="openshift-ingress-canary/ingress-canary-2z6p9" Sep 19 08:21:45.281239 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.281148 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vllx5\" (UniqueName: \"kubernetes.io/projected/dcd59d2f-1e60-44da-9855-685123b5ea73-kube-api-access-vllx5\") pod \"insights-runtime-extractor-j2brr\" (UID: \"dcd59d2f-1e60-44da-9855-685123b5ea73\") " pod="openshift-insights/insights-runtime-extractor-j2brr" Sep 19 08:21:45.293033 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.293011 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-k97bb"] Sep 19 08:21:45.311255 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.311230 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-k97bb"] Sep 19 08:21:45.311361 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.311335 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k97bb" Sep 19 08:21:45.315148 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.315129 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cdf7v\"" Sep 19 08:21:45.315240 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.315129 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 19 08:21:45.315393 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.315376 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 19 08:21:45.381975 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.381947 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dcd59d2f-1e60-44da-9855-685123b5ea73-crio-socket\") pod \"insights-runtime-extractor-j2brr\" (UID: \"dcd59d2f-1e60-44da-9855-685123b5ea73\") " pod="openshift-insights/insights-runtime-extractor-j2brr" Sep 19 08:21:45.381975 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.381979 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dcd59d2f-1e60-44da-9855-685123b5ea73-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j2brr\" (UID: \"dcd59d2f-1e60-44da-9855-685123b5ea73\") " pod="openshift-insights/insights-runtime-extractor-j2brr" Sep 19 08:21:45.382240 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.381998 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dcd59d2f-1e60-44da-9855-685123b5ea73-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j2brr\" (UID: \"dcd59d2f-1e60-44da-9855-685123b5ea73\") " pod="openshift-insights/insights-runtime-extractor-j2brr" Sep 19 08:21:45.382240 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.382019 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9baaaa17-8835-4bc2-9651-683dc6f2bf47-tmp-dir\") pod \"dns-default-k97bb\" (UID: \"9baaaa17-8835-4bc2-9651-683dc6f2bf47\") " pod="openshift-dns/dns-default-k97bb" Sep 19 08:21:45.382240 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.382034 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9baaaa17-8835-4bc2-9651-683dc6f2bf47-config-volume\") pod \"dns-default-k97bb\" (UID: \"9baaaa17-8835-4bc2-9651-683dc6f2bf47\") " pod="openshift-dns/dns-default-k97bb" Sep 19 08:21:45.382240 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.382055 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86b5ce2f-cf90-4c06-8692-7041dee6196d-cert\") pod \"ingress-canary-2z6p9\" (UID: \"86b5ce2f-cf90-4c06-8692-7041dee6196d\") " pod="openshift-ingress-canary/ingress-canary-2z6p9" Sep 19 08:21:45.382240 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.382116 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8sgg\" (UniqueName: \"kubernetes.io/projected/9baaaa17-8835-4bc2-9651-683dc6f2bf47-kube-api-access-m8sgg\") pod \"dns-default-k97bb\" (UID: \"9baaaa17-8835-4bc2-9651-683dc6f2bf47\") " pod="openshift-dns/dns-default-k97bb" Sep 19 08:21:45.382240 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.382158 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zm22m\" (UniqueName: \"kubernetes.io/projected/86b5ce2f-cf90-4c06-8692-7041dee6196d-kube-api-access-zm22m\") pod \"ingress-canary-2z6p9\" (UID: \"86b5ce2f-cf90-4c06-8692-7041dee6196d\") " pod="openshift-ingress-canary/ingress-canary-2z6p9" Sep 19 08:21:45.382240 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.382187 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dcd59d2f-1e60-44da-9855-685123b5ea73-crio-socket\") pod \"insights-runtime-extractor-j2brr\" (UID: \"dcd59d2f-1e60-44da-9855-685123b5ea73\") " pod="openshift-insights/insights-runtime-extractor-j2brr" Sep 19 08:21:45.382240 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.382208 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vllx5\" (UniqueName: \"kubernetes.io/projected/dcd59d2f-1e60-44da-9855-685123b5ea73-kube-api-access-vllx5\") pod \"insights-runtime-extractor-j2brr\" (UID: \"dcd59d2f-1e60-44da-9855-685123b5ea73\") " pod="openshift-insights/insights-runtime-extractor-j2brr" Sep 19 08:21:45.382617 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.382247 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9baaaa17-8835-4bc2-9651-683dc6f2bf47-metrics-tls\") pod \"dns-default-k97bb\" (UID: \"9baaaa17-8835-4bc2-9651-683dc6f2bf47\") " pod="openshift-dns/dns-default-k97bb" Sep 19 08:21:45.382617 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.382276 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dcd59d2f-1e60-44da-9855-685123b5ea73-data-volume\") pod \"insights-runtime-extractor-j2brr\" (UID: \"dcd59d2f-1e60-44da-9855-685123b5ea73\") " pod="openshift-insights/insights-runtime-extractor-j2brr" Sep 19 08:21:45.382617 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.382586 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dcd59d2f-1e60-44da-9855-685123b5ea73-data-volume\") pod \"insights-runtime-extractor-j2brr\" (UID: \"dcd59d2f-1e60-44da-9855-685123b5ea73\") " pod="openshift-insights/insights-runtime-extractor-j2brr" Sep 19 08:21:45.382763 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.382644 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dcd59d2f-1e60-44da-9855-685123b5ea73-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j2brr\" (UID: \"dcd59d2f-1e60-44da-9855-685123b5ea73\") " pod="openshift-insights/insights-runtime-extractor-j2brr" Sep 19 08:21:45.385774 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.385754 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dcd59d2f-1e60-44da-9855-685123b5ea73-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j2brr\" (UID: \"dcd59d2f-1e60-44da-9855-685123b5ea73\") " pod="openshift-insights/insights-runtime-extractor-j2brr" Sep 19 08:21:45.385845 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.385795 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86b5ce2f-cf90-4c06-8692-7041dee6196d-cert\") pod \"ingress-canary-2z6p9\" (UID: \"86b5ce2f-cf90-4c06-8692-7041dee6196d\") " pod="openshift-ingress-canary/ingress-canary-2z6p9" Sep 19 08:21:45.392043 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.391983 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vllx5\" (UniqueName: \"kubernetes.io/projected/dcd59d2f-1e60-44da-9855-685123b5ea73-kube-api-access-vllx5\") pod \"insights-runtime-extractor-j2brr\" (UID: \"dcd59d2f-1e60-44da-9855-685123b5ea73\") " pod="openshift-insights/insights-runtime-extractor-j2brr" Sep 19 08:21:45.392452 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.392434 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm22m\" (UniqueName: \"kubernetes.io/projected/86b5ce2f-cf90-4c06-8692-7041dee6196d-kube-api-access-zm22m\") pod \"ingress-canary-2z6p9\" (UID: \"86b5ce2f-cf90-4c06-8692-7041dee6196d\") " pod="openshift-ingress-canary/ingress-canary-2z6p9" Sep 19 08:21:45.483217 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.483181 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8sgg\" (UniqueName: \"kubernetes.io/projected/9baaaa17-8835-4bc2-9651-683dc6f2bf47-kube-api-access-m8sgg\") pod \"dns-default-k97bb\" (UID: \"9baaaa17-8835-4bc2-9651-683dc6f2bf47\") " pod="openshift-dns/dns-default-k97bb" Sep 19 08:21:45.483374 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.483335 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9baaaa17-8835-4bc2-9651-683dc6f2bf47-metrics-tls\") pod \"dns-default-k97bb\" (UID: \"9baaaa17-8835-4bc2-9651-683dc6f2bf47\") " pod="openshift-dns/dns-default-k97bb" Sep 19 08:21:45.483431 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.483418 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9baaaa17-8835-4bc2-9651-683dc6f2bf47-tmp-dir\") pod \"dns-default-k97bb\" (UID: \"9baaaa17-8835-4bc2-9651-683dc6f2bf47\") " pod="openshift-dns/dns-default-k97bb" Sep 19 08:21:45.483483 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.483445 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9baaaa17-8835-4bc2-9651-683dc6f2bf47-config-volume\") pod \"dns-default-k97bb\" (UID: \"9baaaa17-8835-4bc2-9651-683dc6f2bf47\") " pod="openshift-dns/dns-default-k97bb" Sep 19 08:21:45.483771 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.483751 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9baaaa17-8835-4bc2-9651-683dc6f2bf47-tmp-dir\") pod \"dns-default-k97bb\" (UID: \"9baaaa17-8835-4bc2-9651-683dc6f2bf47\") " pod="openshift-dns/dns-default-k97bb" Sep 19 08:21:45.483952 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.483936 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9baaaa17-8835-4bc2-9651-683dc6f2bf47-config-volume\") pod \"dns-default-k97bb\" (UID: \"9baaaa17-8835-4bc2-9651-683dc6f2bf47\") " pod="openshift-dns/dns-default-k97bb" Sep 19 08:21:45.485557 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.485536 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9baaaa17-8835-4bc2-9651-683dc6f2bf47-metrics-tls\") pod \"dns-default-k97bb\" (UID: \"9baaaa17-8835-4bc2-9651-683dc6f2bf47\") " pod="openshift-dns/dns-default-k97bb" Sep 19 08:21:45.492432 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.492412 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8sgg\" (UniqueName: \"kubernetes.io/projected/9baaaa17-8835-4bc2-9651-683dc6f2bf47-kube-api-access-m8sgg\") pod \"dns-default-k97bb\" (UID: \"9baaaa17-8835-4bc2-9651-683dc6f2bf47\") " pod="openshift-dns/dns-default-k97bb" Sep 19 08:21:45.533275 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.533250 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-j2brr" Sep 19 08:21:45.555392 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.555371 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2z6p9" Sep 19 08:21:45.605984 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.605955 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgprw" Sep 19 08:21:45.606132 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.606054 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqz5p" Sep 19 08:21:45.606132 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.606097 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2qgv" Sep 19 08:21:45.609051 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.608953 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2vrmn\"" Sep 19 08:21:45.609051 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.608963 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 19 08:21:45.609051 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.608993 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 19 08:21:45.609051 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.609043 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 19 08:21:45.609448 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.609059 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 19 08:21:45.609448 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.609169 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-czqpg\"" Sep 19 08:21:45.619671 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.619649 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k97bb" Sep 19 08:21:45.865182 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.865151 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2z6p9"] Sep 19 08:21:45.868242 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.868213 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-j2brr"] Sep 19 08:21:45.872484 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:21:45.872461 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcd59d2f_1e60_44da_9855_685123b5ea73.slice/crio-d887771481a2ad33e3ee7c933251e552cd6b9df6fbfea158dccccea1faf9a75f WatchSource:0}: Error finding container d887771481a2ad33e3ee7c933251e552cd6b9df6fbfea158dccccea1faf9a75f: Status 404 returned error can't find the container with id d887771481a2ad33e3ee7c933251e552cd6b9df6fbfea158dccccea1faf9a75f Sep 19 08:21:45.921265 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.921240 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-k97bb"] Sep 19 08:21:45.929037 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:21:45.929011 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9baaaa17_8835_4bc2_9651_683dc6f2bf47.slice/crio-7c70bbf44cc388d470a297e72c86569e24f501e35e6c388607f07f17419749d5 WatchSource:0}: Error finding container 7c70bbf44cc388d470a297e72c86569e24f501e35e6c388607f07f17419749d5: Status 404 returned error can't find the container with id 7c70bbf44cc388d470a297e72c86569e24f501e35e6c388607f07f17419749d5 Sep 19 08:21:45.975666 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.975634 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k97bb" event={"ID":"9baaaa17-8835-4bc2-9651-683dc6f2bf47","Type":"ContainerStarted","Data":"7c70bbf44cc388d470a297e72c86569e24f501e35e6c388607f07f17419749d5"} Sep 19 08:21:45.976699 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.976676 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2z6p9" event={"ID":"86b5ce2f-cf90-4c06-8692-7041dee6196d","Type":"ContainerStarted","Data":"f71443274b4ed8ac3bf2e01ef44b8d7f14bc27a921430c5349af1ba210a4049a"} Sep 19 08:21:45.977666 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:45.977648 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j2brr" event={"ID":"dcd59d2f-1e60-44da-9855-685123b5ea73","Type":"ContainerStarted","Data":"d887771481a2ad33e3ee7c933251e552cd6b9df6fbfea158dccccea1faf9a75f"} Sep 19 08:21:46.982654 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:46.982612 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j2brr" event={"ID":"dcd59d2f-1e60-44da-9855-685123b5ea73","Type":"ContainerStarted","Data":"82ce63e18af8298bfbbd7b250c14d84f9b0ffd132aaa94a3e0aabe0a69a0aca9"} Sep 19 08:21:48.443132 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:48.443095 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-kcwqt"] Sep 19 08:21:48.462642 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:48.462612 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-kcwqt"] Sep 19 08:21:48.462777 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:48.462723 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-kcwqt" Sep 19 08:21:48.465585 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:48.465564 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 19 08:21:48.466827 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:48.466805 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 19 08:21:48.466827 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:48.466820 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-7rqjk\"" Sep 19 08:21:48.466827 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:48.466806 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 19 08:21:48.467151 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:48.466828 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 19 08:21:48.467151 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:48.466880 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 19 08:21:48.506476 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:48.506453 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cc52163e-1303-45d6-ae55-0318a053aeac-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-kcwqt\" (UID: \"cc52163e-1303-45d6-ae55-0318a053aeac\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-kcwqt" Sep 19 08:21:48.506587 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:48.506511 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl4kx\" (UniqueName: \"kubernetes.io/projected/cc52163e-1303-45d6-ae55-0318a053aeac-kube-api-access-rl4kx\") pod \"prometheus-operator-7bd5d56d6-kcwqt\" (UID: \"cc52163e-1303-45d6-ae55-0318a053aeac\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-kcwqt" Sep 19 08:21:48.506587 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:48.506543 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc52163e-1303-45d6-ae55-0318a053aeac-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-kcwqt\" (UID: \"cc52163e-1303-45d6-ae55-0318a053aeac\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-kcwqt" Sep 19 08:21:48.506587 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:48.506568 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cc52163e-1303-45d6-ae55-0318a053aeac-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-kcwqt\" (UID: \"cc52163e-1303-45d6-ae55-0318a053aeac\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-kcwqt" Sep 19 08:21:48.607120 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:48.607082 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cc52163e-1303-45d6-ae55-0318a053aeac-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-kcwqt\" (UID: \"cc52163e-1303-45d6-ae55-0318a053aeac\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-kcwqt" Sep 19 08:21:48.607268 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:48.607129 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cc52163e-1303-45d6-ae55-0318a053aeac-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-kcwqt\" (UID: \"cc52163e-1303-45d6-ae55-0318a053aeac\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-kcwqt" Sep 19 08:21:48.607268 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:48.607179 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl4kx\" (UniqueName: \"kubernetes.io/projected/cc52163e-1303-45d6-ae55-0318a053aeac-kube-api-access-rl4kx\") pod \"prometheus-operator-7bd5d56d6-kcwqt\" (UID: \"cc52163e-1303-45d6-ae55-0318a053aeac\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-kcwqt" Sep 19 08:21:48.607395 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:48.607299 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc52163e-1303-45d6-ae55-0318a053aeac-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-kcwqt\" (UID: \"cc52163e-1303-45d6-ae55-0318a053aeac\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-kcwqt" Sep 19 08:21:48.607942 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:48.607918 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc52163e-1303-45d6-ae55-0318a053aeac-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-kcwqt\" (UID: \"cc52163e-1303-45d6-ae55-0318a053aeac\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-kcwqt" Sep 19 08:21:48.609501 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:48.609480 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cc52163e-1303-45d6-ae55-0318a053aeac-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-kcwqt\" (UID: \"cc52163e-1303-45d6-ae55-0318a053aeac\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-kcwqt" Sep 19 08:21:48.609619 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:48.609600 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cc52163e-1303-45d6-ae55-0318a053aeac-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-kcwqt\" (UID: \"cc52163e-1303-45d6-ae55-0318a053aeac\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-kcwqt" Sep 19 08:21:48.615422 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:48.615405 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl4kx\" (UniqueName: \"kubernetes.io/projected/cc52163e-1303-45d6-ae55-0318a053aeac-kube-api-access-rl4kx\") pod \"prometheus-operator-7bd5d56d6-kcwqt\" (UID: \"cc52163e-1303-45d6-ae55-0318a053aeac\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-kcwqt" Sep 19 08:21:48.772169 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:48.772092 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-kcwqt" Sep 19 08:21:48.989203 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:48.989170 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k97bb" event={"ID":"9baaaa17-8835-4bc2-9651-683dc6f2bf47","Type":"ContainerStarted","Data":"4b0b3a967e57c30a839188eabd5241f1361bb396f6e55d1cb2854ad453ebf2e7"} Sep 19 08:21:48.991067 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:48.991019 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2z6p9" event={"ID":"86b5ce2f-cf90-4c06-8692-7041dee6196d","Type":"ContainerStarted","Data":"838bdcb19aa738b5d6a2ec39e75ad010ad1d52bbf115eed59582b5962a359f9d"} Sep 19 08:21:48.993284 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:48.993264 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j2brr" event={"ID":"dcd59d2f-1e60-44da-9855-685123b5ea73","Type":"ContainerStarted","Data":"ff078a97cbbc59841aedbb8b7c2f28a9678c0fcfa1fff3e4a860c3b49c914694"} Sep 19 08:21:49.014886 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:49.014627 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2z6p9" podStartSLOduration=1.079771604 podStartE2EDuration="4.014611866s" totalImagesPullingTime="2.934840262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 08:21:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 08:21:49.013558764 +0000 UTC m=+58.743655366" watchObservedRunningTime="2026-09-19 08:21:49.014611866 +0000 UTC m=+58.744708465" Sep 19 08:21:49.068899 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:49.068867 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-kcwqt"] Sep 19 08:21:49.072250 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:21:49.072208 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc52163e_1303_45d6_ae55_0318a053aeac.slice/crio-a6d50896affb87d6d840a85a34681247c5f0cdf38134ddf9057310cfc2303cc5 WatchSource:0}: Error finding container a6d50896affb87d6d840a85a34681247c5f0cdf38134ddf9057310cfc2303cc5: Status 404 returned error can't find the container with id a6d50896affb87d6d840a85a34681247c5f0cdf38134ddf9057310cfc2303cc5 Sep 19 08:21:49.998451 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:49.998406 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-kcwqt" event={"ID":"cc52163e-1303-45d6-ae55-0318a053aeac","Type":"ContainerStarted","Data":"a6d50896affb87d6d840a85a34681247c5f0cdf38134ddf9057310cfc2303cc5"} Sep 19 08:21:50.000517 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:50.000489 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k97bb" event={"ID":"9baaaa17-8835-4bc2-9651-683dc6f2bf47","Type":"ContainerStarted","Data":"f98a9b2219fa49032afb574401ed0f900304914072dde2a8732d2887aac9666f"} Sep 19 08:21:50.023134 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:50.023058 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-k97bb" podStartSLOduration=2.152973995 podStartE2EDuration="5.02303746s" totalImagesPullingTime="2.870063465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 08:21:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 08:21:50.021261496 +0000 UTC m=+59.751358110" watchObservedRunningTime="2026-09-19 08:21:50.02303746 +0000 UTC m=+59.753134064" Sep 19 08:21:51.004812 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:51.004779 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-kcwqt" event={"ID":"cc52163e-1303-45d6-ae55-0318a053aeac","Type":"ContainerStarted","Data":"0ae291c9c537d7c62b28cfd501e4d3324be4d71999fe04d5dcb76b6e4074bb73"} Sep 19 08:21:51.005268 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:51.004831 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-kcwqt" event={"ID":"cc52163e-1303-45d6-ae55-0318a053aeac","Type":"ContainerStarted","Data":"a9dc5aa7e8b81bcf1a7185c9ae1fa6a92041f9d36e7145b8353591c7fc145c48"} Sep 19 08:21:51.006817 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:51.006796 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j2brr" event={"ID":"dcd59d2f-1e60-44da-9855-685123b5ea73","Type":"ContainerStarted","Data":"0d1d2cd3a72c1059398208ebe8e1065658e4f60d35f96fabe85c01e8ebc90f7e"} Sep 19 08:21:51.007065 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:51.007051 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-k97bb" Sep 19 08:21:51.024711 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:51.024667 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-kcwqt" podStartSLOduration=1.587167249 podStartE2EDuration="3.024649212s" totalImagesPullingTime="1.437481963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 08:21:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 08:21:51.024344545 +0000 UTC m=+60.754441171" watchObservedRunningTime="2026-09-19 08:21:51.024649212 +0000 UTC m=+60.754745816" Sep 19 08:21:51.044489 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:51.044447 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-j2brr" podStartSLOduration=1.7073336000000001 podStartE2EDuration="6.044432377s" totalImagesPullingTime="4.337098777s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 08:21:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 08:21:51.043842888 +0000 UTC m=+60.773939492" watchObservedRunningTime="2026-09-19 08:21:51.044432377 +0000 UTC m=+60.774528978" Sep 19 08:21:52.793494 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:52.793460 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-s2bqw"] Sep 19 08:21:52.795803 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:52.795783 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-s2bqw" Sep 19 08:21:52.798397 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:52.798376 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-xzwxk\"" Sep 19 08:21:52.799392 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:52.799366 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 19 08:21:52.799501 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:52.799370 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 19 08:21:52.810110 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:52.810057 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-s2bqw"] Sep 19 08:21:52.827874 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:52.827842 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8x6zs"] Sep 19 08:21:52.829935 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:52.829919 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-qrr6z"] Sep 19 08:21:52.830064 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:52.830047 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8x6zs" Sep 19 08:21:52.831651 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:52.831637 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-qrr6z" Sep 19 08:21:52.834249 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:52.834197 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 19 08:21:52.835028 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:52.835007 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 19 08:21:52.835439 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:52.835421 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 19 08:21:52.836171 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:52.836151 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 19 08:21:52.836268 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:52.836174 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-sln4t\"" Sep 19 08:21:52.836268 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:52.836220 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 19 08:21:52.836268 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:52.836224 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 19 08:21:52.836406 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:52.836160 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-f7j7t\"" Sep 19 08:21:52.838285 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:52.838268 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0669adfe-a5ed-4b64-bc9c-f572feabbf88-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-s2bqw\" (UID: \"0669adfe-a5ed-4b64-bc9c-f572feabbf88\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-s2bqw" Sep 19 08:21:52.838460 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:52.838294 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0669adfe-a5ed-4b64-bc9c-f572feabbf88-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-s2bqw\" (UID: \"0669adfe-a5ed-4b64-bc9c-f572feabbf88\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-s2bqw" Sep 19 08:21:52.838460 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:52.838311 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzxw4\" (UniqueName: \"kubernetes.io/projected/0669adfe-a5ed-4b64-bc9c-f572feabbf88-kube-api-access-kzxw4\") pod \"openshift-state-metrics-86c5bc79d6-s2bqw\" (UID: \"0669adfe-a5ed-4b64-bc9c-f572feabbf88\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-s2bqw" Sep 19 08:21:52.838460 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:52.838421 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0669adfe-a5ed-4b64-bc9c-f572feabbf88-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-s2bqw\" (UID: \"0669adfe-a5ed-4b64-bc9c-f572feabbf88\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-s2bqw" Sep 19 08:21:52.849730 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:52.849689 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-qrr6z"] Sep 19 08:21:52.939144 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:52.939112 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b2117f2e-52c2-4254-ad98-f83540d8eda2-node-exporter-tls\") pod \"node-exporter-8x6zs\" (UID: \"b2117f2e-52c2-4254-ad98-f83540d8eda2\") " pod="openshift-monitoring/node-exporter-8x6zs" Sep 19 08:21:52.939144 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:52.939157 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b2117f2e-52c2-4254-ad98-f83540d8eda2-sys\") pod \"node-exporter-8x6zs\" (UID: \"b2117f2e-52c2-4254-ad98-f83540d8eda2\") " pod="openshift-monitoring/node-exporter-8x6zs" Sep 19 08:21:52.939373 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:52.939175 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2167602f-49ad-4b65-9fad-4e8d35f6661b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-qrr6z\" (UID: \"2167602f-49ad-4b65-9fad-4e8d35f6661b\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-qrr6z" Sep 19 08:21:52.939373 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:52.939276 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz64v\" (UniqueName: \"kubernetes.io/projected/b2117f2e-52c2-4254-ad98-f83540d8eda2-kube-api-access-nz64v\") pod \"node-exporter-8x6zs\" (UID: \"b2117f2e-52c2-4254-ad98-f83540d8eda2\") " pod="openshift-monitoring/node-exporter-8x6zs" Sep 19 08:21:52.939373 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:52.939331 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0669adfe-a5ed-4b64-bc9c-f572feabbf88-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-s2bqw\" (UID: \"0669adfe-a5ed-4b64-bc9c-f572feabbf88\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-s2bqw" Sep 19 08:21:52.939373 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:52.939356 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0669adfe-a5ed-4b64-bc9c-f572feabbf88-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-s2bqw\" (UID: \"0669adfe-a5ed-4b64-bc9c-f572feabbf88\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-s2bqw" Sep 19 08:21:52.939373 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:52.939375 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b2117f2e-52c2-4254-ad98-f83540d8eda2-node-exporter-textfile\") pod \"node-exporter-8x6zs\" (UID: \"b2117f2e-52c2-4254-ad98-f83540d8eda2\") " pod="openshift-monitoring/node-exporter-8x6zs" Sep 19 08:21:52.939606 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:52.939395 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2167602f-49ad-4b65-9fad-4e8d35f6661b-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-qrr6z\" (UID: \"2167602f-49ad-4b65-9fad-4e8d35f6661b\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-qrr6z" Sep 19 08:21:52.939606 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:52.939431 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2167602f-49ad-4b65-9fad-4e8d35f6661b-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-qrr6z\" (UID: \"2167602f-49ad-4b65-9fad-4e8d35f6661b\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-qrr6z" Sep 19 08:21:52.939606 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:52.939447 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b2117f2e-52c2-4254-ad98-f83540d8eda2-node-exporter-wtmp\") pod \"node-exporter-8x6zs\" (UID: \"b2117f2e-52c2-4254-ad98-f83540d8eda2\") " pod="openshift-monitoring/node-exporter-8x6zs" Sep 19 08:21:52.939606 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:52.939464 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2167602f-49ad-4b65-9fad-4e8d35f6661b-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-qrr6z\" (UID: \"2167602f-49ad-4b65-9fad-4e8d35f6661b\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-qrr6z" Sep 19 08:21:52.939606 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:52.939483 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcllv\" (UniqueName: \"kubernetes.io/projected/2167602f-49ad-4b65-9fad-4e8d35f6661b-kube-api-access-wcllv\") pod \"kube-state-metrics-84c885658c-qrr6z\" (UID: \"2167602f-49ad-4b65-9fad-4e8d35f6661b\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-qrr6z" Sep 19 08:21:52.939606 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:52.939532 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzxw4\" (UniqueName: \"kubernetes.io/projected/0669adfe-a5ed-4b64-bc9c-f572feabbf88-kube-api-access-kzxw4\") pod \"openshift-state-metrics-86c5bc79d6-s2bqw\" (UID: \"0669adfe-a5ed-4b64-bc9c-f572feabbf88\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-s2bqw" Sep 19 08:21:52.939903 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:52.939643 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2167602f-49ad-4b65-9fad-4e8d35f6661b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-qrr6z\" (UID: \"2167602f-49ad-4b65-9fad-4e8d35f6661b\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-qrr6z" Sep 19 08:21:52.939903 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:52.939690 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b2117f2e-52c2-4254-ad98-f83540d8eda2-node-exporter-accelerators-collector-config\") pod \"node-exporter-8x6zs\" (UID: \"b2117f2e-52c2-4254-ad98-f83540d8eda2\") " pod="openshift-monitoring/node-exporter-8x6zs" Sep 19 08:21:52.939903 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:52.939740 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b2117f2e-52c2-4254-ad98-f83540d8eda2-root\") pod \"node-exporter-8x6zs\" (UID: \"b2117f2e-52c2-4254-ad98-f83540d8eda2\") " pod="openshift-monitoring/node-exporter-8x6zs" Sep 19 08:21:52.939903 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:52.939767 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0669adfe-a5ed-4b64-bc9c-f572feabbf88-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-s2bqw\" (UID: \"0669adfe-a5ed-4b64-bc9c-f572feabbf88\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-s2bqw" Sep 19 08:21:52.939903 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:52.939798 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2117f2e-52c2-4254-ad98-f83540d8eda2-metrics-client-ca\") pod \"node-exporter-8x6zs\" (UID: \"b2117f2e-52c2-4254-ad98-f83540d8eda2\") " pod="openshift-monitoring/node-exporter-8x6zs" Sep 19 08:21:52.939903 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:52.939814 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b2117f2e-52c2-4254-ad98-f83540d8eda2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8x6zs\" (UID: \"b2117f2e-52c2-4254-ad98-f83540d8eda2\") " pod="openshift-monitoring/node-exporter-8x6zs" Sep 19 08:21:52.940218 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:52.940170 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0669adfe-a5ed-4b64-bc9c-f572feabbf88-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-s2bqw\" (UID: \"0669adfe-a5ed-4b64-bc9c-f572feabbf88\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-s2bqw" Sep 19 08:21:52.941685 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:52.941665 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0669adfe-a5ed-4b64-bc9c-f572feabbf88-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-s2bqw\" (UID: \"0669adfe-a5ed-4b64-bc9c-f572feabbf88\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-s2bqw" Sep 19 08:21:52.941965 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:52.941945 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0669adfe-a5ed-4b64-bc9c-f572feabbf88-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-s2bqw\" (UID: \"0669adfe-a5ed-4b64-bc9c-f572feabbf88\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-s2bqw" Sep 19 08:21:52.948175 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:52.948157 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzxw4\" (UniqueName: \"kubernetes.io/projected/0669adfe-a5ed-4b64-bc9c-f572feabbf88-kube-api-access-kzxw4\") pod \"openshift-state-metrics-86c5bc79d6-s2bqw\" (UID: \"0669adfe-a5ed-4b64-bc9c-f572feabbf88\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-s2bqw" Sep 19 08:21:53.040322 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.040288 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2167602f-49ad-4b65-9fad-4e8d35f6661b-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-qrr6z\" (UID: \"2167602f-49ad-4b65-9fad-4e8d35f6661b\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-qrr6z" Sep 19 08:21:53.040322 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.040324 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b2117f2e-52c2-4254-ad98-f83540d8eda2-node-exporter-wtmp\") pod \"node-exporter-8x6zs\" (UID: \"b2117f2e-52c2-4254-ad98-f83540d8eda2\") " pod="openshift-monitoring/node-exporter-8x6zs" Sep 19 08:21:53.040574 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.040343 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2167602f-49ad-4b65-9fad-4e8d35f6661b-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-qrr6z\" (UID: \"2167602f-49ad-4b65-9fad-4e8d35f6661b\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-qrr6z" Sep 19 08:21:53.040574 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:53.040435 2584 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Sep 19 08:21:53.040574 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.040487 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcllv\" (UniqueName: \"kubernetes.io/projected/2167602f-49ad-4b65-9fad-4e8d35f6661b-kube-api-access-wcllv\") pod \"kube-state-metrics-84c885658c-qrr6z\" (UID: \"2167602f-49ad-4b65-9fad-4e8d35f6661b\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-qrr6z" Sep 19 08:21:53.040574 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.040493 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b2117f2e-52c2-4254-ad98-f83540d8eda2-node-exporter-wtmp\") pod \"node-exporter-8x6zs\" (UID: \"b2117f2e-52c2-4254-ad98-f83540d8eda2\") " pod="openshift-monitoring/node-exporter-8x6zs" Sep 19 08:21:53.040574 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:53.040498 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2167602f-49ad-4b65-9fad-4e8d35f6661b-kube-state-metrics-tls podName:2167602f-49ad-4b65-9fad-4e8d35f6661b nodeName:}" failed. No retries permitted until 2026-09-19 08:21:53.540481188 +0000 UTC m=+63.270577768 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/2167602f-49ad-4b65-9fad-4e8d35f6661b-kube-state-metrics-tls") pod "kube-state-metrics-84c885658c-qrr6z" (UID: "2167602f-49ad-4b65-9fad-4e8d35f6661b") : secret "kube-state-metrics-tls" not found Sep 19 08:21:53.040825 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.040577 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2167602f-49ad-4b65-9fad-4e8d35f6661b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-qrr6z\" (UID: \"2167602f-49ad-4b65-9fad-4e8d35f6661b\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-qrr6z" Sep 19 08:21:53.040825 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.040612 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b2117f2e-52c2-4254-ad98-f83540d8eda2-node-exporter-accelerators-collector-config\") pod \"node-exporter-8x6zs\" (UID: \"b2117f2e-52c2-4254-ad98-f83540d8eda2\") " pod="openshift-monitoring/node-exporter-8x6zs" Sep 19 08:21:53.040825 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.040642 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b2117f2e-52c2-4254-ad98-f83540d8eda2-root\") pod \"node-exporter-8x6zs\" (UID: \"b2117f2e-52c2-4254-ad98-f83540d8eda2\") " pod="openshift-monitoring/node-exporter-8x6zs" Sep 19 08:21:53.040825 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.040674 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2117f2e-52c2-4254-ad98-f83540d8eda2-metrics-client-ca\") pod \"node-exporter-8x6zs\" (UID: \"b2117f2e-52c2-4254-ad98-f83540d8eda2\") " pod="openshift-monitoring/node-exporter-8x6zs" Sep 19 08:21:53.040825 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.040727 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b2117f2e-52c2-4254-ad98-f83540d8eda2-root\") pod \"node-exporter-8x6zs\" (UID: \"b2117f2e-52c2-4254-ad98-f83540d8eda2\") " pod="openshift-monitoring/node-exporter-8x6zs" Sep 19 08:21:53.040825 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.040767 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b2117f2e-52c2-4254-ad98-f83540d8eda2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8x6zs\" (UID: \"b2117f2e-52c2-4254-ad98-f83540d8eda2\") " pod="openshift-monitoring/node-exporter-8x6zs" Sep 19 08:21:53.040825 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.040799 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b2117f2e-52c2-4254-ad98-f83540d8eda2-node-exporter-tls\") pod \"node-exporter-8x6zs\" (UID: \"b2117f2e-52c2-4254-ad98-f83540d8eda2\") " pod="openshift-monitoring/node-exporter-8x6zs" Sep 19 08:21:53.041182 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.040839 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b2117f2e-52c2-4254-ad98-f83540d8eda2-sys\") pod \"node-exporter-8x6zs\" (UID: \"b2117f2e-52c2-4254-ad98-f83540d8eda2\") " pod="openshift-monitoring/node-exporter-8x6zs" Sep 19 08:21:53.041182 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.040856 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2167602f-49ad-4b65-9fad-4e8d35f6661b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-qrr6z\" (UID: \"2167602f-49ad-4b65-9fad-4e8d35f6661b\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-qrr6z" Sep 19 08:21:53.041182 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.040884 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nz64v\" (UniqueName: \"kubernetes.io/projected/b2117f2e-52c2-4254-ad98-f83540d8eda2-kube-api-access-nz64v\") pod \"node-exporter-8x6zs\" (UID: \"b2117f2e-52c2-4254-ad98-f83540d8eda2\") " pod="openshift-monitoring/node-exporter-8x6zs" Sep 19 08:21:53.041182 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.040915 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b2117f2e-52c2-4254-ad98-f83540d8eda2-node-exporter-textfile\") pod \"node-exporter-8x6zs\" (UID: \"b2117f2e-52c2-4254-ad98-f83540d8eda2\") " pod="openshift-monitoring/node-exporter-8x6zs" Sep 19 08:21:53.041182 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.040949 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b2117f2e-52c2-4254-ad98-f83540d8eda2-sys\") pod \"node-exporter-8x6zs\" (UID: \"b2117f2e-52c2-4254-ad98-f83540d8eda2\") " pod="openshift-monitoring/node-exporter-8x6zs" Sep 19 08:21:53.041182 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.040953 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2167602f-49ad-4b65-9fad-4e8d35f6661b-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-qrr6z\" (UID: \"2167602f-49ad-4b65-9fad-4e8d35f6661b\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-qrr6z" Sep 19 08:21:53.041182 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.041145 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2167602f-49ad-4b65-9fad-4e8d35f6661b-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-qrr6z\" (UID: \"2167602f-49ad-4b65-9fad-4e8d35f6661b\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-qrr6z" Sep 19 08:21:53.041501 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.041342 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b2117f2e-52c2-4254-ad98-f83540d8eda2-node-exporter-accelerators-collector-config\") pod \"node-exporter-8x6zs\" (UID: \"b2117f2e-52c2-4254-ad98-f83540d8eda2\") " pod="openshift-monitoring/node-exporter-8x6zs" Sep 19 08:21:53.041501 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.041369 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2117f2e-52c2-4254-ad98-f83540d8eda2-metrics-client-ca\") pod \"node-exporter-8x6zs\" (UID: \"b2117f2e-52c2-4254-ad98-f83540d8eda2\") " pod="openshift-monitoring/node-exporter-8x6zs" Sep 19 08:21:53.041501 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.041483 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b2117f2e-52c2-4254-ad98-f83540d8eda2-node-exporter-textfile\") pod \"node-exporter-8x6zs\" (UID: \"b2117f2e-52c2-4254-ad98-f83540d8eda2\") " pod="openshift-monitoring/node-exporter-8x6zs" Sep 19 08:21:53.041601 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.041582 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2167602f-49ad-4b65-9fad-4e8d35f6661b-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-qrr6z\" (UID: \"2167602f-49ad-4b65-9fad-4e8d35f6661b\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-qrr6z" Sep 19 08:21:53.041967 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.041943 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2167602f-49ad-4b65-9fad-4e8d35f6661b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-qrr6z\" (UID: \"2167602f-49ad-4b65-9fad-4e8d35f6661b\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-qrr6z" Sep 19 08:21:53.043111 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.043068 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2167602f-49ad-4b65-9fad-4e8d35f6661b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-qrr6z\" (UID: \"2167602f-49ad-4b65-9fad-4e8d35f6661b\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-qrr6z" Sep 19 08:21:53.043111 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.043095 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b2117f2e-52c2-4254-ad98-f83540d8eda2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8x6zs\" (UID: \"b2117f2e-52c2-4254-ad98-f83540d8eda2\") " pod="openshift-monitoring/node-exporter-8x6zs" Sep 19 08:21:53.043523 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.043485 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b2117f2e-52c2-4254-ad98-f83540d8eda2-node-exporter-tls\") pod \"node-exporter-8x6zs\" (UID: \"b2117f2e-52c2-4254-ad98-f83540d8eda2\") " pod="openshift-monitoring/node-exporter-8x6zs" Sep 19 08:21:53.051993 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.051975 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz64v\" (UniqueName: \"kubernetes.io/projected/b2117f2e-52c2-4254-ad98-f83540d8eda2-kube-api-access-nz64v\") pod \"node-exporter-8x6zs\" (UID: \"b2117f2e-52c2-4254-ad98-f83540d8eda2\") " pod="openshift-monitoring/node-exporter-8x6zs" Sep 19 08:21:53.052280 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.052262 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcllv\" (UniqueName: \"kubernetes.io/projected/2167602f-49ad-4b65-9fad-4e8d35f6661b-kube-api-access-wcllv\") pod \"kube-state-metrics-84c885658c-qrr6z\" (UID: \"2167602f-49ad-4b65-9fad-4e8d35f6661b\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-qrr6z" Sep 19 08:21:53.104105 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.104059 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-s2bqw" Sep 19 08:21:53.140280 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.140249 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8x6zs" Sep 19 08:21:53.150600 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:21:53.150571 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2117f2e_52c2_4254_ad98_f83540d8eda2.slice/crio-cdd889c81719b28e79738f737480c5e3cff947f3b083355d6506f4dd066f1e5e WatchSource:0}: Error finding container cdd889c81719b28e79738f737480c5e3cff947f3b083355d6506f4dd066f1e5e: Status 404 returned error can't find the container with id cdd889c81719b28e79738f737480c5e3cff947f3b083355d6506f4dd066f1e5e Sep 19 08:21:53.377661 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.377621 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-s2bqw"] Sep 19 08:21:53.380358 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:21:53.380333 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0669adfe_a5ed_4b64_bc9c_f572feabbf88.slice/crio-c3a29277957d7aa3d138830f8a549ed390e6c74d2d52ebd8f94ae9390b909b0f WatchSource:0}: Error finding container c3a29277957d7aa3d138830f8a549ed390e6c74d2d52ebd8f94ae9390b909b0f: Status 404 returned error can't find the container with id c3a29277957d7aa3d138830f8a549ed390e6c74d2d52ebd8f94ae9390b909b0f Sep 19 08:21:53.545126 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.545090 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2167602f-49ad-4b65-9fad-4e8d35f6661b-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-qrr6z\" (UID: \"2167602f-49ad-4b65-9fad-4e8d35f6661b\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-qrr6z" Sep 19 08:21:53.547388 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.547360 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2167602f-49ad-4b65-9fad-4e8d35f6661b-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-qrr6z\" (UID: \"2167602f-49ad-4b65-9fad-4e8d35f6661b\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-qrr6z" Sep 19 08:21:53.580576 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.580551 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l2hqv" Sep 19 08:21:53.744599 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.744514 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-qrr6z" Sep 19 08:21:53.918466 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.918408 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 19 08:21:53.921893 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.921867 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:21:53.924957 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.924940 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 19 08:21:53.925399 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.925359 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 19 08:21:53.925589 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.925566 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 19 08:21:53.925589 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.925588 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 19 08:21:53.925842 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.925827 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-kr6wv\"" Sep 19 08:21:53.926109 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.926087 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 19 08:21:53.926509 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.926476 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 19 08:21:53.926509 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.926486 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 19 08:21:53.927328 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.927303 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 19 08:21:53.932432 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.932411 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 19 08:21:53.938844 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.938823 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 19 08:21:53.949012 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.948986 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4988d662-b874-479f-b2c0-3202e05b6c31-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:21:53.949150 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.949061 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4988d662-b874-479f-b2c0-3202e05b6c31-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:21:53.949150 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.949124 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4988d662-b874-479f-b2c0-3202e05b6c31-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:21:53.949269 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.949157 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4988d662-b874-479f-b2c0-3202e05b6c31-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:21:53.949269 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.949178 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4988d662-b874-479f-b2c0-3202e05b6c31-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:21:53.949269 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.949199 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4988d662-b874-479f-b2c0-3202e05b6c31-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:21:53.949269 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.949238 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4988d662-b874-479f-b2c0-3202e05b6c31-web-config\") pod \"alertmanager-main-0\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:21:53.949462 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.949272 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4988d662-b874-479f-b2c0-3202e05b6c31-config-volume\") pod \"alertmanager-main-0\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:21:53.949462 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.949361 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4988d662-b874-479f-b2c0-3202e05b6c31-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:21:53.949462 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.949419 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtkfd\" (UniqueName: \"kubernetes.io/projected/4988d662-b874-479f-b2c0-3202e05b6c31-kube-api-access-wtkfd\") pod \"alertmanager-main-0\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:21:53.949462 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.949441 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4988d662-b874-479f-b2c0-3202e05b6c31-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:21:53.949596 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.949509 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4988d662-b874-479f-b2c0-3202e05b6c31-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:21:53.949596 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:53.949539 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4988d662-b874-479f-b2c0-3202e05b6c31-config-out\") pod \"alertmanager-main-0\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:21:54.023958 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:54.023876 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-s2bqw" event={"ID":"0669adfe-a5ed-4b64-bc9c-f572feabbf88","Type":"ContainerStarted","Data":"e7c6680f95984947ab98b83b50b0987fcd3fb6466769862251be13be88ccadd3"} Sep 19 08:21:54.024133 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:54.023973 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-s2bqw" event={"ID":"0669adfe-a5ed-4b64-bc9c-f572feabbf88","Type":"ContainerStarted","Data":"bb6f465b242a77c19a856dc20535c8903bc7c1c1c557ef3c55ccdc0b6e8783e8"} Sep 19 08:21:54.024133 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:54.024048 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-s2bqw" event={"ID":"0669adfe-a5ed-4b64-bc9c-f572feabbf88","Type":"ContainerStarted","Data":"c3a29277957d7aa3d138830f8a549ed390e6c74d2d52ebd8f94ae9390b909b0f"} Sep 19 08:21:54.026295 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:54.026212 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-qrr6z"] Sep 19 08:21:54.028032 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:54.028000 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8x6zs" event={"ID":"b2117f2e-52c2-4254-ad98-f83540d8eda2","Type":"ContainerStarted","Data":"cdd889c81719b28e79738f737480c5e3cff947f3b083355d6506f4dd066f1e5e"} Sep 19 08:21:54.050645 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:54.050613 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4988d662-b874-479f-b2c0-3202e05b6c31-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:21:54.050766 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:54.050655 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4988d662-b874-479f-b2c0-3202e05b6c31-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:21:54.050766 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:54.050684 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4988d662-b874-479f-b2c0-3202e05b6c31-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:21:54.050766 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:54.050710 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4988d662-b874-479f-b2c0-3202e05b6c31-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:21:54.050766 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:54.050744 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4988d662-b874-479f-b2c0-3202e05b6c31-web-config\") pod \"alertmanager-main-0\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:21:54.050965 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:54.050770 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4988d662-b874-479f-b2c0-3202e05b6c31-config-volume\") pod \"alertmanager-main-0\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:21:54.050965 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:54.050815 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4988d662-b874-479f-b2c0-3202e05b6c31-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:21:54.050965 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:54.050854 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtkfd\" (UniqueName: \"kubernetes.io/projected/4988d662-b874-479f-b2c0-3202e05b6c31-kube-api-access-wtkfd\") pod \"alertmanager-main-0\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:21:54.050965 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:54.050889 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4988d662-b874-479f-b2c0-3202e05b6c31-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:21:54.050965 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:54.050929 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4988d662-b874-479f-b2c0-3202e05b6c31-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:21:54.051233 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:54.050966 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4988d662-b874-479f-b2c0-3202e05b6c31-config-out\") pod \"alertmanager-main-0\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:21:54.051233 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:54.051011 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4988d662-b874-479f-b2c0-3202e05b6c31-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:21:54.051233 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:54.051041 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4988d662-b874-479f-b2c0-3202e05b6c31-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:21:54.051233 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:54.051105 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4988d662-b874-479f-b2c0-3202e05b6c31-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:21:54.051233 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:54.051191 2584 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Sep 19 08:21:54.051482 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:54.051252 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4988d662-b874-479f-b2c0-3202e05b6c31-secret-alertmanager-main-tls podName:4988d662-b874-479f-b2c0-3202e05b6c31 nodeName:}" failed. No retries permitted until 2026-09-19 08:21:54.551231691 +0000 UTC m=+64.281328272 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/4988d662-b874-479f-b2c0-3202e05b6c31-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "4988d662-b874-479f-b2c0-3202e05b6c31") : secret "alertmanager-main-tls" not found Sep 19 08:21:54.052044 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:54.051734 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4988d662-b874-479f-b2c0-3202e05b6c31-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:21:54.052044 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:54.051938 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4988d662-b874-479f-b2c0-3202e05b6c31-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:21:54.054386 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:54.054359 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4988d662-b874-479f-b2c0-3202e05b6c31-config-volume\") pod \"alertmanager-main-0\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:21:54.054523 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:54.054492 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4988d662-b874-479f-b2c0-3202e05b6c31-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:21:54.054636 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:54.054536 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4988d662-b874-479f-b2c0-3202e05b6c31-web-config\") pod \"alertmanager-main-0\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:21:54.054810 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:54.054788 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4988d662-b874-479f-b2c0-3202e05b6c31-config-out\") pod \"alertmanager-main-0\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:21:54.055359 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:54.055317 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4988d662-b874-479f-b2c0-3202e05b6c31-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:21:54.055457 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:54.055393 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4988d662-b874-479f-b2c0-3202e05b6c31-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:21:54.055512 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:54.055475 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4988d662-b874-479f-b2c0-3202e05b6c31-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:21:54.056265 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:54.056246 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4988d662-b874-479f-b2c0-3202e05b6c31-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:21:54.061350 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:54.061330 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtkfd\" (UniqueName: \"kubernetes.io/projected/4988d662-b874-479f-b2c0-3202e05b6c31-kube-api-access-wtkfd\") pod \"alertmanager-main-0\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:21:54.226366 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:21:54.226328 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2167602f_49ad_4b65_9fad_4e8d35f6661b.slice/crio-ec75d9fdcca36b1744c337431444f698bae3a5e617c226379ff09a1571924039 WatchSource:0}: Error finding container ec75d9fdcca36b1744c337431444f698bae3a5e617c226379ff09a1571924039: Status 404 returned error can't find the container with id ec75d9fdcca36b1744c337431444f698bae3a5e617c226379ff09a1571924039 Sep 19 08:21:54.555354 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:54.555274 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4988d662-b874-479f-b2c0-3202e05b6c31-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:21:54.558219 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:54.558196 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4988d662-b874-479f-b2c0-3202e05b6c31-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:21:54.833626 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:54.833591 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:21:55.033511 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:55.033474 2584 generic.go:356] "Generic (PLEG): container finished" podID="b2117f2e-52c2-4254-ad98-f83540d8eda2" containerID="9dbca98a8ba5315536efdc12d63af5a2cd08fb8d892485cf7fbdee911e829ca5" exitCode=0 Sep 19 08:21:55.033957 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:55.033558 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8x6zs" event={"ID":"b2117f2e-52c2-4254-ad98-f83540d8eda2","Type":"ContainerDied","Data":"9dbca98a8ba5315536efdc12d63af5a2cd08fb8d892485cf7fbdee911e829ca5"} Sep 19 08:21:55.035036 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:55.035009 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-qrr6z" event={"ID":"2167602f-49ad-4b65-9fad-4e8d35f6661b","Type":"ContainerStarted","Data":"ec75d9fdcca36b1744c337431444f698bae3a5e617c226379ff09a1571924039"} Sep 19 08:21:55.037639 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:55.037616 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-s2bqw" event={"ID":"0669adfe-a5ed-4b64-bc9c-f572feabbf88","Type":"ContainerStarted","Data":"b3c63d9baaf2bff118272c679577c17030e712751bbf6aaefde96d702da549c2"} Sep 19 08:21:55.069287 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:55.069245 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-s2bqw" podStartSLOduration=1.907928814 podStartE2EDuration="3.069229287s" totalImagesPullingTime="1.161300473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 08:21:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 08:21:55.068202116 +0000 UTC m=+64.798298719" watchObservedRunningTime="2026-09-19 08:21:55.069229287 +0000 UTC m=+64.799325886" Sep 19 08:21:55.118934 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:55.118904 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 19 08:21:55.390661 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:21:55.390635 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4988d662_b874_479f_b2c0_3202e05b6c31.slice/crio-c4714727c544593be25606793433fc84e5ffef340c10bfc8cbb2a0253ee3d5d5 WatchSource:0}: Error finding container c4714727c544593be25606793433fc84e5ffef340c10bfc8cbb2a0253ee3d5d5: Status 404 returned error can't find the container with id c4714727c544593be25606793433fc84e5ffef340c10bfc8cbb2a0253ee3d5d5 Sep 19 08:21:55.799821 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:55.799741 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-d7754d644-9x2ww"] Sep 19 08:21:55.802305 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:55.802287 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-d7754d644-9x2ww" Sep 19 08:21:55.805191 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:55.805061 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-66j9t0qrm07vg\"" Sep 19 08:21:55.805191 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:55.805103 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-np8fw\"" Sep 19 08:21:55.805191 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:55.805142 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 19 08:21:55.805191 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:55.805171 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 19 08:21:55.805191 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:55.805174 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 19 08:21:55.805503 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:55.805062 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 19 08:21:55.805503 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:55.805477 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 19 08:21:55.818993 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:55.818972 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-d7754d644-9x2ww"] Sep 19 08:21:55.866597 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:55.866566 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9aa92914-bb70-47d9-9e69-c30c113b040d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-d7754d644-9x2ww\" (UID: \"9aa92914-bb70-47d9-9e69-c30c113b040d\") " pod="openshift-monitoring/thanos-querier-d7754d644-9x2ww" Sep 19 08:21:55.866597 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:55.866600 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9aa92914-bb70-47d9-9e69-c30c113b040d-metrics-client-ca\") pod \"thanos-querier-d7754d644-9x2ww\" (UID: \"9aa92914-bb70-47d9-9e69-c30c113b040d\") " pod="openshift-monitoring/thanos-querier-d7754d644-9x2ww" Sep 19 08:21:55.866848 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:55.866615 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgsfn\" (UniqueName: \"kubernetes.io/projected/9aa92914-bb70-47d9-9e69-c30c113b040d-kube-api-access-cgsfn\") pod \"thanos-querier-d7754d644-9x2ww\" (UID: \"9aa92914-bb70-47d9-9e69-c30c113b040d\") " pod="openshift-monitoring/thanos-querier-d7754d644-9x2ww" Sep 19 08:21:55.866848 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:55.866663 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9aa92914-bb70-47d9-9e69-c30c113b040d-secret-thanos-querier-tls\") pod \"thanos-querier-d7754d644-9x2ww\" (UID: \"9aa92914-bb70-47d9-9e69-c30c113b040d\") " pod="openshift-monitoring/thanos-querier-d7754d644-9x2ww" Sep 19 08:21:55.866848 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:55.866719 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9aa92914-bb70-47d9-9e69-c30c113b040d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-d7754d644-9x2ww\" (UID: \"9aa92914-bb70-47d9-9e69-c30c113b040d\") " pod="openshift-monitoring/thanos-querier-d7754d644-9x2ww" Sep 19 08:21:55.866848 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:55.866801 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9aa92914-bb70-47d9-9e69-c30c113b040d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-d7754d644-9x2ww\" (UID: \"9aa92914-bb70-47d9-9e69-c30c113b040d\") " pod="openshift-monitoring/thanos-querier-d7754d644-9x2ww" Sep 19 08:21:55.866848 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:55.866828 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9aa92914-bb70-47d9-9e69-c30c113b040d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-d7754d644-9x2ww\" (UID: \"9aa92914-bb70-47d9-9e69-c30c113b040d\") " pod="openshift-monitoring/thanos-querier-d7754d644-9x2ww" Sep 19 08:21:55.866848 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:55.866844 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9aa92914-bb70-47d9-9e69-c30c113b040d-secret-grpc-tls\") pod \"thanos-querier-d7754d644-9x2ww\" (UID: \"9aa92914-bb70-47d9-9e69-c30c113b040d\") " pod="openshift-monitoring/thanos-querier-d7754d644-9x2ww" Sep 19 08:21:55.968179 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:55.968148 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9aa92914-bb70-47d9-9e69-c30c113b040d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-d7754d644-9x2ww\" (UID: \"9aa92914-bb70-47d9-9e69-c30c113b040d\") " pod="openshift-monitoring/thanos-querier-d7754d644-9x2ww" Sep 19 08:21:55.968328 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:55.968189 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9aa92914-bb70-47d9-9e69-c30c113b040d-secret-grpc-tls\") pod \"thanos-querier-d7754d644-9x2ww\" (UID: \"9aa92914-bb70-47d9-9e69-c30c113b040d\") " pod="openshift-monitoring/thanos-querier-d7754d644-9x2ww" Sep 19 08:21:55.968328 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:55.968257 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9aa92914-bb70-47d9-9e69-c30c113b040d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-d7754d644-9x2ww\" (UID: \"9aa92914-bb70-47d9-9e69-c30c113b040d\") " pod="openshift-monitoring/thanos-querier-d7754d644-9x2ww" Sep 19 08:21:55.968328 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:55.968282 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9aa92914-bb70-47d9-9e69-c30c113b040d-metrics-client-ca\") pod \"thanos-querier-d7754d644-9x2ww\" (UID: \"9aa92914-bb70-47d9-9e69-c30c113b040d\") " pod="openshift-monitoring/thanos-querier-d7754d644-9x2ww" Sep 19 08:21:55.968503 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:55.968358 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgsfn\" (UniqueName: \"kubernetes.io/projected/9aa92914-bb70-47d9-9e69-c30c113b040d-kube-api-access-cgsfn\") pod \"thanos-querier-d7754d644-9x2ww\" (UID: \"9aa92914-bb70-47d9-9e69-c30c113b040d\") " pod="openshift-monitoring/thanos-querier-d7754d644-9x2ww" Sep 19 08:21:55.968503 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:55.968435 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9aa92914-bb70-47d9-9e69-c30c113b040d-secret-thanos-querier-tls\") pod \"thanos-querier-d7754d644-9x2ww\" (UID: \"9aa92914-bb70-47d9-9e69-c30c113b040d\") " pod="openshift-monitoring/thanos-querier-d7754d644-9x2ww" Sep 19 08:21:55.968503 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:55.968464 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9aa92914-bb70-47d9-9e69-c30c113b040d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-d7754d644-9x2ww\" (UID: \"9aa92914-bb70-47d9-9e69-c30c113b040d\") " pod="openshift-monitoring/thanos-querier-d7754d644-9x2ww" Sep 19 08:21:55.968657 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:55.968538 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9aa92914-bb70-47d9-9e69-c30c113b040d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-d7754d644-9x2ww\" (UID: \"9aa92914-bb70-47d9-9e69-c30c113b040d\") " pod="openshift-monitoring/thanos-querier-d7754d644-9x2ww" Sep 19 08:21:55.969055 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:55.969023 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9aa92914-bb70-47d9-9e69-c30c113b040d-metrics-client-ca\") pod \"thanos-querier-d7754d644-9x2ww\" (UID: \"9aa92914-bb70-47d9-9e69-c30c113b040d\") " pod="openshift-monitoring/thanos-querier-d7754d644-9x2ww" Sep 19 08:21:55.971043 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:55.970986 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9aa92914-bb70-47d9-9e69-c30c113b040d-secret-thanos-querier-tls\") pod \"thanos-querier-d7754d644-9x2ww\" (UID: \"9aa92914-bb70-47d9-9e69-c30c113b040d\") " pod="openshift-monitoring/thanos-querier-d7754d644-9x2ww" Sep 19 08:21:55.971043 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:55.970995 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9aa92914-bb70-47d9-9e69-c30c113b040d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-d7754d644-9x2ww\" (UID: \"9aa92914-bb70-47d9-9e69-c30c113b040d\") " pod="openshift-monitoring/thanos-querier-d7754d644-9x2ww" Sep 19 08:21:55.971259 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:55.971240 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9aa92914-bb70-47d9-9e69-c30c113b040d-secret-grpc-tls\") pod \"thanos-querier-d7754d644-9x2ww\" (UID: \"9aa92914-bb70-47d9-9e69-c30c113b040d\") " pod="openshift-monitoring/thanos-querier-d7754d644-9x2ww" Sep 19 08:21:55.971312 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:55.971255 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9aa92914-bb70-47d9-9e69-c30c113b040d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-d7754d644-9x2ww\" (UID: \"9aa92914-bb70-47d9-9e69-c30c113b040d\") " pod="openshift-monitoring/thanos-querier-d7754d644-9x2ww" Sep 19 08:21:55.971312 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:55.971267 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9aa92914-bb70-47d9-9e69-c30c113b040d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-d7754d644-9x2ww\" (UID: \"9aa92914-bb70-47d9-9e69-c30c113b040d\") " pod="openshift-monitoring/thanos-querier-d7754d644-9x2ww" Sep 19 08:21:55.971312 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:55.971238 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9aa92914-bb70-47d9-9e69-c30c113b040d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-d7754d644-9x2ww\" (UID: \"9aa92914-bb70-47d9-9e69-c30c113b040d\") " pod="openshift-monitoring/thanos-querier-d7754d644-9x2ww" Sep 19 08:21:55.975537 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:55.975517 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgsfn\" (UniqueName: \"kubernetes.io/projected/9aa92914-bb70-47d9-9e69-c30c113b040d-kube-api-access-cgsfn\") pod \"thanos-querier-d7754d644-9x2ww\" (UID: \"9aa92914-bb70-47d9-9e69-c30c113b040d\") " pod="openshift-monitoring/thanos-querier-d7754d644-9x2ww" Sep 19 08:21:56.042991 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:56.042947 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4988d662-b874-479f-b2c0-3202e05b6c31","Type":"ContainerStarted","Data":"c4714727c544593be25606793433fc84e5ffef340c10bfc8cbb2a0253ee3d5d5"} Sep 19 08:21:56.045510 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:56.045479 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8x6zs" event={"ID":"b2117f2e-52c2-4254-ad98-f83540d8eda2","Type":"ContainerStarted","Data":"21403b2025b93c0a4a07605bf2a33d13279d6ff0823ce1ceefced3d3f7b23f1c"} Sep 19 08:21:56.045648 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:56.045537 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8x6zs" event={"ID":"b2117f2e-52c2-4254-ad98-f83540d8eda2","Type":"ContainerStarted","Data":"64c998d89611312fee0ca6760cda2affe85426ad4734603c780a727c33b20453"} Sep 19 08:21:56.047813 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:56.047783 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-qrr6z" event={"ID":"2167602f-49ad-4b65-9fad-4e8d35f6661b","Type":"ContainerStarted","Data":"5725ffc008cdb7c3aa1aab20d3797fcd44a9d0eaa96f95d559eb126ac377a18c"} Sep 19 08:21:56.047909 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:56.047850 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-qrr6z" event={"ID":"2167602f-49ad-4b65-9fad-4e8d35f6661b","Type":"ContainerStarted","Data":"281c3e2996b49e7c2897f597f8b558675da0363d03bf4a4c191d6063b69b9ff7"} Sep 19 08:21:56.047909 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:56.047888 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-qrr6z" event={"ID":"2167602f-49ad-4b65-9fad-4e8d35f6661b","Type":"ContainerStarted","Data":"0df655b090b0dd2e716aeb22b0efe49305217f77a0a4546b531b8d644af84199"} Sep 19 08:21:56.066278 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:56.066237 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8x6zs" podStartSLOduration=2.901567191 podStartE2EDuration="4.066219777s" totalImagesPullingTime="1.095283337s" totalInitContainerRuntime="69.369249ms" isStatefulPod=true podCreationTimestamp="2026-09-19 08:21:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 08:21:56.064828393 +0000 UTC m=+65.794925053" watchObservedRunningTime="2026-09-19 08:21:56.066219777 +0000 UTC m=+65.796316381" Sep 19 08:21:56.084218 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:56.084174 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-84c885658c-qrr6z" podStartSLOduration=2.897924547 podStartE2EDuration="4.084160036s" totalImagesPullingTime="1.186235489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 08:21:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 08:21:56.082811919 +0000 UTC m=+65.812908520" watchObservedRunningTime="2026-09-19 08:21:56.084160036 +0000 UTC m=+65.814256647" Sep 19 08:21:56.112438 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:56.112410 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-d7754d644-9x2ww" Sep 19 08:21:56.391046 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:56.390969 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-d7754d644-9x2ww"] Sep 19 08:21:56.488121 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:21:56.487976 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9aa92914_bb70_47d9_9e69_c30c113b040d.slice/crio-fe51f0172b016e962b476dcc1f4c432e716d8ff235042a9a228d79f926e22c93 WatchSource:0}: Error finding container fe51f0172b016e962b476dcc1f4c432e716d8ff235042a9a228d79f926e22c93: Status 404 returned error can't find the container with id fe51f0172b016e962b476dcc1f4c432e716d8ff235042a9a228d79f926e22c93 Sep 19 08:21:57.054102 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:57.054059 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d7754d644-9x2ww" event={"ID":"9aa92914-bb70-47d9-9e69-c30c113b040d","Type":"ContainerStarted","Data":"fe51f0172b016e962b476dcc1f4c432e716d8ff235042a9a228d79f926e22c93"} Sep 19 08:21:57.055830 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:57.055804 2584 generic.go:356] "Generic (PLEG): container finished" podID="4988d662-b874-479f-b2c0-3202e05b6c31" containerID="cc2ed7e19b722540538a475cdd6fdfa46b5a08c3322c32bf857dc1e0bae12806" exitCode=0 Sep 19 08:21:57.055952 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:57.055893 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4988d662-b874-479f-b2c0-3202e05b6c31","Type":"ContainerDied","Data":"cc2ed7e19b722540538a475cdd6fdfa46b5a08c3322c32bf857dc1e0bae12806"} Sep 19 08:21:57.222009 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:57.221977 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7d88dff558-npwqw"] Sep 19 08:21:57.224560 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:57.224536 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7d88dff558-npwqw" Sep 19 08:21:57.227155 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:57.227129 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 19 08:21:57.227285 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:57.227175 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 19 08:21:57.227285 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:57.227189 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-7k8e7a4ja2h71\"" Sep 19 08:21:57.227285 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:57.227277 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 19 08:21:57.227422 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:57.227405 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 19 08:21:57.229508 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:57.229489 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-zmk9v\"" Sep 19 08:21:57.252272 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:57.252243 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7d88dff558-npwqw"] Sep 19 08:21:57.281090 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:57.281045 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ebeb5d84-09c7-4293-acb2-5279186b8cb8-secret-metrics-server-client-certs\") pod \"metrics-server-7d88dff558-npwqw\" (UID: \"ebeb5d84-09c7-4293-acb2-5279186b8cb8\") " pod="openshift-monitoring/metrics-server-7d88dff558-npwqw" Sep 19 08:21:57.281274 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:57.281124 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chwt5\" (UniqueName: \"kubernetes.io/projected/ebeb5d84-09c7-4293-acb2-5279186b8cb8-kube-api-access-chwt5\") pod \"metrics-server-7d88dff558-npwqw\" (UID: \"ebeb5d84-09c7-4293-acb2-5279186b8cb8\") " pod="openshift-monitoring/metrics-server-7d88dff558-npwqw" Sep 19 08:21:57.281274 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:57.281229 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebeb5d84-09c7-4293-acb2-5279186b8cb8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d88dff558-npwqw\" (UID: \"ebeb5d84-09c7-4293-acb2-5279186b8cb8\") " pod="openshift-monitoring/metrics-server-7d88dff558-npwqw" Sep 19 08:21:57.281400 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:57.281274 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ebeb5d84-09c7-4293-acb2-5279186b8cb8-client-ca-bundle\") pod \"metrics-server-7d88dff558-npwqw\" (UID: \"ebeb5d84-09c7-4293-acb2-5279186b8cb8\") " pod="openshift-monitoring/metrics-server-7d88dff558-npwqw" Sep 19 08:21:57.281400 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:57.281355 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ebeb5d84-09c7-4293-acb2-5279186b8cb8-secret-metrics-server-tls\") pod \"metrics-server-7d88dff558-npwqw\" (UID: \"ebeb5d84-09c7-4293-acb2-5279186b8cb8\") " pod="openshift-monitoring/metrics-server-7d88dff558-npwqw" Sep 19 08:21:57.281576 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:57.281397 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ebeb5d84-09c7-4293-acb2-5279186b8cb8-audit-log\") pod \"metrics-server-7d88dff558-npwqw\" (UID: \"ebeb5d84-09c7-4293-acb2-5279186b8cb8\") " pod="openshift-monitoring/metrics-server-7d88dff558-npwqw" Sep 19 08:21:57.281576 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:57.281430 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ebeb5d84-09c7-4293-acb2-5279186b8cb8-metrics-server-audit-profiles\") pod \"metrics-server-7d88dff558-npwqw\" (UID: \"ebeb5d84-09c7-4293-acb2-5279186b8cb8\") " pod="openshift-monitoring/metrics-server-7d88dff558-npwqw" Sep 19 08:21:57.382423 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:57.382387 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chwt5\" (UniqueName: \"kubernetes.io/projected/ebeb5d84-09c7-4293-acb2-5279186b8cb8-kube-api-access-chwt5\") pod \"metrics-server-7d88dff558-npwqw\" (UID: \"ebeb5d84-09c7-4293-acb2-5279186b8cb8\") " pod="openshift-monitoring/metrics-server-7d88dff558-npwqw" Sep 19 08:21:57.382604 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:57.382460 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebeb5d84-09c7-4293-acb2-5279186b8cb8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d88dff558-npwqw\" (UID: \"ebeb5d84-09c7-4293-acb2-5279186b8cb8\") " pod="openshift-monitoring/metrics-server-7d88dff558-npwqw" Sep 19 08:21:57.382604 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:57.382506 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ebeb5d84-09c7-4293-acb2-5279186b8cb8-client-ca-bundle\") pod \"metrics-server-7d88dff558-npwqw\" (UID: \"ebeb5d84-09c7-4293-acb2-5279186b8cb8\") " pod="openshift-monitoring/metrics-server-7d88dff558-npwqw" Sep 19 08:21:57.382604 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:57.382555 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ebeb5d84-09c7-4293-acb2-5279186b8cb8-secret-metrics-server-tls\") pod \"metrics-server-7d88dff558-npwqw\" (UID: \"ebeb5d84-09c7-4293-acb2-5279186b8cb8\") " pod="openshift-monitoring/metrics-server-7d88dff558-npwqw" Sep 19 08:21:57.382831 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:57.382626 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ebeb5d84-09c7-4293-acb2-5279186b8cb8-audit-log\") pod \"metrics-server-7d88dff558-npwqw\" (UID: \"ebeb5d84-09c7-4293-acb2-5279186b8cb8\") " pod="openshift-monitoring/metrics-server-7d88dff558-npwqw" Sep 19 08:21:57.382831 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:57.382661 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ebeb5d84-09c7-4293-acb2-5279186b8cb8-metrics-server-audit-profiles\") pod \"metrics-server-7d88dff558-npwqw\" (UID: \"ebeb5d84-09c7-4293-acb2-5279186b8cb8\") " pod="openshift-monitoring/metrics-server-7d88dff558-npwqw" Sep 19 08:21:57.382831 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:57.382693 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ebeb5d84-09c7-4293-acb2-5279186b8cb8-secret-metrics-server-client-certs\") pod \"metrics-server-7d88dff558-npwqw\" (UID: \"ebeb5d84-09c7-4293-acb2-5279186b8cb8\") " pod="openshift-monitoring/metrics-server-7d88dff558-npwqw" Sep 19 08:21:57.383119 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:57.383064 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ebeb5d84-09c7-4293-acb2-5279186b8cb8-audit-log\") pod \"metrics-server-7d88dff558-npwqw\" (UID: \"ebeb5d84-09c7-4293-acb2-5279186b8cb8\") " pod="openshift-monitoring/metrics-server-7d88dff558-npwqw" Sep 19 08:21:57.383249 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:57.383218 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebeb5d84-09c7-4293-acb2-5279186b8cb8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d88dff558-npwqw\" (UID: \"ebeb5d84-09c7-4293-acb2-5279186b8cb8\") " pod="openshift-monitoring/metrics-server-7d88dff558-npwqw" Sep 19 08:21:57.384093 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:57.384032 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ebeb5d84-09c7-4293-acb2-5279186b8cb8-metrics-server-audit-profiles\") pod \"metrics-server-7d88dff558-npwqw\" (UID: \"ebeb5d84-09c7-4293-acb2-5279186b8cb8\") " pod="openshift-monitoring/metrics-server-7d88dff558-npwqw" Sep 19 08:21:57.385641 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:57.385598 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ebeb5d84-09c7-4293-acb2-5279186b8cb8-secret-metrics-server-client-certs\") pod \"metrics-server-7d88dff558-npwqw\" (UID: \"ebeb5d84-09c7-4293-acb2-5279186b8cb8\") " pod="openshift-monitoring/metrics-server-7d88dff558-npwqw" Sep 19 08:21:57.385845 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:57.385821 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ebeb5d84-09c7-4293-acb2-5279186b8cb8-secret-metrics-server-tls\") pod \"metrics-server-7d88dff558-npwqw\" (UID: \"ebeb5d84-09c7-4293-acb2-5279186b8cb8\") " pod="openshift-monitoring/metrics-server-7d88dff558-npwqw" Sep 19 08:21:57.385911 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:57.385855 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ebeb5d84-09c7-4293-acb2-5279186b8cb8-client-ca-bundle\") pod \"metrics-server-7d88dff558-npwqw\" (UID: \"ebeb5d84-09c7-4293-acb2-5279186b8cb8\") " pod="openshift-monitoring/metrics-server-7d88dff558-npwqw" Sep 19 08:21:57.390177 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:57.390160 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chwt5\" (UniqueName: \"kubernetes.io/projected/ebeb5d84-09c7-4293-acb2-5279186b8cb8-kube-api-access-chwt5\") pod \"metrics-server-7d88dff558-npwqw\" (UID: \"ebeb5d84-09c7-4293-acb2-5279186b8cb8\") " pod="openshift-monitoring/metrics-server-7d88dff558-npwqw" Sep 19 08:21:57.536306 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:57.536263 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7d88dff558-npwqw" Sep 19 08:21:57.557145 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:57.556312 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-95jcs"] Sep 19 08:21:57.558814 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:57.558795 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-95jcs" Sep 19 08:21:57.561176 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:57.561159 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 19 08:21:57.561370 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:57.561346 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-zd8fs\"" Sep 19 08:21:57.572798 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:57.569838 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-95jcs"] Sep 19 08:21:57.684676 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:57.684590 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nzc5\" (UniqueName: \"kubernetes.io/projected/37a9b8f9-7cb5-42aa-b068-2f134b71e77d-kube-api-access-2nzc5\") pod \"monitoring-plugin-5984459ff8-95jcs\" (UID: \"37a9b8f9-7cb5-42aa-b068-2f134b71e77d\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-95jcs" Sep 19 08:21:57.684676 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:57.684643 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/37a9b8f9-7cb5-42aa-b068-2f134b71e77d-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-95jcs\" (UID: \"37a9b8f9-7cb5-42aa-b068-2f134b71e77d\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-95jcs" Sep 19 08:21:57.785877 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:57.785833 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nzc5\" (UniqueName: \"kubernetes.io/projected/37a9b8f9-7cb5-42aa-b068-2f134b71e77d-kube-api-access-2nzc5\") pod \"monitoring-plugin-5984459ff8-95jcs\" (UID: \"37a9b8f9-7cb5-42aa-b068-2f134b71e77d\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-95jcs" Sep 19 08:21:57.785877 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:57.785881 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/37a9b8f9-7cb5-42aa-b068-2f134b71e77d-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-95jcs\" (UID: \"37a9b8f9-7cb5-42aa-b068-2f134b71e77d\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-95jcs" Sep 19 08:21:57.786116 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:57.786000 2584 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Sep 19 08:21:57.786116 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:21:57.786053 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37a9b8f9-7cb5-42aa-b068-2f134b71e77d-monitoring-plugin-cert podName:37a9b8f9-7cb5-42aa-b068-2f134b71e77d nodeName:}" failed. No retries permitted until 2026-09-19 08:21:58.286039475 +0000 UTC m=+68.016136055 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/37a9b8f9-7cb5-42aa-b068-2f134b71e77d-monitoring-plugin-cert") pod "monitoring-plugin-5984459ff8-95jcs" (UID: "37a9b8f9-7cb5-42aa-b068-2f134b71e77d") : secret "monitoring-plugin-cert" not found Sep 19 08:21:57.796097 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:57.795840 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nzc5\" (UniqueName: \"kubernetes.io/projected/37a9b8f9-7cb5-42aa-b068-2f134b71e77d-kube-api-access-2nzc5\") pod \"monitoring-plugin-5984459ff8-95jcs\" (UID: \"37a9b8f9-7cb5-42aa-b068-2f134b71e77d\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-95jcs" Sep 19 08:21:57.818284 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:57.818257 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7d88dff558-npwqw"] Sep 19 08:21:58.012230 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:58.012151 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-k97bb" Sep 19 08:21:58.291348 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:58.291261 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35c26dae-8ddc-4ea9-b6d7-6de02274508c-metrics-certs\") pod \"network-metrics-daemon-kqz5p\" (UID: \"35c26dae-8ddc-4ea9-b6d7-6de02274508c\") " pod="openshift-multus/network-metrics-daemon-kqz5p" Sep 19 08:21:58.291348 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:58.291309 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/37a9b8f9-7cb5-42aa-b068-2f134b71e77d-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-95jcs\" (UID: \"37a9b8f9-7cb5-42aa-b068-2f134b71e77d\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-95jcs" Sep 19 08:21:58.291839 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:58.291364 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06d9bb1e-838b-4f04-9ff4-f668714c7877-original-pull-secret\") pod \"global-pull-secret-syncer-xgprw\" (UID: \"06d9bb1e-838b-4f04-9ff4-f668714c7877\") " pod="kube-system/global-pull-secret-syncer-xgprw" Sep 19 08:21:58.294201 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:58.294171 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/37a9b8f9-7cb5-42aa-b068-2f134b71e77d-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-95jcs\" (UID: \"37a9b8f9-7cb5-42aa-b068-2f134b71e77d\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-95jcs" Sep 19 08:21:58.294501 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:58.294450 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 19 08:21:58.294501 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:58.294452 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 19 08:21:58.304912 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:58.304893 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06d9bb1e-838b-4f04-9ff4-f668714c7877-original-pull-secret\") pod \"global-pull-secret-syncer-xgprw\" (UID: \"06d9bb1e-838b-4f04-9ff4-f668714c7877\") " pod="kube-system/global-pull-secret-syncer-xgprw" Sep 19 08:21:58.305041 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:58.305022 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35c26dae-8ddc-4ea9-b6d7-6de02274508c-metrics-certs\") pod \"network-metrics-daemon-kqz5p\" (UID: \"35c26dae-8ddc-4ea9-b6d7-6de02274508c\") " pod="openshift-multus/network-metrics-daemon-kqz5p" Sep 19 08:21:58.351977 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:21:58.351946 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebeb5d84_09c7_4293_acb2_5279186b8cb8.slice/crio-61082b88e7783a58b4314ae4f0b3cc8655b4205cc1863bdb957f64cb36024b4d WatchSource:0}: Error finding container 61082b88e7783a58b4314ae4f0b3cc8655b4205cc1863bdb957f64cb36024b4d: Status 404 returned error can't find the container with id 61082b88e7783a58b4314ae4f0b3cc8655b4205cc1863bdb957f64cb36024b4d Sep 19 08:21:58.391952 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:58.391918 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtrgm\" (UniqueName: \"kubernetes.io/projected/1f40898d-6f69-48bc-8af6-3224a163f776-kube-api-access-xtrgm\") pod \"network-check-target-h2qgv\" (UID: \"1f40898d-6f69-48bc-8af6-3224a163f776\") " pod="openshift-network-diagnostics/network-check-target-h2qgv" Sep 19 08:21:58.394521 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:58.394500 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 19 08:21:58.404900 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:58.404878 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 19 08:21:58.415784 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:58.415762 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtrgm\" (UniqueName: \"kubernetes.io/projected/1f40898d-6f69-48bc-8af6-3224a163f776-kube-api-access-xtrgm\") pod \"network-check-target-h2qgv\" (UID: \"1f40898d-6f69-48bc-8af6-3224a163f776\") " pod="openshift-network-diagnostics/network-check-target-h2qgv" Sep 19 08:21:58.471127 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:58.471100 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-95jcs" Sep 19 08:21:58.516221 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:58.516187 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgprw" Sep 19 08:21:58.526796 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:58.526761 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2vrmn\"" Sep 19 08:21:58.532336 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:58.532301 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-czqpg\"" Sep 19 08:21:58.534495 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:58.534202 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kqz5p" Sep 19 08:21:58.540318 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:58.540296 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2qgv" Sep 19 08:21:59.020783 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.020173 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-95jcs"] Sep 19 08:21:59.031804 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:21:59.031772 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37a9b8f9_7cb5_42aa_b068_2f134b71e77d.slice/crio-7645b40d6141b7a2eca524db12e1ff287ef78557cc7ff2f845fe85c8194ca323 WatchSource:0}: Error finding container 7645b40d6141b7a2eca524db12e1ff287ef78557cc7ff2f845fe85c8194ca323: Status 404 returned error can't find the container with id 7645b40d6141b7a2eca524db12e1ff287ef78557cc7ff2f845fe85c8194ca323 Sep 19 08:21:59.040350 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.039128 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xgprw"] Sep 19 08:21:59.040350 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.039183 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-h2qgv"] Sep 19 08:21:59.041663 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.041321 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kqz5p"] Sep 19 08:21:59.071362 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.071283 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d7754d644-9x2ww" event={"ID":"9aa92914-bb70-47d9-9e69-c30c113b040d","Type":"ContainerStarted","Data":"8d4d4683ceed9fea0e6a730705d146902e57686838aaa81835a2224783658676"} Sep 19 08:21:59.071486 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.071371 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d7754d644-9x2ww" event={"ID":"9aa92914-bb70-47d9-9e69-c30c113b040d","Type":"ContainerStarted","Data":"aaca11a7ad2de61ce9c96ab4fb8e1f59f90ed84b40e163b9994a46402ac3395f"} Sep 19 08:21:59.071486 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.071415 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d7754d644-9x2ww" event={"ID":"9aa92914-bb70-47d9-9e69-c30c113b040d","Type":"ContainerStarted","Data":"c071df16678a8d88a90f95f771fb545faa3a7368917e58b0a875b1084710e873"} Sep 19 08:21:59.074151 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.074039 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kqz5p" event={"ID":"35c26dae-8ddc-4ea9-b6d7-6de02274508c","Type":"ContainerStarted","Data":"a082b10b6ce74632647f54b5be32827357e60e3a42482105c65198b60d32c906"} Sep 19 08:21:59.076150 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.076055 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-95jcs" event={"ID":"37a9b8f9-7cb5-42aa-b068-2f134b71e77d","Type":"ContainerStarted","Data":"7645b40d6141b7a2eca524db12e1ff287ef78557cc7ff2f845fe85c8194ca323"} Sep 19 08:21:59.077843 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.077701 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7d88dff558-npwqw" event={"ID":"ebeb5d84-09c7-4293-acb2-5279186b8cb8","Type":"ContainerStarted","Data":"61082b88e7783a58b4314ae4f0b3cc8655b4205cc1863bdb957f64cb36024b4d"} Sep 19 08:21:59.081196 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.081146 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4988d662-b874-479f-b2c0-3202e05b6c31","Type":"ContainerStarted","Data":"df72cad5e4967e8b4bf228a6974d6b2a714f7013369ea2bb8428c6e766ce9d5d"} Sep 19 08:21:59.081288 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.081213 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4988d662-b874-479f-b2c0-3202e05b6c31","Type":"ContainerStarted","Data":"b40465c719cd5530fdd851f1262a0832a2ec57561421060d7a61e7040c6f4856"} Sep 19 08:21:59.081288 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.081255 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4988d662-b874-479f-b2c0-3202e05b6c31","Type":"ContainerStarted","Data":"277d176827a5225d85d73c72014c087693a0b43f611ad9eb00f14f8929d5df63"} Sep 19 08:21:59.082689 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.082665 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xgprw" event={"ID":"06d9bb1e-838b-4f04-9ff4-f668714c7877","Type":"ContainerStarted","Data":"8b72737b4b619afdad5e4d5fffeac3dc815d745ac533dec54e06194326ad2dd8"} Sep 19 08:21:59.084320 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.084169 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-h2qgv" event={"ID":"1f40898d-6f69-48bc-8af6-3224a163f776","Type":"ContainerStarted","Data":"f8b13496d187e48ec8dcb17db012e72ddc2aafc32d36d46a15ecedf29ae37c8c"} Sep 19 08:21:59.130662 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.130252 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 19 08:21:59.133663 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.133639 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.138703 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.138678 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 19 08:21:59.140161 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.139936 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-qsmxv\"" Sep 19 08:21:59.143232 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.141513 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 19 08:21:59.143232 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.141856 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 19 08:21:59.143232 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.142349 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-dm7r42q0jbubj\"" Sep 19 08:21:59.143232 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.142722 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 19 08:21:59.144855 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.143534 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 19 08:21:59.144855 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.143868 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 19 08:21:59.149179 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.149155 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 19 08:21:59.149755 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.149730 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 19 08:21:59.149755 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.149748 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 19 08:21:59.149978 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.149960 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 19 08:21:59.150746 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.150724 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 19 08:21:59.151279 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.151264 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 19 08:21:59.153339 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.152548 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 19 08:21:59.155411 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.154944 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 19 08:21:59.158005 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.157872 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 19 08:21:59.197649 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.197563 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-web-config\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.197649 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.197597 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.197649 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.197643 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.197819 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.197717 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n268s\" (UniqueName: \"kubernetes.io/projected/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-kube-api-access-n268s\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.197819 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.197742 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.197819 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.197763 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.197819 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.197800 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.198029 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.197836 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.198029 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.197864 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.198029 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.197889 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.198029 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.197912 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-config\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.198029 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.197931 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.198029 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.197954 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.198029 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.197976 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.198029 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.197994 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.198029 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.198016 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.198492 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.198050 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.198492 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.198101 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.198492 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.198131 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-config-out\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.198492 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.198173 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.299113 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.299025 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-web-config\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.299113 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.299063 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.299113 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.299113 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.299646 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.299144 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n268s\" (UniqueName: \"kubernetes.io/projected/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-kube-api-access-n268s\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.299646 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.299170 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.299646 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.299204 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.299646 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.299232 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.299646 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.299255 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.299646 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.299276 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.299646 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.299297 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.299646 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.299331 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-config\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.299646 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.299352 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.299646 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.299373 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.299646 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.299401 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.299646 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.299446 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.299646 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.299475 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.299646 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.299499 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.299646 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.299530 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.299646 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.299561 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-config-out\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.299646 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.299593 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.302406 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.299977 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.302406 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.300164 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.302406 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.302067 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.303110 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.303067 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.305414 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.305389 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.306167 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.306067 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.306271 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.306186 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.306991 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.306522 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.306991 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.306890 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-web-config\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.307125 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.307094 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.307831 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.307806 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.308253 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.308225 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.308735 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.308709 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.308917 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.308894 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n268s\" (UniqueName: \"kubernetes.io/projected/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-kube-api-access-n268s\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.309496 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.309472 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.309648 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.309599 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.309920 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.309900 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-config\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.310576 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.310554 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-config-out\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.310818 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.310800 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.311519 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.311500 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.459176 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.458835 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:21:59.777621 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:21:59.777411 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 19 08:22:00.096314 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:22:00.096252 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4988d662-b874-479f-b2c0-3202e05b6c31","Type":"ContainerStarted","Data":"ac2ca40d2cbfee8f48e4ad51d3e2a99399704a5a27b84add4c8466e4763f60f8"} Sep 19 08:22:00.096511 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:22:00.096341 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4988d662-b874-479f-b2c0-3202e05b6c31","Type":"ContainerStarted","Data":"aa982dedd18923323d656b2d5739ae0595b21ce4e769772c87d019f1118b0738"} Sep 19 08:22:00.384753 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:22:00.384679 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24e4e74f_8cc4_4733_ae5f_f9ae0e2eced4.slice/crio-2b88cf0d97b130b7c265dbaae76b8d6e1cd24cbb71b10e1296fc931c3e31cad2 WatchSource:0}: Error finding container 2b88cf0d97b130b7c265dbaae76b8d6e1cd24cbb71b10e1296fc931c3e31cad2: Status 404 returned error can't find the container with id 2b88cf0d97b130b7c265dbaae76b8d6e1cd24cbb71b10e1296fc931c3e31cad2 Sep 19 08:22:01.102963 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:22:01.102922 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4","Type":"ContainerStarted","Data":"2b88cf0d97b130b7c265dbaae76b8d6e1cd24cbb71b10e1296fc931c3e31cad2"} Sep 19 08:22:02.112487 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:22:02.112440 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d7754d644-9x2ww" event={"ID":"9aa92914-bb70-47d9-9e69-c30c113b040d","Type":"ContainerStarted","Data":"c5419a09a33acaaf6dbeecab6c52f9c6adce8cf3287d34c5ac88328229ede549"} Sep 19 08:22:02.112929 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:22:02.112560 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d7754d644-9x2ww" event={"ID":"9aa92914-bb70-47d9-9e69-c30c113b040d","Type":"ContainerStarted","Data":"0f23157fe313761a562a1012873fe97dd3d75546ba772972f6fdd3525c8a5fed"} Sep 19 08:22:02.114524 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:22:02.114464 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kqz5p" event={"ID":"35c26dae-8ddc-4ea9-b6d7-6de02274508c","Type":"ContainerStarted","Data":"77cff119428ad7cc95dd2ebbe57404906f6a60ae260d9ffc57c1c2a85e0a3415"} Sep 19 08:22:02.117190 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:22:02.116224 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-95jcs" event={"ID":"37a9b8f9-7cb5-42aa-b068-2f134b71e77d","Type":"ContainerStarted","Data":"cdc30e354a5787dbb5971bcbff3ae8c11dbaff2d1de1bd8e00523859265261d9"} Sep 19 08:22:02.117190 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:22:02.117141 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-95jcs" Sep 19 08:22:02.120182 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:22:02.120121 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7d88dff558-npwqw" event={"ID":"ebeb5d84-09c7-4293-acb2-5279186b8cb8","Type":"ContainerStarted","Data":"96c161184ec07aa5ea7263be11bc7cb4f840f87499302ab6dc67995c3d70efcb"} Sep 19 08:22:02.123982 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:22:02.123944 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-95jcs" Sep 19 08:22:02.125436 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:22:02.125402 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4988d662-b874-479f-b2c0-3202e05b6c31","Type":"ContainerStarted","Data":"e10e9a51814b431055a22db2d7e9c976b5e1d4fd63214f348ed381c47d8eb625"} Sep 19 08:22:02.127575 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:22:02.127504 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4","Type":"ContainerStarted","Data":"5b0e466b6b27dc6f67c1b0107078e9b51fadac28a93179f08621a2ddcc2bff6c"} Sep 19 08:22:02.143739 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:22:02.143692 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5984459ff8-95jcs" podStartSLOduration=2.833808502 podStartE2EDuration="5.143677649s" totalImagesPullingTime="2.309869147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 08:21:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 08:22:02.141927729 +0000 UTC m=+71.872024342" watchObservedRunningTime="2026-09-19 08:22:02.143677649 +0000 UTC m=+71.873774245" Sep 19 08:22:02.183316 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:22:02.182817 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.214758508 podStartE2EDuration="9.182794768s" totalImagesPullingTime="4.953483696s" totalInitContainerRuntime="14.552564ms" isStatefulPod=false podCreationTimestamp="2026-09-19 08:21:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 08:22:02.180317355 +0000 UTC m=+71.910413958" watchObservedRunningTime="2026-09-19 08:22:02.182794768 +0000 UTC m=+71.912891371" Sep 19 08:22:02.218337 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:22:02.218275 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7d88dff558-npwqw" podStartSLOduration=2.218168722 podStartE2EDuration="5.218253325s" totalImagesPullingTime="3.000084603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 08:21:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 08:22:02.216484218 +0000 UTC m=+71.946580821" watchObservedRunningTime="2026-09-19 08:22:02.218253325 +0000 UTC m=+71.948349929" Sep 19 08:22:03.134234 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:22:03.134199 2584 generic.go:356] "Generic (PLEG): container finished" podID="24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" containerID="5b0e466b6b27dc6f67c1b0107078e9b51fadac28a93179f08621a2ddcc2bff6c" exitCode=0 Sep 19 08:22:03.134698 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:22:03.134332 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4","Type":"ContainerDied","Data":"5b0e466b6b27dc6f67c1b0107078e9b51fadac28a93179f08621a2ddcc2bff6c"} Sep 19 08:22:05.155761 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:22:05.155663 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d7754d644-9x2ww" event={"ID":"9aa92914-bb70-47d9-9e69-c30c113b040d","Type":"ContainerStarted","Data":"a847d751ef2af2b75614b6306af17aec12fafe7e296b0ee67187a2a1508d8927"} Sep 19 08:22:05.156265 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:22:05.156031 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-d7754d644-9x2ww" Sep 19 08:22:05.158088 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:22:05.158034 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kqz5p" event={"ID":"35c26dae-8ddc-4ea9-b6d7-6de02274508c","Type":"ContainerStarted","Data":"33276baac83afe5019f8bb4f0cde53c21ef6db194e115f5f64b05ca9bb3d4016"} Sep 19 08:22:05.160311 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:22:05.160131 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xgprw" event={"ID":"06d9bb1e-838b-4f04-9ff4-f668714c7877","Type":"ContainerStarted","Data":"fcf8e29c5fb1dd12aeb752d1b31b5d70edde757f47b018cd015f640f4157d319"} Sep 19 08:22:05.162130 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:22:05.162105 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-h2qgv" event={"ID":"1f40898d-6f69-48bc-8af6-3224a163f776","Type":"ContainerStarted","Data":"bdf1b2e3f2bb78a1d207fbf789085facdfd38ee896ad0656486db7789302dc78"} Sep 19 08:22:05.162258 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:22:05.162224 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-h2qgv" Sep 19 08:22:05.162811 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:22:05.162795 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-d7754d644-9x2ww" Sep 19 08:22:05.183725 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:22:05.183684 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-d7754d644-9x2ww" podStartSLOduration=5.627287901 podStartE2EDuration="10.183671819s" totalImagesPullingTime="4.556383918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 08:21:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 08:22:05.182035388 +0000 UTC m=+74.912131990" watchObservedRunningTime="2026-09-19 08:22:05.183671819 +0000 UTC m=+74.913768420" Sep 19 08:22:05.199686 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:22:05.199646 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xgprw" podStartSLOduration=67.021582982 podStartE2EDuration="1m12.199632898s" totalImagesPullingTime="5.178049916s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 08:20:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 08:22:05.198705616 +0000 UTC m=+74.928802219" watchObservedRunningTime="2026-09-19 08:22:05.199632898 +0000 UTC m=+74.929729500" Sep 19 08:22:05.241017 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:22:05.240966 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-kqz5p" podStartSLOduration=69.934905342 podStartE2EDuration="1m12.240947083s" totalImagesPullingTime="2.306041741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 08:20:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 08:22:05.240013267 +0000 UTC m=+74.970109871" watchObservedRunningTime="2026-09-19 08:22:05.240947083 +0000 UTC m=+74.971043685" Sep 19 08:22:05.258738 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:22:05.258687 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-h2qgv" podStartSLOduration=68.095063916 podStartE2EDuration="1m13.258671013s" totalImagesPullingTime="5.163607097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 08:20:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 08:22:05.25690038 +0000 UTC m=+74.986996984" watchObservedRunningTime="2026-09-19 08:22:05.258671013 +0000 UTC m=+74.988767615" Sep 19 08:22:08.181380 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:22:08.181335 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4","Type":"ContainerStarted","Data":"c5da71f312d466b60b80cd627da6b175c5455ea1a81ddf93cdea0371dc5d90cd"} Sep 19 08:22:08.181858 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:22:08.181439 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4","Type":"ContainerStarted","Data":"b68341ee3728ec2d384abc95ab1fce11d0249754a61971f944625fc185ad2c7c"} Sep 19 08:22:08.181858 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:22:08.181471 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4","Type":"ContainerStarted","Data":"39dcd4c4346290328bb0d2887cef6bf18e5974e11237bfcb0a77842a7cfde330"} Sep 19 08:22:08.181858 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:22:08.181497 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4","Type":"ContainerStarted","Data":"4d54eb4dfd9fff2d8bbb10ad7a3f242c02624b3619acf71a0c4f71c467708786"} Sep 19 08:22:08.181858 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:22:08.181529 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4","Type":"ContainerStarted","Data":"bb7939a4a5784e17a1f513f1547839743310d2229cefff17d6cb4e632491c6cb"} Sep 19 08:22:08.181858 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:22:08.181565 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4","Type":"ContainerStarted","Data":"e24c3bbc896297dee0b443e095a0b21e49af197dc57371a7d8ec5ff307a30c85"} Sep 19 08:22:08.212576 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:22:08.212491 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=5.10144829 podStartE2EDuration="9.21247324s" totalImagesPullingTime="4.083529203s" totalInitContainerRuntime="27.495747ms" isStatefulPod=false podCreationTimestamp="2026-09-19 08:21:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 08:22:08.211156404 +0000 UTC m=+77.941252997" watchObservedRunningTime="2026-09-19 08:22:08.21247324 +0000 UTC m=+77.942569843" Sep 19 08:22:09.459590 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:22:09.459557 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:22:16.966913 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:22:16.966872 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2z6p9_86b5ce2f-cf90-4c06-8692-7041dee6196d/serve-healthcheck-canary/0.log" Sep 19 08:22:17.537017 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:22:17.536973 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7d88dff558-npwqw" Sep 19 08:22:17.537216 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:22:17.537042 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7d88dff558-npwqw" Sep 19 08:22:36.170689 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:22:36.170658 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-h2qgv" Sep 19 08:22:37.543243 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:22:37.543207 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7d88dff558-npwqw" Sep 19 08:22:37.547473 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:22:37.547453 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7d88dff558-npwqw" Sep 19 08:22:59.460050 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:22:59.460004 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:22:59.478816 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:22:59.478788 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:00.408262 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:00.408236 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:13.088524 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:13.088483 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 19 08:23:13.089221 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:13.088909 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4988d662-b874-479f-b2c0-3202e05b6c31" containerName="alertmanager" containerID="cri-o://277d176827a5225d85d73c72014c087693a0b43f611ad9eb00f14f8929d5df63" gracePeriod=120 Sep 19 08:23:13.089221 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:13.088940 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4988d662-b874-479f-b2c0-3202e05b6c31" containerName="kube-rbac-proxy-metric" containerID="cri-o://ac2ca40d2cbfee8f48e4ad51d3e2a99399704a5a27b84add4c8466e4763f60f8" gracePeriod=120 Sep 19 08:23:13.089221 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:13.088970 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4988d662-b874-479f-b2c0-3202e05b6c31" containerName="prom-label-proxy" containerID="cri-o://e10e9a51814b431055a22db2d7e9c976b5e1d4fd63214f348ed381c47d8eb625" gracePeriod=120 Sep 19 08:23:13.089221 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:13.089055 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4988d662-b874-479f-b2c0-3202e05b6c31" containerName="config-reloader" containerID="cri-o://b40465c719cd5530fdd851f1262a0832a2ec57561421060d7a61e7040c6f4856" gracePeriod=120 Sep 19 08:23:13.089221 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:13.089095 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4988d662-b874-479f-b2c0-3202e05b6c31" containerName="kube-rbac-proxy" containerID="cri-o://aa982dedd18923323d656b2d5739ae0595b21ce4e769772c87d019f1118b0738" gracePeriod=120 Sep 19 08:23:13.089221 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:13.089179 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4988d662-b874-479f-b2c0-3202e05b6c31" containerName="kube-rbac-proxy-web" containerID="cri-o://df72cad5e4967e8b4bf228a6974d6b2a714f7013369ea2bb8428c6e766ce9d5d" gracePeriod=120 Sep 19 08:23:13.445824 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:13.445734 2584 generic.go:356] "Generic (PLEG): container finished" podID="4988d662-b874-479f-b2c0-3202e05b6c31" containerID="e10e9a51814b431055a22db2d7e9c976b5e1d4fd63214f348ed381c47d8eb625" exitCode=0 Sep 19 08:23:13.445824 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:13.445757 2584 generic.go:356] "Generic (PLEG): container finished" podID="4988d662-b874-479f-b2c0-3202e05b6c31" containerID="aa982dedd18923323d656b2d5739ae0595b21ce4e769772c87d019f1118b0738" exitCode=0 Sep 19 08:23:13.445824 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:13.445765 2584 generic.go:356] "Generic (PLEG): container finished" podID="4988d662-b874-479f-b2c0-3202e05b6c31" containerID="b40465c719cd5530fdd851f1262a0832a2ec57561421060d7a61e7040c6f4856" exitCode=0 Sep 19 08:23:13.445824 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:13.445772 2584 generic.go:356] "Generic (PLEG): container finished" podID="4988d662-b874-479f-b2c0-3202e05b6c31" containerID="277d176827a5225d85d73c72014c087693a0b43f611ad9eb00f14f8929d5df63" exitCode=0 Sep 19 08:23:13.445824 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:13.445807 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4988d662-b874-479f-b2c0-3202e05b6c31","Type":"ContainerDied","Data":"e10e9a51814b431055a22db2d7e9c976b5e1d4fd63214f348ed381c47d8eb625"} Sep 19 08:23:13.446101 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:13.445869 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4988d662-b874-479f-b2c0-3202e05b6c31","Type":"ContainerDied","Data":"aa982dedd18923323d656b2d5739ae0595b21ce4e769772c87d019f1118b0738"} Sep 19 08:23:13.446101 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:13.445895 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4988d662-b874-479f-b2c0-3202e05b6c31","Type":"ContainerDied","Data":"b40465c719cd5530fdd851f1262a0832a2ec57561421060d7a61e7040c6f4856"} Sep 19 08:23:13.446101 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:13.445919 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4988d662-b874-479f-b2c0-3202e05b6c31","Type":"ContainerDied","Data":"277d176827a5225d85d73c72014c087693a0b43f611ad9eb00f14f8929d5df63"} Sep 19 08:23:14.327371 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.327346 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:23:14.366603 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.366575 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4988d662-b874-479f-b2c0-3202e05b6c31-config-out\") pod \"4988d662-b874-479f-b2c0-3202e05b6c31\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " Sep 19 08:23:14.366603 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.366610 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4988d662-b874-479f-b2c0-3202e05b6c31-metrics-client-ca\") pod \"4988d662-b874-479f-b2c0-3202e05b6c31\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " Sep 19 08:23:14.366852 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.366635 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4988d662-b874-479f-b2c0-3202e05b6c31-tls-assets\") pod \"4988d662-b874-479f-b2c0-3202e05b6c31\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " Sep 19 08:23:14.366852 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.366661 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4988d662-b874-479f-b2c0-3202e05b6c31-web-config\") pod \"4988d662-b874-479f-b2c0-3202e05b6c31\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " Sep 19 08:23:14.366852 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.366684 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4988d662-b874-479f-b2c0-3202e05b6c31-alertmanager-trusted-ca-bundle\") pod \"4988d662-b874-479f-b2c0-3202e05b6c31\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " Sep 19 08:23:14.366852 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.366723 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4988d662-b874-479f-b2c0-3202e05b6c31-cluster-tls-config\") pod \"4988d662-b874-479f-b2c0-3202e05b6c31\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " Sep 19 08:23:14.366852 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.366750 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4988d662-b874-479f-b2c0-3202e05b6c31-secret-alertmanager-main-tls\") pod \"4988d662-b874-479f-b2c0-3202e05b6c31\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " Sep 19 08:23:14.366852 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.366787 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtkfd\" (UniqueName: \"kubernetes.io/projected/4988d662-b874-479f-b2c0-3202e05b6c31-kube-api-access-wtkfd\") pod \"4988d662-b874-479f-b2c0-3202e05b6c31\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " Sep 19 08:23:14.366852 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.366819 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4988d662-b874-479f-b2c0-3202e05b6c31-secret-alertmanager-kube-rbac-proxy-metric\") pod \"4988d662-b874-479f-b2c0-3202e05b6c31\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " Sep 19 08:23:14.366852 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.366850 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4988d662-b874-479f-b2c0-3202e05b6c31-secret-alertmanager-kube-rbac-proxy-web\") pod \"4988d662-b874-479f-b2c0-3202e05b6c31\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " Sep 19 08:23:14.367282 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.366912 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4988d662-b874-479f-b2c0-3202e05b6c31-config-volume\") pod \"4988d662-b874-479f-b2c0-3202e05b6c31\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " Sep 19 08:23:14.367282 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.366971 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4988d662-b874-479f-b2c0-3202e05b6c31-secret-alertmanager-kube-rbac-proxy\") pod \"4988d662-b874-479f-b2c0-3202e05b6c31\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " Sep 19 08:23:14.367282 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.367008 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4988d662-b874-479f-b2c0-3202e05b6c31-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "4988d662-b874-479f-b2c0-3202e05b6c31" (UID: "4988d662-b874-479f-b2c0-3202e05b6c31"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 08:23:14.367282 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.367050 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4988d662-b874-479f-b2c0-3202e05b6c31-alertmanager-main-db\") pod \"4988d662-b874-479f-b2c0-3202e05b6c31\" (UID: \"4988d662-b874-479f-b2c0-3202e05b6c31\") " Sep 19 08:23:14.367467 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.367440 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4988d662-b874-479f-b2c0-3202e05b6c31-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "4988d662-b874-479f-b2c0-3202e05b6c31" (UID: "4988d662-b874-479f-b2c0-3202e05b6c31"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 08:23:14.367920 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.367567 2584 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4988d662-b874-479f-b2c0-3202e05b6c31-metrics-client-ca\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 08:23:14.367920 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.367595 2584 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4988d662-b874-479f-b2c0-3202e05b6c31-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 08:23:14.367920 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.367773 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4988d662-b874-479f-b2c0-3202e05b6c31-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "4988d662-b874-479f-b2c0-3202e05b6c31" (UID: "4988d662-b874-479f-b2c0-3202e05b6c31"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 08:23:14.370822 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.370778 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4988d662-b874-479f-b2c0-3202e05b6c31-config-out" (OuterVolumeSpecName: "config-out") pod "4988d662-b874-479f-b2c0-3202e05b6c31" (UID: "4988d662-b874-479f-b2c0-3202e05b6c31"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 08:23:14.371165 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.371139 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4988d662-b874-479f-b2c0-3202e05b6c31-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "4988d662-b874-479f-b2c0-3202e05b6c31" (UID: "4988d662-b874-479f-b2c0-3202e05b6c31"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 08:23:14.371814 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.371770 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4988d662-b874-479f-b2c0-3202e05b6c31-kube-api-access-wtkfd" (OuterVolumeSpecName: "kube-api-access-wtkfd") pod "4988d662-b874-479f-b2c0-3202e05b6c31" (UID: "4988d662-b874-479f-b2c0-3202e05b6c31"). InnerVolumeSpecName "kube-api-access-wtkfd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 08:23:14.372358 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.372219 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4988d662-b874-479f-b2c0-3202e05b6c31-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "4988d662-b874-479f-b2c0-3202e05b6c31" (UID: "4988d662-b874-479f-b2c0-3202e05b6c31"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 08:23:14.372817 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.372765 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4988d662-b874-479f-b2c0-3202e05b6c31-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "4988d662-b874-479f-b2c0-3202e05b6c31" (UID: "4988d662-b874-479f-b2c0-3202e05b6c31"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 08:23:14.372817 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.372780 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4988d662-b874-479f-b2c0-3202e05b6c31-config-volume" (OuterVolumeSpecName: "config-volume") pod "4988d662-b874-479f-b2c0-3202e05b6c31" (UID: "4988d662-b874-479f-b2c0-3202e05b6c31"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 08:23:14.372966 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.372865 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4988d662-b874-479f-b2c0-3202e05b6c31-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "4988d662-b874-479f-b2c0-3202e05b6c31" (UID: "4988d662-b874-479f-b2c0-3202e05b6c31"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 08:23:14.373024 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.372966 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4988d662-b874-479f-b2c0-3202e05b6c31-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "4988d662-b874-479f-b2c0-3202e05b6c31" (UID: "4988d662-b874-479f-b2c0-3202e05b6c31"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 08:23:14.377016 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.376923 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4988d662-b874-479f-b2c0-3202e05b6c31-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "4988d662-b874-479f-b2c0-3202e05b6c31" (UID: "4988d662-b874-479f-b2c0-3202e05b6c31"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 08:23:14.383264 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.383244 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4988d662-b874-479f-b2c0-3202e05b6c31-web-config" (OuterVolumeSpecName: "web-config") pod "4988d662-b874-479f-b2c0-3202e05b6c31" (UID: "4988d662-b874-479f-b2c0-3202e05b6c31"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 08:23:14.452152 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.452037 2584 generic.go:356] "Generic (PLEG): container finished" podID="4988d662-b874-479f-b2c0-3202e05b6c31" containerID="ac2ca40d2cbfee8f48e4ad51d3e2a99399704a5a27b84add4c8466e4763f60f8" exitCode=0 Sep 19 08:23:14.452152 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.452059 2584 generic.go:356] "Generic (PLEG): container finished" podID="4988d662-b874-479f-b2c0-3202e05b6c31" containerID="df72cad5e4967e8b4bf228a6974d6b2a714f7013369ea2bb8428c6e766ce9d5d" exitCode=0 Sep 19 08:23:14.452152 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.452109 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4988d662-b874-479f-b2c0-3202e05b6c31","Type":"ContainerDied","Data":"ac2ca40d2cbfee8f48e4ad51d3e2a99399704a5a27b84add4c8466e4763f60f8"} Sep 19 08:23:14.452422 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.452153 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:23:14.452422 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.452177 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4988d662-b874-479f-b2c0-3202e05b6c31","Type":"ContainerDied","Data":"df72cad5e4967e8b4bf228a6974d6b2a714f7013369ea2bb8428c6e766ce9d5d"} Sep 19 08:23:14.452422 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.452204 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4988d662-b874-479f-b2c0-3202e05b6c31","Type":"ContainerDied","Data":"c4714727c544593be25606793433fc84e5ffef340c10bfc8cbb2a0253ee3d5d5"} Sep 19 08:23:14.452422 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.452246 2584 scope.go:117] "RemoveContainer" containerID="e10e9a51814b431055a22db2d7e9c976b5e1d4fd63214f348ed381c47d8eb625" Sep 19 08:23:14.464360 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.464339 2584 scope.go:117] "RemoveContainer" containerID="ac2ca40d2cbfee8f48e4ad51d3e2a99399704a5a27b84add4c8466e4763f60f8" Sep 19 08:23:14.468517 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.468493 2584 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4988d662-b874-479f-b2c0-3202e05b6c31-cluster-tls-config\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 08:23:14.468614 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.468520 2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4988d662-b874-479f-b2c0-3202e05b6c31-secret-alertmanager-main-tls\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 08:23:14.468614 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.468534 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtkfd\" (UniqueName: \"kubernetes.io/projected/4988d662-b874-479f-b2c0-3202e05b6c31-kube-api-access-wtkfd\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 08:23:14.468614 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.468543 2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4988d662-b874-479f-b2c0-3202e05b6c31-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 08:23:14.468614 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.468552 2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4988d662-b874-479f-b2c0-3202e05b6c31-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 08:23:14.468614 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.468560 2584 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4988d662-b874-479f-b2c0-3202e05b6c31-config-volume\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 08:23:14.468614 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.468568 2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4988d662-b874-479f-b2c0-3202e05b6c31-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 08:23:14.468614 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.468576 2584 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4988d662-b874-479f-b2c0-3202e05b6c31-alertmanager-main-db\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 08:23:14.468614 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.468584 2584 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4988d662-b874-479f-b2c0-3202e05b6c31-config-out\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 08:23:14.468614 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.468591 2584 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4988d662-b874-479f-b2c0-3202e05b6c31-tls-assets\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 08:23:14.468614 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.468614 2584 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4988d662-b874-479f-b2c0-3202e05b6c31-web-config\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 08:23:14.471929 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.471913 2584 scope.go:117] "RemoveContainer" containerID="aa982dedd18923323d656b2d5739ae0595b21ce4e769772c87d019f1118b0738" Sep 19 08:23:14.479186 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.479163 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 19 08:23:14.479633 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.479615 2584 scope.go:117] "RemoveContainer" containerID="df72cad5e4967e8b4bf228a6974d6b2a714f7013369ea2bb8428c6e766ce9d5d" Sep 19 08:23:14.483190 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.483170 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 19 08:23:14.486633 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.486611 2584 scope.go:117] "RemoveContainer" containerID="b40465c719cd5530fdd851f1262a0832a2ec57561421060d7a61e7040c6f4856" Sep 19 08:23:14.493371 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.493356 2584 scope.go:117] "RemoveContainer" containerID="277d176827a5225d85d73c72014c087693a0b43f611ad9eb00f14f8929d5df63" Sep 19 08:23:14.500134 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.500114 2584 scope.go:117] "RemoveContainer" containerID="cc2ed7e19b722540538a475cdd6fdfa46b5a08c3322c32bf857dc1e0bae12806" Sep 19 08:23:14.506955 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.506935 2584 scope.go:117] "RemoveContainer" containerID="e10e9a51814b431055a22db2d7e9c976b5e1d4fd63214f348ed381c47d8eb625" Sep 19 08:23:14.507210 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:23:14.507190 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e10e9a51814b431055a22db2d7e9c976b5e1d4fd63214f348ed381c47d8eb625\": container with ID starting with e10e9a51814b431055a22db2d7e9c976b5e1d4fd63214f348ed381c47d8eb625 not found: ID does not exist" containerID="e10e9a51814b431055a22db2d7e9c976b5e1d4fd63214f348ed381c47d8eb625" Sep 19 08:23:14.507277 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.507218 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e10e9a51814b431055a22db2d7e9c976b5e1d4fd63214f348ed381c47d8eb625"} err="failed to get container status \"e10e9a51814b431055a22db2d7e9c976b5e1d4fd63214f348ed381c47d8eb625\": rpc error: code = NotFound desc = could not find container \"e10e9a51814b431055a22db2d7e9c976b5e1d4fd63214f348ed381c47d8eb625\": container with ID starting with e10e9a51814b431055a22db2d7e9c976b5e1d4fd63214f348ed381c47d8eb625 not found: ID does not exist" Sep 19 08:23:14.507277 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.507249 2584 scope.go:117] "RemoveContainer" containerID="ac2ca40d2cbfee8f48e4ad51d3e2a99399704a5a27b84add4c8466e4763f60f8" Sep 19 08:23:14.507506 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:23:14.507489 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac2ca40d2cbfee8f48e4ad51d3e2a99399704a5a27b84add4c8466e4763f60f8\": container with ID starting with ac2ca40d2cbfee8f48e4ad51d3e2a99399704a5a27b84add4c8466e4763f60f8 not found: ID does not exist" containerID="ac2ca40d2cbfee8f48e4ad51d3e2a99399704a5a27b84add4c8466e4763f60f8" Sep 19 08:23:14.507551 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.507513 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac2ca40d2cbfee8f48e4ad51d3e2a99399704a5a27b84add4c8466e4763f60f8"} err="failed to get container status \"ac2ca40d2cbfee8f48e4ad51d3e2a99399704a5a27b84add4c8466e4763f60f8\": rpc error: code = NotFound desc = could not find container \"ac2ca40d2cbfee8f48e4ad51d3e2a99399704a5a27b84add4c8466e4763f60f8\": container with ID starting with ac2ca40d2cbfee8f48e4ad51d3e2a99399704a5a27b84add4c8466e4763f60f8 not found: ID does not exist" Sep 19 08:23:14.507551 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.507529 2584 scope.go:117] "RemoveContainer" containerID="aa982dedd18923323d656b2d5739ae0595b21ce4e769772c87d019f1118b0738" Sep 19 08:23:14.507740 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:23:14.507727 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa982dedd18923323d656b2d5739ae0595b21ce4e769772c87d019f1118b0738\": container with ID starting with aa982dedd18923323d656b2d5739ae0595b21ce4e769772c87d019f1118b0738 not found: ID does not exist" containerID="aa982dedd18923323d656b2d5739ae0595b21ce4e769772c87d019f1118b0738" Sep 19 08:23:14.507775 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.507743 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa982dedd18923323d656b2d5739ae0595b21ce4e769772c87d019f1118b0738"} err="failed to get container status \"aa982dedd18923323d656b2d5739ae0595b21ce4e769772c87d019f1118b0738\": rpc error: code = NotFound desc = could not find container \"aa982dedd18923323d656b2d5739ae0595b21ce4e769772c87d019f1118b0738\": container with ID starting with aa982dedd18923323d656b2d5739ae0595b21ce4e769772c87d019f1118b0738 not found: ID does not exist" Sep 19 08:23:14.507775 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.507757 2584 scope.go:117] "RemoveContainer" containerID="df72cad5e4967e8b4bf228a6974d6b2a714f7013369ea2bb8428c6e766ce9d5d" Sep 19 08:23:14.507970 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:23:14.507956 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df72cad5e4967e8b4bf228a6974d6b2a714f7013369ea2bb8428c6e766ce9d5d\": container with ID starting with df72cad5e4967e8b4bf228a6974d6b2a714f7013369ea2bb8428c6e766ce9d5d not found: ID does not exist" containerID="df72cad5e4967e8b4bf228a6974d6b2a714f7013369ea2bb8428c6e766ce9d5d" Sep 19 08:23:14.508010 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.507972 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df72cad5e4967e8b4bf228a6974d6b2a714f7013369ea2bb8428c6e766ce9d5d"} err="failed to get container status \"df72cad5e4967e8b4bf228a6974d6b2a714f7013369ea2bb8428c6e766ce9d5d\": rpc error: code = NotFound desc = could not find container \"df72cad5e4967e8b4bf228a6974d6b2a714f7013369ea2bb8428c6e766ce9d5d\": container with ID starting with df72cad5e4967e8b4bf228a6974d6b2a714f7013369ea2bb8428c6e766ce9d5d not found: ID does not exist" Sep 19 08:23:14.508010 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.507984 2584 scope.go:117] "RemoveContainer" containerID="b40465c719cd5530fdd851f1262a0832a2ec57561421060d7a61e7040c6f4856" Sep 19 08:23:14.508284 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:23:14.508269 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b40465c719cd5530fdd851f1262a0832a2ec57561421060d7a61e7040c6f4856\": container with ID starting with b40465c719cd5530fdd851f1262a0832a2ec57561421060d7a61e7040c6f4856 not found: ID does not exist" containerID="b40465c719cd5530fdd851f1262a0832a2ec57561421060d7a61e7040c6f4856" Sep 19 08:23:14.508334 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.508288 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b40465c719cd5530fdd851f1262a0832a2ec57561421060d7a61e7040c6f4856"} err="failed to get container status \"b40465c719cd5530fdd851f1262a0832a2ec57561421060d7a61e7040c6f4856\": rpc error: code = NotFound desc = could not find container \"b40465c719cd5530fdd851f1262a0832a2ec57561421060d7a61e7040c6f4856\": container with ID starting with b40465c719cd5530fdd851f1262a0832a2ec57561421060d7a61e7040c6f4856 not found: ID does not exist" Sep 19 08:23:14.508334 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.508301 2584 scope.go:117] "RemoveContainer" containerID="277d176827a5225d85d73c72014c087693a0b43f611ad9eb00f14f8929d5df63" Sep 19 08:23:14.508533 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:23:14.508519 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"277d176827a5225d85d73c72014c087693a0b43f611ad9eb00f14f8929d5df63\": container with ID starting with 277d176827a5225d85d73c72014c087693a0b43f611ad9eb00f14f8929d5df63 not found: ID does not exist" containerID="277d176827a5225d85d73c72014c087693a0b43f611ad9eb00f14f8929d5df63" Sep 19 08:23:14.508582 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.508537 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"277d176827a5225d85d73c72014c087693a0b43f611ad9eb00f14f8929d5df63"} err="failed to get container status \"277d176827a5225d85d73c72014c087693a0b43f611ad9eb00f14f8929d5df63\": rpc error: code = NotFound desc = could not find container \"277d176827a5225d85d73c72014c087693a0b43f611ad9eb00f14f8929d5df63\": container with ID starting with 277d176827a5225d85d73c72014c087693a0b43f611ad9eb00f14f8929d5df63 not found: ID does not exist" Sep 19 08:23:14.508582 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.508550 2584 scope.go:117] "RemoveContainer" containerID="cc2ed7e19b722540538a475cdd6fdfa46b5a08c3322c32bf857dc1e0bae12806" Sep 19 08:23:14.508822 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:23:14.508802 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc2ed7e19b722540538a475cdd6fdfa46b5a08c3322c32bf857dc1e0bae12806\": container with ID starting with cc2ed7e19b722540538a475cdd6fdfa46b5a08c3322c32bf857dc1e0bae12806 not found: ID does not exist" containerID="cc2ed7e19b722540538a475cdd6fdfa46b5a08c3322c32bf857dc1e0bae12806" Sep 19 08:23:14.508867 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.508848 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc2ed7e19b722540538a475cdd6fdfa46b5a08c3322c32bf857dc1e0bae12806"} err="failed to get container status \"cc2ed7e19b722540538a475cdd6fdfa46b5a08c3322c32bf857dc1e0bae12806\": rpc error: code = NotFound desc = could not find container \"cc2ed7e19b722540538a475cdd6fdfa46b5a08c3322c32bf857dc1e0bae12806\": container with ID starting with cc2ed7e19b722540538a475cdd6fdfa46b5a08c3322c32bf857dc1e0bae12806 not found: ID does not exist" Sep 19 08:23:14.508926 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.508866 2584 scope.go:117] "RemoveContainer" containerID="e10e9a51814b431055a22db2d7e9c976b5e1d4fd63214f348ed381c47d8eb625" Sep 19 08:23:14.509716 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.509692 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e10e9a51814b431055a22db2d7e9c976b5e1d4fd63214f348ed381c47d8eb625"} err="failed to get container status \"e10e9a51814b431055a22db2d7e9c976b5e1d4fd63214f348ed381c47d8eb625\": rpc error: code = NotFound desc = could not find container \"e10e9a51814b431055a22db2d7e9c976b5e1d4fd63214f348ed381c47d8eb625\": container with ID starting with e10e9a51814b431055a22db2d7e9c976b5e1d4fd63214f348ed381c47d8eb625 not found: ID does not exist" Sep 19 08:23:14.509816 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.509717 2584 scope.go:117] "RemoveContainer" containerID="ac2ca40d2cbfee8f48e4ad51d3e2a99399704a5a27b84add4c8466e4763f60f8" Sep 19 08:23:14.510008 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.509988 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac2ca40d2cbfee8f48e4ad51d3e2a99399704a5a27b84add4c8466e4763f60f8"} err="failed to get container status \"ac2ca40d2cbfee8f48e4ad51d3e2a99399704a5a27b84add4c8466e4763f60f8\": rpc error: code = NotFound desc = could not find container \"ac2ca40d2cbfee8f48e4ad51d3e2a99399704a5a27b84add4c8466e4763f60f8\": container with ID starting with ac2ca40d2cbfee8f48e4ad51d3e2a99399704a5a27b84add4c8466e4763f60f8 not found: ID does not exist" Sep 19 08:23:14.510008 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.510008 2584 scope.go:117] "RemoveContainer" containerID="aa982dedd18923323d656b2d5739ae0595b21ce4e769772c87d019f1118b0738" Sep 19 08:23:14.510291 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.510272 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa982dedd18923323d656b2d5739ae0595b21ce4e769772c87d019f1118b0738"} err="failed to get container status \"aa982dedd18923323d656b2d5739ae0595b21ce4e769772c87d019f1118b0738\": rpc error: code = NotFound desc = could not find container \"aa982dedd18923323d656b2d5739ae0595b21ce4e769772c87d019f1118b0738\": container with ID starting with aa982dedd18923323d656b2d5739ae0595b21ce4e769772c87d019f1118b0738 not found: ID does not exist" Sep 19 08:23:14.510343 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.510292 2584 scope.go:117] "RemoveContainer" containerID="df72cad5e4967e8b4bf228a6974d6b2a714f7013369ea2bb8428c6e766ce9d5d" Sep 19 08:23:14.510593 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.510570 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df72cad5e4967e8b4bf228a6974d6b2a714f7013369ea2bb8428c6e766ce9d5d"} err="failed to get container status \"df72cad5e4967e8b4bf228a6974d6b2a714f7013369ea2bb8428c6e766ce9d5d\": rpc error: code = NotFound desc = could not find container \"df72cad5e4967e8b4bf228a6974d6b2a714f7013369ea2bb8428c6e766ce9d5d\": container with ID starting with df72cad5e4967e8b4bf228a6974d6b2a714f7013369ea2bb8428c6e766ce9d5d not found: ID does not exist" Sep 19 08:23:14.510696 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.510603 2584 scope.go:117] "RemoveContainer" containerID="b40465c719cd5530fdd851f1262a0832a2ec57561421060d7a61e7040c6f4856" Sep 19 08:23:14.510893 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.510862 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b40465c719cd5530fdd851f1262a0832a2ec57561421060d7a61e7040c6f4856"} err="failed to get container status \"b40465c719cd5530fdd851f1262a0832a2ec57561421060d7a61e7040c6f4856\": rpc error: code = NotFound desc = could not find container \"b40465c719cd5530fdd851f1262a0832a2ec57561421060d7a61e7040c6f4856\": container with ID starting with b40465c719cd5530fdd851f1262a0832a2ec57561421060d7a61e7040c6f4856 not found: ID does not exist" Sep 19 08:23:14.510893 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.510880 2584 scope.go:117] "RemoveContainer" containerID="277d176827a5225d85d73c72014c087693a0b43f611ad9eb00f14f8929d5df63" Sep 19 08:23:14.511196 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.511176 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"277d176827a5225d85d73c72014c087693a0b43f611ad9eb00f14f8929d5df63"} err="failed to get container status \"277d176827a5225d85d73c72014c087693a0b43f611ad9eb00f14f8929d5df63\": rpc error: code = NotFound desc = could not find container \"277d176827a5225d85d73c72014c087693a0b43f611ad9eb00f14f8929d5df63\": container with ID starting with 277d176827a5225d85d73c72014c087693a0b43f611ad9eb00f14f8929d5df63 not found: ID does not exist" Sep 19 08:23:14.511256 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.511196 2584 scope.go:117] "RemoveContainer" containerID="cc2ed7e19b722540538a475cdd6fdfa46b5a08c3322c32bf857dc1e0bae12806" Sep 19 08:23:14.511433 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.511416 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 19 08:23:14.511504 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.511452 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc2ed7e19b722540538a475cdd6fdfa46b5a08c3322c32bf857dc1e0bae12806"} err="failed to get container status \"cc2ed7e19b722540538a475cdd6fdfa46b5a08c3322c32bf857dc1e0bae12806\": rpc error: code = NotFound desc = could not find container \"cc2ed7e19b722540538a475cdd6fdfa46b5a08c3322c32bf857dc1e0bae12806\": container with ID starting with cc2ed7e19b722540538a475cdd6fdfa46b5a08c3322c32bf857dc1e0bae12806 not found: ID does not exist" Sep 19 08:23:14.511740 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.511727 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4988d662-b874-479f-b2c0-3202e05b6c31" containerName="prom-label-proxy" Sep 19 08:23:14.511784 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.511742 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="4988d662-b874-479f-b2c0-3202e05b6c31" containerName="prom-label-proxy" Sep 19 08:23:14.511784 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.511752 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4988d662-b874-479f-b2c0-3202e05b6c31" containerName="kube-rbac-proxy-metric" Sep 19 08:23:14.511784 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.511758 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="4988d662-b874-479f-b2c0-3202e05b6c31" containerName="kube-rbac-proxy-metric" Sep 19 08:23:14.511784 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.511766 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4988d662-b874-479f-b2c0-3202e05b6c31" containerName="config-reloader" Sep 19 08:23:14.511784 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.511772 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="4988d662-b874-479f-b2c0-3202e05b6c31" containerName="config-reloader" Sep 19 08:23:14.511784 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.511780 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4988d662-b874-479f-b2c0-3202e05b6c31" containerName="init-config-reloader" Sep 19 08:23:14.511784 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.511785 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="4988d662-b874-479f-b2c0-3202e05b6c31" containerName="init-config-reloader" Sep 19 08:23:14.512010 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.511798 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4988d662-b874-479f-b2c0-3202e05b6c31" containerName="alertmanager" Sep 19 08:23:14.512010 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.511803 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="4988d662-b874-479f-b2c0-3202e05b6c31" containerName="alertmanager" Sep 19 08:23:14.512010 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.511812 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4988d662-b874-479f-b2c0-3202e05b6c31" containerName="kube-rbac-proxy-web" Sep 19 08:23:14.512010 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.511817 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="4988d662-b874-479f-b2c0-3202e05b6c31" containerName="kube-rbac-proxy-web" Sep 19 08:23:14.512010 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.511822 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4988d662-b874-479f-b2c0-3202e05b6c31" containerName="kube-rbac-proxy" Sep 19 08:23:14.512010 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.511827 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="4988d662-b874-479f-b2c0-3202e05b6c31" containerName="kube-rbac-proxy" Sep 19 08:23:14.512010 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.511869 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="4988d662-b874-479f-b2c0-3202e05b6c31" containerName="kube-rbac-proxy" Sep 19 08:23:14.512010 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.511878 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="4988d662-b874-479f-b2c0-3202e05b6c31" containerName="kube-rbac-proxy-web" Sep 19 08:23:14.512010 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.511883 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="4988d662-b874-479f-b2c0-3202e05b6c31" containerName="kube-rbac-proxy-metric" Sep 19 08:23:14.512010 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.511889 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="4988d662-b874-479f-b2c0-3202e05b6c31" containerName="prom-label-proxy" Sep 19 08:23:14.512010 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.511894 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="4988d662-b874-479f-b2c0-3202e05b6c31" containerName="alertmanager" Sep 19 08:23:14.512010 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.511900 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="4988d662-b874-479f-b2c0-3202e05b6c31" containerName="config-reloader" Sep 19 08:23:14.516481 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.516464 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:23:14.519003 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.518980 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 19 08:23:14.519126 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.519028 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 19 08:23:14.519126 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.519111 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 19 08:23:14.519126 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.519116 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-kr6wv\"" Sep 19 08:23:14.519298 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.519145 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 19 08:23:14.519347 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.519295 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 19 08:23:14.519491 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.519476 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 19 08:23:14.520126 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.520068 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 19 08:23:14.520187 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.520113 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 19 08:23:14.525475 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.525457 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 19 08:23:14.530716 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.530696 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 19 08:23:14.569505 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.569477 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f6362017-5b9b-4625-be05-9ceee22b3426-config-out\") pod \"alertmanager-main-0\" (UID: \"f6362017-5b9b-4625-be05-9ceee22b3426\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:23:14.569505 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.569509 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f6362017-5b9b-4625-be05-9ceee22b3426-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f6362017-5b9b-4625-be05-9ceee22b3426\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:23:14.569721 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.569534 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f6362017-5b9b-4625-be05-9ceee22b3426-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f6362017-5b9b-4625-be05-9ceee22b3426\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:23:14.569721 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.569550 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f6362017-5b9b-4625-be05-9ceee22b3426-config-volume\") pod \"alertmanager-main-0\" (UID: \"f6362017-5b9b-4625-be05-9ceee22b3426\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:23:14.569721 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.569588 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6362017-5b9b-4625-be05-9ceee22b3426-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f6362017-5b9b-4625-be05-9ceee22b3426\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:23:14.569721 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.569695 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f6362017-5b9b-4625-be05-9ceee22b3426-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f6362017-5b9b-4625-be05-9ceee22b3426\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:23:14.569906 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.569728 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f6362017-5b9b-4625-be05-9ceee22b3426-web-config\") pod \"alertmanager-main-0\" (UID: \"f6362017-5b9b-4625-be05-9ceee22b3426\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:23:14.569906 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.569750 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj9fd\" (UniqueName: \"kubernetes.io/projected/f6362017-5b9b-4625-be05-9ceee22b3426-kube-api-access-jj9fd\") pod \"alertmanager-main-0\" (UID: \"f6362017-5b9b-4625-be05-9ceee22b3426\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:23:14.569906 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.569801 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6362017-5b9b-4625-be05-9ceee22b3426-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f6362017-5b9b-4625-be05-9ceee22b3426\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:23:14.569906 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.569867 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f6362017-5b9b-4625-be05-9ceee22b3426-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f6362017-5b9b-4625-be05-9ceee22b3426\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:23:14.570121 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.569906 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f6362017-5b9b-4625-be05-9ceee22b3426-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f6362017-5b9b-4625-be05-9ceee22b3426\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:23:14.570121 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.569942 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f6362017-5b9b-4625-be05-9ceee22b3426-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f6362017-5b9b-4625-be05-9ceee22b3426\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:23:14.570121 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.569968 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f6362017-5b9b-4625-be05-9ceee22b3426-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f6362017-5b9b-4625-be05-9ceee22b3426\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:23:14.610866 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.610842 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4988d662-b874-479f-b2c0-3202e05b6c31" path="/var/lib/kubelet/pods/4988d662-b874-479f-b2c0-3202e05b6c31/volumes" Sep 19 08:23:14.670980 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.670951 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f6362017-5b9b-4625-be05-9ceee22b3426-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f6362017-5b9b-4625-be05-9ceee22b3426\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:23:14.670980 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.670982 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f6362017-5b9b-4625-be05-9ceee22b3426-web-config\") pod \"alertmanager-main-0\" (UID: \"f6362017-5b9b-4625-be05-9ceee22b3426\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:23:14.671223 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.671003 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj9fd\" (UniqueName: \"kubernetes.io/projected/f6362017-5b9b-4625-be05-9ceee22b3426-kube-api-access-jj9fd\") pod \"alertmanager-main-0\" (UID: \"f6362017-5b9b-4625-be05-9ceee22b3426\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:23:14.671223 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.671128 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6362017-5b9b-4625-be05-9ceee22b3426-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f6362017-5b9b-4625-be05-9ceee22b3426\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:23:14.671223 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.671185 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f6362017-5b9b-4625-be05-9ceee22b3426-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f6362017-5b9b-4625-be05-9ceee22b3426\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:23:14.671372 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.671229 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f6362017-5b9b-4625-be05-9ceee22b3426-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f6362017-5b9b-4625-be05-9ceee22b3426\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:23:14.671372 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.671269 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f6362017-5b9b-4625-be05-9ceee22b3426-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f6362017-5b9b-4625-be05-9ceee22b3426\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:23:14.671372 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.671296 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f6362017-5b9b-4625-be05-9ceee22b3426-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f6362017-5b9b-4625-be05-9ceee22b3426\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:23:14.671372 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.671333 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f6362017-5b9b-4625-be05-9ceee22b3426-config-out\") pod \"alertmanager-main-0\" (UID: \"f6362017-5b9b-4625-be05-9ceee22b3426\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:23:14.671372 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.671358 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f6362017-5b9b-4625-be05-9ceee22b3426-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f6362017-5b9b-4625-be05-9ceee22b3426\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:23:14.671645 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.671405 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f6362017-5b9b-4625-be05-9ceee22b3426-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f6362017-5b9b-4625-be05-9ceee22b3426\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:23:14.671645 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.671457 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f6362017-5b9b-4625-be05-9ceee22b3426-config-volume\") pod \"alertmanager-main-0\" (UID: \"f6362017-5b9b-4625-be05-9ceee22b3426\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:23:14.671645 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.671483 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6362017-5b9b-4625-be05-9ceee22b3426-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f6362017-5b9b-4625-be05-9ceee22b3426\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:23:14.671892 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.671868 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6362017-5b9b-4625-be05-9ceee22b3426-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f6362017-5b9b-4625-be05-9ceee22b3426\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:23:14.671960 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.671868 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f6362017-5b9b-4625-be05-9ceee22b3426-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f6362017-5b9b-4625-be05-9ceee22b3426\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:23:14.672417 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.672392 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6362017-5b9b-4625-be05-9ceee22b3426-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f6362017-5b9b-4625-be05-9ceee22b3426\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:23:14.674176 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.674152 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f6362017-5b9b-4625-be05-9ceee22b3426-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f6362017-5b9b-4625-be05-9ceee22b3426\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:23:14.674176 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.674162 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f6362017-5b9b-4625-be05-9ceee22b3426-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f6362017-5b9b-4625-be05-9ceee22b3426\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:23:14.674340 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.674215 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f6362017-5b9b-4625-be05-9ceee22b3426-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f6362017-5b9b-4625-be05-9ceee22b3426\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:23:14.674340 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.674228 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f6362017-5b9b-4625-be05-9ceee22b3426-web-config\") pod \"alertmanager-main-0\" (UID: \"f6362017-5b9b-4625-be05-9ceee22b3426\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:23:14.674449 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.674369 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f6362017-5b9b-4625-be05-9ceee22b3426-config-out\") pod \"alertmanager-main-0\" (UID: \"f6362017-5b9b-4625-be05-9ceee22b3426\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:23:14.674449 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.674415 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f6362017-5b9b-4625-be05-9ceee22b3426-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f6362017-5b9b-4625-be05-9ceee22b3426\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:23:14.674567 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.674455 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f6362017-5b9b-4625-be05-9ceee22b3426-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f6362017-5b9b-4625-be05-9ceee22b3426\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:23:14.675235 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.675216 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f6362017-5b9b-4625-be05-9ceee22b3426-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f6362017-5b9b-4625-be05-9ceee22b3426\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:23:14.675990 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.675970 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f6362017-5b9b-4625-be05-9ceee22b3426-config-volume\") pod \"alertmanager-main-0\" (UID: \"f6362017-5b9b-4625-be05-9ceee22b3426\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:23:14.678530 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.678512 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj9fd\" (UniqueName: \"kubernetes.io/projected/f6362017-5b9b-4625-be05-9ceee22b3426-kube-api-access-jj9fd\") pod \"alertmanager-main-0\" (UID: \"f6362017-5b9b-4625-be05-9ceee22b3426\") " pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:23:14.825861 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:14.825832 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 19 08:23:15.101609 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:15.101585 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 19 08:23:15.104062 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:23:15.104038 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6362017_5b9b_4625_be05_9ceee22b3426.slice/crio-c347923c0c0cd21cc19a4961ff69f87b48b7bd77ef1b5238b92e874361789518 WatchSource:0}: Error finding container c347923c0c0cd21cc19a4961ff69f87b48b7bd77ef1b5238b92e874361789518: Status 404 returned error can't find the container with id c347923c0c0cd21cc19a4961ff69f87b48b7bd77ef1b5238b92e874361789518 Sep 19 08:23:15.458607 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:15.458524 2584 generic.go:356] "Generic (PLEG): container finished" podID="f6362017-5b9b-4625-be05-9ceee22b3426" containerID="2276686ac95e60243ebbf3409c01869509df84b1bb9d881fb56bb9fccb19dcbc" exitCode=0 Sep 19 08:23:15.458607 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:15.458559 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f6362017-5b9b-4625-be05-9ceee22b3426","Type":"ContainerDied","Data":"2276686ac95e60243ebbf3409c01869509df84b1bb9d881fb56bb9fccb19dcbc"} Sep 19 08:23:15.458971 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:15.458619 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f6362017-5b9b-4625-be05-9ceee22b3426","Type":"ContainerStarted","Data":"c347923c0c0cd21cc19a4961ff69f87b48b7bd77ef1b5238b92e874361789518"} Sep 19 08:23:16.465972 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:16.465941 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f6362017-5b9b-4625-be05-9ceee22b3426","Type":"ContainerStarted","Data":"4e32d01ef87b325e12b06e6cbbbc5bc17b39f7d9592d0118bf8568ac562aff4c"} Sep 19 08:23:16.466416 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:16.466031 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f6362017-5b9b-4625-be05-9ceee22b3426","Type":"ContainerStarted","Data":"c8834beb97cdc6141b142ac96bfbc4b3a5176e333005c714a6c90c3c42f367ee"} Sep 19 08:23:16.466416 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:16.466063 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f6362017-5b9b-4625-be05-9ceee22b3426","Type":"ContainerStarted","Data":"76bf1adf8de6119bd83e599f47d920dd9e5e0346e85152fc8558baa147698325"} Sep 19 08:23:16.466416 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:16.466102 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f6362017-5b9b-4625-be05-9ceee22b3426","Type":"ContainerStarted","Data":"fcb683cd0a9d7313f997e92e67fdb3d78d3db7dc0652482c2995bfdcf6210acc"} Sep 19 08:23:16.466416 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:16.466126 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f6362017-5b9b-4625-be05-9ceee22b3426","Type":"ContainerStarted","Data":"5a001c198e46f7e09546303614520a1128db0f70f90c20dff885349d44bdd9a2"} Sep 19 08:23:16.466416 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:16.466167 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f6362017-5b9b-4625-be05-9ceee22b3426","Type":"ContainerStarted","Data":"2e18791c948a66846db11f3850b4159b01d89d1cd4e71e0b983a9c6dd75f16c1"} Sep 19 08:23:16.494169 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:16.494122 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.480038181 podStartE2EDuration="2.494107622s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.069441ms" isStatefulPod=false podCreationTimestamp="2026-09-19 08:23:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 08:23:16.492279771 +0000 UTC m=+146.222376385" watchObservedRunningTime="2026-09-19 08:23:16.494107622 +0000 UTC m=+146.224204223" Sep 19 08:23:17.136404 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:17.136370 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7b65d4c7-86qpf"] Sep 19 08:23:17.139269 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:17.139247 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7b65d4c7-86qpf" Sep 19 08:23:17.141820 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:17.141784 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-f567s\"" Sep 19 08:23:17.141951 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:17.141866 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 19 08:23:17.141951 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:17.141887 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 19 08:23:17.142477 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:17.142303 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 19 08:23:17.142477 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:17.142450 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 19 08:23:17.142641 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:17.142620 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 19 08:23:17.148110 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:17.148091 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 19 08:23:17.154280 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:17.154256 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7b65d4c7-86qpf"] Sep 19 08:23:17.192798 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:17.192761 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1256aa83-593b-477e-b885-38e3bfd122e6-telemeter-client-tls\") pod \"telemeter-client-7b65d4c7-86qpf\" (UID: \"1256aa83-593b-477e-b885-38e3bfd122e6\") " pod="openshift-monitoring/telemeter-client-7b65d4c7-86qpf" Sep 19 08:23:17.192958 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:17.192847 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1256aa83-593b-477e-b885-38e3bfd122e6-metrics-client-ca\") pod \"telemeter-client-7b65d4c7-86qpf\" (UID: \"1256aa83-593b-477e-b885-38e3bfd122e6\") " pod="openshift-monitoring/telemeter-client-7b65d4c7-86qpf" Sep 19 08:23:17.192958 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:17.192870 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1256aa83-593b-477e-b885-38e3bfd122e6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7b65d4c7-86qpf\" (UID: \"1256aa83-593b-477e-b885-38e3bfd122e6\") " pod="openshift-monitoring/telemeter-client-7b65d4c7-86qpf" Sep 19 08:23:17.192958 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:17.192932 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1256aa83-593b-477e-b885-38e3bfd122e6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7b65d4c7-86qpf\" (UID: \"1256aa83-593b-477e-b885-38e3bfd122e6\") " pod="openshift-monitoring/telemeter-client-7b65d4c7-86qpf" Sep 19 08:23:17.193055 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:17.192982 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1256aa83-593b-477e-b885-38e3bfd122e6-federate-client-tls\") pod \"telemeter-client-7b65d4c7-86qpf\" (UID: \"1256aa83-593b-477e-b885-38e3bfd122e6\") " pod="openshift-monitoring/telemeter-client-7b65d4c7-86qpf" Sep 19 08:23:17.193055 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:17.192999 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1256aa83-593b-477e-b885-38e3bfd122e6-secret-telemeter-client\") pod \"telemeter-client-7b65d4c7-86qpf\" (UID: \"1256aa83-593b-477e-b885-38e3bfd122e6\") " pod="openshift-monitoring/telemeter-client-7b65d4c7-86qpf" Sep 19 08:23:17.193055 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:17.193035 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1256aa83-593b-477e-b885-38e3bfd122e6-serving-certs-ca-bundle\") pod \"telemeter-client-7b65d4c7-86qpf\" (UID: \"1256aa83-593b-477e-b885-38e3bfd122e6\") " pod="openshift-monitoring/telemeter-client-7b65d4c7-86qpf" Sep 19 08:23:17.193055 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:17.193052 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cvqj\" (UniqueName: \"kubernetes.io/projected/1256aa83-593b-477e-b885-38e3bfd122e6-kube-api-access-7cvqj\") pod \"telemeter-client-7b65d4c7-86qpf\" (UID: \"1256aa83-593b-477e-b885-38e3bfd122e6\") " pod="openshift-monitoring/telemeter-client-7b65d4c7-86qpf" Sep 19 08:23:17.294095 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:17.294038 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1256aa83-593b-477e-b885-38e3bfd122e6-telemeter-client-tls\") pod \"telemeter-client-7b65d4c7-86qpf\" (UID: \"1256aa83-593b-477e-b885-38e3bfd122e6\") " pod="openshift-monitoring/telemeter-client-7b65d4c7-86qpf" Sep 19 08:23:17.294275 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:17.294104 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1256aa83-593b-477e-b885-38e3bfd122e6-metrics-client-ca\") pod \"telemeter-client-7b65d4c7-86qpf\" (UID: \"1256aa83-593b-477e-b885-38e3bfd122e6\") " pod="openshift-monitoring/telemeter-client-7b65d4c7-86qpf" Sep 19 08:23:17.294275 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:17.294125 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1256aa83-593b-477e-b885-38e3bfd122e6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7b65d4c7-86qpf\" (UID: \"1256aa83-593b-477e-b885-38e3bfd122e6\") " pod="openshift-monitoring/telemeter-client-7b65d4c7-86qpf" Sep 19 08:23:17.294275 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:17.294145 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1256aa83-593b-477e-b885-38e3bfd122e6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7b65d4c7-86qpf\" (UID: \"1256aa83-593b-477e-b885-38e3bfd122e6\") " pod="openshift-monitoring/telemeter-client-7b65d4c7-86qpf" Sep 19 08:23:17.294275 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:17.294198 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1256aa83-593b-477e-b885-38e3bfd122e6-federate-client-tls\") pod \"telemeter-client-7b65d4c7-86qpf\" (UID: \"1256aa83-593b-477e-b885-38e3bfd122e6\") " pod="openshift-monitoring/telemeter-client-7b65d4c7-86qpf" Sep 19 08:23:17.294275 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:17.294222 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1256aa83-593b-477e-b885-38e3bfd122e6-secret-telemeter-client\") pod \"telemeter-client-7b65d4c7-86qpf\" (UID: \"1256aa83-593b-477e-b885-38e3bfd122e6\") " pod="openshift-monitoring/telemeter-client-7b65d4c7-86qpf" Sep 19 08:23:17.294531 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:17.294279 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1256aa83-593b-477e-b885-38e3bfd122e6-serving-certs-ca-bundle\") pod \"telemeter-client-7b65d4c7-86qpf\" (UID: \"1256aa83-593b-477e-b885-38e3bfd122e6\") " pod="openshift-monitoring/telemeter-client-7b65d4c7-86qpf" Sep 19 08:23:17.294531 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:17.294304 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cvqj\" (UniqueName: \"kubernetes.io/projected/1256aa83-593b-477e-b885-38e3bfd122e6-kube-api-access-7cvqj\") pod \"telemeter-client-7b65d4c7-86qpf\" (UID: \"1256aa83-593b-477e-b885-38e3bfd122e6\") " pod="openshift-monitoring/telemeter-client-7b65d4c7-86qpf" Sep 19 08:23:17.294979 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:17.294952 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1256aa83-593b-477e-b885-38e3bfd122e6-metrics-client-ca\") pod \"telemeter-client-7b65d4c7-86qpf\" (UID: \"1256aa83-593b-477e-b885-38e3bfd122e6\") " pod="openshift-monitoring/telemeter-client-7b65d4c7-86qpf" Sep 19 08:23:17.295210 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:17.295179 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1256aa83-593b-477e-b885-38e3bfd122e6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7b65d4c7-86qpf\" (UID: \"1256aa83-593b-477e-b885-38e3bfd122e6\") " pod="openshift-monitoring/telemeter-client-7b65d4c7-86qpf" Sep 19 08:23:17.295294 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:17.295242 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1256aa83-593b-477e-b885-38e3bfd122e6-serving-certs-ca-bundle\") pod \"telemeter-client-7b65d4c7-86qpf\" (UID: \"1256aa83-593b-477e-b885-38e3bfd122e6\") " pod="openshift-monitoring/telemeter-client-7b65d4c7-86qpf" Sep 19 08:23:17.297436 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:17.297393 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1256aa83-593b-477e-b885-38e3bfd122e6-secret-telemeter-client\") pod \"telemeter-client-7b65d4c7-86qpf\" (UID: \"1256aa83-593b-477e-b885-38e3bfd122e6\") " pod="openshift-monitoring/telemeter-client-7b65d4c7-86qpf" Sep 19 08:23:17.297590 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:17.297565 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1256aa83-593b-477e-b885-38e3bfd122e6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7b65d4c7-86qpf\" (UID: \"1256aa83-593b-477e-b885-38e3bfd122e6\") " pod="openshift-monitoring/telemeter-client-7b65d4c7-86qpf" Sep 19 08:23:17.298025 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:17.298006 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1256aa83-593b-477e-b885-38e3bfd122e6-federate-client-tls\") pod \"telemeter-client-7b65d4c7-86qpf\" (UID: \"1256aa83-593b-477e-b885-38e3bfd122e6\") " pod="openshift-monitoring/telemeter-client-7b65d4c7-86qpf" Sep 19 08:23:17.298483 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:17.298462 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1256aa83-593b-477e-b885-38e3bfd122e6-telemeter-client-tls\") pod \"telemeter-client-7b65d4c7-86qpf\" (UID: \"1256aa83-593b-477e-b885-38e3bfd122e6\") " pod="openshift-monitoring/telemeter-client-7b65d4c7-86qpf" Sep 19 08:23:17.302890 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:17.302867 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cvqj\" (UniqueName: \"kubernetes.io/projected/1256aa83-593b-477e-b885-38e3bfd122e6-kube-api-access-7cvqj\") pod \"telemeter-client-7b65d4c7-86qpf\" (UID: \"1256aa83-593b-477e-b885-38e3bfd122e6\") " pod="openshift-monitoring/telemeter-client-7b65d4c7-86qpf" Sep 19 08:23:17.443798 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:17.443717 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 19 08:23:17.444212 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:17.444021 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" containerName="prometheus" containerID="cri-o://e24c3bbc896297dee0b443e095a0b21e49af197dc57371a7d8ec5ff307a30c85" gracePeriod=600 Sep 19 08:23:17.444212 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:17.444058 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" containerName="kube-rbac-proxy-thanos" containerID="cri-o://c5da71f312d466b60b80cd627da6b175c5455ea1a81ddf93cdea0371dc5d90cd" gracePeriod=600 Sep 19 08:23:17.444212 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:17.444100 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" containerName="config-reloader" containerID="cri-o://bb7939a4a5784e17a1f513f1547839743310d2229cefff17d6cb4e632491c6cb" gracePeriod=600 Sep 19 08:23:17.444212 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:17.444101 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" containerName="kube-rbac-proxy-web" containerID="cri-o://39dcd4c4346290328bb0d2887cef6bf18e5974e11237bfcb0a77842a7cfde330" gracePeriod=600 Sep 19 08:23:17.444212 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:17.444026 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" containerName="kube-rbac-proxy" containerID="cri-o://b68341ee3728ec2d384abc95ab1fce11d0249754a61971f944625fc185ad2c7c" gracePeriod=600 Sep 19 08:23:17.444212 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:17.444062 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" containerName="thanos-sidecar" containerID="cri-o://4d54eb4dfd9fff2d8bbb10ad7a3f242c02624b3619acf71a0c4f71c467708786" gracePeriod=600 Sep 19 08:23:17.455759 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:17.455595 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7b65d4c7-86qpf" Sep 19 08:23:17.755154 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:17.755119 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7b65d4c7-86qpf"] Sep 19 08:23:18.481376 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:18.481333 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b65d4c7-86qpf" event={"ID":"1256aa83-593b-477e-b885-38e3bfd122e6","Type":"ContainerStarted","Data":"67c0e4f076ad95f7259e096724e2c9f7241056cf1725fe09f2fb9e92e86cd2fd"} Sep 19 08:23:18.485733 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:18.485699 2584 generic.go:356] "Generic (PLEG): container finished" podID="24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" containerID="39dcd4c4346290328bb0d2887cef6bf18e5974e11237bfcb0a77842a7cfde330" exitCode=0 Sep 19 08:23:18.485733 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:18.485731 2584 generic.go:356] "Generic (PLEG): container finished" podID="24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" containerID="4d54eb4dfd9fff2d8bbb10ad7a3f242c02624b3619acf71a0c4f71c467708786" exitCode=0 Sep 19 08:23:18.485733 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:18.485741 2584 generic.go:356] "Generic (PLEG): container finished" podID="24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" containerID="bb7939a4a5784e17a1f513f1547839743310d2229cefff17d6cb4e632491c6cb" exitCode=0 Sep 19 08:23:18.485914 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:18.485774 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4","Type":"ContainerDied","Data":"39dcd4c4346290328bb0d2887cef6bf18e5974e11237bfcb0a77842a7cfde330"} Sep 19 08:23:18.485914 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:18.485841 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4","Type":"ContainerDied","Data":"4d54eb4dfd9fff2d8bbb10ad7a3f242c02624b3619acf71a0c4f71c467708786"} Sep 19 08:23:18.485914 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:18.485882 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4","Type":"ContainerDied","Data":"bb7939a4a5784e17a1f513f1547839743310d2229cefff17d6cb4e632491c6cb"} Sep 19 08:23:19.495939 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:19.495902 2584 generic.go:356] "Generic (PLEG): container finished" podID="24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" containerID="c5da71f312d466b60b80cd627da6b175c5455ea1a81ddf93cdea0371dc5d90cd" exitCode=0 Sep 19 08:23:19.495939 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:19.495933 2584 generic.go:356] "Generic (PLEG): container finished" podID="24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" containerID="b68341ee3728ec2d384abc95ab1fce11d0249754a61971f944625fc185ad2c7c" exitCode=0 Sep 19 08:23:19.496457 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:19.495995 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4","Type":"ContainerDied","Data":"c5da71f312d466b60b80cd627da6b175c5455ea1a81ddf93cdea0371dc5d90cd"} Sep 19 08:23:19.496457 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:19.496066 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4","Type":"ContainerDied","Data":"b68341ee3728ec2d384abc95ab1fce11d0249754a61971f944625fc185ad2c7c"} Sep 19 08:23:20.395310 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:23:20.395268 2584 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e24c3bbc896297dee0b443e095a0b21e49af197dc57371a7d8ec5ff307a30c85" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] Sep 19 08:23:20.396275 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:23:20.396246 2584 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e24c3bbc896297dee0b443e095a0b21e49af197dc57371a7d8ec5ff307a30c85" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] Sep 19 08:23:20.397139 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:23:20.397100 2584 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e24c3bbc896297dee0b443e095a0b21e49af197dc57371a7d8ec5ff307a30c85" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] Sep 19 08:23:20.397220 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:23:20.397141 2584 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openshift-monitoring/prometheus-k8s-0" podUID="24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" containerName="prometheus" probeResult="unknown" Sep 19 08:23:20.502486 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:20.502452 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b65d4c7-86qpf" event={"ID":"1256aa83-593b-477e-b885-38e3bfd122e6","Type":"ContainerStarted","Data":"76e6089abb8a49c833498aa4e988c09e59c8354d36aa9c61726bccdeb5fd8c3b"} Sep 19 08:23:20.502915 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:20.502506 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b65d4c7-86qpf" event={"ID":"1256aa83-593b-477e-b885-38e3bfd122e6","Type":"ContainerStarted","Data":"13541e7ebd73a9d2b611593020162b3e4972510e67c3a3c2a4241deccdab1f83"} Sep 19 08:23:20.502915 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:20.502524 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b65d4c7-86qpf" event={"ID":"1256aa83-593b-477e-b885-38e3bfd122e6","Type":"ContainerStarted","Data":"ee677c3cb9560dd43a2e90ecd9e41dc0f8249b8fb9734ef4de642f2126746cef"} Sep 19 08:23:20.523739 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:20.523682 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7b65d4c7-86qpf" podStartSLOduration=1.406728758 podStartE2EDuration="3.523660616s" totalImagesPullingTime="2.116931858s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 08:23:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 08:23:20.522693324 +0000 UTC m=+150.252789926" watchObservedRunningTime="2026-09-19 08:23:20.523660616 +0000 UTC m=+150.253757219" Sep 19 08:23:25.395607 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:23:25.395560 2584 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e24c3bbc896297dee0b443e095a0b21e49af197dc57371a7d8ec5ff307a30c85" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] Sep 19 08:23:25.396453 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:23:25.396425 2584 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e24c3bbc896297dee0b443e095a0b21e49af197dc57371a7d8ec5ff307a30c85" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] Sep 19 08:23:25.397271 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:23:25.397242 2584 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="e24c3bbc896297dee0b443e095a0b21e49af197dc57371a7d8ec5ff307a30c85" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] Sep 19 08:23:25.397343 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:23:25.397282 2584 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openshift-monitoring/prometheus-k8s-0" podUID="24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" containerName="prometheus" probeResult="unknown" Sep 19 08:23:27.083699 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.083675 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.184633 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.184542 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-prometheus-k8s-rulefiles-2\") pod \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " Sep 19 08:23:27.184633 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.184580 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-prometheus-k8s-rulefiles-1\") pod \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " Sep 19 08:23:27.184633 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.184608 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-configmap-kubelet-serving-ca-bundle\") pod \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " Sep 19 08:23:27.184894 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.184634 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-config-out\") pod \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " Sep 19 08:23:27.184894 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.184789 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-thanos-prometheus-http-client-file\") pod \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " Sep 19 08:23:27.184894 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.184835 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-configmap-serving-certs-ca-bundle\") pod \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " Sep 19 08:23:27.184894 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.184862 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-prometheus-k8s-db\") pod \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " Sep 19 08:23:27.184894 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.184891 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-config\") pod \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " Sep 19 08:23:27.185160 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.184917 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-configmap-metrics-client-ca\") pod \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " Sep 19 08:23:27.185160 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.184951 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " Sep 19 08:23:27.185160 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.184957 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" (UID: "24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 08:23:27.185160 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.184975 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-secret-kube-rbac-proxy\") pod \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " Sep 19 08:23:27.185160 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.185002 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-secret-metrics-client-certs\") pod \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " Sep 19 08:23:27.185160 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.185063 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-secret-prometheus-k8s-tls\") pod \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " Sep 19 08:23:27.185160 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.185141 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-web-config\") pod \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " Sep 19 08:23:27.185508 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.185179 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-tls-assets\") pod \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " Sep 19 08:23:27.185508 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.185204 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n268s\" (UniqueName: \"kubernetes.io/projected/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-kube-api-access-n268s\") pod \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " Sep 19 08:23:27.185508 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.185227 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-prometheus-trusted-ca-bundle\") pod \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " Sep 19 08:23:27.185508 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.185261 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-prometheus-k8s-rulefiles-0\") pod \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " Sep 19 08:23:27.185508 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.185287 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " Sep 19 08:23:27.185508 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.185313 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-secret-grpc-tls\") pod \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\" (UID: \"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4\") " Sep 19 08:23:27.185808 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.185616 2584 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 08:23:27.185866 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.184994 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" (UID: "24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 08:23:27.185922 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.185001 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" (UID: "24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 08:23:27.185922 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.185323 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" (UID: "24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 08:23:27.185922 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.185535 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" (UID: "24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 08:23:27.187066 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.187043 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" (UID: "24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 08:23:27.187283 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.187107 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" (UID: "24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 08:23:27.187685 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.187640 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-config-out" (OuterVolumeSpecName: "config-out") pod "24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" (UID: "24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 08:23:27.187685 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.187669 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" (UID: "24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 08:23:27.189153 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.189113 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-config" (OuterVolumeSpecName: "config") pod "24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" (UID: "24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 08:23:27.189493 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.189466 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" (UID: "24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 08:23:27.189704 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.189667 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" (UID: "24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 08:23:27.189806 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.189783 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" (UID: "24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 08:23:27.189977 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.189892 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" (UID: "24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 08:23:27.190087 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.189966 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" (UID: "24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 08:23:27.190158 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.190131 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" (UID: "24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 08:23:27.190230 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.190181 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-kube-api-access-n268s" (OuterVolumeSpecName: "kube-api-access-n268s") pod "24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" (UID: "24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4"). InnerVolumeSpecName "kube-api-access-n268s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 08:23:27.190303 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.190283 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" (UID: "24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 08:23:27.190968 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.190950 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" (UID: "24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 08:23:27.201109 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.201063 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-web-config" (OuterVolumeSpecName: "web-config") pod "24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" (UID: "24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 08:23:27.286599 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.286567 2584 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-web-config\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 08:23:27.286599 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.286594 2584 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-tls-assets\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 08:23:27.286599 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.286605 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n268s\" (UniqueName: \"kubernetes.io/projected/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-kube-api-access-n268s\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 08:23:27.286821 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.286615 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-prometheus-trusted-ca-bundle\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 08:23:27.286821 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.286625 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 08:23:27.286821 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.286634 2584 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 08:23:27.286821 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.286643 2584 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-secret-grpc-tls\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 08:23:27.286821 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.286651 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 08:23:27.286821 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.286659 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 08:23:27.286821 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.286667 2584 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-config-out\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 08:23:27.286821 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.286676 2584 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-thanos-prometheus-http-client-file\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 08:23:27.286821 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.286683 2584 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 08:23:27.286821 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.286692 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-prometheus-k8s-db\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 08:23:27.286821 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.286700 2584 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-config\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 08:23:27.286821 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.286707 2584 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-configmap-metrics-client-ca\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 08:23:27.286821 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.286716 2584 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 08:23:27.286821 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.286724 2584 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-secret-kube-rbac-proxy\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 08:23:27.286821 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.286732 2584 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-secret-metrics-client-certs\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 08:23:27.286821 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.286741 2584 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4-secret-prometheus-k8s-tls\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 08:23:27.537626 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.537539 2584 generic.go:356] "Generic (PLEG): container finished" podID="24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" containerID="e24c3bbc896297dee0b443e095a0b21e49af197dc57371a7d8ec5ff307a30c85" exitCode=0 Sep 19 08:23:27.537626 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.537593 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4","Type":"ContainerDied","Data":"e24c3bbc896297dee0b443e095a0b21e49af197dc57371a7d8ec5ff307a30c85"} Sep 19 08:23:27.537804 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.537659 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.537804 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.537673 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4","Type":"ContainerDied","Data":"2b88cf0d97b130b7c265dbaae76b8d6e1cd24cbb71b10e1296fc931c3e31cad2"} Sep 19 08:23:27.537804 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.537706 2584 scope.go:117] "RemoveContainer" containerID="c5da71f312d466b60b80cd627da6b175c5455ea1a81ddf93cdea0371dc5d90cd" Sep 19 08:23:27.546408 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.546385 2584 scope.go:117] "RemoveContainer" containerID="b68341ee3728ec2d384abc95ab1fce11d0249754a61971f944625fc185ad2c7c" Sep 19 08:23:27.553499 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.553482 2584 scope.go:117] "RemoveContainer" containerID="39dcd4c4346290328bb0d2887cef6bf18e5974e11237bfcb0a77842a7cfde330" Sep 19 08:23:27.559894 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.559875 2584 scope.go:117] "RemoveContainer" containerID="4d54eb4dfd9fff2d8bbb10ad7a3f242c02624b3619acf71a0c4f71c467708786" Sep 19 08:23:27.563882 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.563860 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 19 08:23:27.567029 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.567008 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 19 08:23:27.567716 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.567702 2584 scope.go:117] "RemoveContainer" containerID="bb7939a4a5784e17a1f513f1547839743310d2229cefff17d6cb4e632491c6cb" Sep 19 08:23:27.574218 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.574200 2584 scope.go:117] "RemoveContainer" containerID="e24c3bbc896297dee0b443e095a0b21e49af197dc57371a7d8ec5ff307a30c85" Sep 19 08:23:27.581068 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.581050 2584 scope.go:117] "RemoveContainer" containerID="5b0e466b6b27dc6f67c1b0107078e9b51fadac28a93179f08621a2ddcc2bff6c" Sep 19 08:23:27.587610 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.587594 2584 scope.go:117] "RemoveContainer" containerID="c5da71f312d466b60b80cd627da6b175c5455ea1a81ddf93cdea0371dc5d90cd" Sep 19 08:23:27.587897 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:23:27.587879 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5da71f312d466b60b80cd627da6b175c5455ea1a81ddf93cdea0371dc5d90cd\": container with ID starting with c5da71f312d466b60b80cd627da6b175c5455ea1a81ddf93cdea0371dc5d90cd not found: ID does not exist" containerID="c5da71f312d466b60b80cd627da6b175c5455ea1a81ddf93cdea0371dc5d90cd" Sep 19 08:23:27.587973 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.587909 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5da71f312d466b60b80cd627da6b175c5455ea1a81ddf93cdea0371dc5d90cd"} err="failed to get container status \"c5da71f312d466b60b80cd627da6b175c5455ea1a81ddf93cdea0371dc5d90cd\": rpc error: code = NotFound desc = could not find container \"c5da71f312d466b60b80cd627da6b175c5455ea1a81ddf93cdea0371dc5d90cd\": container with ID starting with c5da71f312d466b60b80cd627da6b175c5455ea1a81ddf93cdea0371dc5d90cd not found: ID does not exist" Sep 19 08:23:27.587973 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.587936 2584 scope.go:117] "RemoveContainer" containerID="b68341ee3728ec2d384abc95ab1fce11d0249754a61971f944625fc185ad2c7c" Sep 19 08:23:27.588219 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:23:27.588201 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b68341ee3728ec2d384abc95ab1fce11d0249754a61971f944625fc185ad2c7c\": container with ID starting with b68341ee3728ec2d384abc95ab1fce11d0249754a61971f944625fc185ad2c7c not found: ID does not exist" containerID="b68341ee3728ec2d384abc95ab1fce11d0249754a61971f944625fc185ad2c7c" Sep 19 08:23:27.588298 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.588225 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b68341ee3728ec2d384abc95ab1fce11d0249754a61971f944625fc185ad2c7c"} err="failed to get container status \"b68341ee3728ec2d384abc95ab1fce11d0249754a61971f944625fc185ad2c7c\": rpc error: code = NotFound desc = could not find container \"b68341ee3728ec2d384abc95ab1fce11d0249754a61971f944625fc185ad2c7c\": container with ID starting with b68341ee3728ec2d384abc95ab1fce11d0249754a61971f944625fc185ad2c7c not found: ID does not exist" Sep 19 08:23:27.588298 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.588238 2584 scope.go:117] "RemoveContainer" containerID="39dcd4c4346290328bb0d2887cef6bf18e5974e11237bfcb0a77842a7cfde330" Sep 19 08:23:27.588473 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:23:27.588457 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39dcd4c4346290328bb0d2887cef6bf18e5974e11237bfcb0a77842a7cfde330\": container with ID starting with 39dcd4c4346290328bb0d2887cef6bf18e5974e11237bfcb0a77842a7cfde330 not found: ID does not exist" containerID="39dcd4c4346290328bb0d2887cef6bf18e5974e11237bfcb0a77842a7cfde330" Sep 19 08:23:27.588518 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.588478 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39dcd4c4346290328bb0d2887cef6bf18e5974e11237bfcb0a77842a7cfde330"} err="failed to get container status \"39dcd4c4346290328bb0d2887cef6bf18e5974e11237bfcb0a77842a7cfde330\": rpc error: code = NotFound desc = could not find container \"39dcd4c4346290328bb0d2887cef6bf18e5974e11237bfcb0a77842a7cfde330\": container with ID starting with 39dcd4c4346290328bb0d2887cef6bf18e5974e11237bfcb0a77842a7cfde330 not found: ID does not exist" Sep 19 08:23:27.588518 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.588496 2584 scope.go:117] "RemoveContainer" containerID="4d54eb4dfd9fff2d8bbb10ad7a3f242c02624b3619acf71a0c4f71c467708786" Sep 19 08:23:27.588730 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:23:27.588714 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d54eb4dfd9fff2d8bbb10ad7a3f242c02624b3619acf71a0c4f71c467708786\": container with ID starting with 4d54eb4dfd9fff2d8bbb10ad7a3f242c02624b3619acf71a0c4f71c467708786 not found: ID does not exist" containerID="4d54eb4dfd9fff2d8bbb10ad7a3f242c02624b3619acf71a0c4f71c467708786" Sep 19 08:23:27.588789 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.588738 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d54eb4dfd9fff2d8bbb10ad7a3f242c02624b3619acf71a0c4f71c467708786"} err="failed to get container status \"4d54eb4dfd9fff2d8bbb10ad7a3f242c02624b3619acf71a0c4f71c467708786\": rpc error: code = NotFound desc = could not find container \"4d54eb4dfd9fff2d8bbb10ad7a3f242c02624b3619acf71a0c4f71c467708786\": container with ID starting with 4d54eb4dfd9fff2d8bbb10ad7a3f242c02624b3619acf71a0c4f71c467708786 not found: ID does not exist" Sep 19 08:23:27.588789 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.588758 2584 scope.go:117] "RemoveContainer" containerID="bb7939a4a5784e17a1f513f1547839743310d2229cefff17d6cb4e632491c6cb" Sep 19 08:23:27.588981 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:23:27.588963 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb7939a4a5784e17a1f513f1547839743310d2229cefff17d6cb4e632491c6cb\": container with ID starting with bb7939a4a5784e17a1f513f1547839743310d2229cefff17d6cb4e632491c6cb not found: ID does not exist" containerID="bb7939a4a5784e17a1f513f1547839743310d2229cefff17d6cb4e632491c6cb" Sep 19 08:23:27.589018 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.588985 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb7939a4a5784e17a1f513f1547839743310d2229cefff17d6cb4e632491c6cb"} err="failed to get container status \"bb7939a4a5784e17a1f513f1547839743310d2229cefff17d6cb4e632491c6cb\": rpc error: code = NotFound desc = could not find container \"bb7939a4a5784e17a1f513f1547839743310d2229cefff17d6cb4e632491c6cb\": container with ID starting with bb7939a4a5784e17a1f513f1547839743310d2229cefff17d6cb4e632491c6cb not found: ID does not exist" Sep 19 08:23:27.589018 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.588998 2584 scope.go:117] "RemoveContainer" containerID="e24c3bbc896297dee0b443e095a0b21e49af197dc57371a7d8ec5ff307a30c85" Sep 19 08:23:27.589240 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:23:27.589226 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e24c3bbc896297dee0b443e095a0b21e49af197dc57371a7d8ec5ff307a30c85\": container with ID starting with e24c3bbc896297dee0b443e095a0b21e49af197dc57371a7d8ec5ff307a30c85 not found: ID does not exist" containerID="e24c3bbc896297dee0b443e095a0b21e49af197dc57371a7d8ec5ff307a30c85" Sep 19 08:23:27.589290 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.589243 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e24c3bbc896297dee0b443e095a0b21e49af197dc57371a7d8ec5ff307a30c85"} err="failed to get container status \"e24c3bbc896297dee0b443e095a0b21e49af197dc57371a7d8ec5ff307a30c85\": rpc error: code = NotFound desc = could not find container \"e24c3bbc896297dee0b443e095a0b21e49af197dc57371a7d8ec5ff307a30c85\": container with ID starting with e24c3bbc896297dee0b443e095a0b21e49af197dc57371a7d8ec5ff307a30c85 not found: ID does not exist" Sep 19 08:23:27.589290 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.589258 2584 scope.go:117] "RemoveContainer" containerID="5b0e466b6b27dc6f67c1b0107078e9b51fadac28a93179f08621a2ddcc2bff6c" Sep 19 08:23:27.589500 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:23:27.589483 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b0e466b6b27dc6f67c1b0107078e9b51fadac28a93179f08621a2ddcc2bff6c\": container with ID starting with 5b0e466b6b27dc6f67c1b0107078e9b51fadac28a93179f08621a2ddcc2bff6c not found: ID does not exist" containerID="5b0e466b6b27dc6f67c1b0107078e9b51fadac28a93179f08621a2ddcc2bff6c" Sep 19 08:23:27.589550 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.589507 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b0e466b6b27dc6f67c1b0107078e9b51fadac28a93179f08621a2ddcc2bff6c"} err="failed to get container status \"5b0e466b6b27dc6f67c1b0107078e9b51fadac28a93179f08621a2ddcc2bff6c\": rpc error: code = NotFound desc = could not find container \"5b0e466b6b27dc6f67c1b0107078e9b51fadac28a93179f08621a2ddcc2bff6c\": container with ID starting with 5b0e466b6b27dc6f67c1b0107078e9b51fadac28a93179f08621a2ddcc2bff6c not found: ID does not exist" Sep 19 08:23:27.592099 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.592062 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 19 08:23:27.592410 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.592393 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" containerName="thanos-sidecar" Sep 19 08:23:27.592484 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.592412 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" containerName="thanos-sidecar" Sep 19 08:23:27.592484 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.592426 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" containerName="kube-rbac-proxy-web" Sep 19 08:23:27.592484 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.592436 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" containerName="kube-rbac-proxy-web" Sep 19 08:23:27.592484 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.592459 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" containerName="config-reloader" Sep 19 08:23:27.592484 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.592468 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" containerName="config-reloader" Sep 19 08:23:27.592484 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.592477 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" containerName="kube-rbac-proxy-thanos" Sep 19 08:23:27.592484 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.592485 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" containerName="kube-rbac-proxy-thanos" Sep 19 08:23:27.592816 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.592499 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" containerName="init-config-reloader" Sep 19 08:23:27.592816 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.592508 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" containerName="init-config-reloader" Sep 19 08:23:27.592816 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.592519 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" containerName="prometheus" Sep 19 08:23:27.592816 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.592528 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" containerName="prometheus" Sep 19 08:23:27.592816 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.592545 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" containerName="kube-rbac-proxy" Sep 19 08:23:27.592816 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.592554 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" containerName="kube-rbac-proxy" Sep 19 08:23:27.592816 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.592650 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" containerName="config-reloader" Sep 19 08:23:27.592816 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.592664 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" containerName="thanos-sidecar" Sep 19 08:23:27.592816 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.592676 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" containerName="prometheus" Sep 19 08:23:27.592816 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.592687 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" containerName="kube-rbac-proxy-web" Sep 19 08:23:27.592816 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.592697 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" containerName="kube-rbac-proxy-thanos" Sep 19 08:23:27.592816 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.592706 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" containerName="kube-rbac-proxy" Sep 19 08:23:27.596286 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.596267 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.610638 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.610617 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 19 08:23:27.610730 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.610634 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 19 08:23:27.610820 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.610807 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 19 08:23:27.610877 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.610834 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 19 08:23:27.610929 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.610885 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 19 08:23:27.611184 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.611164 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 19 08:23:27.611449 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.611424 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-dm7r42q0jbubj\"" Sep 19 08:23:27.611449 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.611438 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 19 08:23:27.611605 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.611466 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 19 08:23:27.611605 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.611517 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 19 08:23:27.611605 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.611423 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-qsmxv\"" Sep 19 08:23:27.611605 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.611540 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 19 08:23:27.611807 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.611724 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 19 08:23:27.611807 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.611783 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 19 08:23:27.613115 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.613095 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 19 08:23:27.613575 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.613558 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 19 08:23:27.615442 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.615418 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 19 08:23:27.688966 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.688934 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d90562c3-1dc8-4966-b625-ce0f5db18855-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.688966 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.688970 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d90562c3-1dc8-4966-b625-ce0f5db18855-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.689204 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.688992 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d90562c3-1dc8-4966-b625-ce0f5db18855-config-out\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.689204 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.689011 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d90562c3-1dc8-4966-b625-ce0f5db18855-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.689204 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.689094 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d90562c3-1dc8-4966-b625-ce0f5db18855-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.689204 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.689123 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d90562c3-1dc8-4966-b625-ce0f5db18855-web-config\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.689204 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.689150 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d90562c3-1dc8-4966-b625-ce0f5db18855-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.689204 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.689172 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d90562c3-1dc8-4966-b625-ce0f5db18855-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.689204 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.689187 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d90562c3-1dc8-4966-b625-ce0f5db18855-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.689420 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.689241 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d90562c3-1dc8-4966-b625-ce0f5db18855-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.689420 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.689257 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d90562c3-1dc8-4966-b625-ce0f5db18855-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.689420 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.689273 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d90562c3-1dc8-4966-b625-ce0f5db18855-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.689420 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.689293 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d90562c3-1dc8-4966-b625-ce0f5db18855-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.689420 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.689312 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d90562c3-1dc8-4966-b625-ce0f5db18855-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.689420 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.689345 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d90562c3-1dc8-4966-b625-ce0f5db18855-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.689420 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.689362 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d90562c3-1dc8-4966-b625-ce0f5db18855-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.689420 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.689381 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d90562c3-1dc8-4966-b625-ce0f5db18855-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.689420 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.689398 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d90562c3-1dc8-4966-b625-ce0f5db18855-config\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.689420 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.689419 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djr8h\" (UniqueName: \"kubernetes.io/projected/d90562c3-1dc8-4966-b625-ce0f5db18855-kube-api-access-djr8h\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.689719 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.689440 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d90562c3-1dc8-4966-b625-ce0f5db18855-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.789844 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.789780 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d90562c3-1dc8-4966-b625-ce0f5db18855-config\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.789844 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.789815 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djr8h\" (UniqueName: \"kubernetes.io/projected/d90562c3-1dc8-4966-b625-ce0f5db18855-kube-api-access-djr8h\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.789844 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.789832 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d90562c3-1dc8-4966-b625-ce0f5db18855-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.790049 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.789849 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d90562c3-1dc8-4966-b625-ce0f5db18855-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.790049 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.789868 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d90562c3-1dc8-4966-b625-ce0f5db18855-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.790049 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.789888 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d90562c3-1dc8-4966-b625-ce0f5db18855-config-out\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.790049 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.789912 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d90562c3-1dc8-4966-b625-ce0f5db18855-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.790049 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.789947 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d90562c3-1dc8-4966-b625-ce0f5db18855-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.790049 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.789973 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d90562c3-1dc8-4966-b625-ce0f5db18855-web-config\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.790049 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.790007 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d90562c3-1dc8-4966-b625-ce0f5db18855-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.790049 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.790036 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d90562c3-1dc8-4966-b625-ce0f5db18855-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.790430 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.790060 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d90562c3-1dc8-4966-b625-ce0f5db18855-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.790430 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.790131 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d90562c3-1dc8-4966-b625-ce0f5db18855-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.790430 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.790157 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d90562c3-1dc8-4966-b625-ce0f5db18855-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.790430 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.790179 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d90562c3-1dc8-4966-b625-ce0f5db18855-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.790430 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.790210 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d90562c3-1dc8-4966-b625-ce0f5db18855-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.790430 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.790243 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d90562c3-1dc8-4966-b625-ce0f5db18855-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.790430 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.790271 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d90562c3-1dc8-4966-b625-ce0f5db18855-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.790430 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.790297 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d90562c3-1dc8-4966-b625-ce0f5db18855-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.790430 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.790331 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d90562c3-1dc8-4966-b625-ce0f5db18855-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.790876 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.790553 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d90562c3-1dc8-4966-b625-ce0f5db18855-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.790876 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.790647 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d90562c3-1dc8-4966-b625-ce0f5db18855-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.790876 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.790718 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d90562c3-1dc8-4966-b625-ce0f5db18855-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.790876 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.790849 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d90562c3-1dc8-4966-b625-ce0f5db18855-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.791136 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.791057 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d90562c3-1dc8-4966-b625-ce0f5db18855-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.791640 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.791616 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d90562c3-1dc8-4966-b625-ce0f5db18855-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.792466 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.792438 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d90562c3-1dc8-4966-b625-ce0f5db18855-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.792831 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.792803 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d90562c3-1dc8-4966-b625-ce0f5db18855-config-out\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.793224 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.793102 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d90562c3-1dc8-4966-b625-ce0f5db18855-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.793400 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.793380 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d90562c3-1dc8-4966-b625-ce0f5db18855-config\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.793482 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.793421 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d90562c3-1dc8-4966-b625-ce0f5db18855-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.793635 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.793617 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d90562c3-1dc8-4966-b625-ce0f5db18855-web-config\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.793889 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.793867 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d90562c3-1dc8-4966-b625-ce0f5db18855-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.794135 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.794065 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d90562c3-1dc8-4966-b625-ce0f5db18855-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.794824 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.794800 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d90562c3-1dc8-4966-b625-ce0f5db18855-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.795413 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.795394 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d90562c3-1dc8-4966-b625-ce0f5db18855-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.795568 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.795549 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d90562c3-1dc8-4966-b625-ce0f5db18855-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.795722 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.795700 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d90562c3-1dc8-4966-b625-ce0f5db18855-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.796540 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.796519 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d90562c3-1dc8-4966-b625-ce0f5db18855-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.798044 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.798026 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djr8h\" (UniqueName: \"kubernetes.io/projected/d90562c3-1dc8-4966-b625-ce0f5db18855-kube-api-access-djr8h\") pod \"prometheus-k8s-0\" (UID: \"d90562c3-1dc8-4966-b625-ce0f5db18855\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:27.905310 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:27.905263 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:23:28.184687 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:28.184663 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 19 08:23:28.185752 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:23:28.185723 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd90562c3_1dc8_4966_b625_ce0f5db18855.slice/crio-671e0588546d190b9721b5d42f529e2163615f1bab07c42d681f78e8cac825b1 WatchSource:0}: Error finding container 671e0588546d190b9721b5d42f529e2163615f1bab07c42d681f78e8cac825b1: Status 404 returned error can't find the container with id 671e0588546d190b9721b5d42f529e2163615f1bab07c42d681f78e8cac825b1 Sep 19 08:23:28.544043 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:28.543949 2584 generic.go:356] "Generic (PLEG): container finished" podID="d90562c3-1dc8-4966-b625-ce0f5db18855" containerID="9610a539e32bdd110190775718385ce52e01e25773c017fa2119dcbb0d919ca8" exitCode=0 Sep 19 08:23:28.544043 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:28.544027 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d90562c3-1dc8-4966-b625-ce0f5db18855","Type":"ContainerDied","Data":"9610a539e32bdd110190775718385ce52e01e25773c017fa2119dcbb0d919ca8"} Sep 19 08:23:28.544284 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:28.544103 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d90562c3-1dc8-4966-b625-ce0f5db18855","Type":"ContainerStarted","Data":"671e0588546d190b9721b5d42f529e2163615f1bab07c42d681f78e8cac825b1"} Sep 19 08:23:28.611326 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:28.611300 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4" path="/var/lib/kubelet/pods/24e4e74f-8cc4-4733-ae5f-f9ae0e2eced4/volumes" Sep 19 08:23:29.554937 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:29.554903 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d90562c3-1dc8-4966-b625-ce0f5db18855","Type":"ContainerStarted","Data":"dba11f4e6d5149573224fd0cae2096fd15f62c0a4a02514a22d786279799589b"} Sep 19 08:23:29.555302 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:29.554985 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d90562c3-1dc8-4966-b625-ce0f5db18855","Type":"ContainerStarted","Data":"4cdd369ca5343287c213a7c00aa6d18ccb67ef766b408cd635b8f4c661367231"} Sep 19 08:23:29.555302 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:29.555028 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d90562c3-1dc8-4966-b625-ce0f5db18855","Type":"ContainerStarted","Data":"c4a2b3b58dffbf00c780ccef051b4550157549b2fed88938a12a45c9b0dce8a6"} Sep 19 08:23:29.555302 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:29.555084 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d90562c3-1dc8-4966-b625-ce0f5db18855","Type":"ContainerStarted","Data":"a0a7d3bb3fb05e3ee62e9aa60469cc73f2d20769c011e9137975bbca7d84f5bb"} Sep 19 08:23:29.555302 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:29.555127 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d90562c3-1dc8-4966-b625-ce0f5db18855","Type":"ContainerStarted","Data":"5bf37b6240d56e5c07483989743c9e770250e6b0a717fa98df583990951a8563"} Sep 19 08:23:29.555302 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:29.555165 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d90562c3-1dc8-4966-b625-ce0f5db18855","Type":"ContainerStarted","Data":"827c7fa18fc233451cfa6f9f86f678ae0d8e57f42a82355b94fd5696fb25fcd4"} Sep 19 08:23:29.582381 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:29.582335 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.56044588 podStartE2EDuration="2.58232109s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.87521ms" isStatefulPod=false podCreationTimestamp="2026-09-19 08:23:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 08:23:29.581009832 +0000 UTC m=+159.311106459" watchObservedRunningTime="2026-09-19 08:23:29.58232109 +0000 UTC m=+159.312417723" Sep 19 08:23:32.906102 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:23:32.906057 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:24:27.906168 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:24:27.906114 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:24:27.921504 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:24:27.921471 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:24:28.806060 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:24:28.806034 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 08:25:52.503218 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:25:52.503187 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2hqv_3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136/ovn-acl-logging/0.log" Sep 19 08:25:52.504410 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:25:52.504382 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2hqv_3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136/ovn-acl-logging/0.log" Sep 19 08:25:52.510282 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:25:52.510264 2584 kubelet.go:1648] "Image garbage collection succeeded" Sep 19 08:27:27.685211 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:27:27.685180 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-2nz56"] Sep 19 08:27:27.688747 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:27:27.688723 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-645f9c8fd6-2nz56" Sep 19 08:27:27.691494 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:27:27.691473 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-2gvxf\"" Sep 19 08:27:27.691596 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:27:27.691496 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Sep 19 08:27:27.692585 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:27:27.692562 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Sep 19 08:27:27.692684 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:27:27.692608 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Sep 19 08:27:27.698963 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:27:27.698941 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-2nz56"] Sep 19 08:27:27.781143 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:27:27.781114 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5990292a-9e8e-4da6-9d8c-f2c30058ced5-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-2nz56\" (UID: \"5990292a-9e8e-4da6-9d8c-f2c30058ced5\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-2nz56" Sep 19 08:27:27.781307 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:27:27.781161 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptlcm\" (UniqueName: \"kubernetes.io/projected/5990292a-9e8e-4da6-9d8c-f2c30058ced5-kube-api-access-ptlcm\") pod \"llmisvc-controller-manager-645f9c8fd6-2nz56\" (UID: \"5990292a-9e8e-4da6-9d8c-f2c30058ced5\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-2nz56" Sep 19 08:27:27.882482 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:27:27.882449 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5990292a-9e8e-4da6-9d8c-f2c30058ced5-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-2nz56\" (UID: \"5990292a-9e8e-4da6-9d8c-f2c30058ced5\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-2nz56" Sep 19 08:27:27.882682 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:27:27.882493 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptlcm\" (UniqueName: \"kubernetes.io/projected/5990292a-9e8e-4da6-9d8c-f2c30058ced5-kube-api-access-ptlcm\") pod \"llmisvc-controller-manager-645f9c8fd6-2nz56\" (UID: \"5990292a-9e8e-4da6-9d8c-f2c30058ced5\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-2nz56" Sep 19 08:27:27.884865 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:27:27.884843 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5990292a-9e8e-4da6-9d8c-f2c30058ced5-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-2nz56\" (UID: \"5990292a-9e8e-4da6-9d8c-f2c30058ced5\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-2nz56" Sep 19 08:27:27.890870 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:27:27.890850 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptlcm\" (UniqueName: \"kubernetes.io/projected/5990292a-9e8e-4da6-9d8c-f2c30058ced5-kube-api-access-ptlcm\") pod \"llmisvc-controller-manager-645f9c8fd6-2nz56\" (UID: \"5990292a-9e8e-4da6-9d8c-f2c30058ced5\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-2nz56" Sep 19 08:27:27.999874 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:27:27.999791 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-645f9c8fd6-2nz56" Sep 19 08:27:28.269979 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:27:28.269955 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-2nz56"] Sep 19 08:27:28.272648 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:27:28.272623 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5990292a_9e8e_4da6_9d8c_f2c30058ced5.slice/crio-7493bc8c981b52cc67a1fd2f8631a2cfe35b5ba37c00823c0e918510a96f0fc4 WatchSource:0}: Error finding container 7493bc8c981b52cc67a1fd2f8631a2cfe35b5ba37c00823c0e918510a96f0fc4: Status 404 returned error can't find the container with id 7493bc8c981b52cc67a1fd2f8631a2cfe35b5ba37c00823c0e918510a96f0fc4 Sep 19 08:27:28.274013 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:27:28.273994 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 19 08:27:28.507863 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:27:28.507829 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-645f9c8fd6-2nz56" event={"ID":"5990292a-9e8e-4da6-9d8c-f2c30058ced5","Type":"ContainerStarted","Data":"7493bc8c981b52cc67a1fd2f8631a2cfe35b5ba37c00823c0e918510a96f0fc4"} Sep 19 08:27:31.527239 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:27:31.527204 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-645f9c8fd6-2nz56" event={"ID":"5990292a-9e8e-4da6-9d8c-f2c30058ced5","Type":"ContainerStarted","Data":"713d8cfdea52a22f7cc8b25d69dbf0b3035b65aa3a53505081e86734bf7ad769"} Sep 19 08:27:31.527632 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:27:31.527305 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-2nz56" Sep 19 08:27:31.543853 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:27:31.543802 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-645f9c8fd6-2nz56" podStartSLOduration=2.035903937 podStartE2EDuration="4.543786563s" totalImagesPullingTime="2.507882626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 08:27:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 08:27:31.542982791 +0000 UTC m=+401.273079394" watchObservedRunningTime="2026-09-19 08:27:31.543786563 +0000 UTC m=+401.273883166" Sep 19 08:28:02.533440 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:28:02.533403 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-2nz56" Sep 19 08:29:00.056020 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:29:00.055978 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-jl9hs"] Sep 19 08:29:00.059509 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:29:00.059489 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-jl9hs" Sep 19 08:29:00.061794 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:29:00.061774 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"hf-token\"" Sep 19 08:29:00.061908 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:29:00.061778 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Sep 19 08:29:00.061908 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:29:00.061811 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-rbdpz\"" Sep 19 08:29:00.067033 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:29:00.067013 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-jl9hs"] Sep 19 08:29:00.146390 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:29:00.146325 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21d90b22-c52c-44a7-8767-7e477be73053-model-cache\") pod \"s3-init-jl9hs\" (UID: \"21d90b22-c52c-44a7-8767-7e477be73053\") " pod="kserve/s3-init-jl9hs" Sep 19 08:29:00.146558 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:29:00.146428 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjqlb\" (UniqueName: \"kubernetes.io/projected/21d90b22-c52c-44a7-8767-7e477be73053-kube-api-access-fjqlb\") pod \"s3-init-jl9hs\" (UID: \"21d90b22-c52c-44a7-8767-7e477be73053\") " pod="kserve/s3-init-jl9hs" Sep 19 08:29:00.247805 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:29:00.247770 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21d90b22-c52c-44a7-8767-7e477be73053-model-cache\") pod \"s3-init-jl9hs\" (UID: \"21d90b22-c52c-44a7-8767-7e477be73053\") " pod="kserve/s3-init-jl9hs" Sep 19 08:29:00.247978 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:29:00.247817 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjqlb\" (UniqueName: \"kubernetes.io/projected/21d90b22-c52c-44a7-8767-7e477be73053-kube-api-access-fjqlb\") pod \"s3-init-jl9hs\" (UID: \"21d90b22-c52c-44a7-8767-7e477be73053\") " pod="kserve/s3-init-jl9hs" Sep 19 08:29:00.248186 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:29:00.248168 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21d90b22-c52c-44a7-8767-7e477be73053-model-cache\") pod \"s3-init-jl9hs\" (UID: \"21d90b22-c52c-44a7-8767-7e477be73053\") " pod="kserve/s3-init-jl9hs" Sep 19 08:29:00.256787 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:29:00.256768 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjqlb\" (UniqueName: \"kubernetes.io/projected/21d90b22-c52c-44a7-8767-7e477be73053-kube-api-access-fjqlb\") pod \"s3-init-jl9hs\" (UID: \"21d90b22-c52c-44a7-8767-7e477be73053\") " pod="kserve/s3-init-jl9hs" Sep 19 08:29:00.377981 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:29:00.377950 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-jl9hs" Sep 19 08:29:00.648563 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:29:00.648489 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-jl9hs"] Sep 19 08:29:00.652059 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:29:00.652033 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod21d90b22_c52c_44a7_8767_7e477be73053.slice/crio-1b4fa5c6470b04cf593ba341c98c2c1c66b7d76b59f3214cc92c5ebad5d3c621 WatchSource:0}: Error finding container 1b4fa5c6470b04cf593ba341c98c2c1c66b7d76b59f3214cc92c5ebad5d3c621: Status 404 returned error can't find the container with id 1b4fa5c6470b04cf593ba341c98c2c1c66b7d76b59f3214cc92c5ebad5d3c621 Sep 19 08:29:00.882247 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:29:00.882205 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-jl9hs" event={"ID":"21d90b22-c52c-44a7-8767-7e477be73053","Type":"ContainerStarted","Data":"1b4fa5c6470b04cf593ba341c98c2c1c66b7d76b59f3214cc92c5ebad5d3c621"} Sep 19 08:29:04.900976 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:29:04.900934 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-jl9hs" event={"ID":"21d90b22-c52c-44a7-8767-7e477be73053","Type":"ContainerStarted","Data":"2e27dcef229266b21cf59ce62446c1d5e07f99a8d548f91d2d7ae9df2c04195d"} Sep 19 08:29:05.906995 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:29:05.906963 2584 generic.go:356] "Generic (PLEG): container finished" podID="21d90b22-c52c-44a7-8767-7e477be73053" containerID="2e27dcef229266b21cf59ce62446c1d5e07f99a8d548f91d2d7ae9df2c04195d" exitCode=0 Sep 19 08:29:05.907443 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:29:05.907046 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-jl9hs" event={"ID":"21d90b22-c52c-44a7-8767-7e477be73053","Type":"ContainerDied","Data":"2e27dcef229266b21cf59ce62446c1d5e07f99a8d548f91d2d7ae9df2c04195d"} Sep 19 08:29:10.933337 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:29:10.933298 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-jl9hs" event={"ID":"21d90b22-c52c-44a7-8767-7e477be73053","Type":"ContainerStarted","Data":"ff93808f9480c39942ebffd52fd08068de95aaa16886338e6920634f41667bd8"} Sep 19 08:29:10.950219 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:29:10.950157 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-jl9hs" podStartSLOduration=1.708338457 podStartE2EDuration="10.950137502s" totalImagesPullingTime="7.990508478s" totalInitContainerRuntime="1.251290567s" isStatefulPod=false podCreationTimestamp="2026-09-19 08:29:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 08:29:10.949260309 +0000 UTC m=+500.679356924" watchObservedRunningTime="2026-09-19 08:29:10.950137502 +0000 UTC m=+500.680234106" Sep 19 08:30:15.196529 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:15.196491 2584 generic.go:356] "Generic (PLEG): container finished" podID="21d90b22-c52c-44a7-8767-7e477be73053" containerID="ff93808f9480c39942ebffd52fd08068de95aaa16886338e6920634f41667bd8" exitCode=0 Sep 19 08:30:15.196954 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:15.196551 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-jl9hs" event={"ID":"21d90b22-c52c-44a7-8767-7e477be73053","Type":"ContainerDied","Data":"ff93808f9480c39942ebffd52fd08068de95aaa16886338e6920634f41667bd8"} Sep 19 08:30:16.317881 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:16.317859 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-jl9hs" Sep 19 08:30:16.390143 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:16.390108 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjqlb\" (UniqueName: \"kubernetes.io/projected/21d90b22-c52c-44a7-8767-7e477be73053-kube-api-access-fjqlb\") pod \"21d90b22-c52c-44a7-8767-7e477be73053\" (UID: \"21d90b22-c52c-44a7-8767-7e477be73053\") " Sep 19 08:30:16.390309 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:16.390209 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21d90b22-c52c-44a7-8767-7e477be73053-model-cache\") pod \"21d90b22-c52c-44a7-8767-7e477be73053\" (UID: \"21d90b22-c52c-44a7-8767-7e477be73053\") " Sep 19 08:30:16.392299 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:16.392265 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21d90b22-c52c-44a7-8767-7e477be73053-kube-api-access-fjqlb" (OuterVolumeSpecName: "kube-api-access-fjqlb") pod "21d90b22-c52c-44a7-8767-7e477be73053" (UID: "21d90b22-c52c-44a7-8767-7e477be73053"). InnerVolumeSpecName "kube-api-access-fjqlb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 08:30:16.408809 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:16.408784 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21d90b22-c52c-44a7-8767-7e477be73053-model-cache" (OuterVolumeSpecName: "model-cache") pod "21d90b22-c52c-44a7-8767-7e477be73053" (UID: "21d90b22-c52c-44a7-8767-7e477be73053"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 08:30:16.491418 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:16.491340 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjqlb\" (UniqueName: \"kubernetes.io/projected/21d90b22-c52c-44a7-8767-7e477be73053-kube-api-access-fjqlb\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 08:30:16.491418 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:16.491368 2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21d90b22-c52c-44a7-8767-7e477be73053-model-cache\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 08:30:17.205856 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:17.205824 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-jl9hs" Sep 19 08:30:17.205856 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:17.205841 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-jl9hs" event={"ID":"21d90b22-c52c-44a7-8767-7e477be73053","Type":"ContainerDied","Data":"1b4fa5c6470b04cf593ba341c98c2c1c66b7d76b59f3214cc92c5ebad5d3c621"} Sep 19 08:30:17.206062 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:17.205878 2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1b4fa5c6470b04cf593ba341c98c2c1c66b7d76b59f3214cc92c5ebad5d3c621" Sep 19 08:30:31.682185 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:31.682150 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm"] Sep 19 08:30:31.682597 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:31.682478 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21d90b22-c52c-44a7-8767-7e477be73053" containerName="s3-init" Sep 19 08:30:31.682597 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:31.682489 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="21d90b22-c52c-44a7-8767-7e477be73053" containerName="s3-init" Sep 19 08:30:31.682597 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:31.682505 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21d90b22-c52c-44a7-8767-7e477be73053" containerName="download-hf-model" Sep 19 08:30:31.682597 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:31.682512 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="21d90b22-c52c-44a7-8767-7e477be73053" containerName="download-hf-model" Sep 19 08:30:31.682597 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:31.682561 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="21d90b22-c52c-44a7-8767-7e477be73053" containerName="s3-init" Sep 19 08:30:31.686209 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:31.686191 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm" Sep 19 08:30:31.688436 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:31.688392 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-predictor-serving-cert\"" Sep 19 08:30:31.688633 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:31.688615 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\"" Sep 19 08:30:31.688633 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:31.688625 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Sep 19 08:30:31.688792 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:31.688685 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\"" Sep 19 08:30:31.688792 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:31.688690 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-zd5sl\"" Sep 19 08:30:31.689369 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:31.689351 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\"" Sep 19 08:30:31.689473 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:31.689401 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\"" Sep 19 08:30:31.696424 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:31.696405 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm"] Sep 19 08:30:31.783408 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:31.783374 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2"] Sep 19 08:30:31.787148 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:31.787130 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2" Sep 19 08:30:31.789270 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:31.789249 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-kube-rbac-proxy-sar-config\"" Sep 19 08:30:31.789377 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:31.789357 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-predictor-serving-cert\"" Sep 19 08:30:31.798677 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:31.798654 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2"] Sep 19 08:30:31.828109 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:31.828061 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6957ac7f-b232-4eb0-984e-1cc67cd439af-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm\" (UID: \"6957ac7f-b232-4eb0-984e-1cc67cd439af\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm" Sep 19 08:30:31.828277 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:31.828149 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6957ac7f-b232-4eb0-984e-1cc67cd439af-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm\" (UID: \"6957ac7f-b232-4eb0-984e-1cc67cd439af\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm" Sep 19 08:30:31.828277 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:31.828222 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6957ac7f-b232-4eb0-984e-1cc67cd439af-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm\" (UID: \"6957ac7f-b232-4eb0-984e-1cc67cd439af\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm" Sep 19 08:30:31.828277 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:31.828262 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6z8k\" (UniqueName: \"kubernetes.io/projected/6957ac7f-b232-4eb0-984e-1cc67cd439af-kube-api-access-m6z8k\") pod \"isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm\" (UID: \"6957ac7f-b232-4eb0-984e-1cc67cd439af\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm" Sep 19 08:30:31.828385 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:31.828314 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6957ac7f-b232-4eb0-984e-1cc67cd439af-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm\" (UID: \"6957ac7f-b232-4eb0-984e-1cc67cd439af\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm" Sep 19 08:30:31.928758 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:31.928719 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1cba6c78-470d-429b-824b-bc18b3dd3190-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-qk6g2\" (UID: \"1cba6c78-470d-429b-824b-bc18b3dd3190\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2" Sep 19 08:30:31.928758 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:31.928764 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1cba6c78-470d-429b-824b-bc18b3dd3190-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-qk6g2\" (UID: \"1cba6c78-470d-429b-824b-bc18b3dd3190\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2" Sep 19 08:30:31.928983 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:31.928825 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6957ac7f-b232-4eb0-984e-1cc67cd439af-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm\" (UID: \"6957ac7f-b232-4eb0-984e-1cc67cd439af\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm" Sep 19 08:30:31.928983 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:31.928870 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6957ac7f-b232-4eb0-984e-1cc67cd439af-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm\" (UID: \"6957ac7f-b232-4eb0-984e-1cc67cd439af\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm" Sep 19 08:30:31.928983 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:31.928890 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1cba6c78-470d-429b-824b-bc18b3dd3190-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-qk6g2\" (UID: \"1cba6c78-470d-429b-824b-bc18b3dd3190\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2" Sep 19 08:30:31.928983 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:31.928930 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwdhn\" (UniqueName: \"kubernetes.io/projected/1cba6c78-470d-429b-824b-bc18b3dd3190-kube-api-access-qwdhn\") pod \"isvc-xgboost-graph-predictor-555fc69d56-qk6g2\" (UID: \"1cba6c78-470d-429b-824b-bc18b3dd3190\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2" Sep 19 08:30:31.928983 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:31.928962 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6957ac7f-b232-4eb0-984e-1cc67cd439af-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm\" (UID: \"6957ac7f-b232-4eb0-984e-1cc67cd439af\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm" Sep 19 08:30:31.929273 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:31.928999 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6z8k\" (UniqueName: \"kubernetes.io/projected/6957ac7f-b232-4eb0-984e-1cc67cd439af-kube-api-access-m6z8k\") pod \"isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm\" (UID: \"6957ac7f-b232-4eb0-984e-1cc67cd439af\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm" Sep 19 08:30:31.929273 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:31.929047 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6957ac7f-b232-4eb0-984e-1cc67cd439af-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm\" (UID: \"6957ac7f-b232-4eb0-984e-1cc67cd439af\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm" Sep 19 08:30:31.929273 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:31.929067 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/1cba6c78-470d-429b-824b-bc18b3dd3190-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-qk6g2\" (UID: \"1cba6c78-470d-429b-824b-bc18b3dd3190\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2" Sep 19 08:30:31.929273 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:30:31.929213 2584 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-serving-cert: secret "isvc-sklearn-graph-1-predictor-serving-cert" not found Sep 19 08:30:31.929493 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:30:31.929284 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6957ac7f-b232-4eb0-984e-1cc67cd439af-proxy-tls podName:6957ac7f-b232-4eb0-984e-1cc67cd439af nodeName:}" failed. No retries permitted until 2026-09-19 08:30:32.429264331 +0000 UTC m=+582.159360914 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/6957ac7f-b232-4eb0-984e-1cc67cd439af-proxy-tls") pod "isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm" (UID: "6957ac7f-b232-4eb0-984e-1cc67cd439af") : secret "isvc-sklearn-graph-1-predictor-serving-cert" not found Sep 19 08:30:31.929493 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:31.929317 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6957ac7f-b232-4eb0-984e-1cc67cd439af-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm\" (UID: \"6957ac7f-b232-4eb0-984e-1cc67cd439af\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm" Sep 19 08:30:31.929614 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:31.929534 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6957ac7f-b232-4eb0-984e-1cc67cd439af-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm\" (UID: \"6957ac7f-b232-4eb0-984e-1cc67cd439af\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm" Sep 19 08:30:31.929711 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:31.929689 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6957ac7f-b232-4eb0-984e-1cc67cd439af-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm\" (UID: \"6957ac7f-b232-4eb0-984e-1cc67cd439af\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm" Sep 19 08:30:31.937777 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:31.937717 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6z8k\" (UniqueName: \"kubernetes.io/projected/6957ac7f-b232-4eb0-984e-1cc67cd439af-kube-api-access-m6z8k\") pod \"isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm\" (UID: \"6957ac7f-b232-4eb0-984e-1cc67cd439af\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm" Sep 19 08:30:32.011134 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:32.011102 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2"] Sep 19 08:30:32.015114 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:32.015095 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2" Sep 19 08:30:32.017499 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:32.017477 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-predictor-serving-cert\"" Sep 19 08:30:32.017814 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:32.017800 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\"" Sep 19 08:30:32.026449 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:32.026429 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2"] Sep 19 08:30:32.030306 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:32.030288 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/1cba6c78-470d-429b-824b-bc18b3dd3190-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-qk6g2\" (UID: \"1cba6c78-470d-429b-824b-bc18b3dd3190\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2" Sep 19 08:30:32.030411 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:32.030316 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1cba6c78-470d-429b-824b-bc18b3dd3190-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-qk6g2\" (UID: \"1cba6c78-470d-429b-824b-bc18b3dd3190\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2" Sep 19 08:30:32.030411 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:32.030341 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1cba6c78-470d-429b-824b-bc18b3dd3190-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-qk6g2\" (UID: \"1cba6c78-470d-429b-824b-bc18b3dd3190\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2" Sep 19 08:30:32.030411 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:32.030374 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1cba6c78-470d-429b-824b-bc18b3dd3190-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-qk6g2\" (UID: \"1cba6c78-470d-429b-824b-bc18b3dd3190\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2" Sep 19 08:30:32.030411 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:32.030405 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwdhn\" (UniqueName: \"kubernetes.io/projected/1cba6c78-470d-429b-824b-bc18b3dd3190-kube-api-access-qwdhn\") pod \"isvc-xgboost-graph-predictor-555fc69d56-qk6g2\" (UID: \"1cba6c78-470d-429b-824b-bc18b3dd3190\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2" Sep 19 08:30:32.030738 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:32.030716 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1cba6c78-470d-429b-824b-bc18b3dd3190-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-qk6g2\" (UID: \"1cba6c78-470d-429b-824b-bc18b3dd3190\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2" Sep 19 08:30:32.031014 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:32.030998 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/1cba6c78-470d-429b-824b-bc18b3dd3190-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-qk6g2\" (UID: \"1cba6c78-470d-429b-824b-bc18b3dd3190\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2" Sep 19 08:30:32.031199 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:32.031177 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1cba6c78-470d-429b-824b-bc18b3dd3190-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-qk6g2\" (UID: \"1cba6c78-470d-429b-824b-bc18b3dd3190\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2" Sep 19 08:30:32.032938 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:32.032917 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1cba6c78-470d-429b-824b-bc18b3dd3190-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-qk6g2\" (UID: \"1cba6c78-470d-429b-824b-bc18b3dd3190\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2" Sep 19 08:30:32.040279 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:32.040258 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwdhn\" (UniqueName: \"kubernetes.io/projected/1cba6c78-470d-429b-824b-bc18b3dd3190-kube-api-access-qwdhn\") pod \"isvc-xgboost-graph-predictor-555fc69d56-qk6g2\" (UID: \"1cba6c78-470d-429b-824b-bc18b3dd3190\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2" Sep 19 08:30:32.097562 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:32.097532 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2" Sep 19 08:30:32.131793 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:32.131764 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rzlg\" (UniqueName: \"kubernetes.io/projected/ee50536d-4699-4622-9068-13caf56dfe01-kube-api-access-5rzlg\") pod \"isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2\" (UID: \"ee50536d-4699-4622-9068-13caf56dfe01\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2" Sep 19 08:30:32.131926 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:32.131806 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ee50536d-4699-4622-9068-13caf56dfe01-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2\" (UID: \"ee50536d-4699-4622-9068-13caf56dfe01\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2" Sep 19 08:30:32.131926 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:32.131830 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ee50536d-4699-4622-9068-13caf56dfe01-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2\" (UID: \"ee50536d-4699-4622-9068-13caf56dfe01\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2" Sep 19 08:30:32.132039 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:32.131934 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ee50536d-4699-4622-9068-13caf56dfe01-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2\" (UID: \"ee50536d-4699-4622-9068-13caf56dfe01\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2" Sep 19 08:30:32.132039 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:32.131967 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ee50536d-4699-4622-9068-13caf56dfe01-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2\" (UID: \"ee50536d-4699-4622-9068-13caf56dfe01\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2" Sep 19 08:30:32.232743 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:32.232642 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rzlg\" (UniqueName: \"kubernetes.io/projected/ee50536d-4699-4622-9068-13caf56dfe01-kube-api-access-5rzlg\") pod \"isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2\" (UID: \"ee50536d-4699-4622-9068-13caf56dfe01\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2" Sep 19 08:30:32.232743 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:32.232692 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ee50536d-4699-4622-9068-13caf56dfe01-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2\" (UID: \"ee50536d-4699-4622-9068-13caf56dfe01\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2" Sep 19 08:30:32.232743 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:32.232721 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ee50536d-4699-4622-9068-13caf56dfe01-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2\" (UID: \"ee50536d-4699-4622-9068-13caf56dfe01\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2" Sep 19 08:30:32.233061 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:32.232906 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ee50536d-4699-4622-9068-13caf56dfe01-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2\" (UID: \"ee50536d-4699-4622-9068-13caf56dfe01\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2" Sep 19 08:30:32.233061 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:32.232968 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ee50536d-4699-4622-9068-13caf56dfe01-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2\" (UID: \"ee50536d-4699-4622-9068-13caf56dfe01\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2" Sep 19 08:30:32.233264 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:32.233243 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ee50536d-4699-4622-9068-13caf56dfe01-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2\" (UID: \"ee50536d-4699-4622-9068-13caf56dfe01\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2" Sep 19 08:30:32.233551 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:32.233529 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ee50536d-4699-4622-9068-13caf56dfe01-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2\" (UID: \"ee50536d-4699-4622-9068-13caf56dfe01\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2" Sep 19 08:30:32.233617 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:32.233602 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ee50536d-4699-4622-9068-13caf56dfe01-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2\" (UID: \"ee50536d-4699-4622-9068-13caf56dfe01\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2" Sep 19 08:30:32.235318 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:32.235301 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ee50536d-4699-4622-9068-13caf56dfe01-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2\" (UID: \"ee50536d-4699-4622-9068-13caf56dfe01\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2" Sep 19 08:30:32.248232 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:32.248208 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rzlg\" (UniqueName: \"kubernetes.io/projected/ee50536d-4699-4622-9068-13caf56dfe01-kube-api-access-5rzlg\") pod \"isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2\" (UID: \"ee50536d-4699-4622-9068-13caf56dfe01\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2" Sep 19 08:30:32.326330 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:32.326291 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2" Sep 19 08:30:32.374490 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:32.373582 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2"] Sep 19 08:30:32.434477 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:32.434451 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6957ac7f-b232-4eb0-984e-1cc67cd439af-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm\" (UID: \"6957ac7f-b232-4eb0-984e-1cc67cd439af\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm" Sep 19 08:30:32.436612 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:32.436590 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6957ac7f-b232-4eb0-984e-1cc67cd439af-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm\" (UID: \"6957ac7f-b232-4eb0-984e-1cc67cd439af\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm" Sep 19 08:30:32.596840 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:32.596808 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm" Sep 19 08:30:32.605100 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:32.605065 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2"] Sep 19 08:30:32.607739 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:30:32.607697 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee50536d_4699_4622_9068_13caf56dfe01.slice/crio-a23f946ed386b9ee986ee0b4556dac3a759ce0a3e74dfd74266369a58710d4b8 WatchSource:0}: Error finding container a23f946ed386b9ee986ee0b4556dac3a759ce0a3e74dfd74266369a58710d4b8: Status 404 returned error can't find the container with id a23f946ed386b9ee986ee0b4556dac3a759ce0a3e74dfd74266369a58710d4b8 Sep 19 08:30:32.878569 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:32.878528 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm"] Sep 19 08:30:32.881636 ip-10-0-143-96 kubenswrapper[2584]: W0919 08:30:32.881610 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6957ac7f_b232_4eb0_984e_1cc67cd439af.slice/crio-21cf04721b91121fcbbd815c0a656bcf66c7e8835984676b415a592ae15abc54 WatchSource:0}: Error finding container 21cf04721b91121fcbbd815c0a656bcf66c7e8835984676b415a592ae15abc54: Status 404 returned error can't find the container with id 21cf04721b91121fcbbd815c0a656bcf66c7e8835984676b415a592ae15abc54 Sep 19 08:30:33.275755 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:33.275666 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm" event={"ID":"6957ac7f-b232-4eb0-984e-1cc67cd439af","Type":"ContainerStarted","Data":"087256c479bac4ef6794cf4a1d3091eda68740d081156e8adda8da8258aff1ef"} Sep 19 08:30:33.275755 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:33.275735 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm" event={"ID":"6957ac7f-b232-4eb0-984e-1cc67cd439af","Type":"ContainerStarted","Data":"21cf04721b91121fcbbd815c0a656bcf66c7e8835984676b415a592ae15abc54"} Sep 19 08:30:33.277535 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:33.277502 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2" event={"ID":"1cba6c78-470d-429b-824b-bc18b3dd3190","Type":"ContainerStarted","Data":"444556b78f874285e754f3d0a050099a69b5cd1a6e2a074b181c2116e5a491c0"} Sep 19 08:30:33.277660 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:33.277569 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2" event={"ID":"1cba6c78-470d-429b-824b-bc18b3dd3190","Type":"ContainerStarted","Data":"ed769fc2736973bbeb2d0957424b4babdce6f44752f7fa9e7394ac061aa1ef8a"} Sep 19 08:30:33.279214 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:33.279190 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2" event={"ID":"ee50536d-4699-4622-9068-13caf56dfe01","Type":"ContainerStarted","Data":"7020273e5b02036f1edc9b6a07a790bb87b0218cfc31f5f0fdfd9ee6a7a69d3a"} Sep 19 08:30:33.279344 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:33.279236 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2" event={"ID":"ee50536d-4699-4622-9068-13caf56dfe01","Type":"ContainerStarted","Data":"a23f946ed386b9ee986ee0b4556dac3a759ce0a3e74dfd74266369a58710d4b8"} Sep 19 08:30:37.299138 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:37.299025 2584 generic.go:356] "Generic (PLEG): container finished" podID="ee50536d-4699-4622-9068-13caf56dfe01" containerID="7020273e5b02036f1edc9b6a07a790bb87b0218cfc31f5f0fdfd9ee6a7a69d3a" exitCode=0 Sep 19 08:30:37.299138 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:37.299100 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2" event={"ID":"ee50536d-4699-4622-9068-13caf56dfe01","Type":"ContainerDied","Data":"7020273e5b02036f1edc9b6a07a790bb87b0218cfc31f5f0fdfd9ee6a7a69d3a"} Sep 19 08:30:37.300679 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:37.300657 2584 generic.go:356] "Generic (PLEG): container finished" podID="6957ac7f-b232-4eb0-984e-1cc67cd439af" containerID="087256c479bac4ef6794cf4a1d3091eda68740d081156e8adda8da8258aff1ef" exitCode=0 Sep 19 08:30:37.300774 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:37.300731 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm" event={"ID":"6957ac7f-b232-4eb0-984e-1cc67cd439af","Type":"ContainerDied","Data":"087256c479bac4ef6794cf4a1d3091eda68740d081156e8adda8da8258aff1ef"} Sep 19 08:30:37.302290 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:37.302272 2584 generic.go:356] "Generic (PLEG): container finished" podID="1cba6c78-470d-429b-824b-bc18b3dd3190" containerID="444556b78f874285e754f3d0a050099a69b5cd1a6e2a074b181c2116e5a491c0" exitCode=0 Sep 19 08:30:37.302355 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:30:37.302319 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2" event={"ID":"1cba6c78-470d-429b-824b-bc18b3dd3190","Type":"ContainerDied","Data":"444556b78f874285e754f3d0a050099a69b5cd1a6e2a074b181c2116e5a491c0"} Sep 19 08:31:06.292426 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:31:06.292400 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2hqv_3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136/ovn-acl-logging/0.log" Sep 19 08:31:06.293037 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:31:06.293013 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2hqv_3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136/ovn-acl-logging/0.log" Sep 19 08:31:06.502940 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:31:06.502857 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2" event={"ID":"ee50536d-4699-4622-9068-13caf56dfe01","Type":"ContainerStarted","Data":"01d2a4b89dca57e46e8296979f1c6f7ec8a110ffdf140ed9df8ef59b70994d61"} Sep 19 08:31:06.504682 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:31:06.504660 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm" event={"ID":"6957ac7f-b232-4eb0-984e-1cc67cd439af","Type":"ContainerStarted","Data":"3e1ba3df4d4df67130a6c9515c8f75d45de252b59300652206cc4c2e18033982"} Sep 19 08:31:07.525905 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:31:07.525776 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2" event={"ID":"1cba6c78-470d-429b-824b-bc18b3dd3190","Type":"ContainerStarted","Data":"17c3a15ac6e4a524cf0435717b7a584ab04df4a2b36eddd7fd99bf7f2b64eabd"} Sep 19 08:31:09.536418 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:31:09.536333 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2" event={"ID":"ee50536d-4699-4622-9068-13caf56dfe01","Type":"ContainerStarted","Data":"2a7255c3ee95d260e6fae231298c1f50890e67a8f9da39d562d2f6402a70f147"} Sep 19 08:31:09.537093 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:31:09.536446 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2" Sep 19 08:31:09.537093 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:31:09.536616 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2" Sep 19 08:31:09.538147 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:31:09.538107 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2" podUID="ee50536d-4699-4622-9068-13caf56dfe01" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused" Sep 19 08:31:09.538683 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:31:09.538664 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm" event={"ID":"6957ac7f-b232-4eb0-984e-1cc67cd439af","Type":"ContainerStarted","Data":"646e22c9c202ab0d2d70ed3d64a52f69b6c244b315cb85b4bbe120d555fd1f84"} Sep 19 08:31:09.538758 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:31:09.538720 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm" Sep 19 08:31:09.538758 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:31:09.538752 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm" Sep 19 08:31:09.539776 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:31:09.539755 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm" podUID="6957ac7f-b232-4eb0-984e-1cc67cd439af" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.22:8080: connect: connection refused" Sep 19 08:31:09.540949 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:31:09.540929 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2" event={"ID":"1cba6c78-470d-429b-824b-bc18b3dd3190","Type":"ContainerStarted","Data":"04f7a3891a2c818325dda8cbf7948f30cf22aab586ad54f1640eb3fc973b19c7"} Sep 19 08:31:09.541111 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:31:09.541096 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2" Sep 19 08:31:09.541187 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:31:09.541139 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2" Sep 19 08:31:09.541952 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:31:09.541931 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2" podUID="1cba6c78-470d-429b-824b-bc18b3dd3190" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.23:8080: connect: connection refused" Sep 19 08:31:09.557481 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:31:09.557443 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2" podStartSLOduration=3.095326978 podStartE2EDuration="38.557428656s" totalImagesPullingTime="31.759064449s" totalInitContainerRuntime="3.703037229s" isStatefulPod=false podCreationTimestamp="2026-09-19 08:30:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 08:31:09.555245932 +0000 UTC m=+619.285342544" watchObservedRunningTime="2026-09-19 08:31:09.557428656 +0000 UTC m=+619.287525260" Sep 19 08:31:09.573356 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:31:09.573319 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm" podStartSLOduration=2.89276005 podStartE2EDuration="38.573306545s" totalImagesPullingTime="31.759658228s" totalInitContainerRuntime="3.920888267s" isStatefulPod=false podCreationTimestamp="2026-09-19 08:30:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 08:31:09.572445641 +0000 UTC m=+619.302542244" watchObservedRunningTime="2026-09-19 08:31:09.573306545 +0000 UTC m=+619.303403148" Sep 19 08:31:09.591870 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:31:09.591828 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2" podStartSLOduration=2.9500677079999997 podStartE2EDuration="38.591815212s" totalImagesPullingTime="31.75918001s" totalInitContainerRuntime="3.882567494s" isStatefulPod=false podCreationTimestamp="2026-09-19 08:30:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 08:31:09.589779079 +0000 UTC m=+619.319875705" watchObservedRunningTime="2026-09-19 08:31:09.591815212 +0000 UTC m=+619.321911814" Sep 19 08:31:10.545409 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:31:10.545365 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2" podUID="1cba6c78-470d-429b-824b-bc18b3dd3190" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.23:8080: connect: connection refused" Sep 19 08:31:10.545779 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:31:10.545450 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm" podUID="6957ac7f-b232-4eb0-984e-1cc67cd439af" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.22:8080: connect: connection refused" Sep 19 08:31:10.545779 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:31:10.545475 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2" podUID="ee50536d-4699-4622-9068-13caf56dfe01" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused" Sep 19 08:31:15.550669 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:31:15.550638 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2" Sep 19 08:31:15.551341 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:31:15.551319 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm" Sep 19 08:31:15.551413 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:31:15.551399 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2" Sep 19 08:31:15.551706 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:31:15.551682 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2" podUID="ee50536d-4699-4622-9068-13caf56dfe01" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused" Sep 19 08:31:15.552102 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:31:15.552055 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2" podUID="1cba6c78-470d-429b-824b-bc18b3dd3190" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.23:8080: connect: connection refused" Sep 19 08:31:15.552383 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:31:15.552360 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm" podUID="6957ac7f-b232-4eb0-984e-1cc67cd439af" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.22:8080: connect: connection refused" Sep 19 08:31:25.552507 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:31:25.552469 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2" podUID="ee50536d-4699-4622-9068-13caf56dfe01" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused" Sep 19 08:31:25.552945 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:31:25.552480 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2" podUID="1cba6c78-470d-429b-824b-bc18b3dd3190" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.23:8080: connect: connection refused" Sep 19 08:31:25.552945 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:31:25.552479 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm" podUID="6957ac7f-b232-4eb0-984e-1cc67cd439af" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.22:8080: connect: connection refused" Sep 19 08:31:35.551833 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:31:35.551793 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2" podUID="ee50536d-4699-4622-9068-13caf56dfe01" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused" Sep 19 08:31:35.552289 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:31:35.551898 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2" podUID="1cba6c78-470d-429b-824b-bc18b3dd3190" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.23:8080: connect: connection refused" Sep 19 08:31:35.552289 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:31:35.552268 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm" podUID="6957ac7f-b232-4eb0-984e-1cc67cd439af" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.22:8080: connect: connection refused" Sep 19 08:31:45.551741 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:31:45.551701 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2" podUID="ee50536d-4699-4622-9068-13caf56dfe01" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused" Sep 19 08:31:45.552162 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:31:45.551937 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2" podUID="1cba6c78-470d-429b-824b-bc18b3dd3190" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.23:8080: connect: connection refused" Sep 19 08:31:45.553146 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:31:45.553122 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm" podUID="6957ac7f-b232-4eb0-984e-1cc67cd439af" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.22:8080: connect: connection refused" Sep 19 08:31:55.552301 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:31:55.552261 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2" podUID="ee50536d-4699-4622-9068-13caf56dfe01" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused" Sep 19 08:31:55.552791 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:31:55.552265 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2" podUID="1cba6c78-470d-429b-824b-bc18b3dd3190" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.23:8080: connect: connection refused" Sep 19 08:31:55.552791 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:31:55.552260 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm" podUID="6957ac7f-b232-4eb0-984e-1cc67cd439af" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.22:8080: connect: connection refused" Sep 19 08:32:05.552507 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:32:05.552466 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2" podUID="ee50536d-4699-4622-9068-13caf56dfe01" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused" Sep 19 08:32:05.552901 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:32:05.552469 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm" podUID="6957ac7f-b232-4eb0-984e-1cc67cd439af" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.22:8080: connect: connection refused" Sep 19 08:32:05.552901 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:32:05.552470 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2" podUID="1cba6c78-470d-429b-824b-bc18b3dd3190" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.23:8080: connect: connection refused" Sep 19 08:32:15.552532 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:32:15.552493 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm" podUID="6957ac7f-b232-4eb0-984e-1cc67cd439af" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.22:8080: connect: connection refused" Sep 19 08:32:15.552921 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:32:15.552540 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2" podUID="ee50536d-4699-4622-9068-13caf56dfe01" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused" Sep 19 08:32:15.552921 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:32:15.552501 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2" podUID="1cba6c78-470d-429b-824b-bc18b3dd3190" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.23:8080: connect: connection refused" Sep 19 08:32:25.553045 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:32:25.553013 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm" Sep 19 08:32:25.553522 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:32:25.553139 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2" Sep 19 08:32:25.553522 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:32:25.553338 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2" Sep 19 08:33:03.084418 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:03.084385 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2"] Sep 19 08:33:03.084966 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:03.084632 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2" podUID="ee50536d-4699-4622-9068-13caf56dfe01" containerName="kserve-container" containerID="cri-o://01d2a4b89dca57e46e8296979f1c6f7ec8a110ffdf140ed9df8ef59b70994d61" gracePeriod=30 Sep 19 08:33:03.084966 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:03.084720 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2" podUID="ee50536d-4699-4622-9068-13caf56dfe01" containerName="kube-rbac-proxy" containerID="cri-o://2a7255c3ee95d260e6fae231298c1f50890e67a8f9da39d562d2f6402a70f147" gracePeriod=30 Sep 19 08:33:03.124168 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:03.124141 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm"] Sep 19 08:33:03.124424 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:03.124401 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm" podUID="6957ac7f-b232-4eb0-984e-1cc67cd439af" containerName="kserve-container" containerID="cri-o://3e1ba3df4d4df67130a6c9515c8f75d45de252b59300652206cc4c2e18033982" gracePeriod=30 Sep 19 08:33:03.124512 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:03.124434 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm" podUID="6957ac7f-b232-4eb0-984e-1cc67cd439af" containerName="kube-rbac-proxy" containerID="cri-o://646e22c9c202ab0d2d70ed3d64a52f69b6c244b315cb85b4bbe120d555fd1f84" gracePeriod=30 Sep 19 08:33:03.178610 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:03.178577 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2"] Sep 19 08:33:03.178912 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:03.178886 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2" podUID="1cba6c78-470d-429b-824b-bc18b3dd3190" containerName="kserve-container" containerID="cri-o://17c3a15ac6e4a524cf0435717b7a584ab04df4a2b36eddd7fd99bf7f2b64eabd" gracePeriod=30 Sep 19 08:33:03.178990 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:03.178927 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2" podUID="1cba6c78-470d-429b-824b-bc18b3dd3190" containerName="kube-rbac-proxy" containerID="cri-o://04f7a3891a2c818325dda8cbf7948f30cf22aab586ad54f1640eb3fc973b19c7" gracePeriod=30 Sep 19 08:33:04.040770 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:04.040734 2584 generic.go:356] "Generic (PLEG): container finished" podID="ee50536d-4699-4622-9068-13caf56dfe01" containerID="2a7255c3ee95d260e6fae231298c1f50890e67a8f9da39d562d2f6402a70f147" exitCode=2 Sep 19 08:33:04.040955 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:04.040807 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2" event={"ID":"ee50536d-4699-4622-9068-13caf56dfe01","Type":"ContainerDied","Data":"2a7255c3ee95d260e6fae231298c1f50890e67a8f9da39d562d2f6402a70f147"} Sep 19 08:33:04.042904 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:04.042882 2584 generic.go:356] "Generic (PLEG): container finished" podID="6957ac7f-b232-4eb0-984e-1cc67cd439af" containerID="646e22c9c202ab0d2d70ed3d64a52f69b6c244b315cb85b4bbe120d555fd1f84" exitCode=2 Sep 19 08:33:04.043023 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:04.042954 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm" event={"ID":"6957ac7f-b232-4eb0-984e-1cc67cd439af","Type":"ContainerDied","Data":"646e22c9c202ab0d2d70ed3d64a52f69b6c244b315cb85b4bbe120d555fd1f84"} Sep 19 08:33:04.044951 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:04.044931 2584 generic.go:356] "Generic (PLEG): container finished" podID="1cba6c78-470d-429b-824b-bc18b3dd3190" containerID="04f7a3891a2c818325dda8cbf7948f30cf22aab586ad54f1640eb3fc973b19c7" exitCode=2 Sep 19 08:33:04.045030 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:04.044965 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2" event={"ID":"1cba6c78-470d-429b-824b-bc18b3dd3190","Type":"ContainerDied","Data":"04f7a3891a2c818325dda8cbf7948f30cf22aab586ad54f1640eb3fc973b19c7"} Sep 19 08:33:05.545841 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:05.545801 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2" podUID="ee50536d-4699-4622-9068-13caf56dfe01" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.24:8643/healthz\": dial tcp 10.134.0.24:8643: connect: connection refused" Sep 19 08:33:05.546240 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:05.545802 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2" podUID="1cba6c78-470d-429b-824b-bc18b3dd3190" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.23:8643/healthz\": dial tcp 10.134.0.23:8643: connect: connection refused" Sep 19 08:33:05.546240 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:05.545802 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm" podUID="6957ac7f-b232-4eb0-984e-1cc67cd439af" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.22:8643/healthz\": dial tcp 10.134.0.22:8643: connect: connection refused" Sep 19 08:33:05.552548 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:05.552528 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2" podUID="1cba6c78-470d-429b-824b-bc18b3dd3190" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.23:8080: connect: connection refused" Sep 19 08:33:05.552612 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:05.552555 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm" podUID="6957ac7f-b232-4eb0-984e-1cc67cd439af" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.22:8080: connect: connection refused" Sep 19 08:33:05.552612 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:05.552553 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2" podUID="ee50536d-4699-4622-9068-13caf56dfe01" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused" Sep 19 08:33:07.528652 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:07.528625 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2" Sep 19 08:33:07.537752 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:07.537723 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1cba6c78-470d-429b-824b-bc18b3dd3190-kserve-provision-location\") pod \"1cba6c78-470d-429b-824b-bc18b3dd3190\" (UID: \"1cba6c78-470d-429b-824b-bc18b3dd3190\") " Sep 19 08:33:07.537879 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:07.537820 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/1cba6c78-470d-429b-824b-bc18b3dd3190-cabundle-cert\") pod \"1cba6c78-470d-429b-824b-bc18b3dd3190\" (UID: \"1cba6c78-470d-429b-824b-bc18b3dd3190\") " Sep 19 08:33:07.537879 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:07.537858 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1cba6c78-470d-429b-824b-bc18b3dd3190-proxy-tls\") pod \"1cba6c78-470d-429b-824b-bc18b3dd3190\" (UID: \"1cba6c78-470d-429b-824b-bc18b3dd3190\") " Sep 19 08:33:07.537976 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:07.537883 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qwdhn\" (UniqueName: \"kubernetes.io/projected/1cba6c78-470d-429b-824b-bc18b3dd3190-kube-api-access-qwdhn\") pod \"1cba6c78-470d-429b-824b-bc18b3dd3190\" (UID: \"1cba6c78-470d-429b-824b-bc18b3dd3190\") " Sep 19 08:33:07.537976 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:07.537935 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1cba6c78-470d-429b-824b-bc18b3dd3190-kube-rbac-proxy-sar-config\") pod \"1cba6c78-470d-429b-824b-bc18b3dd3190\" (UID: \"1cba6c78-470d-429b-824b-bc18b3dd3190\") " Sep 19 08:33:07.538111 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:07.538007 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cba6c78-470d-429b-824b-bc18b3dd3190-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "1cba6c78-470d-429b-824b-bc18b3dd3190" (UID: "1cba6c78-470d-429b-824b-bc18b3dd3190"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 08:33:07.538187 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:07.538170 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1cba6c78-470d-429b-824b-bc18b3dd3190-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "1cba6c78-470d-429b-824b-bc18b3dd3190" (UID: "1cba6c78-470d-429b-824b-bc18b3dd3190"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 08:33:07.538341 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:07.538249 2584 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1cba6c78-470d-429b-824b-bc18b3dd3190-kserve-provision-location\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 08:33:07.538341 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:07.538266 2584 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/1cba6c78-470d-429b-824b-bc18b3dd3190-cabundle-cert\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 08:33:07.538450 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:07.538374 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1cba6c78-470d-429b-824b-bc18b3dd3190-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "1cba6c78-470d-429b-824b-bc18b3dd3190" (UID: "1cba6c78-470d-429b-824b-bc18b3dd3190"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 08:33:07.540207 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:07.540182 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1cba6c78-470d-429b-824b-bc18b3dd3190-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "1cba6c78-470d-429b-824b-bc18b3dd3190" (UID: "1cba6c78-470d-429b-824b-bc18b3dd3190"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 08:33:07.540308 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:07.540251 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cba6c78-470d-429b-824b-bc18b3dd3190-kube-api-access-qwdhn" (OuterVolumeSpecName: "kube-api-access-qwdhn") pod "1cba6c78-470d-429b-824b-bc18b3dd3190" (UID: "1cba6c78-470d-429b-824b-bc18b3dd3190"). InnerVolumeSpecName "kube-api-access-qwdhn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 08:33:07.639718 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:07.639613 2584 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1cba6c78-470d-429b-824b-bc18b3dd3190-kube-rbac-proxy-sar-config\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 08:33:07.639718 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:07.639650 2584 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1cba6c78-470d-429b-824b-bc18b3dd3190-proxy-tls\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 08:33:07.639718 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:07.639666 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwdhn\" (UniqueName: \"kubernetes.io/projected/1cba6c78-470d-429b-824b-bc18b3dd3190-kube-api-access-qwdhn\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 08:33:08.064186 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:08.064155 2584 generic.go:356] "Generic (PLEG): container finished" podID="1cba6c78-470d-429b-824b-bc18b3dd3190" containerID="17c3a15ac6e4a524cf0435717b7a584ab04df4a2b36eddd7fd99bf7f2b64eabd" exitCode=0 Sep 19 08:33:08.064353 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:08.064222 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2" Sep 19 08:33:08.064353 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:08.064230 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2" event={"ID":"1cba6c78-470d-429b-824b-bc18b3dd3190","Type":"ContainerDied","Data":"17c3a15ac6e4a524cf0435717b7a584ab04df4a2b36eddd7fd99bf7f2b64eabd"} Sep 19 08:33:08.064353 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:08.064289 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2" event={"ID":"1cba6c78-470d-429b-824b-bc18b3dd3190","Type":"ContainerDied","Data":"ed769fc2736973bbeb2d0957424b4babdce6f44752f7fa9e7394ac061aa1ef8a"} Sep 19 08:33:08.064353 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:08.064315 2584 scope.go:117] "RemoveContainer" containerID="04f7a3891a2c818325dda8cbf7948f30cf22aab586ad54f1640eb3fc973b19c7" Sep 19 08:33:08.073008 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:08.072992 2584 scope.go:117] "RemoveContainer" containerID="17c3a15ac6e4a524cf0435717b7a584ab04df4a2b36eddd7fd99bf7f2b64eabd" Sep 19 08:33:08.080486 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:08.080461 2584 scope.go:117] "RemoveContainer" containerID="444556b78f874285e754f3d0a050099a69b5cd1a6e2a074b181c2116e5a491c0" Sep 19 08:33:08.087242 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:08.087219 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2"] Sep 19 08:33:08.089219 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:08.089199 2584 scope.go:117] "RemoveContainer" containerID="04f7a3891a2c818325dda8cbf7948f30cf22aab586ad54f1640eb3fc973b19c7" Sep 19 08:33:08.089526 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:33:08.089509 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04f7a3891a2c818325dda8cbf7948f30cf22aab586ad54f1640eb3fc973b19c7\": container with ID starting with 04f7a3891a2c818325dda8cbf7948f30cf22aab586ad54f1640eb3fc973b19c7 not found: ID does not exist" containerID="04f7a3891a2c818325dda8cbf7948f30cf22aab586ad54f1640eb3fc973b19c7" Sep 19 08:33:08.089601 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:08.089535 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04f7a3891a2c818325dda8cbf7948f30cf22aab586ad54f1640eb3fc973b19c7"} err="failed to get container status \"04f7a3891a2c818325dda8cbf7948f30cf22aab586ad54f1640eb3fc973b19c7\": rpc error: code = NotFound desc = could not find container \"04f7a3891a2c818325dda8cbf7948f30cf22aab586ad54f1640eb3fc973b19c7\": container with ID starting with 04f7a3891a2c818325dda8cbf7948f30cf22aab586ad54f1640eb3fc973b19c7 not found: ID does not exist" Sep 19 08:33:08.089601 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:08.089552 2584 scope.go:117] "RemoveContainer" containerID="17c3a15ac6e4a524cf0435717b7a584ab04df4a2b36eddd7fd99bf7f2b64eabd" Sep 19 08:33:08.089601 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:08.089565 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-qk6g2"] Sep 19 08:33:08.089812 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:33:08.089795 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17c3a15ac6e4a524cf0435717b7a584ab04df4a2b36eddd7fd99bf7f2b64eabd\": container with ID starting with 17c3a15ac6e4a524cf0435717b7a584ab04df4a2b36eddd7fd99bf7f2b64eabd not found: ID does not exist" containerID="17c3a15ac6e4a524cf0435717b7a584ab04df4a2b36eddd7fd99bf7f2b64eabd" Sep 19 08:33:08.089851 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:08.089819 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17c3a15ac6e4a524cf0435717b7a584ab04df4a2b36eddd7fd99bf7f2b64eabd"} err="failed to get container status \"17c3a15ac6e4a524cf0435717b7a584ab04df4a2b36eddd7fd99bf7f2b64eabd\": rpc error: code = NotFound desc = could not find container \"17c3a15ac6e4a524cf0435717b7a584ab04df4a2b36eddd7fd99bf7f2b64eabd\": container with ID starting with 17c3a15ac6e4a524cf0435717b7a584ab04df4a2b36eddd7fd99bf7f2b64eabd not found: ID does not exist" Sep 19 08:33:08.089851 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:08.089834 2584 scope.go:117] "RemoveContainer" containerID="444556b78f874285e754f3d0a050099a69b5cd1a6e2a074b181c2116e5a491c0" Sep 19 08:33:08.090084 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:33:08.090055 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"444556b78f874285e754f3d0a050099a69b5cd1a6e2a074b181c2116e5a491c0\": container with ID starting with 444556b78f874285e754f3d0a050099a69b5cd1a6e2a074b181c2116e5a491c0 not found: ID does not exist" containerID="444556b78f874285e754f3d0a050099a69b5cd1a6e2a074b181c2116e5a491c0" Sep 19 08:33:08.090156 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:08.090089 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"444556b78f874285e754f3d0a050099a69b5cd1a6e2a074b181c2116e5a491c0"} err="failed to get container status \"444556b78f874285e754f3d0a050099a69b5cd1a6e2a074b181c2116e5a491c0\": rpc error: code = NotFound desc = could not find container \"444556b78f874285e754f3d0a050099a69b5cd1a6e2a074b181c2116e5a491c0\": container with ID starting with 444556b78f874285e754f3d0a050099a69b5cd1a6e2a074b181c2116e5a491c0 not found: ID does not exist" Sep 19 08:33:08.549428 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:08.549404 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2" Sep 19 08:33:08.552028 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:08.552012 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm" Sep 19 08:33:08.611054 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:08.610983 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1cba6c78-470d-429b-824b-bc18b3dd3190" path="/var/lib/kubelet/pods/1cba6c78-470d-429b-824b-bc18b3dd3190/volumes" Sep 19 08:33:08.648465 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:08.648433 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6957ac7f-b232-4eb0-984e-1cc67cd439af-kserve-provision-location\") pod \"6957ac7f-b232-4eb0-984e-1cc67cd439af\" (UID: \"6957ac7f-b232-4eb0-984e-1cc67cd439af\") " Sep 19 08:33:08.648465 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:08.648467 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ee50536d-4699-4622-9068-13caf56dfe01-kube-rbac-proxy-sar-config\") pod \"ee50536d-4699-4622-9068-13caf56dfe01\" (UID: \"ee50536d-4699-4622-9068-13caf56dfe01\") " Sep 19 08:33:08.648696 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:08.648495 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6957ac7f-b232-4eb0-984e-1cc67cd439af-cabundle-cert\") pod \"6957ac7f-b232-4eb0-984e-1cc67cd439af\" (UID: \"6957ac7f-b232-4eb0-984e-1cc67cd439af\") " Sep 19 08:33:08.648696 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:08.648540 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rzlg\" (UniqueName: \"kubernetes.io/projected/ee50536d-4699-4622-9068-13caf56dfe01-kube-api-access-5rzlg\") pod \"ee50536d-4699-4622-9068-13caf56dfe01\" (UID: \"ee50536d-4699-4622-9068-13caf56dfe01\") " Sep 19 08:33:08.648696 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:08.648555 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ee50536d-4699-4622-9068-13caf56dfe01-cabundle-cert\") pod \"ee50536d-4699-4622-9068-13caf56dfe01\" (UID: \"ee50536d-4699-4622-9068-13caf56dfe01\") " Sep 19 08:33:08.648696 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:08.648590 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6957ac7f-b232-4eb0-984e-1cc67cd439af-proxy-tls\") pod \"6957ac7f-b232-4eb0-984e-1cc67cd439af\" (UID: \"6957ac7f-b232-4eb0-984e-1cc67cd439af\") " Sep 19 08:33:08.648696 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:08.648616 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ee50536d-4699-4622-9068-13caf56dfe01-kserve-provision-location\") pod \"ee50536d-4699-4622-9068-13caf56dfe01\" (UID: \"ee50536d-4699-4622-9068-13caf56dfe01\") " Sep 19 08:33:08.648696 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:08.648646 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ee50536d-4699-4622-9068-13caf56dfe01-proxy-tls\") pod \"ee50536d-4699-4622-9068-13caf56dfe01\" (UID: \"ee50536d-4699-4622-9068-13caf56dfe01\") " Sep 19 08:33:08.648696 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:08.648694 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6957ac7f-b232-4eb0-984e-1cc67cd439af-kube-rbac-proxy-sar-config\") pod \"6957ac7f-b232-4eb0-984e-1cc67cd439af\" (UID: \"6957ac7f-b232-4eb0-984e-1cc67cd439af\") " Sep 19 08:33:08.649040 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:08.648731 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m6z8k\" (UniqueName: \"kubernetes.io/projected/6957ac7f-b232-4eb0-984e-1cc67cd439af-kube-api-access-m6z8k\") pod \"6957ac7f-b232-4eb0-984e-1cc67cd439af\" (UID: \"6957ac7f-b232-4eb0-984e-1cc67cd439af\") " Sep 19 08:33:08.649040 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:08.648821 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6957ac7f-b232-4eb0-984e-1cc67cd439af-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "6957ac7f-b232-4eb0-984e-1cc67cd439af" (UID: "6957ac7f-b232-4eb0-984e-1cc67cd439af"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 08:33:08.649040 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:08.648938 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6957ac7f-b232-4eb0-984e-1cc67cd439af-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "6957ac7f-b232-4eb0-984e-1cc67cd439af" (UID: "6957ac7f-b232-4eb0-984e-1cc67cd439af"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 08:33:08.649040 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:08.648957 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee50536d-4699-4622-9068-13caf56dfe01-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "ee50536d-4699-4622-9068-13caf56dfe01" (UID: "ee50536d-4699-4622-9068-13caf56dfe01"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 08:33:08.649040 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:08.648965 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee50536d-4699-4622-9068-13caf56dfe01-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "ee50536d-4699-4622-9068-13caf56dfe01" (UID: "ee50536d-4699-4622-9068-13caf56dfe01"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 08:33:08.649040 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:08.649027 2584 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6957ac7f-b232-4eb0-984e-1cc67cd439af-kserve-provision-location\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 08:33:08.649353 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:08.649048 2584 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6957ac7f-b232-4eb0-984e-1cc67cd439af-cabundle-cert\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 08:33:08.649353 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:08.649251 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee50536d-4699-4622-9068-13caf56dfe01-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "ee50536d-4699-4622-9068-13caf56dfe01" (UID: "ee50536d-4699-4622-9068-13caf56dfe01"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 08:33:08.649353 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:08.649313 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6957ac7f-b232-4eb0-984e-1cc67cd439af-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "6957ac7f-b232-4eb0-984e-1cc67cd439af" (UID: "6957ac7f-b232-4eb0-984e-1cc67cd439af"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 08:33:08.650957 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:08.650938 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee50536d-4699-4622-9068-13caf56dfe01-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "ee50536d-4699-4622-9068-13caf56dfe01" (UID: "ee50536d-4699-4622-9068-13caf56dfe01"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 08:33:08.651018 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:08.650961 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6957ac7f-b232-4eb0-984e-1cc67cd439af-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "6957ac7f-b232-4eb0-984e-1cc67cd439af" (UID: "6957ac7f-b232-4eb0-984e-1cc67cd439af"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 08:33:08.651201 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:08.651183 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee50536d-4699-4622-9068-13caf56dfe01-kube-api-access-5rzlg" (OuterVolumeSpecName: "kube-api-access-5rzlg") pod "ee50536d-4699-4622-9068-13caf56dfe01" (UID: "ee50536d-4699-4622-9068-13caf56dfe01"). InnerVolumeSpecName "kube-api-access-5rzlg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 08:33:08.651266 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:08.651208 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6957ac7f-b232-4eb0-984e-1cc67cd439af-kube-api-access-m6z8k" (OuterVolumeSpecName: "kube-api-access-m6z8k") pod "6957ac7f-b232-4eb0-984e-1cc67cd439af" (UID: "6957ac7f-b232-4eb0-984e-1cc67cd439af"). InnerVolumeSpecName "kube-api-access-m6z8k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 08:33:08.749960 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:08.749920 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rzlg\" (UniqueName: \"kubernetes.io/projected/ee50536d-4699-4622-9068-13caf56dfe01-kube-api-access-5rzlg\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 08:33:08.749960 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:08.749950 2584 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ee50536d-4699-4622-9068-13caf56dfe01-cabundle-cert\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 08:33:08.749960 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:08.749961 2584 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6957ac7f-b232-4eb0-984e-1cc67cd439af-proxy-tls\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 08:33:08.749960 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:08.749969 2584 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ee50536d-4699-4622-9068-13caf56dfe01-kserve-provision-location\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 08:33:08.750263 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:08.749979 2584 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ee50536d-4699-4622-9068-13caf56dfe01-proxy-tls\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 08:33:08.750263 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:08.749990 2584 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6957ac7f-b232-4eb0-984e-1cc67cd439af-kube-rbac-proxy-sar-config\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 08:33:08.750263 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:08.749999 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6z8k\" (UniqueName: \"kubernetes.io/projected/6957ac7f-b232-4eb0-984e-1cc67cd439af-kube-api-access-m6z8k\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 08:33:08.750263 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:08.750008 2584 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ee50536d-4699-4622-9068-13caf56dfe01-kube-rbac-proxy-sar-config\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 08:33:09.070357 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:09.070326 2584 generic.go:356] "Generic (PLEG): container finished" podID="ee50536d-4699-4622-9068-13caf56dfe01" containerID="01d2a4b89dca57e46e8296979f1c6f7ec8a110ffdf140ed9df8ef59b70994d61" exitCode=0 Sep 19 08:33:09.070545 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:09.070383 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2" Sep 19 08:33:09.070545 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:09.070416 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2" event={"ID":"ee50536d-4699-4622-9068-13caf56dfe01","Type":"ContainerDied","Data":"01d2a4b89dca57e46e8296979f1c6f7ec8a110ffdf140ed9df8ef59b70994d61"} Sep 19 08:33:09.070545 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:09.070496 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2" event={"ID":"ee50536d-4699-4622-9068-13caf56dfe01","Type":"ContainerDied","Data":"a23f946ed386b9ee986ee0b4556dac3a759ce0a3e74dfd74266369a58710d4b8"} Sep 19 08:33:09.070545 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:09.070540 2584 scope.go:117] "RemoveContainer" containerID="2a7255c3ee95d260e6fae231298c1f50890e67a8f9da39d562d2f6402a70f147" Sep 19 08:33:09.072412 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:09.072392 2584 generic.go:356] "Generic (PLEG): container finished" podID="6957ac7f-b232-4eb0-984e-1cc67cd439af" containerID="3e1ba3df4d4df67130a6c9515c8f75d45de252b59300652206cc4c2e18033982" exitCode=0 Sep 19 08:33:09.072513 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:09.072425 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm" event={"ID":"6957ac7f-b232-4eb0-984e-1cc67cd439af","Type":"ContainerDied","Data":"3e1ba3df4d4df67130a6c9515c8f75d45de252b59300652206cc4c2e18033982"} Sep 19 08:33:09.072513 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:09.072460 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm" Sep 19 08:33:09.072513 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:09.072493 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm" event={"ID":"6957ac7f-b232-4eb0-984e-1cc67cd439af","Type":"ContainerDied","Data":"21cf04721b91121fcbbd815c0a656bcf66c7e8835984676b415a592ae15abc54"} Sep 19 08:33:09.080139 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:09.080067 2584 scope.go:117] "RemoveContainer" containerID="01d2a4b89dca57e46e8296979f1c6f7ec8a110ffdf140ed9df8ef59b70994d61" Sep 19 08:33:09.090816 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:09.090791 2584 scope.go:117] "RemoveContainer" containerID="7020273e5b02036f1edc9b6a07a790bb87b0218cfc31f5f0fdfd9ee6a7a69d3a" Sep 19 08:33:09.098669 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:09.098644 2584 scope.go:117] "RemoveContainer" containerID="2a7255c3ee95d260e6fae231298c1f50890e67a8f9da39d562d2f6402a70f147" Sep 19 08:33:09.098979 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:33:09.098961 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a7255c3ee95d260e6fae231298c1f50890e67a8f9da39d562d2f6402a70f147\": container with ID starting with 2a7255c3ee95d260e6fae231298c1f50890e67a8f9da39d562d2f6402a70f147 not found: ID does not exist" containerID="2a7255c3ee95d260e6fae231298c1f50890e67a8f9da39d562d2f6402a70f147" Sep 19 08:33:09.099046 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:09.098986 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a7255c3ee95d260e6fae231298c1f50890e67a8f9da39d562d2f6402a70f147"} err="failed to get container status \"2a7255c3ee95d260e6fae231298c1f50890e67a8f9da39d562d2f6402a70f147\": rpc error: code = NotFound desc = could not find container \"2a7255c3ee95d260e6fae231298c1f50890e67a8f9da39d562d2f6402a70f147\": container with ID starting with 2a7255c3ee95d260e6fae231298c1f50890e67a8f9da39d562d2f6402a70f147 not found: ID does not exist" Sep 19 08:33:09.099046 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:09.099003 2584 scope.go:117] "RemoveContainer" containerID="01d2a4b89dca57e46e8296979f1c6f7ec8a110ffdf140ed9df8ef59b70994d61" Sep 19 08:33:09.099353 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:33:09.099314 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01d2a4b89dca57e46e8296979f1c6f7ec8a110ffdf140ed9df8ef59b70994d61\": container with ID starting with 01d2a4b89dca57e46e8296979f1c6f7ec8a110ffdf140ed9df8ef59b70994d61 not found: ID does not exist" containerID="01d2a4b89dca57e46e8296979f1c6f7ec8a110ffdf140ed9df8ef59b70994d61" Sep 19 08:33:09.099452 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:09.099348 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01d2a4b89dca57e46e8296979f1c6f7ec8a110ffdf140ed9df8ef59b70994d61"} err="failed to get container status \"01d2a4b89dca57e46e8296979f1c6f7ec8a110ffdf140ed9df8ef59b70994d61\": rpc error: code = NotFound desc = could not find container \"01d2a4b89dca57e46e8296979f1c6f7ec8a110ffdf140ed9df8ef59b70994d61\": container with ID starting with 01d2a4b89dca57e46e8296979f1c6f7ec8a110ffdf140ed9df8ef59b70994d61 not found: ID does not exist" Sep 19 08:33:09.099452 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:09.099369 2584 scope.go:117] "RemoveContainer" containerID="7020273e5b02036f1edc9b6a07a790bb87b0218cfc31f5f0fdfd9ee6a7a69d3a" Sep 19 08:33:09.099702 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:33:09.099668 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7020273e5b02036f1edc9b6a07a790bb87b0218cfc31f5f0fdfd9ee6a7a69d3a\": container with ID starting with 7020273e5b02036f1edc9b6a07a790bb87b0218cfc31f5f0fdfd9ee6a7a69d3a not found: ID does not exist" containerID="7020273e5b02036f1edc9b6a07a790bb87b0218cfc31f5f0fdfd9ee6a7a69d3a" Sep 19 08:33:09.099761 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:09.099718 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7020273e5b02036f1edc9b6a07a790bb87b0218cfc31f5f0fdfd9ee6a7a69d3a"} err="failed to get container status \"7020273e5b02036f1edc9b6a07a790bb87b0218cfc31f5f0fdfd9ee6a7a69d3a\": rpc error: code = NotFound desc = could not find container \"7020273e5b02036f1edc9b6a07a790bb87b0218cfc31f5f0fdfd9ee6a7a69d3a\": container with ID starting with 7020273e5b02036f1edc9b6a07a790bb87b0218cfc31f5f0fdfd9ee6a7a69d3a not found: ID does not exist" Sep 19 08:33:09.099761 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:09.099743 2584 scope.go:117] "RemoveContainer" containerID="646e22c9c202ab0d2d70ed3d64a52f69b6c244b315cb85b4bbe120d555fd1f84" Sep 19 08:33:09.100441 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:09.100413 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm"] Sep 19 08:33:09.103609 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:09.103590 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-2wbcm"] Sep 19 08:33:09.107694 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:09.107678 2584 scope.go:117] "RemoveContainer" containerID="3e1ba3df4d4df67130a6c9515c8f75d45de252b59300652206cc4c2e18033982" Sep 19 08:33:09.114707 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:09.114687 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2"] Sep 19 08:33:09.116062 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:09.116012 2584 scope.go:117] "RemoveContainer" containerID="087256c479bac4ef6794cf4a1d3091eda68740d081156e8adda8da8258aff1ef" Sep 19 08:33:09.117811 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:09.117790 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-4h4w2"] Sep 19 08:33:09.123134 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:09.123114 2584 scope.go:117] "RemoveContainer" containerID="646e22c9c202ab0d2d70ed3d64a52f69b6c244b315cb85b4bbe120d555fd1f84" Sep 19 08:33:09.123382 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:33:09.123364 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"646e22c9c202ab0d2d70ed3d64a52f69b6c244b315cb85b4bbe120d555fd1f84\": container with ID starting with 646e22c9c202ab0d2d70ed3d64a52f69b6c244b315cb85b4bbe120d555fd1f84 not found: ID does not exist" containerID="646e22c9c202ab0d2d70ed3d64a52f69b6c244b315cb85b4bbe120d555fd1f84" Sep 19 08:33:09.123449 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:09.123394 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"646e22c9c202ab0d2d70ed3d64a52f69b6c244b315cb85b4bbe120d555fd1f84"} err="failed to get container status \"646e22c9c202ab0d2d70ed3d64a52f69b6c244b315cb85b4bbe120d555fd1f84\": rpc error: code = NotFound desc = could not find container \"646e22c9c202ab0d2d70ed3d64a52f69b6c244b315cb85b4bbe120d555fd1f84\": container with ID starting with 646e22c9c202ab0d2d70ed3d64a52f69b6c244b315cb85b4bbe120d555fd1f84 not found: ID does not exist" Sep 19 08:33:09.123449 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:09.123417 2584 scope.go:117] "RemoveContainer" containerID="3e1ba3df4d4df67130a6c9515c8f75d45de252b59300652206cc4c2e18033982" Sep 19 08:33:09.123684 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:33:09.123667 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e1ba3df4d4df67130a6c9515c8f75d45de252b59300652206cc4c2e18033982\": container with ID starting with 3e1ba3df4d4df67130a6c9515c8f75d45de252b59300652206cc4c2e18033982 not found: ID does not exist" containerID="3e1ba3df4d4df67130a6c9515c8f75d45de252b59300652206cc4c2e18033982" Sep 19 08:33:09.123726 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:09.123689 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e1ba3df4d4df67130a6c9515c8f75d45de252b59300652206cc4c2e18033982"} err="failed to get container status \"3e1ba3df4d4df67130a6c9515c8f75d45de252b59300652206cc4c2e18033982\": rpc error: code = NotFound desc = could not find container \"3e1ba3df4d4df67130a6c9515c8f75d45de252b59300652206cc4c2e18033982\": container with ID starting with 3e1ba3df4d4df67130a6c9515c8f75d45de252b59300652206cc4c2e18033982 not found: ID does not exist" Sep 19 08:33:09.123726 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:09.123703 2584 scope.go:117] "RemoveContainer" containerID="087256c479bac4ef6794cf4a1d3091eda68740d081156e8adda8da8258aff1ef" Sep 19 08:33:09.123925 ip-10-0-143-96 kubenswrapper[2584]: E0919 08:33:09.123908 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"087256c479bac4ef6794cf4a1d3091eda68740d081156e8adda8da8258aff1ef\": container with ID starting with 087256c479bac4ef6794cf4a1d3091eda68740d081156e8adda8da8258aff1ef not found: ID does not exist" containerID="087256c479bac4ef6794cf4a1d3091eda68740d081156e8adda8da8258aff1ef" Sep 19 08:33:09.123977 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:09.123932 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"087256c479bac4ef6794cf4a1d3091eda68740d081156e8adda8da8258aff1ef"} err="failed to get container status \"087256c479bac4ef6794cf4a1d3091eda68740d081156e8adda8da8258aff1ef\": rpc error: code = NotFound desc = could not find container \"087256c479bac4ef6794cf4a1d3091eda68740d081156e8adda8da8258aff1ef\": container with ID starting with 087256c479bac4ef6794cf4a1d3091eda68740d081156e8adda8da8258aff1ef not found: ID does not exist" Sep 19 08:33:10.611199 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:10.611171 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6957ac7f-b232-4eb0-984e-1cc67cd439af" path="/var/lib/kubelet/pods/6957ac7f-b232-4eb0-984e-1cc67cd439af/volumes" Sep 19 08:33:10.611641 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:33:10.611627 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee50536d-4699-4622-9068-13caf56dfe01" path="/var/lib/kubelet/pods/ee50536d-4699-4622-9068-13caf56dfe01/volumes" Sep 19 08:36:06.321836 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:36:06.321803 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2hqv_3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136/ovn-acl-logging/0.log" Sep 19 08:36:06.322886 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:36:06.322866 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2hqv_3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136/ovn-acl-logging/0.log" Sep 19 08:41:06.349759 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:41:06.349726 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2hqv_3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136/ovn-acl-logging/0.log" Sep 19 08:41:06.352261 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:41:06.351846 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2hqv_3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136/ovn-acl-logging/0.log" Sep 19 08:46:06.377596 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:46:06.377483 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2hqv_3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136/ovn-acl-logging/0.log" Sep 19 08:46:06.380973 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:46:06.380710 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2hqv_3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136/ovn-acl-logging/0.log" Sep 19 08:51:06.405873 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:51:06.405767 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2hqv_3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136/ovn-acl-logging/0.log" Sep 19 08:51:06.410064 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:51:06.410044 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2hqv_3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136/ovn-acl-logging/0.log" Sep 19 08:56:06.437908 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:56:06.437792 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2hqv_3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136/ovn-acl-logging/0.log" Sep 19 08:56:06.443621 ip-10-0-143-96 kubenswrapper[2584]: I0919 08:56:06.443602 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2hqv_3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136/ovn-acl-logging/0.log" Sep 19 09:01:06.470103 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:01:06.469984 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2hqv_3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136/ovn-acl-logging/0.log" Sep 19 09:01:06.476603 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:01:06.476582 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2hqv_3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136/ovn-acl-logging/0.log" Sep 19 09:06:06.503818 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:06:06.503715 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2hqv_3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136/ovn-acl-logging/0.log" Sep 19 09:06:06.510661 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:06:06.510642 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2hqv_3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136/ovn-acl-logging/0.log" Sep 19 09:10:46.621315 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:10:46.621280 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zh9m5/must-gather-796pv"] Sep 19 09:10:46.621808 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:10:46.621590 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cba6c78-470d-429b-824b-bc18b3dd3190" containerName="kube-rbac-proxy" Sep 19 09:10:46.621808 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:10:46.621601 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cba6c78-470d-429b-824b-bc18b3dd3190" containerName="kube-rbac-proxy" Sep 19 09:10:46.621808 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:10:46.621614 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6957ac7f-b232-4eb0-984e-1cc67cd439af" containerName="kserve-container" Sep 19 09:10:46.621808 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:10:46.621620 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="6957ac7f-b232-4eb0-984e-1cc67cd439af" containerName="kserve-container" Sep 19 09:10:46.621808 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:10:46.621625 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee50536d-4699-4622-9068-13caf56dfe01" containerName="kube-rbac-proxy" Sep 19 09:10:46.621808 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:10:46.621630 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee50536d-4699-4622-9068-13caf56dfe01" containerName="kube-rbac-proxy" Sep 19 09:10:46.621808 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:10:46.621639 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6957ac7f-b232-4eb0-984e-1cc67cd439af" containerName="storage-initializer" Sep 19 09:10:46.621808 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:10:46.621645 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="6957ac7f-b232-4eb0-984e-1cc67cd439af" containerName="storage-initializer" Sep 19 09:10:46.621808 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:10:46.621650 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee50536d-4699-4622-9068-13caf56dfe01" containerName="kserve-container" Sep 19 09:10:46.621808 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:10:46.621655 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee50536d-4699-4622-9068-13caf56dfe01" containerName="kserve-container" Sep 19 09:10:46.621808 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:10:46.621663 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cba6c78-470d-429b-824b-bc18b3dd3190" containerName="kserve-container" Sep 19 09:10:46.621808 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:10:46.621667 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cba6c78-470d-429b-824b-bc18b3dd3190" containerName="kserve-container" Sep 19 09:10:46.621808 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:10:46.621674 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6957ac7f-b232-4eb0-984e-1cc67cd439af" containerName="kube-rbac-proxy" Sep 19 09:10:46.621808 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:10:46.621679 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="6957ac7f-b232-4eb0-984e-1cc67cd439af" containerName="kube-rbac-proxy" Sep 19 09:10:46.621808 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:10:46.621686 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee50536d-4699-4622-9068-13caf56dfe01" containerName="storage-initializer" Sep 19 09:10:46.621808 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:10:46.621691 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee50536d-4699-4622-9068-13caf56dfe01" containerName="storage-initializer" Sep 19 09:10:46.621808 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:10:46.621701 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cba6c78-470d-429b-824b-bc18b3dd3190" containerName="storage-initializer" Sep 19 09:10:46.621808 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:10:46.621706 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cba6c78-470d-429b-824b-bc18b3dd3190" containerName="storage-initializer" Sep 19 09:10:46.621808 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:10:46.621759 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cba6c78-470d-429b-824b-bc18b3dd3190" containerName="kube-rbac-proxy" Sep 19 09:10:46.621808 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:10:46.621767 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="6957ac7f-b232-4eb0-984e-1cc67cd439af" containerName="kserve-container" Sep 19 09:10:46.621808 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:10:46.621773 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="6957ac7f-b232-4eb0-984e-1cc67cd439af" containerName="kube-rbac-proxy" Sep 19 09:10:46.621808 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:10:46.621782 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee50536d-4699-4622-9068-13caf56dfe01" containerName="kserve-container" Sep 19 09:10:46.621808 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:10:46.621788 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee50536d-4699-4622-9068-13caf56dfe01" containerName="kube-rbac-proxy" Sep 19 09:10:46.621808 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:10:46.621794 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cba6c78-470d-429b-824b-bc18b3dd3190" containerName="kserve-container" Sep 19 09:10:46.624885 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:10:46.624869 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zh9m5/must-gather-796pv" Sep 19 09:10:46.627519 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:10:46.627501 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zh9m5\"/\"openshift-service-ca.crt\"" Sep 19 09:10:46.627757 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:10:46.627739 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zh9m5\"/\"default-dockercfg-vflrp\"" Sep 19 09:10:46.628494 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:10:46.628479 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zh9m5\"/\"kube-root-ca.crt\"" Sep 19 09:10:46.636678 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:10:46.636659 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zh9m5/must-gather-796pv"] Sep 19 09:10:46.725963 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:10:46.725927 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlfpj\" (UniqueName: \"kubernetes.io/projected/b8d528b8-0afb-4988-bdd2-37fcb87ea948-kube-api-access-tlfpj\") pod \"must-gather-796pv\" (UID: \"b8d528b8-0afb-4988-bdd2-37fcb87ea948\") " pod="openshift-must-gather-zh9m5/must-gather-796pv" Sep 19 09:10:46.726183 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:10:46.726064 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b8d528b8-0afb-4988-bdd2-37fcb87ea948-must-gather-output\") pod \"must-gather-796pv\" (UID: \"b8d528b8-0afb-4988-bdd2-37fcb87ea948\") " pod="openshift-must-gather-zh9m5/must-gather-796pv" Sep 19 09:10:46.826719 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:10:46.826682 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b8d528b8-0afb-4988-bdd2-37fcb87ea948-must-gather-output\") pod \"must-gather-796pv\" (UID: \"b8d528b8-0afb-4988-bdd2-37fcb87ea948\") " pod="openshift-must-gather-zh9m5/must-gather-796pv" Sep 19 09:10:46.826719 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:10:46.826727 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlfpj\" (UniqueName: \"kubernetes.io/projected/b8d528b8-0afb-4988-bdd2-37fcb87ea948-kube-api-access-tlfpj\") pod \"must-gather-796pv\" (UID: \"b8d528b8-0afb-4988-bdd2-37fcb87ea948\") " pod="openshift-must-gather-zh9m5/must-gather-796pv" Sep 19 09:10:46.827051 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:10:46.827030 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b8d528b8-0afb-4988-bdd2-37fcb87ea948-must-gather-output\") pod \"must-gather-796pv\" (UID: \"b8d528b8-0afb-4988-bdd2-37fcb87ea948\") " pod="openshift-must-gather-zh9m5/must-gather-796pv" Sep 19 09:10:46.835386 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:10:46.835353 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlfpj\" (UniqueName: \"kubernetes.io/projected/b8d528b8-0afb-4988-bdd2-37fcb87ea948-kube-api-access-tlfpj\") pod \"must-gather-796pv\" (UID: \"b8d528b8-0afb-4988-bdd2-37fcb87ea948\") " pod="openshift-must-gather-zh9m5/must-gather-796pv" Sep 19 09:10:46.943838 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:10:46.943751 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zh9m5/must-gather-796pv" Sep 19 09:10:47.217998 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:10:47.217917 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zh9m5/must-gather-796pv"] Sep 19 09:10:47.221994 ip-10-0-143-96 kubenswrapper[2584]: W0919 09:10:47.221971 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb8d528b8_0afb_4988_bdd2_37fcb87ea948.slice/crio-4af583b275e5b3c6edab5bba5ba07be607c56d228476970039bbe216b549a2a1 WatchSource:0}: Error finding container 4af583b275e5b3c6edab5bba5ba07be607c56d228476970039bbe216b549a2a1: Status 404 returned error can't find the container with id 4af583b275e5b3c6edab5bba5ba07be607c56d228476970039bbe216b549a2a1 Sep 19 09:10:47.224245 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:10:47.224228 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 19 09:10:48.156189 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:10:48.156142 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zh9m5/must-gather-796pv" event={"ID":"b8d528b8-0afb-4988-bdd2-37fcb87ea948","Type":"ContainerStarted","Data":"4af583b275e5b3c6edab5bba5ba07be607c56d228476970039bbe216b549a2a1"} Sep 19 09:10:54.185444 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:10:54.185401 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zh9m5/must-gather-796pv" event={"ID":"b8d528b8-0afb-4988-bdd2-37fcb87ea948","Type":"ContainerStarted","Data":"a3da4c8b5a42b12326f9d5bd68e59b15d88271ab77a3d0b9e4ce23e211557f67"} Sep 19 09:10:54.185444 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:10:54.185448 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zh9m5/must-gather-796pv" event={"ID":"b8d528b8-0afb-4988-bdd2-37fcb87ea948","Type":"ContainerStarted","Data":"f833cd9e3abf0be9c3c3da821b0ce09a52ae95c5db5c7617f66a6a47374314c6"} Sep 19 09:10:54.204965 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:10:54.204904 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-zh9m5/must-gather-796pv" podStartSLOduration=2.288669389 podStartE2EDuration="8.204882506s" totalImagesPullingTime="5.916213117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:10:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:10:54.203863404 +0000 UTC m=+3003.933960009" watchObservedRunningTime="2026-09-19 09:10:54.204882506 +0000 UTC m=+3003.934979109" Sep 19 09:11:06.535537 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:06.535416 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2hqv_3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136/ovn-acl-logging/0.log" Sep 19 09:11:06.542611 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:06.542593 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2hqv_3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136/ovn-acl-logging/0.log" Sep 19 09:11:17.291737 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:17.291703 2584 generic.go:356] "Generic (PLEG): container finished" podID="b8d528b8-0afb-4988-bdd2-37fcb87ea948" containerID="f833cd9e3abf0be9c3c3da821b0ce09a52ae95c5db5c7617f66a6a47374314c6" exitCode=0 Sep 19 09:11:17.292189 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:17.291776 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zh9m5/must-gather-796pv" event={"ID":"b8d528b8-0afb-4988-bdd2-37fcb87ea948","Type":"ContainerDied","Data":"f833cd9e3abf0be9c3c3da821b0ce09a52ae95c5db5c7617f66a6a47374314c6"} Sep 19 09:11:17.292235 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:17.292183 2584 scope.go:117] "RemoveContainer" containerID="f833cd9e3abf0be9c3c3da821b0ce09a52ae95c5db5c7617f66a6a47374314c6" Sep 19 09:11:17.696693 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:17.696661 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-zh9m5_must-gather-796pv_b8d528b8-0afb-4988-bdd2-37fcb87ea948/gather/0.log" Sep 19 09:11:18.308148 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:18.308117 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wb8bw/must-gather-xgg9x"] Sep 19 09:11:18.310545 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:18.310528 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wb8bw/must-gather-xgg9x" Sep 19 09:11:18.317541 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:18.317525 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wb8bw\"/\"default-dockercfg-b4dzd\"" Sep 19 09:11:18.318783 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:18.318769 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wb8bw\"/\"openshift-service-ca.crt\"" Sep 19 09:11:18.318938 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:18.318920 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wb8bw\"/\"kube-root-ca.crt\"" Sep 19 09:11:18.335265 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:18.335236 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wb8bw/must-gather-xgg9x"] Sep 19 09:11:18.411180 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:18.411154 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wslzd\" (UniqueName: \"kubernetes.io/projected/2616757a-931f-45f4-8e43-164c9f642aaa-kube-api-access-wslzd\") pod \"must-gather-xgg9x\" (UID: \"2616757a-931f-45f4-8e43-164c9f642aaa\") " pod="openshift-must-gather-wb8bw/must-gather-xgg9x" Sep 19 09:11:18.411344 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:18.411218 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2616757a-931f-45f4-8e43-164c9f642aaa-must-gather-output\") pod \"must-gather-xgg9x\" (UID: \"2616757a-931f-45f4-8e43-164c9f642aaa\") " pod="openshift-must-gather-wb8bw/must-gather-xgg9x" Sep 19 09:11:18.511999 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:18.511956 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2616757a-931f-45f4-8e43-164c9f642aaa-must-gather-output\") pod \"must-gather-xgg9x\" (UID: \"2616757a-931f-45f4-8e43-164c9f642aaa\") " pod="openshift-must-gather-wb8bw/must-gather-xgg9x" Sep 19 09:11:18.512193 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:18.512023 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wslzd\" (UniqueName: \"kubernetes.io/projected/2616757a-931f-45f4-8e43-164c9f642aaa-kube-api-access-wslzd\") pod \"must-gather-xgg9x\" (UID: \"2616757a-931f-45f4-8e43-164c9f642aaa\") " pod="openshift-must-gather-wb8bw/must-gather-xgg9x" Sep 19 09:11:18.512313 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:18.512295 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2616757a-931f-45f4-8e43-164c9f642aaa-must-gather-output\") pod \"must-gather-xgg9x\" (UID: \"2616757a-931f-45f4-8e43-164c9f642aaa\") " pod="openshift-must-gather-wb8bw/must-gather-xgg9x" Sep 19 09:11:18.520281 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:18.520263 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wslzd\" (UniqueName: \"kubernetes.io/projected/2616757a-931f-45f4-8e43-164c9f642aaa-kube-api-access-wslzd\") pod \"must-gather-xgg9x\" (UID: \"2616757a-931f-45f4-8e43-164c9f642aaa\") " pod="openshift-must-gather-wb8bw/must-gather-xgg9x" Sep 19 09:11:18.618723 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:18.618647 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wb8bw/must-gather-xgg9x" Sep 19 09:11:18.888702 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:18.888675 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wb8bw/must-gather-xgg9x"] Sep 19 09:11:18.891257 ip-10-0-143-96 kubenswrapper[2584]: W0919 09:11:18.891219 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2616757a_931f_45f4_8e43_164c9f642aaa.slice/crio-d65e9d6467ed40afcea9a2067d2d1a71baacf6c51187dc14e9d99b93bc3b5204 WatchSource:0}: Error finding container d65e9d6467ed40afcea9a2067d2d1a71baacf6c51187dc14e9d99b93bc3b5204: Status 404 returned error can't find the container with id d65e9d6467ed40afcea9a2067d2d1a71baacf6c51187dc14e9d99b93bc3b5204 Sep 19 09:11:19.308176 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:19.308142 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wb8bw/must-gather-xgg9x" event={"ID":"2616757a-931f-45f4-8e43-164c9f642aaa","Type":"ContainerStarted","Data":"d65e9d6467ed40afcea9a2067d2d1a71baacf6c51187dc14e9d99b93bc3b5204"} Sep 19 09:11:20.317224 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:20.316573 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wb8bw/must-gather-xgg9x" event={"ID":"2616757a-931f-45f4-8e43-164c9f642aaa","Type":"ContainerStarted","Data":"1c762e54a886bcffb014ca219c3edcd37ded80a47ac5514e05f94e5db98ba089"} Sep 19 09:11:20.317224 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:20.316627 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wb8bw/must-gather-xgg9x" event={"ID":"2616757a-931f-45f4-8e43-164c9f642aaa","Type":"ContainerStarted","Data":"b78707df9876234e2e6f93c060c40e4e3b9a20aecf43a06c1c77a897fc291638"} Sep 19 09:11:20.335727 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:20.335676 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wb8bw/must-gather-xgg9x" podStartSLOduration=1.5935493429999998 podStartE2EDuration="2.335661264s" totalImagesPullingTime="742.111921ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:11:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:11:20.334272167 +0000 UTC m=+3030.064368782" watchObservedRunningTime="2026-09-19 09:11:20.335661264 +0000 UTC m=+3030.065757865" Sep 19 09:11:21.117028 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:21.116980 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xgprw_06d9bb1e-838b-4f04-9ff4-f668714c7877/global-pull-secret-syncer/0.log" Sep 19 09:11:21.248908 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:21.248870 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qw5l5_92a2d024-eab7-44e8-9886-867fe54981d0/konnectivity-agent/0.log" Sep 19 09:11:21.351434 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:21.351400 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-96.ec2.internal_bb1f3dcffd05d522e85d0257d7561dec/haproxy/0.log" Sep 19 09:11:23.161221 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:23.161178 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-zh9m5/must-gather-796pv"] Sep 19 09:11:23.162711 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:23.162252 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-zh9m5/must-gather-796pv" podUID="b8d528b8-0afb-4988-bdd2-37fcb87ea948" containerName="copy" containerID="cri-o://a3da4c8b5a42b12326f9d5bd68e59b15d88271ab77a3d0b9e4ce23e211557f67" gracePeriod=2 Sep 19 09:11:23.164883 ip-10-0-143-96 kubenswrapper[2584]: E0919 09:11:23.164836 2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-796pv\" is forbidden: User \"system:node:ip-10-0-143-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-zh9m5\": no relationship found between node 'ip-10-0-143-96.ec2.internal' and this object" podUID="b8d528b8-0afb-4988-bdd2-37fcb87ea948" pod="openshift-must-gather-zh9m5/must-gather-796pv" Sep 19 09:11:23.166509 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:23.166485 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-zh9m5/must-gather-796pv"] Sep 19 09:11:23.336445 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:23.336357 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-zh9m5_must-gather-796pv_b8d528b8-0afb-4988-bdd2-37fcb87ea948/copy/0.log" Sep 19 09:11:23.337125 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:23.337024 2584 generic.go:356] "Generic (PLEG): container finished" podID="b8d528b8-0afb-4988-bdd2-37fcb87ea948" containerID="a3da4c8b5a42b12326f9d5bd68e59b15d88271ab77a3d0b9e4ce23e211557f67" exitCode=143 Sep 19 09:11:23.555513 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:23.555488 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-zh9m5_must-gather-796pv_b8d528b8-0afb-4988-bdd2-37fcb87ea948/copy/0.log" Sep 19 09:11:23.558441 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:23.558418 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zh9m5/must-gather-796pv" Sep 19 09:11:23.564102 ip-10-0-143-96 kubenswrapper[2584]: E0919 09:11:23.564052 2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-796pv\" is forbidden: User \"system:node:ip-10-0-143-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-zh9m5\": no relationship found between node 'ip-10-0-143-96.ec2.internal' and this object" podUID="b8d528b8-0afb-4988-bdd2-37fcb87ea948" pod="openshift-must-gather-zh9m5/must-gather-796pv" Sep 19 09:11:23.567334 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:23.567308 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b8d528b8-0afb-4988-bdd2-37fcb87ea948-must-gather-output\") pod \"b8d528b8-0afb-4988-bdd2-37fcb87ea948\" (UID: \"b8d528b8-0afb-4988-bdd2-37fcb87ea948\") " Sep 19 09:11:23.570244 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:23.570221 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tlfpj\" (UniqueName: \"kubernetes.io/projected/b8d528b8-0afb-4988-bdd2-37fcb87ea948-kube-api-access-tlfpj\") pod \"b8d528b8-0afb-4988-bdd2-37fcb87ea948\" (UID: \"b8d528b8-0afb-4988-bdd2-37fcb87ea948\") " Sep 19 09:11:23.570888 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:23.569055 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8d528b8-0afb-4988-bdd2-37fcb87ea948-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "b8d528b8-0afb-4988-bdd2-37fcb87ea948" (UID: "b8d528b8-0afb-4988-bdd2-37fcb87ea948"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 09:11:23.576801 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:23.576773 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8d528b8-0afb-4988-bdd2-37fcb87ea948-kube-api-access-tlfpj" (OuterVolumeSpecName: "kube-api-access-tlfpj") pod "b8d528b8-0afb-4988-bdd2-37fcb87ea948" (UID: "b8d528b8-0afb-4988-bdd2-37fcb87ea948"). InnerVolumeSpecName "kube-api-access-tlfpj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 09:11:23.671944 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:23.671298 2584 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b8d528b8-0afb-4988-bdd2-37fcb87ea948-must-gather-output\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 09:11:23.671944 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:23.671334 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tlfpj\" (UniqueName: \"kubernetes.io/projected/b8d528b8-0afb-4988-bdd2-37fcb87ea948-kube-api-access-tlfpj\") on node \"ip-10-0-143-96.ec2.internal\" DevicePath \"\"" Sep 19 09:11:24.344950 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:24.344916 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-zh9m5_must-gather-796pv_b8d528b8-0afb-4988-bdd2-37fcb87ea948/copy/0.log" Sep 19 09:11:24.345596 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:24.345509 2584 scope.go:117] "RemoveContainer" containerID="a3da4c8b5a42b12326f9d5bd68e59b15d88271ab77a3d0b9e4ce23e211557f67" Sep 19 09:11:24.345710 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:24.345692 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zh9m5/must-gather-796pv" Sep 19 09:11:24.349163 ip-10-0-143-96 kubenswrapper[2584]: E0919 09:11:24.349119 2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-796pv\" is forbidden: User \"system:node:ip-10-0-143-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-zh9m5\": no relationship found between node 'ip-10-0-143-96.ec2.internal' and this object" podUID="b8d528b8-0afb-4988-bdd2-37fcb87ea948" pod="openshift-must-gather-zh9m5/must-gather-796pv" Sep 19 09:11:24.362044 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:24.360227 2584 scope.go:117] "RemoveContainer" containerID="f833cd9e3abf0be9c3c3da821b0ce09a52ae95c5db5c7617f66a6a47374314c6" Sep 19 09:11:24.412233 ip-10-0-143-96 kubenswrapper[2584]: E0919 09:11:24.410574 2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-796pv\" is forbidden: User \"system:node:ip-10-0-143-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-zh9m5\": no relationship found between node 'ip-10-0-143-96.ec2.internal' and this object" podUID="b8d528b8-0afb-4988-bdd2-37fcb87ea948" pod="openshift-must-gather-zh9m5/must-gather-796pv" Sep 19 09:11:24.614378 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:24.614333 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8d528b8-0afb-4988-bdd2-37fcb87ea948" path="/var/lib/kubelet/pods/b8d528b8-0afb-4988-bdd2-37fcb87ea948/volumes" Sep 19 09:11:25.079484 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:25.079451 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f6362017-5b9b-4625-be05-9ceee22b3426/alertmanager/0.log" Sep 19 09:11:25.126127 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:25.126062 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f6362017-5b9b-4625-be05-9ceee22b3426/config-reloader/0.log" Sep 19 09:11:25.173195 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:25.173169 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f6362017-5b9b-4625-be05-9ceee22b3426/kube-rbac-proxy-web/0.log" Sep 19 09:11:25.205685 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:25.205474 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f6362017-5b9b-4625-be05-9ceee22b3426/kube-rbac-proxy/0.log" Sep 19 09:11:25.237363 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:25.237334 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f6362017-5b9b-4625-be05-9ceee22b3426/kube-rbac-proxy-metric/0.log" Sep 19 09:11:25.265492 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:25.265461 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f6362017-5b9b-4625-be05-9ceee22b3426/prom-label-proxy/0.log" Sep 19 09:11:25.298490 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:25.298415 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f6362017-5b9b-4625-be05-9ceee22b3426/init-config-reloader/0.log" Sep 19 09:11:25.385799 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:25.385766 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-qrr6z_2167602f-49ad-4b65-9fad-4e8d35f6661b/kube-state-metrics/0.log" Sep 19 09:11:25.420698 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:25.420670 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-qrr6z_2167602f-49ad-4b65-9fad-4e8d35f6661b/kube-rbac-proxy-main/0.log" Sep 19 09:11:25.447628 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:25.447597 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-qrr6z_2167602f-49ad-4b65-9fad-4e8d35f6661b/kube-rbac-proxy-self/0.log" Sep 19 09:11:25.482179 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:25.482147 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7d88dff558-npwqw_ebeb5d84-09c7-4293-acb2-5279186b8cb8/metrics-server/0.log" Sep 19 09:11:25.509480 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:25.509446 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5984459ff8-95jcs_37a9b8f9-7cb5-42aa-b068-2f134b71e77d/monitoring-plugin/0.log" Sep 19 09:11:25.547182 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:25.547151 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8x6zs_b2117f2e-52c2-4254-ad98-f83540d8eda2/node-exporter/0.log" Sep 19 09:11:25.580971 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:25.580942 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8x6zs_b2117f2e-52c2-4254-ad98-f83540d8eda2/kube-rbac-proxy/0.log" Sep 19 09:11:25.604877 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:25.604837 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8x6zs_b2117f2e-52c2-4254-ad98-f83540d8eda2/init-textfile/0.log" Sep 19 09:11:25.788587 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:25.788513 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-s2bqw_0669adfe-a5ed-4b64-bc9c-f572feabbf88/kube-rbac-proxy-main/0.log" Sep 19 09:11:25.820410 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:25.820355 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-s2bqw_0669adfe-a5ed-4b64-bc9c-f572feabbf88/kube-rbac-proxy-self/0.log" Sep 19 09:11:25.848683 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:25.848533 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-s2bqw_0669adfe-a5ed-4b64-bc9c-f572feabbf88/openshift-state-metrics/0.log" Sep 19 09:11:25.909872 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:25.909798 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d90562c3-1dc8-4966-b625-ce0f5db18855/prometheus/0.log" Sep 19 09:11:25.948720 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:25.948686 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d90562c3-1dc8-4966-b625-ce0f5db18855/config-reloader/0.log" Sep 19 09:11:25.982116 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:25.982089 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d90562c3-1dc8-4966-b625-ce0f5db18855/thanos-sidecar/0.log" Sep 19 09:11:26.011830 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:26.011805 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d90562c3-1dc8-4966-b625-ce0f5db18855/kube-rbac-proxy-web/0.log" Sep 19 09:11:26.041299 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:26.041260 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d90562c3-1dc8-4966-b625-ce0f5db18855/kube-rbac-proxy/0.log" Sep 19 09:11:26.067522 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:26.067476 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d90562c3-1dc8-4966-b625-ce0f5db18855/kube-rbac-proxy-thanos/0.log" Sep 19 09:11:26.098319 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:26.098287 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d90562c3-1dc8-4966-b625-ce0f5db18855/init-config-reloader/0.log" Sep 19 09:11:26.133554 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:26.133481 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-kcwqt_cc52163e-1303-45d6-ae55-0318a053aeac/prometheus-operator/0.log" Sep 19 09:11:26.189477 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:26.189438 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-kcwqt_cc52163e-1303-45d6-ae55-0318a053aeac/kube-rbac-proxy/0.log" Sep 19 09:11:26.250893 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:26.250858 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b65d4c7-86qpf_1256aa83-593b-477e-b885-38e3bfd122e6/telemeter-client/0.log" Sep 19 09:11:26.275988 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:26.275956 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b65d4c7-86qpf_1256aa83-593b-477e-b885-38e3bfd122e6/reload/0.log" Sep 19 09:11:26.299680 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:26.299654 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b65d4c7-86qpf_1256aa83-593b-477e-b885-38e3bfd122e6/kube-rbac-proxy/0.log" Sep 19 09:11:26.339005 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:26.338963 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d7754d644-9x2ww_9aa92914-bb70-47d9-9e69-c30c113b040d/thanos-query/0.log" Sep 19 09:11:26.365575 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:26.365544 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d7754d644-9x2ww_9aa92914-bb70-47d9-9e69-c30c113b040d/kube-rbac-proxy-web/0.log" Sep 19 09:11:26.390203 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:26.390117 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d7754d644-9x2ww_9aa92914-bb70-47d9-9e69-c30c113b040d/kube-rbac-proxy/0.log" Sep 19 09:11:26.410823 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:26.410797 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d7754d644-9x2ww_9aa92914-bb70-47d9-9e69-c30c113b040d/prom-label-proxy/0.log" Sep 19 09:11:26.435441 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:26.435411 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d7754d644-9x2ww_9aa92914-bb70-47d9-9e69-c30c113b040d/kube-rbac-proxy-rules/0.log" Sep 19 09:11:26.462824 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:26.462791 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d7754d644-9x2ww_9aa92914-bb70-47d9-9e69-c30c113b040d/kube-rbac-proxy-metrics/0.log" Sep 19 09:11:29.323727 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:29.323697 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wb8bw/perf-node-gather-daemonset-bsxpf"] Sep 19 09:11:29.324347 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:29.324326 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8d528b8-0afb-4988-bdd2-37fcb87ea948" containerName="gather" Sep 19 09:11:29.324429 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:29.324351 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8d528b8-0afb-4988-bdd2-37fcb87ea948" containerName="gather" Sep 19 09:11:29.324429 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:29.324382 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8d528b8-0afb-4988-bdd2-37fcb87ea948" containerName="copy" Sep 19 09:11:29.324429 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:29.324391 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8d528b8-0afb-4988-bdd2-37fcb87ea948" containerName="copy" Sep 19 09:11:29.324573 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:29.324468 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8d528b8-0afb-4988-bdd2-37fcb87ea948" containerName="gather" Sep 19 09:11:29.324573 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:29.324482 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8d528b8-0afb-4988-bdd2-37fcb87ea948" containerName="copy" Sep 19 09:11:29.327869 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:29.327844 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wb8bw/perf-node-gather-daemonset-bsxpf" Sep 19 09:11:29.341322 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:29.341284 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wb8bw/perf-node-gather-daemonset-bsxpf"] Sep 19 09:11:29.430520 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:29.430480 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8ca88b42-6aaa-42f9-b6e4-9dfc7de8ccd2-podres\") pod \"perf-node-gather-daemonset-bsxpf\" (UID: \"8ca88b42-6aaa-42f9-b6e4-9dfc7de8ccd2\") " pod="openshift-must-gather-wb8bw/perf-node-gather-daemonset-bsxpf" Sep 19 09:11:29.430714 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:29.430534 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8ca88b42-6aaa-42f9-b6e4-9dfc7de8ccd2-lib-modules\") pod \"perf-node-gather-daemonset-bsxpf\" (UID: \"8ca88b42-6aaa-42f9-b6e4-9dfc7de8ccd2\") " pod="openshift-must-gather-wb8bw/perf-node-gather-daemonset-bsxpf" Sep 19 09:11:29.430714 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:29.430576 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvfs5\" (UniqueName: \"kubernetes.io/projected/8ca88b42-6aaa-42f9-b6e4-9dfc7de8ccd2-kube-api-access-zvfs5\") pod \"perf-node-gather-daemonset-bsxpf\" (UID: \"8ca88b42-6aaa-42f9-b6e4-9dfc7de8ccd2\") " pod="openshift-must-gather-wb8bw/perf-node-gather-daemonset-bsxpf" Sep 19 09:11:29.430714 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:29.430612 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ca88b42-6aaa-42f9-b6e4-9dfc7de8ccd2-sys\") pod \"perf-node-gather-daemonset-bsxpf\" (UID: \"8ca88b42-6aaa-42f9-b6e4-9dfc7de8ccd2\") " pod="openshift-must-gather-wb8bw/perf-node-gather-daemonset-bsxpf" Sep 19 09:11:29.430890 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:29.430713 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8ca88b42-6aaa-42f9-b6e4-9dfc7de8ccd2-proc\") pod \"perf-node-gather-daemonset-bsxpf\" (UID: \"8ca88b42-6aaa-42f9-b6e4-9dfc7de8ccd2\") " pod="openshift-must-gather-wb8bw/perf-node-gather-daemonset-bsxpf" Sep 19 09:11:29.531347 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:29.531314 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8ca88b42-6aaa-42f9-b6e4-9dfc7de8ccd2-lib-modules\") pod \"perf-node-gather-daemonset-bsxpf\" (UID: \"8ca88b42-6aaa-42f9-b6e4-9dfc7de8ccd2\") " pod="openshift-must-gather-wb8bw/perf-node-gather-daemonset-bsxpf" Sep 19 09:11:29.531540 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:29.531357 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvfs5\" (UniqueName: \"kubernetes.io/projected/8ca88b42-6aaa-42f9-b6e4-9dfc7de8ccd2-kube-api-access-zvfs5\") pod \"perf-node-gather-daemonset-bsxpf\" (UID: \"8ca88b42-6aaa-42f9-b6e4-9dfc7de8ccd2\") " pod="openshift-must-gather-wb8bw/perf-node-gather-daemonset-bsxpf" Sep 19 09:11:29.531540 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:29.531377 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ca88b42-6aaa-42f9-b6e4-9dfc7de8ccd2-sys\") pod \"perf-node-gather-daemonset-bsxpf\" (UID: \"8ca88b42-6aaa-42f9-b6e4-9dfc7de8ccd2\") " pod="openshift-must-gather-wb8bw/perf-node-gather-daemonset-bsxpf" Sep 19 09:11:29.531540 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:29.531415 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8ca88b42-6aaa-42f9-b6e4-9dfc7de8ccd2-proc\") pod \"perf-node-gather-daemonset-bsxpf\" (UID: \"8ca88b42-6aaa-42f9-b6e4-9dfc7de8ccd2\") " pod="openshift-must-gather-wb8bw/perf-node-gather-daemonset-bsxpf" Sep 19 09:11:29.531540 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:29.531503 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8ca88b42-6aaa-42f9-b6e4-9dfc7de8ccd2-podres\") pod \"perf-node-gather-daemonset-bsxpf\" (UID: \"8ca88b42-6aaa-42f9-b6e4-9dfc7de8ccd2\") " pod="openshift-must-gather-wb8bw/perf-node-gather-daemonset-bsxpf" Sep 19 09:11:29.531540 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:29.531506 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ca88b42-6aaa-42f9-b6e4-9dfc7de8ccd2-sys\") pod \"perf-node-gather-daemonset-bsxpf\" (UID: \"8ca88b42-6aaa-42f9-b6e4-9dfc7de8ccd2\") " pod="openshift-must-gather-wb8bw/perf-node-gather-daemonset-bsxpf" Sep 19 09:11:29.531540 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:29.531508 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8ca88b42-6aaa-42f9-b6e4-9dfc7de8ccd2-lib-modules\") pod \"perf-node-gather-daemonset-bsxpf\" (UID: \"8ca88b42-6aaa-42f9-b6e4-9dfc7de8ccd2\") " pod="openshift-must-gather-wb8bw/perf-node-gather-daemonset-bsxpf" Sep 19 09:11:29.531747 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:29.531586 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8ca88b42-6aaa-42f9-b6e4-9dfc7de8ccd2-proc\") pod \"perf-node-gather-daemonset-bsxpf\" (UID: \"8ca88b42-6aaa-42f9-b6e4-9dfc7de8ccd2\") " pod="openshift-must-gather-wb8bw/perf-node-gather-daemonset-bsxpf" Sep 19 09:11:29.531747 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:29.531602 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8ca88b42-6aaa-42f9-b6e4-9dfc7de8ccd2-podres\") pod \"perf-node-gather-daemonset-bsxpf\" (UID: \"8ca88b42-6aaa-42f9-b6e4-9dfc7de8ccd2\") " pod="openshift-must-gather-wb8bw/perf-node-gather-daemonset-bsxpf" Sep 19 09:11:29.539400 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:29.539369 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvfs5\" (UniqueName: \"kubernetes.io/projected/8ca88b42-6aaa-42f9-b6e4-9dfc7de8ccd2-kube-api-access-zvfs5\") pod \"perf-node-gather-daemonset-bsxpf\" (UID: \"8ca88b42-6aaa-42f9-b6e4-9dfc7de8ccd2\") " pod="openshift-must-gather-wb8bw/perf-node-gather-daemonset-bsxpf" Sep 19 09:11:29.655854 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:29.655779 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wb8bw/perf-node-gather-daemonset-bsxpf" Sep 19 09:11:29.951211 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:29.951134 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wb8bw/perf-node-gather-daemonset-bsxpf"] Sep 19 09:11:29.954962 ip-10-0-143-96 kubenswrapper[2584]: W0919 09:11:29.954929 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8ca88b42_6aaa_42f9_b6e4_9dfc7de8ccd2.slice/crio-7ab87a829112fddf42cf00b915e3c35da5c034ac44a31fe4f4a092e169a78500 WatchSource:0}: Error finding container 7ab87a829112fddf42cf00b915e3c35da5c034ac44a31fe4f4a092e169a78500: Status 404 returned error can't find the container with id 7ab87a829112fddf42cf00b915e3c35da5c034ac44a31fe4f4a092e169a78500 Sep 19 09:11:30.372414 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:30.372388 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-k97bb_9baaaa17-8835-4bc2-9651-683dc6f2bf47/dns/0.log" Sep 19 09:11:30.381752 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:30.381724 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wb8bw/perf-node-gather-daemonset-bsxpf" event={"ID":"8ca88b42-6aaa-42f9-b6e4-9dfc7de8ccd2","Type":"ContainerStarted","Data":"abf9de67a5b06c6dca9618f8ea43df3f9e81dba9dc639e5e578eee645adbe747"} Sep 19 09:11:30.381928 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:30.381778 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wb8bw/perf-node-gather-daemonset-bsxpf" event={"ID":"8ca88b42-6aaa-42f9-b6e4-9dfc7de8ccd2","Type":"ContainerStarted","Data":"7ab87a829112fddf42cf00b915e3c35da5c034ac44a31fe4f4a092e169a78500"} Sep 19 09:11:30.381928 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:30.381910 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wb8bw/perf-node-gather-daemonset-bsxpf" Sep 19 09:11:30.409847 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:30.409794 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wb8bw/perf-node-gather-daemonset-bsxpf" podStartSLOduration=1.4097790620000001 podStartE2EDuration="1.409779062s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 09:11:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:11:30.408159561 +0000 UTC m=+3040.138256161" watchObservedRunningTime="2026-09-19 09:11:30.409779062 +0000 UTC m=+3040.139875663" Sep 19 09:11:30.411990 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:30.411968 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-k97bb_9baaaa17-8835-4bc2-9651-683dc6f2bf47/kube-rbac-proxy/0.log" Sep 19 09:11:30.576995 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:30.576968 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7mwjp_e3a2c7d3-39cd-48fe-b472-cc9bb9cac54e/dns-node-resolver/0.log" Sep 19 09:11:31.205815 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:31.205789 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vlbrv_e4d94997-9978-4be2-b81c-3a610fd1b54e/node-ca/0.log" Sep 19 09:11:32.268533 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:32.268507 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2z6p9_86b5ce2f-cf90-4c06-8692-7041dee6196d/serve-healthcheck-canary/0.log" Sep 19 09:11:32.910500 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:32.910476 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j2brr_dcd59d2f-1e60-44da-9855-685123b5ea73/kube-rbac-proxy/0.log" Sep 19 09:11:32.932239 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:32.932214 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j2brr_dcd59d2f-1e60-44da-9855-685123b5ea73/exporter/0.log" Sep 19 09:11:32.953270 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:32.953240 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j2brr_dcd59d2f-1e60-44da-9855-685123b5ea73/extractor/0.log" Sep 19 09:11:35.286038 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:35.285944 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-645f9c8fd6-2nz56_5990292a-9e8e-4da6-9d8c-f2c30058ced5/manager/0.log" Sep 19 09:11:35.434621 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:35.434585 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-jl9hs_21d90b22-c52c-44a7-8767-7e477be73053/s3-init/0.log" Sep 19 09:11:35.451812 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:35.451787 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-jl9hs_21d90b22-c52c-44a7-8767-7e477be73053/download-hf-model/0.log" Sep 19 09:11:36.395826 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:36.395800 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wb8bw/perf-node-gather-daemonset-bsxpf" Sep 19 09:11:41.233516 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:41.233481 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jgn8b_55c84c99-604b-49d6-8ba9-01e04e3accda/kube-multus-additional-cni-plugins/0.log" Sep 19 09:11:41.255373 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:41.255347 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jgn8b_55c84c99-604b-49d6-8ba9-01e04e3accda/egress-router-binary-copy/0.log" Sep 19 09:11:41.276393 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:41.276367 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jgn8b_55c84c99-604b-49d6-8ba9-01e04e3accda/cni-plugins/0.log" Sep 19 09:11:41.297350 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:41.297325 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jgn8b_55c84c99-604b-49d6-8ba9-01e04e3accda/bond-cni-plugin/0.log" Sep 19 09:11:41.320154 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:41.320125 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jgn8b_55c84c99-604b-49d6-8ba9-01e04e3accda/routeoverride-cni/0.log" Sep 19 09:11:41.340562 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:41.340505 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jgn8b_55c84c99-604b-49d6-8ba9-01e04e3accda/whereabouts-cni-bincopy/0.log" Sep 19 09:11:41.360921 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:41.360899 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jgn8b_55c84c99-604b-49d6-8ba9-01e04e3accda/whereabouts-cni/0.log" Sep 19 09:11:41.636007 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:41.635923 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-x9knk_dbe6e4ed-b0e6-4b36-b569-8fdef3f6d4ee/kube-multus/0.log" Sep 19 09:11:41.713541 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:41.713510 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kqz5p_35c26dae-8ddc-4ea9-b6d7-6de02274508c/network-metrics-daemon/0.log" Sep 19 09:11:41.735632 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:41.735607 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kqz5p_35c26dae-8ddc-4ea9-b6d7-6de02274508c/kube-rbac-proxy/0.log" Sep 19 09:11:42.751122 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:42.751093 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2hqv_3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136/ovn-controller/0.log" Sep 19 09:11:42.771389 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:42.771363 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2hqv_3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136/ovn-acl-logging/0.log" Sep 19 09:11:42.771538 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:42.771412 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2hqv_3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136/ovn-acl-logging/1.log" Sep 19 09:11:42.791675 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:42.791653 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2hqv_3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136/kube-rbac-proxy-node/0.log" Sep 19 09:11:42.813291 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:42.813258 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2hqv_3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136/kube-rbac-proxy-ovn-metrics/0.log" Sep 19 09:11:42.836121 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:42.836097 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2hqv_3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136/northd/0.log" Sep 19 09:11:42.861034 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:42.861000 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2hqv_3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136/nbdb/0.log" Sep 19 09:11:42.882881 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:42.882856 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2hqv_3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136/sbdb/0.log" Sep 19 09:11:42.927766 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:42.927719 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l2hqv_3b1aa1b2-0b64-4fa5-be7d-8325bf0c5136/ovnkube-controller/0.log" Sep 19 09:11:44.103510 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:44.103480 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-h2qgv_1f40898d-6f69-48bc-8af6-3224a163f776/network-check-target-container/0.log" Sep 19 09:11:45.014613 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:45.014585 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-hmhmw_340df34f-ef23-43c5-a79a-aa7bd01f7fda/iptables-alerter/0.log" Sep 19 09:11:45.747852 ip-10-0-143-96 kubenswrapper[2584]: I0919 09:11:45.747815 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-lndpt_51eaaa01-f96a-4933-a1c3-54b7c1ac2a72/tuned/0.log"