Sep 10 12:45:39.490460 ip-10-0-139-146 systemd[1]: Starting Kubernetes Kubelet... Sep 10 12:45:39.901863 ip-10-0-139-146 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 12:45:39.901863 ip-10-0-139-146 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 10 12:45:39.901863 ip-10-0-139-146 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 12:45:39.901863 ip-10-0-139-146 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 10 12:45:39.901863 ip-10-0-139-146 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 12:45:39.904459 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.904366 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 10 12:45:39.907938 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.907921 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 12:45:39.907938 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.907938 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 12:45:39.908008 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.907943 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 12:45:39.908008 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.907947 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 12:45:39.908008 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.907950 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 12:45:39.908008 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.907954 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 12:45:39.908008 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.907957 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 12:45:39.908008 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.907960 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 12:45:39.908008 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.907963 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 12:45:39.908008 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.907966 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 12:45:39.908008 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.907969 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 12:45:39.908008 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.907972 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 12:45:39.908008 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.907975 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 12:45:39.908008 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.907978 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 12:45:39.908008 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.907981 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 12:45:39.908008 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.907984 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 12:45:39.908008 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.907987 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 12:45:39.908008 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.907989 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 12:45:39.908008 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.907992 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 12:45:39.908008 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.907995 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 12:45:39.908008 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.907998 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 12:45:39.908008 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908006 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 12:45:39.908489 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908009 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 12:45:39.908489 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908012 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 12:45:39.908489 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908016 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 12:45:39.908489 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908018 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 12:45:39.908489 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908021 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 12:45:39.908489 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908024 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 12:45:39.908489 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908026 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 12:45:39.908489 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908029 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 12:45:39.908489 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908032 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 12:45:39.908489 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908034 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 12:45:39.908489 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908037 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 12:45:39.908489 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908039 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 12:45:39.908489 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908042 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 12:45:39.908489 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908045 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 12:45:39.908489 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908052 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 12:45:39.908489 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908054 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 12:45:39.908489 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908057 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 12:45:39.908489 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908060 2577 feature_gate.go:328] unrecognized feature gate: Example Sep 10 12:45:39.908489 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908062 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 12:45:39.908489 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908065 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 12:45:39.909012 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908067 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 12:45:39.909012 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908070 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 12:45:39.909012 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908072 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 12:45:39.909012 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908074 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 12:45:39.909012 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908077 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 12:45:39.909012 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908079 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 12:45:39.909012 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908082 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 12:45:39.909012 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908084 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 12:45:39.909012 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908087 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 12:45:39.909012 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908089 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 12:45:39.909012 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908092 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 12:45:39.909012 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908094 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 12:45:39.909012 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908097 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 12:45:39.909012 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908100 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 12:45:39.909012 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908103 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 12:45:39.909012 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908106 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 12:45:39.909012 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908108 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 12:45:39.909012 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908111 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 12:45:39.909012 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908113 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 12:45:39.909505 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908117 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 12:45:39.909505 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908119 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 12:45:39.909505 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908122 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 12:45:39.909505 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908124 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 12:45:39.909505 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908127 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 12:45:39.909505 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908130 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 12:45:39.909505 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908132 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 12:45:39.909505 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908136 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 12:45:39.909505 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908150 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 12:45:39.909505 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908153 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 12:45:39.909505 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908155 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 12:45:39.909505 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908158 2577 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 12:45:39.909505 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908160 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 12:45:39.909505 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908163 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 12:45:39.909505 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908165 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 12:45:39.909505 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908168 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 12:45:39.909505 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908170 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 12:45:39.909505 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908173 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 12:45:39.909505 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908176 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 12:45:39.909505 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908178 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 12:45:39.910002 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908181 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 12:45:39.910002 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908183 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 12:45:39.910002 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908186 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 12:45:39.910002 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908188 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 12:45:39.910002 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908193 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 12:45:39.910002 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908198 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 12:45:39.910002 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908203 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 12:45:39.910002 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908206 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 12:45:39.910002 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908209 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 12:45:39.910002 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908212 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 12:45:39.910002 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908215 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 12:45:39.910002 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908218 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 12:45:39.910002 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908220 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 12:45:39.910002 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908223 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 12:45:39.910002 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908226 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 12:45:39.910002 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908228 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 12:45:39.910002 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908230 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 12:45:39.910002 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908233 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 12:45:39.910002 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908930 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 12:45:39.910482 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908937 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 12:45:39.910482 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908939 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 12:45:39.910482 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908942 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 12:45:39.910482 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908945 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 12:45:39.910482 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908947 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 12:45:39.910482 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908950 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 12:45:39.910482 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908953 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 12:45:39.910482 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908955 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 12:45:39.910482 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908958 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 12:45:39.910482 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908960 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 12:45:39.910482 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908963 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 12:45:39.910482 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908965 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 12:45:39.910482 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908968 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 12:45:39.910482 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908970 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 12:45:39.910482 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908973 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 12:45:39.910482 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908975 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 12:45:39.910482 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908978 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 12:45:39.910482 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908981 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 12:45:39.910482 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908983 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 12:45:39.910482 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908988 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 12:45:39.910971 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908992 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 12:45:39.910971 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908994 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 12:45:39.910971 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908997 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 12:45:39.910971 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.908999 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 12:45:39.910971 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909002 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 12:45:39.910971 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909004 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 12:45:39.910971 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909007 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 12:45:39.910971 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909009 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 12:45:39.910971 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909012 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 12:45:39.910971 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909015 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 12:45:39.910971 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909018 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 12:45:39.910971 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909021 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 12:45:39.910971 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909024 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 12:45:39.910971 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909027 2577 feature_gate.go:328] unrecognized feature gate: Example Sep 10 12:45:39.910971 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909029 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 12:45:39.910971 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909032 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 12:45:39.910971 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909035 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 12:45:39.910971 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909037 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 12:45:39.910971 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909040 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 12:45:39.911683 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909043 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 12:45:39.911683 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909045 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 12:45:39.911683 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909048 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 12:45:39.911683 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909050 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 12:45:39.911683 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909053 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 12:45:39.911683 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909055 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 12:45:39.911683 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909058 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 12:45:39.911683 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909060 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 12:45:39.911683 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909063 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 12:45:39.911683 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909066 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 12:45:39.911683 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909068 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 12:45:39.911683 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909071 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 12:45:39.911683 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909074 2577 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 12:45:39.911683 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909077 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 12:45:39.911683 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909080 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 12:45:39.911683 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909083 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 12:45:39.911683 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909085 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 12:45:39.911683 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909088 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 12:45:39.911683 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909091 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 12:45:39.911683 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909093 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 12:45:39.912337 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909096 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 12:45:39.912337 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909098 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 12:45:39.912337 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909101 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 12:45:39.912337 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909103 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 12:45:39.912337 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909106 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 12:45:39.912337 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909109 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 12:45:39.912337 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909111 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 12:45:39.912337 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909114 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 12:45:39.912337 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909117 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 12:45:39.912337 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909121 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 12:45:39.912337 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909125 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 12:45:39.912337 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909128 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 12:45:39.912337 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909130 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 12:45:39.912337 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909133 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 12:45:39.912337 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909135 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 12:45:39.912337 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909138 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 12:45:39.912337 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909155 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 12:45:39.912337 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909158 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 12:45:39.912337 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909161 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 12:45:39.912337 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909163 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 12:45:39.912882 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909166 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 12:45:39.912882 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909172 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 12:45:39.912882 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909176 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 12:45:39.912882 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909180 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 12:45:39.912882 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909183 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 12:45:39.912882 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909186 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 12:45:39.912882 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909189 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 12:45:39.912882 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909192 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 12:45:39.912882 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909195 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 12:45:39.912882 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909198 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 12:45:39.912882 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909201 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 12:45:39.912882 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909204 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 12:45:39.912882 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909206 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 12:45:39.912882 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909209 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 12:45:39.912882 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909211 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 12:45:39.912882 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909214 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 12:45:39.912882 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909216 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 12:45:39.912882 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909220 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 12:45:39.912882 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909224 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 12:45:39.913387 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909710 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 12:45:39.913387 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909722 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 12:45:39.913387 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909725 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 12:45:39.913387 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909730 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 12:45:39.913387 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909734 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 12:45:39.913387 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909738 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 12:45:39.913387 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909741 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 12:45:39.913387 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909744 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 12:45:39.913387 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909747 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 12:45:39.913387 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909750 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 12:45:39.913387 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909753 2577 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 12:45:39.913387 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909755 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 12:45:39.913387 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909758 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 12:45:39.913387 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909761 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 12:45:39.913387 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909763 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 12:45:39.913387 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909766 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 12:45:39.913387 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909769 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 12:45:39.913387 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909771 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 12:45:39.913387 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909774 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 12:45:39.913387 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909776 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 12:45:39.913881 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909779 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 12:45:39.913881 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909782 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 12:45:39.913881 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909787 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 12:45:39.913881 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909791 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 12:45:39.913881 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909794 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 12:45:39.913881 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909798 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 12:45:39.913881 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909801 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 12:45:39.913881 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909803 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 12:45:39.913881 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909806 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 12:45:39.913881 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909808 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 12:45:39.913881 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909811 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 12:45:39.913881 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909814 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 12:45:39.913881 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909816 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 12:45:39.913881 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909820 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 12:45:39.913881 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909822 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 12:45:39.913881 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909825 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 12:45:39.913881 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909828 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 12:45:39.913881 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909831 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 12:45:39.913881 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909833 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 12:45:39.914359 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909836 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 12:45:39.914359 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909839 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 12:45:39.914359 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909841 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 12:45:39.914359 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909844 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 12:45:39.914359 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909848 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 12:45:39.914359 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909852 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 12:45:39.914359 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909854 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 12:45:39.914359 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909857 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 12:45:39.914359 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909860 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 12:45:39.914359 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909862 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 12:45:39.914359 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909865 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 12:45:39.914359 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909867 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 12:45:39.914359 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909870 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 12:45:39.914359 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909873 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 12:45:39.914359 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909875 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 12:45:39.914359 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909878 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 12:45:39.914359 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909881 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 12:45:39.914359 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909884 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 12:45:39.914359 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909887 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 12:45:39.914359 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909890 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 12:45:39.914865 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909893 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 12:45:39.914865 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909895 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 12:45:39.914865 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909898 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 12:45:39.914865 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909901 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 12:45:39.914865 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909903 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 12:45:39.914865 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909906 2577 feature_gate.go:328] unrecognized feature gate: Example Sep 10 12:45:39.914865 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909909 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 12:45:39.914865 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909912 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 12:45:39.914865 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909915 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 12:45:39.914865 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909917 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 12:45:39.914865 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909920 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 12:45:39.914865 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909922 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 12:45:39.914865 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909925 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 12:45:39.914865 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909927 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 12:45:39.914865 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909930 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 12:45:39.914865 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909932 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 12:45:39.914865 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909935 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 12:45:39.914865 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909937 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 12:45:39.914865 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909940 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 12:45:39.914865 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909942 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 12:45:39.915369 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909945 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 12:45:39.915369 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909948 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 12:45:39.915369 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909950 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 12:45:39.915369 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909953 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 12:45:39.915369 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909955 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 12:45:39.915369 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909962 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 12:45:39.915369 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909967 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 12:45:39.915369 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909969 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 12:45:39.915369 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909972 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 12:45:39.915369 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909976 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 12:45:39.915369 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909980 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 12:45:39.915369 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909983 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 12:45:39.915369 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909986 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 12:45:39.915369 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909989 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 12:45:39.915369 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909992 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 12:45:39.915369 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909995 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 12:45:39.915369 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.909997 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 12:45:39.915369 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.910000 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 12:45:39.915369 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.910003 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 12:45:39.915825 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.910005 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 12:45:39.915825 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910091 2577 flags.go:64] FLAG: --address="0.0.0.0" Sep 10 12:45:39.915825 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910135 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 10 12:45:39.915825 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910159 2577 flags.go:64] FLAG: --anonymous-auth="true" Sep 10 12:45:39.915825 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910164 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 10 12:45:39.915825 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910169 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 10 12:45:39.915825 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910172 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 10 12:45:39.915825 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910176 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 10 12:45:39.915825 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910181 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 10 12:45:39.915825 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910184 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 10 12:45:39.915825 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910187 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 10 12:45:39.915825 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910190 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 10 12:45:39.915825 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910194 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 10 12:45:39.915825 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910197 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 10 12:45:39.915825 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910200 2577 flags.go:64] FLAG: --cgroup-root="" Sep 10 12:45:39.915825 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910204 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 10 12:45:39.915825 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910208 2577 flags.go:64] FLAG: --client-ca-file="" Sep 10 12:45:39.915825 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910211 2577 flags.go:64] FLAG: --cloud-provider="external" Sep 10 12:45:39.915825 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910214 2577 flags.go:64] FLAG: --cluster-dns="[]" Sep 10 12:45:39.915825 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910220 2577 flags.go:64] FLAG: --cluster-domain="" Sep 10 12:45:39.915825 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910223 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 10 12:45:39.915825 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910226 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 10 12:45:39.915825 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910229 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 10 12:45:39.916419 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910241 2577 flags.go:64] FLAG: --container-log-max-files="5" Sep 10 12:45:39.916419 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910246 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 10 12:45:39.916419 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910249 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 10 12:45:39.916419 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910252 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 10 12:45:39.916419 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910255 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 10 12:45:39.916419 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910258 2577 flags.go:64] FLAG: --contention-profiling="false" Sep 10 12:45:39.916419 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910261 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 10 12:45:39.916419 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910264 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 10 12:45:39.916419 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910267 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 10 12:45:39.916419 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910270 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 10 12:45:39.916419 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910275 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 10 12:45:39.916419 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910278 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 10 12:45:39.916419 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910281 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 10 12:45:39.916419 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910284 2577 flags.go:64] FLAG: --enable-load-reader="false" Sep 10 12:45:39.916419 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910286 2577 flags.go:64] FLAG: --enable-server="true" Sep 10 12:45:39.916419 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910290 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 10 12:45:39.916419 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910297 2577 flags.go:64] FLAG: --event-burst="100" Sep 10 12:45:39.916419 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910300 2577 flags.go:64] FLAG: --event-qps="50" Sep 10 12:45:39.916419 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910303 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 10 12:45:39.916419 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910306 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 10 12:45:39.916419 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910309 2577 flags.go:64] FLAG: --eviction-hard="" Sep 10 12:45:39.916419 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910313 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 10 12:45:39.916419 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910316 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 10 12:45:39.916419 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910319 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 10 12:45:39.916419 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910322 2577 flags.go:64] FLAG: --eviction-soft="" Sep 10 12:45:39.917023 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910325 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 10 12:45:39.917023 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910328 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 10 12:45:39.917023 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910331 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 10 12:45:39.917023 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910335 2577 flags.go:64] FLAG: --experimental-mounter-path="" Sep 10 12:45:39.917023 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910339 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 10 12:45:39.917023 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910341 2577 flags.go:64] FLAG: --fail-swap-on="true" Sep 10 12:45:39.917023 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910344 2577 flags.go:64] FLAG: --feature-gates="" Sep 10 12:45:39.917023 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910348 2577 flags.go:64] FLAG: --file-check-frequency="20s" Sep 10 12:45:39.917023 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910357 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 10 12:45:39.917023 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910360 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 10 12:45:39.917023 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910363 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 10 12:45:39.917023 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910366 2577 flags.go:64] FLAG: --healthz-port="10248" Sep 10 12:45:39.917023 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910369 2577 flags.go:64] FLAG: --help="false" Sep 10 12:45:39.917023 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910372 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-139-146.ec2.internal" Sep 10 12:45:39.917023 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910375 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 10 12:45:39.917023 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910378 2577 flags.go:64] FLAG: --http-check-frequency="20s" Sep 10 12:45:39.917023 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910381 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 10 12:45:39.917023 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910384 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 10 12:45:39.917023 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910388 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 10 12:45:39.917023 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910390 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 10 12:45:39.917023 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910393 2577 flags.go:64] FLAG: --image-service-endpoint="" Sep 10 12:45:39.917023 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910396 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 10 12:45:39.917023 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910399 2577 flags.go:64] FLAG: --kube-api-burst="100" Sep 10 12:45:39.917630 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910402 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 10 12:45:39.917630 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910405 2577 flags.go:64] FLAG: --kube-api-qps="50" Sep 10 12:45:39.917630 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910408 2577 flags.go:64] FLAG: --kube-reserved="" Sep 10 12:45:39.917630 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910411 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 10 12:45:39.917630 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910414 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 10 12:45:39.917630 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910417 2577 flags.go:64] FLAG: --kubelet-cgroups="" Sep 10 12:45:39.917630 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910420 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 10 12:45:39.917630 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910423 2577 flags.go:64] FLAG: --lock-file="" Sep 10 12:45:39.917630 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910426 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 10 12:45:39.917630 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910429 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 10 12:45:39.917630 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910432 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 10 12:45:39.917630 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910437 2577 flags.go:64] FLAG: --log-json-split-stream="false" Sep 10 12:45:39.917630 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910442 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 10 12:45:39.917630 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910445 2577 flags.go:64] FLAG: --log-text-split-stream="false" Sep 10 12:45:39.917630 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910448 2577 flags.go:64] FLAG: --logging-format="text" Sep 10 12:45:39.917630 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910450 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 10 12:45:39.917630 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910454 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 10 12:45:39.917630 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910457 2577 flags.go:64] FLAG: --manifest-url="" Sep 10 12:45:39.917630 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910465 2577 flags.go:64] FLAG: --manifest-url-header="" Sep 10 12:45:39.917630 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910470 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 10 12:45:39.917630 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910473 2577 flags.go:64] FLAG: --max-open-files="1000000" Sep 10 12:45:39.917630 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910477 2577 flags.go:64] FLAG: --max-pods="110" Sep 10 12:45:39.917630 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910480 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 10 12:45:39.917630 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910483 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 10 12:45:39.917630 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910486 2577 flags.go:64] FLAG: --memory-manager-policy="None" Sep 10 12:45:39.918366 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910489 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 10 12:45:39.918366 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910492 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 10 12:45:39.918366 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910495 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 10 12:45:39.918366 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910498 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 10 12:45:39.918366 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910506 2577 flags.go:64] FLAG: --node-status-max-images="50" Sep 10 12:45:39.918366 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910510 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 10 12:45:39.918366 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910513 2577 flags.go:64] FLAG: --oom-score-adj="-999" Sep 10 12:45:39.918366 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910516 2577 flags.go:64] FLAG: --pod-cidr="" Sep 10 12:45:39.918366 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910519 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 10 12:45:39.918366 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910524 2577 flags.go:64] FLAG: --pod-manifest-path="" Sep 10 12:45:39.918366 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910527 2577 flags.go:64] FLAG: --pod-max-pids="-1" Sep 10 12:45:39.918366 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910530 2577 flags.go:64] FLAG: --pods-per-core="0" Sep 10 12:45:39.918366 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910533 2577 flags.go:64] FLAG: --port="10250" Sep 10 12:45:39.918366 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910536 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 10 12:45:39.918366 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910539 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0660c637ae89c63a0" Sep 10 12:45:39.918366 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910543 2577 flags.go:64] FLAG: --qos-reserved="" Sep 10 12:45:39.918366 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910546 2577 flags.go:64] FLAG: --read-only-port="10255" Sep 10 12:45:39.918366 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910548 2577 flags.go:64] FLAG: --register-node="true" Sep 10 12:45:39.918366 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910551 2577 flags.go:64] FLAG: --register-with-taints="" Sep 10 12:45:39.918366 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910555 2577 flags.go:64] FLAG: --registry-burst="10" Sep 10 12:45:39.918366 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910559 2577 flags.go:64] FLAG: --registry-qps="5" Sep 10 12:45:39.918366 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910561 2577 flags.go:64] FLAG: --reserved-cpus="" Sep 10 12:45:39.918366 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910564 2577 flags.go:64] FLAG: --reserved-memory="" Sep 10 12:45:39.918366 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910568 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 10 12:45:39.918366 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910571 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 10 12:45:39.918971 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910574 2577 flags.go:64] FLAG: --rotate-certificates="false" Sep 10 12:45:39.918971 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910582 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 10 12:45:39.918971 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910585 2577 flags.go:64] FLAG: --runonce="false" Sep 10 12:45:39.918971 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910588 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 10 12:45:39.918971 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910591 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 10 12:45:39.918971 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910594 2577 flags.go:64] FLAG: --seccomp-default="false" Sep 10 12:45:39.918971 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910597 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 10 12:45:39.918971 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910600 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 10 12:45:39.918971 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910603 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 10 12:45:39.918971 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910606 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 10 12:45:39.918971 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910609 2577 flags.go:64] FLAG: --storage-driver-password="root" Sep 10 12:45:39.918971 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910612 2577 flags.go:64] FLAG: --storage-driver-secure="false" Sep 10 12:45:39.918971 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910615 2577 flags.go:64] FLAG: --storage-driver-table="stats" Sep 10 12:45:39.918971 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910617 2577 flags.go:64] FLAG: --storage-driver-user="root" Sep 10 12:45:39.918971 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910620 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 10 12:45:39.918971 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910623 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 10 12:45:39.918971 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910626 2577 flags.go:64] FLAG: --system-cgroups="" Sep 10 12:45:39.918971 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910629 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 10 12:45:39.918971 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910634 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 10 12:45:39.918971 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910637 2577 flags.go:64] FLAG: --tls-cert-file="" Sep 10 12:45:39.918971 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910640 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 10 12:45:39.918971 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910646 2577 flags.go:64] FLAG: --tls-min-version="" Sep 10 12:45:39.918971 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910651 2577 flags.go:64] FLAG: --tls-private-key-file="" Sep 10 12:45:39.918971 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910654 2577 flags.go:64] FLAG: --topology-manager-policy="none" Sep 10 12:45:39.918971 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910657 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 10 12:45:39.919638 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910659 2577 flags.go:64] FLAG: --topology-manager-scope="container" Sep 10 12:45:39.919638 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910662 2577 flags.go:64] FLAG: --v="2" Sep 10 12:45:39.919638 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910667 2577 flags.go:64] FLAG: --version="false" Sep 10 12:45:39.919638 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910671 2577 flags.go:64] FLAG: --vmodule="" Sep 10 12:45:39.919638 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910674 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 10 12:45:39.919638 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.910678 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 10 12:45:39.919638 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.910810 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 12:45:39.919638 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.910814 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 12:45:39.919638 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.910817 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 12:45:39.919638 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.910867 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 12:45:39.919638 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911199 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 12:45:39.919638 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911221 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 12:45:39.919638 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911232 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 12:45:39.919638 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911242 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 12:45:39.919638 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911252 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 12:45:39.919638 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911260 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 12:45:39.919638 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911269 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 12:45:39.919638 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911275 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 12:45:39.919638 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911283 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 12:45:39.919638 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911290 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 12:45:39.919638 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911297 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 12:45:39.920155 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911305 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 12:45:39.920155 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911313 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 12:45:39.920155 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911326 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 12:45:39.920155 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911333 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 12:45:39.920155 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911340 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 12:45:39.920155 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911348 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 12:45:39.920155 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911354 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 12:45:39.920155 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911363 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 12:45:39.920155 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911375 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 12:45:39.920155 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911382 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 12:45:39.920155 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911390 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 12:45:39.920155 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911397 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 12:45:39.920155 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911404 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 12:45:39.920155 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911412 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 12:45:39.920155 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911424 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 12:45:39.920155 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911431 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 12:45:39.920155 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911439 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 12:45:39.920155 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911445 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 12:45:39.920155 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911452 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 12:45:39.920155 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911459 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 12:45:39.920635 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911465 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 12:45:39.920635 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911527 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 12:45:39.920635 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911535 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 12:45:39.920635 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911542 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 12:45:39.920635 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911549 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 12:45:39.920635 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911556 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 12:45:39.920635 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911563 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 12:45:39.920635 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911575 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 12:45:39.920635 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911582 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 12:45:39.920635 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911589 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 12:45:39.920635 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911596 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 12:45:39.920635 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911603 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 12:45:39.920635 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911610 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 12:45:39.920635 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911616 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 12:45:39.920635 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911623 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 12:45:39.920635 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911628 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 12:45:39.920635 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911632 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 12:45:39.920635 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911636 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 12:45:39.920635 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911640 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 12:45:39.921095 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911645 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 12:45:39.921095 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911655 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 12:45:39.921095 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911659 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 12:45:39.921095 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911663 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 12:45:39.921095 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911667 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 12:45:39.921095 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911671 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 12:45:39.921095 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911675 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 12:45:39.921095 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911679 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 12:45:39.921095 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911684 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 12:45:39.921095 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911690 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 12:45:39.921095 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911695 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 12:45:39.921095 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911699 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 12:45:39.921095 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911704 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 12:45:39.921095 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911713 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 12:45:39.921095 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911717 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 12:45:39.921095 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911750 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 12:45:39.921095 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911756 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 12:45:39.921095 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911761 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 12:45:39.921095 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911766 2577 feature_gate.go:328] unrecognized feature gate: Example Sep 10 12:45:39.921565 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911770 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 12:45:39.921565 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911775 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 12:45:39.921565 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911779 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 12:45:39.921565 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911783 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 12:45:39.921565 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911787 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 12:45:39.921565 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911792 2577 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 12:45:39.921565 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911796 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 12:45:39.921565 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911805 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 12:45:39.921565 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911809 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 12:45:39.921565 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911813 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 12:45:39.921565 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911817 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 12:45:39.921565 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911822 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 12:45:39.921565 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911826 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 12:45:39.921565 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911830 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 12:45:39.921565 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911836 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 12:45:39.921565 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911840 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 12:45:39.921565 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911844 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 12:45:39.921565 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911848 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 12:45:39.921565 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911852 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 12:45:39.921565 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911863 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 12:45:39.922053 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911867 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 12:45:39.922053 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911872 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 12:45:39.922053 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911877 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 12:45:39.922053 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911881 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 12:45:39.922053 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911886 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 12:45:39.922053 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.911890 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 12:45:39.922053 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.912456 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 12:45:39.922053 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.919965 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 10 12:45:39.922053 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.919981 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 10 12:45:39.922053 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.920850 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 10 12:45:39.922053 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.920858 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 10 12:45:39.922053 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.920917 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 12:45:39.922053 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.920922 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 12:45:39.922053 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.920925 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 12:45:39.922053 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.920929 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 12:45:39.922472 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.920931 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 12:45:39.922472 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.920934 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 12:45:39.922472 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.920937 2577 feature_gate.go:328] unrecognized feature gate: Example Sep 10 12:45:39.922472 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.920940 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 12:45:39.922472 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.920943 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 12:45:39.922472 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.920945 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 12:45:39.922472 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.920948 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 12:45:39.922472 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.920951 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 12:45:39.922472 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.920953 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 12:45:39.922472 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.920956 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 12:45:39.922472 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.920958 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 12:45:39.922472 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.920961 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 12:45:39.922472 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.920965 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 12:45:39.922472 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.920969 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 12:45:39.922472 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.920974 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 12:45:39.922472 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.920977 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 12:45:39.922472 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.920980 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 12:45:39.922472 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.920984 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 12:45:39.922472 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.920987 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 12:45:39.922926 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.920990 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 12:45:39.922926 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.920992 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 12:45:39.922926 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.920995 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 12:45:39.922926 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.920997 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 12:45:39.922926 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921000 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 12:45:39.922926 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921002 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 12:45:39.922926 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921005 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 12:45:39.922926 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921007 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 12:45:39.922926 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921010 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 12:45:39.922926 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921012 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 12:45:39.922926 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921015 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 12:45:39.922926 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921018 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 12:45:39.922926 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921020 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 12:45:39.922926 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921023 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 12:45:39.922926 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921025 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 12:45:39.922926 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921028 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 12:45:39.922926 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921030 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 12:45:39.922926 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921033 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 12:45:39.922926 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921036 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 12:45:39.922926 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921038 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 12:45:39.923475 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921041 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 12:45:39.923475 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921044 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 12:45:39.923475 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921046 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 12:45:39.923475 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921049 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 12:45:39.923475 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921052 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 12:45:39.923475 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921055 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 12:45:39.923475 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921058 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 12:45:39.923475 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921061 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 12:45:39.923475 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921064 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 12:45:39.923475 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921066 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 12:45:39.923475 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921069 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 12:45:39.923475 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921073 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 12:45:39.923475 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921076 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 12:45:39.923475 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921079 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 12:45:39.923475 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921082 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 12:45:39.923475 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921085 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 12:45:39.923475 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921088 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 12:45:39.923475 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921091 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 12:45:39.923475 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921093 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 12:45:39.923923 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921097 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 12:45:39.923923 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921101 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 12:45:39.923923 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921105 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 12:45:39.923923 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921108 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 12:45:39.923923 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921111 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 12:45:39.923923 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921113 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 12:45:39.923923 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921116 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 12:45:39.923923 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921119 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 12:45:39.923923 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921122 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 12:45:39.923923 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921124 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 12:45:39.923923 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921127 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 12:45:39.923923 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921130 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 12:45:39.923923 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921132 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 12:45:39.923923 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921135 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 12:45:39.923923 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921137 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 12:45:39.923923 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921154 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 12:45:39.923923 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921157 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 12:45:39.923923 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921160 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 12:45:39.923923 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921164 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 12:45:39.923923 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921166 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 12:45:39.924426 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921169 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 12:45:39.924426 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921171 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 12:45:39.924426 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921174 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 12:45:39.924426 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921176 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 12:45:39.924426 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921179 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 12:45:39.924426 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921182 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 12:45:39.924426 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921185 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 12:45:39.924426 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921187 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 12:45:39.924426 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921190 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 12:45:39.924426 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921193 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 12:45:39.924426 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921196 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 12:45:39.924426 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921198 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 12:45:39.924426 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921201 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 12:45:39.924426 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921203 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 12:45:39.924426 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921206 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 12:45:39.924426 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921208 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 12:45:39.924426 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921211 2577 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 12:45:39.924832 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.921216 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 12:45:39.924832 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921346 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 12:45:39.924832 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921350 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 12:45:39.924832 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921353 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 12:45:39.924832 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921356 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 12:45:39.924832 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921360 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 12:45:39.924832 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921362 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 12:45:39.924832 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921365 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 12:45:39.924832 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921368 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 12:45:39.924832 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921370 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 12:45:39.924832 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921373 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 12:45:39.924832 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921376 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 12:45:39.924832 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921378 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 12:45:39.924832 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921381 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 12:45:39.924832 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921384 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 12:45:39.925217 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921387 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 12:45:39.925217 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921390 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 12:45:39.925217 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921392 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 12:45:39.925217 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921395 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 12:45:39.925217 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921397 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 12:45:39.925217 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921400 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 12:45:39.925217 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921402 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 12:45:39.925217 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921405 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 12:45:39.925217 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921407 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 12:45:39.925217 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921410 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 12:45:39.925217 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921412 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 12:45:39.925217 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921415 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 12:45:39.925217 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921417 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 12:45:39.925217 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921420 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 12:45:39.925217 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921422 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 12:45:39.925217 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921425 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 12:45:39.925217 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921427 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 12:45:39.925217 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921430 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 12:45:39.925217 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921432 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 12:45:39.925217 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921435 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 12:45:39.925691 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921438 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 12:45:39.925691 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921441 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 12:45:39.925691 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921444 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 12:45:39.925691 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921447 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 12:45:39.925691 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921449 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 12:45:39.925691 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921451 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 12:45:39.925691 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921454 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 12:45:39.925691 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921457 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 12:45:39.925691 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921460 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 12:45:39.925691 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921463 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 12:45:39.925691 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921465 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 12:45:39.925691 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921468 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 12:45:39.925691 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921471 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 12:45:39.925691 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921473 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 12:45:39.925691 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921476 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 12:45:39.925691 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921478 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 12:45:39.925691 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921482 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 12:45:39.925691 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921485 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 12:45:39.925691 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921488 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 12:45:39.926170 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921491 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 12:45:39.926170 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921494 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 12:45:39.926170 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921497 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 12:45:39.926170 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921500 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 12:45:39.926170 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921503 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 12:45:39.926170 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921506 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 12:45:39.926170 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921509 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 12:45:39.926170 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921511 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 12:45:39.926170 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921514 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 12:45:39.926170 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921517 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 12:45:39.926170 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921519 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 12:45:39.926170 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921522 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 12:45:39.926170 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921524 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 12:45:39.926170 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921527 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 12:45:39.926170 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921529 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 12:45:39.926170 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921532 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 12:45:39.926170 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921534 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 12:45:39.926170 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921537 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 12:45:39.926170 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921539 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 12:45:39.926170 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921542 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 12:45:39.926653 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921544 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 12:45:39.926653 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921547 2577 feature_gate.go:328] unrecognized feature gate: Example Sep 10 12:45:39.926653 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921550 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 12:45:39.926653 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921552 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 12:45:39.926653 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921555 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 12:45:39.926653 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921557 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 12:45:39.926653 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921562 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 12:45:39.926653 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921565 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 12:45:39.926653 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921568 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 12:45:39.926653 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921571 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 12:45:39.926653 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921574 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 12:45:39.926653 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921577 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 12:45:39.926653 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921580 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 12:45:39.926653 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921583 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 12:45:39.926653 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921585 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 12:45:39.926653 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921588 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 12:45:39.926653 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921590 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 12:45:39.926653 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921593 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 12:45:39.926653 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921596 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 12:45:39.927114 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921598 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 12:45:39.927114 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921601 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 12:45:39.927114 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921603 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 12:45:39.927114 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921606 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 12:45:39.927114 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921608 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 12:45:39.927114 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921611 2577 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 12:45:39.927114 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:39.921614 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 12:45:39.927114 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.921619 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 12:45:39.927114 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.921725 2577 server.go:962] "Client rotation is on, will bootstrap in background" Sep 10 12:45:39.927114 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.925076 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 10 12:45:39.927114 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.926099 2577 server.go:1019] "Starting client certificate rotation" Sep 10 12:45:39.927114 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.926186 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 12:45:39.927114 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.926227 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 12:45:39.928716 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.928703 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 12:45:39.933118 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.933103 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 12:45:39.944304 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.944285 2577 log.go:25] "Validated CRI v1 runtime API" Sep 10 12:45:39.947231 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.947214 2577 log.go:25] "Validated CRI v1 image API" Sep 10 12:45:39.949743 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.949727 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 10 12:45:39.954865 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.954845 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 12:45:39.955321 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.955300 2577 fs.go:135] Filesystem UUIDs: map[0167b639-bc71-4ffb-bc71-4297181b022e:/dev/nvme0n1p4 719a9576-2c05-40f8-ac7b-3fe0b4bb060e:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Sep 10 12:45:39.955395 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.955319 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 10 12:45:39.961846 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.961727 2577 manager.go:216] Machine: {Timestamp:2026-09-10 12:45:39.960417088 +0000 UTC m=+0.353029693 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098933 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20dc91154fc33c9ee0fa23d707e2fc SystemUUID:ec20dc91-154f-c33c-9ee0-fa23d707e2fc BootID:5e7605ad-85fd-46cf-9a75-66835c604ace Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:01:9b:ee:b5:75 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:01:9b:ee:b5:75 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ba:e3:ff:0f:1d:64 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 10 12:45:39.961846 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.961836 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 10 12:45:39.962023 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.962005 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 10 12:45:39.964386 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.964362 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 10 12:45:39.964554 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.964389 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-146.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 10 12:45:39.965707 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.965694 2577 topology_manager.go:138] "Creating topology manager with none policy" Sep 10 12:45:39.965773 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.965713 2577 container_manager_linux.go:309] "Creating device plugin manager" Sep 10 12:45:39.965773 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.965724 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 12:45:39.966402 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.966389 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 12:45:39.967615 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.967604 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 10 12:45:39.971217 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.971203 2577 state_mem.go:36] "Initialized new in-memory state store" Sep 10 12:45:39.971345 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.971334 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 10 12:45:39.971409 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.971372 2577 kubelet.go:486] "Attempting to sync node with API server" Sep 10 12:45:39.971409 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.971386 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 10 12:45:39.971409 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.971408 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 10 12:45:39.971537 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.971421 2577 kubelet.go:398] "Adding apiserver pod source" Sep 10 12:45:39.971537 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.971436 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 10 12:45:39.971842 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.971829 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 12:45:39.971903 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.971853 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 12:45:39.974231 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.974213 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 10 12:45:39.976364 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.976350 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 10 12:45:39.976412 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.976382 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 10 12:45:39.977436 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.977424 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 10 12:45:39.977470 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.977443 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 10 12:45:39.977470 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.977449 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 10 12:45:39.977470 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.977455 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 10 12:45:39.977470 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.977463 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 10 12:45:39.977470 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.977469 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 10 12:45:39.977638 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.977482 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 10 12:45:39.977638 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.977489 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 10 12:45:39.977638 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.977495 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 10 12:45:39.977638 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.977501 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 10 12:45:39.977638 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.977514 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 10 12:45:39.977638 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.977519 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 10 12:45:39.978253 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.978242 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 10 12:45:39.978253 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.978252 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 10 12:45:39.982319 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.982306 2577 server.go:1268] "Started kubelet" Sep 10 12:45:39.982415 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.982388 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 10 12:45:39.982556 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.982482 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 10 12:45:39.982603 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.982574 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 10 12:45:39.984019 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.983997 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 10 12:45:39.984055 ip-10-0-139-146 systemd[1]: Started Kubernetes Kubelet. Sep 10 12:45:39.986185 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.986123 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-146.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 10 12:45:39.986703 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:39.986683 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-146.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 10 12:45:39.986864 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:39.986650 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 10 12:45:39.987076 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.987062 2577 server.go:310] "Adding debug handlers to kubelet server" Sep 10 12:45:39.988299 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.988280 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 10 12:45:39.988623 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:39.988593 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 10 12:45:39.989034 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.989014 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 10 12:45:39.989345 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:39.989312 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-146.ec2.internal\" not found" Sep 10 12:45:39.989817 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.989797 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 10 12:45:39.989896 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.989799 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 10 12:45:39.989896 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.989861 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 10 12:45:39.990049 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.990038 2577 reconstruct.go:97] "Volume reconstruction finished" Sep 10 12:45:39.990049 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.990049 2577 reconciler.go:29] "Reconciler: start to sync state" Sep 10 12:45:39.990781 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.990740 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6ls84" Sep 10 12:45:39.991268 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.991236 2577 factory.go:153] Registering CRI-O factory Sep 10 12:45:39.991360 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.991271 2577 factory.go:223] Registration of the crio container factory successfully Sep 10 12:45:39.991360 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.991350 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 10 12:45:39.991460 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.991360 2577 factory.go:55] Registering systemd factory Sep 10 12:45:39.991460 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.991370 2577 factory.go:223] Registration of the systemd container factory successfully Sep 10 12:45:39.991460 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.991387 2577 factory.go:103] Registering Raw factory Sep 10 12:45:39.991460 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.991403 2577 manager.go:1196] Started watching for new ooms in manager Sep 10 12:45:39.992123 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:39.991047 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-146.ec2.internal.18d3f659341116b1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-146.ec2.internal,UID:ip-10-0-139-146.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-146.ec2.internal,},FirstTimestamp:2026-09-10 12:45:39.982276273 +0000 UTC m=+0.374888878,LastTimestamp:2026-09-10 12:45:39.982276273 +0000 UTC m=+0.374888878,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-146.ec2.internal,}" Sep 10 12:45:39.992243 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:39.992231 2577 manager.go:349] Starting recovery of all containers Sep 10 12:45:39.995017 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:39.994988 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 10 12:45:39.995100 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:39.995044 2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-146.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 10 12:45:40.002735 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.002706 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6ls84" Sep 10 12:45:40.003259 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.003242 2577 manager.go:354] Recovery completed Sep 10 12:45:40.008000 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.007983 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 12:45:40.010970 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.010954 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-146.ec2.internal" event="NodeHasSufficientMemory" Sep 10 12:45:40.011030 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.010984 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-146.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 12:45:40.011030 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.010995 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-146.ec2.internal" event="NodeHasSufficientPID" Sep 10 12:45:40.011679 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.011662 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 10 12:45:40.011679 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.011677 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 10 12:45:40.011806 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.011682 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 12:45:40.011806 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.011696 2577 state_mem.go:36] "Initialized new in-memory state store" Sep 10 12:45:40.012468 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.012451 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-146.ec2.internal" event="NodeHasSufficientMemory" Sep 10 12:45:40.012548 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.012479 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-146.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 12:45:40.012548 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.012492 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-146.ec2.internal" event="NodeHasSufficientPID" Sep 10 12:45:40.013671 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:40.013598 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-146.ec2.internal.18d3f65935c6ede1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-146.ec2.internal,UID:ip-10-0-139-146.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-146.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-146.ec2.internal,},FirstTimestamp:2026-09-10 12:45:40.010970593 +0000 UTC m=+0.403583200,LastTimestamp:2026-09-10 12:45:40.010970593 +0000 UTC m=+0.403583200,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-146.ec2.internal,}" Sep 10 12:45:40.013788 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.013695 2577 policy_none.go:49] "None policy: Start" Sep 10 12:45:40.013788 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.013711 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 10 12:45:40.013788 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.013724 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 10 12:45:40.015681 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.015666 2577 policy_none.go:47] "Start" Sep 10 12:45:40.048775 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.048754 2577 manager.go:337] "Starting Device Plugin manager" Sep 10 12:45:40.066880 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:40.048799 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 10 12:45:40.066880 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.048812 2577 server.go:87] "Starting device plugin registration server" Sep 10 12:45:40.066880 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.049251 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 10 12:45:40.066880 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.049266 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 10 12:45:40.066880 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.049347 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 10 12:45:40.066880 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.049426 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 10 12:45:40.066880 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.049437 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 10 12:45:40.066880 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:40.050334 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 10 12:45:40.066880 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:40.050387 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-146.ec2.internal\" not found" Sep 10 12:45:40.129815 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.129778 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 10 12:45:40.131055 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.131024 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 10 12:45:40.131200 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.131100 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 10 12:45:40.131200 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.131130 2577 kubelet.go:2448] "Starting kubelet main sync loop" Sep 10 12:45:40.131291 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:40.131197 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 10 12:45:40.133773 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.133750 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 12:45:40.149981 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.149952 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 12:45:40.151126 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.151101 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-146.ec2.internal" event="NodeHasSufficientMemory" Sep 10 12:45:40.151234 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.151135 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-146.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 12:45:40.151234 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.151166 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-146.ec2.internal" event="NodeHasSufficientPID" Sep 10 12:45:40.151234 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.151198 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-146.ec2.internal" Sep 10 12:45:40.165495 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.165417 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-146.ec2.internal" Sep 10 12:45:40.165495 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:40.165438 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-146.ec2.internal\": node \"ip-10-0-139-146.ec2.internal\" not found" Sep 10 12:45:40.202532 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:40.202511 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-146.ec2.internal\" not found" Sep 10 12:45:40.232204 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.232174 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-146.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-146.ec2.internal"] Sep 10 12:45:40.232345 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.232274 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 12:45:40.233871 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.233855 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-146.ec2.internal" event="NodeHasSufficientMemory" Sep 10 12:45:40.233982 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.233888 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-146.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 12:45:40.233982 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.233902 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-146.ec2.internal" event="NodeHasSufficientPID" Sep 10 12:45:40.236284 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.236270 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 12:45:40.236407 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.236384 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-146.ec2.internal" Sep 10 12:45:40.236453 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.236423 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 12:45:40.236990 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.236973 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-146.ec2.internal" event="NodeHasSufficientMemory" Sep 10 12:45:40.237082 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.236999 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-146.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 12:45:40.237082 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.237008 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-146.ec2.internal" event="NodeHasSufficientPID" Sep 10 12:45:40.237082 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.237055 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-146.ec2.internal" event="NodeHasSufficientMemory" Sep 10 12:45:40.237082 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.237075 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-146.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 12:45:40.237258 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.237105 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-146.ec2.internal" event="NodeHasSufficientPID" Sep 10 12:45:40.239216 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.239200 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-146.ec2.internal" Sep 10 12:45:40.239308 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.239225 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 12:45:40.239917 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.239903 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-146.ec2.internal" event="NodeHasSufficientMemory" Sep 10 12:45:40.239991 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.239932 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-146.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 12:45:40.239991 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.239943 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-146.ec2.internal" event="NodeHasSufficientPID" Sep 10 12:45:40.251754 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:40.251735 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-146.ec2.internal\" not found" node="ip-10-0-139-146.ec2.internal" Sep 10 12:45:40.256078 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:40.256058 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-146.ec2.internal\" not found" node="ip-10-0-139-146.ec2.internal" Sep 10 12:45:40.292469 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.292440 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/46b92e8128d979327e8571fe66873758-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-146.ec2.internal\" (UID: \"46b92e8128d979327e8571fe66873758\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-146.ec2.internal" Sep 10 12:45:40.292604 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.292478 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/28a60915b4725d613f028290262a63dc-config\") pod \"kube-apiserver-proxy-ip-10-0-139-146.ec2.internal\" (UID: \"28a60915b4725d613f028290262a63dc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-146.ec2.internal" Sep 10 12:45:40.292604 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.292535 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/46b92e8128d979327e8571fe66873758-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-146.ec2.internal\" (UID: \"46b92e8128d979327e8571fe66873758\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-146.ec2.internal" Sep 10 12:45:40.303553 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:40.303519 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-146.ec2.internal\" not found" Sep 10 12:45:40.392895 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.392860 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/46b92e8128d979327e8571fe66873758-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-146.ec2.internal\" (UID: \"46b92e8128d979327e8571fe66873758\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-146.ec2.internal" Sep 10 12:45:40.392895 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.392896 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/46b92e8128d979327e8571fe66873758-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-146.ec2.internal\" (UID: \"46b92e8128d979327e8571fe66873758\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-146.ec2.internal" Sep 10 12:45:40.393040 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.392913 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/28a60915b4725d613f028290262a63dc-config\") pod \"kube-apiserver-proxy-ip-10-0-139-146.ec2.internal\" (UID: \"28a60915b4725d613f028290262a63dc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-146.ec2.internal" Sep 10 12:45:40.393040 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.393004 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/46b92e8128d979327e8571fe66873758-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-146.ec2.internal\" (UID: \"46b92e8128d979327e8571fe66873758\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-146.ec2.internal" Sep 10 12:45:40.393040 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.393022 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/46b92e8128d979327e8571fe66873758-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-146.ec2.internal\" (UID: \"46b92e8128d979327e8571fe66873758\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-146.ec2.internal" Sep 10 12:45:40.393130 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:40.393046 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/28a60915b4725d613f028290262a63dc-config\") pod \"kube-apiserver-proxy-ip-10-0-139-146.ec2.internal\" (UID: \"28a60915b4725d613f028290262a63dc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-146.ec2.internal" Sep 10 12:45:40.403990 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:40.403966 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-146.ec2.internal\" not found" Sep 10 12:45:41.864492 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:41.864459 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-146.ec2.internal\" not found" Sep 10 12:45:41.914650 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:41.914621 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-146.ec2.internal" Sep 10 12:45:41.918619 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:41.918601 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-146.ec2.internal" Sep 10 12:45:41.965226 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:41.965021 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-146.ec2.internal\" not found" Sep 10 12:45:42.065553 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:42.065508 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-146.ec2.internal\" not found" Sep 10 12:45:42.166132 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:42.166050 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-146.ec2.internal\" not found" Sep 10 12:45:42.235424 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.235402 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 12:45:42.242755 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.242737 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 12:45:42.249326 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.249308 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-146.ec2.internal" Sep 10 12:45:42.261457 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.261440 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 12:45:42.263213 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.263200 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-146.ec2.internal" Sep 10 12:45:42.270613 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.270590 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 12:45:42.285748 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.285732 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 10 12:45:42.285864 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.285847 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 12:45:42.285905 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.285885 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 12:45:42.285944 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.285891 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 12:45:42.332067 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.332036 2577 apiserver.go:52] "Watching apiserver" Sep 10 12:45:42.345800 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.345768 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 10 12:45:42.347839 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.347817 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-kdbsr","openshift-image-registry/node-ca-8htgx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-146.ec2.internal","openshift-multus/multus-g8m8c","openshift-multus/network-metrics-daemon-f9qs9","kube-system/konnectivity-agent-9vttg","openshift-dns/node-resolver-hnwpz","openshift-multus/multus-additional-cni-plugins-fbs4n","openshift-network-diagnostics/network-check-target-qt6gw","openshift-network-operator/iptables-alerter-rfpgn","openshift-ovn-kubernetes/ovnkube-node-4sphq","kube-system/global-pull-secret-syncer-nxpwf","kube-system/kube-apiserver-proxy-ip-10-0-139-146.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtwjb"] Sep 10 12:45:42.348932 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.348916 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 10 12:45:42.350311 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.350294 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hnwpz" Sep 10 12:45:42.352618 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.352599 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.353439 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.353419 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-624c4\"" Sep 10 12:45:42.353721 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.353708 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 10 12:45:42.353878 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.353866 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 10 12:45:42.354533 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.354514 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 10 12:45:42.354695 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.354681 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 10 12:45:42.354772 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.354729 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtwjb" Sep 10 12:45:42.355176 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.355160 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 10 12:45:42.355250 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.355221 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 10 12:45:42.356315 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.356301 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e73d37ca-36d4-43f1-a967-0022bc31cc28-hosts-file\") pod \"node-resolver-hnwpz\" (UID: \"e73d37ca-36d4-43f1-a967-0022bc31cc28\") " pod="openshift-dns/node-resolver-hnwpz" Sep 10 12:45:42.356371 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.356322 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e73d37ca-36d4-43f1-a967-0022bc31cc28-tmp-dir\") pod \"node-resolver-hnwpz\" (UID: \"e73d37ca-36d4-43f1-a967-0022bc31cc28\") " pod="openshift-dns/node-resolver-hnwpz" Sep 10 12:45:42.356371 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.356340 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtnls\" (UniqueName: \"kubernetes.io/projected/e73d37ca-36d4-43f1-a967-0022bc31cc28-kube-api-access-gtnls\") pod \"node-resolver-hnwpz\" (UID: \"e73d37ca-36d4-43f1-a967-0022bc31cc28\") " pod="openshift-dns/node-resolver-hnwpz" Sep 10 12:45:42.356826 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.356811 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g8m8c" Sep 10 12:45:42.357585 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.357564 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 10 12:45:42.357680 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.357638 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 10 12:45:42.357680 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.357670 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 10 12:45:42.357799 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.357784 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 10 12:45:42.358244 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.358227 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4xd8h\"" Sep 10 12:45:42.359112 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.359096 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f9qs9" Sep 10 12:45:42.359226 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:42.359209 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f9qs9" podUID="8c429ad1-3c1f-41a5-9759-671b36d5ee17" Sep 10 12:45:42.359536 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.359521 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 10 12:45:42.359536 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.359528 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 10 12:45:42.359653 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.359586 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 10 12:45:42.360593 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.360576 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qbq6f\"" Sep 10 12:45:42.361306 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.361288 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9vttg" Sep 10 12:45:42.362314 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.362298 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 10 12:45:42.362388 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.362366 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 10 12:45:42.362560 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.362546 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8tbf8\"" Sep 10 12:45:42.363196 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.363181 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 10 12:45:42.363430 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.363414 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7r6nx\"" Sep 10 12:45:42.363507 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.363486 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qt6gw" Sep 10 12:45:42.363562 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:42.363527 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qt6gw" podUID="9629113a-f227-4d19-a2ce-b9e201dcefbd" Sep 10 12:45:42.363562 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.363421 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 10 12:45:42.365693 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.365642 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 12:40:41 +0000 UTC" deadline="2028-03-25 09:13:34.542737169 +0000 UTC" Sep 10 12:45:42.365782 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.365694 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13484h27m52.177047485s" Sep 10 12:45:42.366387 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.366372 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fbs4n" Sep 10 12:45:42.368468 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.368448 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 10 12:45:42.368609 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.368587 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8htgx" Sep 10 12:45:42.368928 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.368910 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 10 12:45:42.368963 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.368938 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-fwllm\"" Sep 10 12:45:42.370677 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.370662 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 10 12:45:42.370750 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.370692 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 10 12:45:42.370750 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.370710 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 12:45:42.370750 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.370731 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xrvq4\"" Sep 10 12:45:42.371098 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.371083 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rfpgn" Sep 10 12:45:42.371188 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.371120 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 10 12:45:42.373605 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.373592 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kdbsr" Sep 10 12:45:42.374970 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.374953 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 10 12:45:42.375049 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.375002 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 10 12:45:42.375505 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.375492 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bmd8k\"" Sep 10 12:45:42.375710 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.375693 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxpwf" Sep 10 12:45:42.375786 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.375725 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 10 12:45:42.375786 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:42.375753 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxpwf" podUID="2b0dc0a6-6df7-464d-9890-3ee7814c618e" Sep 10 12:45:42.376619 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.376603 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 10 12:45:42.376705 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.376688 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ks9fk\"" Sep 10 12:45:42.376786 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.376771 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 10 12:45:42.396035 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.396017 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hrs5x" Sep 10 12:45:42.409800 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.409628 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hrs5x" Sep 10 12:45:42.451439 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.451423 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 10 12:45:42.457014 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.456996 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8v2s\" (UniqueName: \"kubernetes.io/projected/7cb323c0-b8cf-40fd-9931-78b8db058640-kube-api-access-f8v2s\") pod \"tuned-kdbsr\" (UID: \"7cb323c0-b8cf-40fd-9931-78b8db058640\") " pod="openshift-cluster-node-tuning-operator/tuned-kdbsr" Sep 10 12:45:42.457085 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.457027 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/969c2051-92b9-4d3e-85f4-3e6139609dcd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fbs4n\" (UID: \"969c2051-92b9-4d3e-85f4-3e6139609dcd\") " pod="openshift-multus/multus-additional-cni-plugins-fbs4n" Sep 10 12:45:42.457085 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.457045 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1335b6c2-94c2-40c5-97a0-f588fac570e9-node-log\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.457085 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.457060 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wzfp\" (UniqueName: \"kubernetes.io/projected/1335b6c2-94c2-40c5-97a0-f588fac570e9-kube-api-access-4wzfp\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.457085 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.457084 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a2efb90-0ec4-4480-b918-1b1cfc03b658-multus-cni-dir\") pod \"multus-g8m8c\" (UID: \"3a2efb90-0ec4-4480-b918-1b1cfc03b658\") " pod="openshift-multus/multus-g8m8c" Sep 10 12:45:42.457223 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.457117 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7cb323c0-b8cf-40fd-9931-78b8db058640-etc-modprobe-d\") pod \"tuned-kdbsr\" (UID: \"7cb323c0-b8cf-40fd-9931-78b8db058640\") " pod="openshift-cluster-node-tuning-operator/tuned-kdbsr" Sep 10 12:45:42.457223 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.457180 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/66aedc7d-c4ff-47e4-8417-5f72f4c54053-socket-dir\") pod \"aws-ebs-csi-driver-node-wtwjb\" (UID: \"66aedc7d-c4ff-47e4-8417-5f72f4c54053\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtwjb" Sep 10 12:45:42.457223 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.457201 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/66aedc7d-c4ff-47e4-8417-5f72f4c54053-registration-dir\") pod \"aws-ebs-csi-driver-node-wtwjb\" (UID: \"66aedc7d-c4ff-47e4-8417-5f72f4c54053\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtwjb" Sep 10 12:45:42.457306 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.457223 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2b0dc0a6-6df7-464d-9890-3ee7814c618e-kubelet-config\") pod \"global-pull-secret-syncer-nxpwf\" (UID: \"2b0dc0a6-6df7-464d-9890-3ee7814c618e\") " pod="kube-system/global-pull-secret-syncer-nxpwf" Sep 10 12:45:42.457306 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.457239 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1335b6c2-94c2-40c5-97a0-f588fac570e9-ovnkube-config\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.457306 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.457269 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3a2efb90-0ec4-4480-b918-1b1cfc03b658-hostroot\") pod \"multus-g8m8c\" (UID: \"3a2efb90-0ec4-4480-b918-1b1cfc03b658\") " pod="openshift-multus/multus-g8m8c" Sep 10 12:45:42.457306 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.457285 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqphs\" (UniqueName: \"kubernetes.io/projected/32029bf2-b2b1-4a78-ac29-1aa65ee60328-kube-api-access-zqphs\") pod \"node-ca-8htgx\" (UID: \"32029bf2-b2b1-4a78-ac29-1aa65ee60328\") " pod="openshift-image-registry/node-ca-8htgx" Sep 10 12:45:42.457306 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.457300 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djpml\" (UniqueName: \"kubernetes.io/projected/8c429ad1-3c1f-41a5-9759-671b36d5ee17-kube-api-access-djpml\") pod \"network-metrics-daemon-f9qs9\" (UID: \"8c429ad1-3c1f-41a5-9759-671b36d5ee17\") " pod="openshift-multus/network-metrics-daemon-f9qs9" Sep 10 12:45:42.457439 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.457318 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/969c2051-92b9-4d3e-85f4-3e6139609dcd-cnibin\") pod \"multus-additional-cni-plugins-fbs4n\" (UID: \"969c2051-92b9-4d3e-85f4-3e6139609dcd\") " pod="openshift-multus/multus-additional-cni-plugins-fbs4n" Sep 10 12:45:42.457439 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.457349 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e73d37ca-36d4-43f1-a967-0022bc31cc28-tmp-dir\") pod \"node-resolver-hnwpz\" (UID: \"e73d37ca-36d4-43f1-a967-0022bc31cc28\") " pod="openshift-dns/node-resolver-hnwpz" Sep 10 12:45:42.457439 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.457372 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1335b6c2-94c2-40c5-97a0-f588fac570e9-ovn-node-metrics-cert\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.457439 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.457393 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3a2efb90-0ec4-4480-b918-1b1cfc03b658-host-run-k8s-cni-cncf-io\") pod \"multus-g8m8c\" (UID: \"3a2efb90-0ec4-4480-b918-1b1cfc03b658\") " pod="openshift-multus/multus-g8m8c" Sep 10 12:45:42.457439 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.457416 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3a2efb90-0ec4-4480-b918-1b1cfc03b658-multus-daemon-config\") pod \"multus-g8m8c\" (UID: \"3a2efb90-0ec4-4480-b918-1b1cfc03b658\") " pod="openshift-multus/multus-g8m8c" Sep 10 12:45:42.457439 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.457435 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a71dc7da-816c-4cae-af16-dbdd1c3805fe-host-slash\") pod \"iptables-alerter-rfpgn\" (UID: \"a71dc7da-816c-4cae-af16-dbdd1c3805fe\") " pod="openshift-network-operator/iptables-alerter-rfpgn" Sep 10 12:45:42.457605 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.457455 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c429ad1-3c1f-41a5-9759-671b36d5ee17-metrics-certs\") pod \"network-metrics-daemon-f9qs9\" (UID: \"8c429ad1-3c1f-41a5-9759-671b36d5ee17\") " pod="openshift-multus/network-metrics-daemon-f9qs9" Sep 10 12:45:42.457605 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.457489 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/969c2051-92b9-4d3e-85f4-3e6139609dcd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fbs4n\" (UID: \"969c2051-92b9-4d3e-85f4-3e6139609dcd\") " pod="openshift-multus/multus-additional-cni-plugins-fbs4n" Sep 10 12:45:42.457605 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.457510 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1335b6c2-94c2-40c5-97a0-f588fac570e9-host-run-ovn-kubernetes\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.457605 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.457526 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1335b6c2-94c2-40c5-97a0-f588fac570e9-host-cni-netd\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.457605 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.457547 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbj8t\" (UniqueName: \"kubernetes.io/projected/a71dc7da-816c-4cae-af16-dbdd1c3805fe-kube-api-access-wbj8t\") pod \"iptables-alerter-rfpgn\" (UID: \"a71dc7da-816c-4cae-af16-dbdd1c3805fe\") " pod="openshift-network-operator/iptables-alerter-rfpgn" Sep 10 12:45:42.457605 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.457581 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/969c2051-92b9-4d3e-85f4-3e6139609dcd-system-cni-dir\") pod \"multus-additional-cni-plugins-fbs4n\" (UID: \"969c2051-92b9-4d3e-85f4-3e6139609dcd\") " pod="openshift-multus/multus-additional-cni-plugins-fbs4n" Sep 10 12:45:42.457605 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.457600 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffkh2\" (UniqueName: \"kubernetes.io/projected/969c2051-92b9-4d3e-85f4-3e6139609dcd-kube-api-access-ffkh2\") pod \"multus-additional-cni-plugins-fbs4n\" (UID: \"969c2051-92b9-4d3e-85f4-3e6139609dcd\") " pod="openshift-multus/multus-additional-cni-plugins-fbs4n" Sep 10 12:45:42.457799 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.457619 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1335b6c2-94c2-40c5-97a0-f588fac570e9-env-overrides\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.457799 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.457638 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3a2efb90-0ec4-4480-b918-1b1cfc03b658-cnibin\") pod \"multus-g8m8c\" (UID: \"3a2efb90-0ec4-4480-b918-1b1cfc03b658\") " pod="openshift-multus/multus-g8m8c" Sep 10 12:45:42.457799 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.457659 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f6d266d9-2de4-4b51-9900-20e96cd6f6a7-agent-certs\") pod \"konnectivity-agent-9vttg\" (UID: \"f6d266d9-2de4-4b51-9900-20e96cd6f6a7\") " pod="kube-system/konnectivity-agent-9vttg" Sep 10 12:45:42.457799 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.457673 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7cb323c0-b8cf-40fd-9931-78b8db058640-sys\") pod \"tuned-kdbsr\" (UID: \"7cb323c0-b8cf-40fd-9931-78b8db058640\") " pod="openshift-cluster-node-tuning-operator/tuned-kdbsr" Sep 10 12:45:42.457799 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.457699 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1335b6c2-94c2-40c5-97a0-f588fac570e9-run-ovn\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.457799 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.457712 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/32029bf2-b2b1-4a78-ac29-1aa65ee60328-serviceca\") pod \"node-ca-8htgx\" (UID: \"32029bf2-b2b1-4a78-ac29-1aa65ee60328\") " pod="openshift-image-registry/node-ca-8htgx" Sep 10 12:45:42.457799 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.457725 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/66aedc7d-c4ff-47e4-8417-5f72f4c54053-sys-fs\") pod \"aws-ebs-csi-driver-node-wtwjb\" (UID: \"66aedc7d-c4ff-47e4-8417-5f72f4c54053\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtwjb" Sep 10 12:45:42.457799 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.457739 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnzrg\" (UniqueName: \"kubernetes.io/projected/9629113a-f227-4d19-a2ce-b9e201dcefbd-kube-api-access-rnzrg\") pod \"network-check-target-qt6gw\" (UID: \"9629113a-f227-4d19-a2ce-b9e201dcefbd\") " pod="openshift-network-diagnostics/network-check-target-qt6gw" Sep 10 12:45:42.457799 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.457753 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1335b6c2-94c2-40c5-97a0-f588fac570e9-systemd-units\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.457799 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.457774 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1335b6c2-94c2-40c5-97a0-f588fac570e9-host-slash\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.457799 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.457795 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1335b6c2-94c2-40c5-97a0-f588fac570e9-ovnkube-script-lib\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.458079 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.457811 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3a2efb90-0ec4-4480-b918-1b1cfc03b658-cni-binary-copy\") pod \"multus-g8m8c\" (UID: \"3a2efb90-0ec4-4480-b918-1b1cfc03b658\") " pod="openshift-multus/multus-g8m8c" Sep 10 12:45:42.458079 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.457839 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a2efb90-0ec4-4480-b918-1b1cfc03b658-host-var-lib-kubelet\") pod \"multus-g8m8c\" (UID: \"3a2efb90-0ec4-4480-b918-1b1cfc03b658\") " pod="openshift-multus/multus-g8m8c" Sep 10 12:45:42.458079 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.457861 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3a2efb90-0ec4-4480-b918-1b1cfc03b658-multus-conf-dir\") pod \"multus-g8m8c\" (UID: \"3a2efb90-0ec4-4480-b918-1b1cfc03b658\") " pod="openshift-multus/multus-g8m8c" Sep 10 12:45:42.458079 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.457877 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szhzp\" (UniqueName: \"kubernetes.io/projected/3a2efb90-0ec4-4480-b918-1b1cfc03b658-kube-api-access-szhzp\") pod \"multus-g8m8c\" (UID: \"3a2efb90-0ec4-4480-b918-1b1cfc03b658\") " pod="openshift-multus/multus-g8m8c" Sep 10 12:45:42.458079 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.457891 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b0dc0a6-6df7-464d-9890-3ee7814c618e-original-pull-secret\") pod \"global-pull-secret-syncer-nxpwf\" (UID: \"2b0dc0a6-6df7-464d-9890-3ee7814c618e\") " pod="kube-system/global-pull-secret-syncer-nxpwf" Sep 10 12:45:42.458079 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.457905 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1335b6c2-94c2-40c5-97a0-f588fac570e9-host-kubelet\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.458079 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.457923 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1335b6c2-94c2-40c5-97a0-f588fac570e9-var-lib-openvswitch\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.458079 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.457948 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1335b6c2-94c2-40c5-97a0-f588fac570e9-log-socket\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.458079 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.457966 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a2efb90-0ec4-4480-b918-1b1cfc03b658-etc-kubernetes\") pod \"multus-g8m8c\" (UID: \"3a2efb90-0ec4-4480-b918-1b1cfc03b658\") " pod="openshift-multus/multus-g8m8c" Sep 10 12:45:42.458079 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.457992 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/66aedc7d-c4ff-47e4-8417-5f72f4c54053-etc-selinux\") pod \"aws-ebs-csi-driver-node-wtwjb\" (UID: \"66aedc7d-c4ff-47e4-8417-5f72f4c54053\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtwjb" Sep 10 12:45:42.458079 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.458017 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/969c2051-92b9-4d3e-85f4-3e6139609dcd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fbs4n\" (UID: \"969c2051-92b9-4d3e-85f4-3e6139609dcd\") " pod="openshift-multus/multus-additional-cni-plugins-fbs4n" Sep 10 12:45:42.458079 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.458032 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1335b6c2-94c2-40c5-97a0-f588fac570e9-host-cni-bin\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.458079 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.458046 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3a2efb90-0ec4-4480-b918-1b1cfc03b658-host-var-lib-cni-multus\") pod \"multus-g8m8c\" (UID: \"3a2efb90-0ec4-4480-b918-1b1cfc03b658\") " pod="openshift-multus/multus-g8m8c" Sep 10 12:45:42.458079 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.458061 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3a2efb90-0ec4-4480-b918-1b1cfc03b658-host-run-multus-certs\") pod \"multus-g8m8c\" (UID: \"3a2efb90-0ec4-4480-b918-1b1cfc03b658\") " pod="openshift-multus/multus-g8m8c" Sep 10 12:45:42.458487 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.458099 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7cb323c0-b8cf-40fd-9931-78b8db058640-lib-modules\") pod \"tuned-kdbsr\" (UID: \"7cb323c0-b8cf-40fd-9931-78b8db058640\") " pod="openshift-cluster-node-tuning-operator/tuned-kdbsr" Sep 10 12:45:42.458487 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.458113 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7cb323c0-b8cf-40fd-9931-78b8db058640-etc-tuned\") pod \"tuned-kdbsr\" (UID: \"7cb323c0-b8cf-40fd-9931-78b8db058640\") " pod="openshift-cluster-node-tuning-operator/tuned-kdbsr" Sep 10 12:45:42.458487 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.458137 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e73d37ca-36d4-43f1-a967-0022bc31cc28-tmp-dir\") pod \"node-resolver-hnwpz\" (UID: \"e73d37ca-36d4-43f1-a967-0022bc31cc28\") " pod="openshift-dns/node-resolver-hnwpz" Sep 10 12:45:42.458487 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.458152 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1335b6c2-94c2-40c5-97a0-f588fac570e9-host-run-netns\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.458487 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.458210 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3a2efb90-0ec4-4480-b918-1b1cfc03b658-multus-socket-dir-parent\") pod \"multus-g8m8c\" (UID: \"3a2efb90-0ec4-4480-b918-1b1cfc03b658\") " pod="openshift-multus/multus-g8m8c" Sep 10 12:45:42.458487 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.458234 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3a2efb90-0ec4-4480-b918-1b1cfc03b658-host-var-lib-cni-bin\") pod \"multus-g8m8c\" (UID: \"3a2efb90-0ec4-4480-b918-1b1cfc03b658\") " pod="openshift-multus/multus-g8m8c" Sep 10 12:45:42.458487 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.458253 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32029bf2-b2b1-4a78-ac29-1aa65ee60328-host\") pod \"node-ca-8htgx\" (UID: \"32029bf2-b2b1-4a78-ac29-1aa65ee60328\") " pod="openshift-image-registry/node-ca-8htgx" Sep 10 12:45:42.458487 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.458269 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xvzc\" (UniqueName: \"kubernetes.io/projected/66aedc7d-c4ff-47e4-8417-5f72f4c54053-kube-api-access-4xvzc\") pod \"aws-ebs-csi-driver-node-wtwjb\" (UID: \"66aedc7d-c4ff-47e4-8417-5f72f4c54053\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtwjb" Sep 10 12:45:42.458487 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.458285 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e73d37ca-36d4-43f1-a967-0022bc31cc28-hosts-file\") pod \"node-resolver-hnwpz\" (UID: \"e73d37ca-36d4-43f1-a967-0022bc31cc28\") " pod="openshift-dns/node-resolver-hnwpz" Sep 10 12:45:42.458487 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.458306 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7cb323c0-b8cf-40fd-9931-78b8db058640-etc-systemd\") pod \"tuned-kdbsr\" (UID: \"7cb323c0-b8cf-40fd-9931-78b8db058640\") " pod="openshift-cluster-node-tuning-operator/tuned-kdbsr" Sep 10 12:45:42.458487 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.458330 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7cb323c0-b8cf-40fd-9931-78b8db058640-run\") pod \"tuned-kdbsr\" (UID: \"7cb323c0-b8cf-40fd-9931-78b8db058640\") " pod="openshift-cluster-node-tuning-operator/tuned-kdbsr" Sep 10 12:45:42.458487 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.458365 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7cb323c0-b8cf-40fd-9931-78b8db058640-var-lib-kubelet\") pod \"tuned-kdbsr\" (UID: \"7cb323c0-b8cf-40fd-9931-78b8db058640\") " pod="openshift-cluster-node-tuning-operator/tuned-kdbsr" Sep 10 12:45:42.458487 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.458388 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7cb323c0-b8cf-40fd-9931-78b8db058640-host\") pod \"tuned-kdbsr\" (UID: \"7cb323c0-b8cf-40fd-9931-78b8db058640\") " pod="openshift-cluster-node-tuning-operator/tuned-kdbsr" Sep 10 12:45:42.458487 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.458386 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e73d37ca-36d4-43f1-a967-0022bc31cc28-hosts-file\") pod \"node-resolver-hnwpz\" (UID: \"e73d37ca-36d4-43f1-a967-0022bc31cc28\") " pod="openshift-dns/node-resolver-hnwpz" Sep 10 12:45:42.458487 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.458411 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtnls\" (UniqueName: \"kubernetes.io/projected/e73d37ca-36d4-43f1-a967-0022bc31cc28-kube-api-access-gtnls\") pod \"node-resolver-hnwpz\" (UID: \"e73d37ca-36d4-43f1-a967-0022bc31cc28\") " pod="openshift-dns/node-resolver-hnwpz" Sep 10 12:45:42.458487 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.458458 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a2efb90-0ec4-4480-b918-1b1cfc03b658-system-cni-dir\") pod \"multus-g8m8c\" (UID: \"3a2efb90-0ec4-4480-b918-1b1cfc03b658\") " pod="openshift-multus/multus-g8m8c" Sep 10 12:45:42.458990 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.458617 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a71dc7da-816c-4cae-af16-dbdd1c3805fe-iptables-alerter-script\") pod \"iptables-alerter-rfpgn\" (UID: \"a71dc7da-816c-4cae-af16-dbdd1c3805fe\") " pod="openshift-network-operator/iptables-alerter-rfpgn" Sep 10 12:45:42.458990 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.458634 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7cb323c0-b8cf-40fd-9931-78b8db058640-etc-kubernetes\") pod \"tuned-kdbsr\" (UID: \"7cb323c0-b8cf-40fd-9931-78b8db058640\") " pod="openshift-cluster-node-tuning-operator/tuned-kdbsr" Sep 10 12:45:42.458990 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.458655 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2b0dc0a6-6df7-464d-9890-3ee7814c618e-dbus\") pod \"global-pull-secret-syncer-nxpwf\" (UID: \"2b0dc0a6-6df7-464d-9890-3ee7814c618e\") " pod="kube-system/global-pull-secret-syncer-nxpwf" Sep 10 12:45:42.458990 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.458671 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1335b6c2-94c2-40c5-97a0-f588fac570e9-run-systemd\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.458990 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.458691 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1335b6c2-94c2-40c5-97a0-f588fac570e9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.458990 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.458719 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3a2efb90-0ec4-4480-b918-1b1cfc03b658-host-run-netns\") pod \"multus-g8m8c\" (UID: \"3a2efb90-0ec4-4480-b918-1b1cfc03b658\") " pod="openshift-multus/multus-g8m8c" Sep 10 12:45:42.458990 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.458742 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f6d266d9-2de4-4b51-9900-20e96cd6f6a7-konnectivity-ca\") pod \"konnectivity-agent-9vttg\" (UID: \"f6d266d9-2de4-4b51-9900-20e96cd6f6a7\") " pod="kube-system/konnectivity-agent-9vttg" Sep 10 12:45:42.458990 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.458782 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7cb323c0-b8cf-40fd-9931-78b8db058640-etc-sysconfig\") pod \"tuned-kdbsr\" (UID: \"7cb323c0-b8cf-40fd-9931-78b8db058640\") " pod="openshift-cluster-node-tuning-operator/tuned-kdbsr" Sep 10 12:45:42.458990 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.458796 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1335b6c2-94c2-40c5-97a0-f588fac570e9-etc-openvswitch\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.458990 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.458809 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7cb323c0-b8cf-40fd-9931-78b8db058640-etc-sysctl-conf\") pod \"tuned-kdbsr\" (UID: \"7cb323c0-b8cf-40fd-9931-78b8db058640\") " pod="openshift-cluster-node-tuning-operator/tuned-kdbsr" Sep 10 12:45:42.458990 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.458832 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7cb323c0-b8cf-40fd-9931-78b8db058640-tmp\") pod \"tuned-kdbsr\" (UID: \"7cb323c0-b8cf-40fd-9931-78b8db058640\") " pod="openshift-cluster-node-tuning-operator/tuned-kdbsr" Sep 10 12:45:42.458990 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.458854 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/66aedc7d-c4ff-47e4-8417-5f72f4c54053-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wtwjb\" (UID: \"66aedc7d-c4ff-47e4-8417-5f72f4c54053\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtwjb" Sep 10 12:45:42.458990 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.458883 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/66aedc7d-c4ff-47e4-8417-5f72f4c54053-device-dir\") pod \"aws-ebs-csi-driver-node-wtwjb\" (UID: \"66aedc7d-c4ff-47e4-8417-5f72f4c54053\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtwjb" Sep 10 12:45:42.458990 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.458905 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1335b6c2-94c2-40c5-97a0-f588fac570e9-run-openvswitch\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.458990 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.458920 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7cb323c0-b8cf-40fd-9931-78b8db058640-etc-sysctl-d\") pod \"tuned-kdbsr\" (UID: \"7cb323c0-b8cf-40fd-9931-78b8db058640\") " pod="openshift-cluster-node-tuning-operator/tuned-kdbsr" Sep 10 12:45:42.458990 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.458944 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/969c2051-92b9-4d3e-85f4-3e6139609dcd-cni-binary-copy\") pod \"multus-additional-cni-plugins-fbs4n\" (UID: \"969c2051-92b9-4d3e-85f4-3e6139609dcd\") " pod="openshift-multus/multus-additional-cni-plugins-fbs4n" Sep 10 12:45:42.465106 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.465087 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 10 12:45:42.468719 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.468701 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtnls\" (UniqueName: \"kubernetes.io/projected/e73d37ca-36d4-43f1-a967-0022bc31cc28-kube-api-access-gtnls\") pod \"node-resolver-hnwpz\" (UID: \"e73d37ca-36d4-43f1-a967-0022bc31cc28\") " pod="openshift-dns/node-resolver-hnwpz" Sep 10 12:45:42.538484 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.538453 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 12:45:42.559892 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.559868 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c429ad1-3c1f-41a5-9759-671b36d5ee17-metrics-certs\") pod \"network-metrics-daemon-f9qs9\" (UID: \"8c429ad1-3c1f-41a5-9759-671b36d5ee17\") " pod="openshift-multus/network-metrics-daemon-f9qs9" Sep 10 12:45:42.559991 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.559900 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/969c2051-92b9-4d3e-85f4-3e6139609dcd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fbs4n\" (UID: \"969c2051-92b9-4d3e-85f4-3e6139609dcd\") " pod="openshift-multus/multus-additional-cni-plugins-fbs4n" Sep 10 12:45:42.559991 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.559925 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1335b6c2-94c2-40c5-97a0-f588fac570e9-host-run-ovn-kubernetes\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.559991 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.559951 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1335b6c2-94c2-40c5-97a0-f588fac570e9-host-cni-netd\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.559991 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.559975 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbj8t\" (UniqueName: \"kubernetes.io/projected/a71dc7da-816c-4cae-af16-dbdd1c3805fe-kube-api-access-wbj8t\") pod \"iptables-alerter-rfpgn\" (UID: \"a71dc7da-816c-4cae-af16-dbdd1c3805fe\") " pod="openshift-network-operator/iptables-alerter-rfpgn" Sep 10 12:45:42.560207 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.559997 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/969c2051-92b9-4d3e-85f4-3e6139609dcd-system-cni-dir\") pod \"multus-additional-cni-plugins-fbs4n\" (UID: \"969c2051-92b9-4d3e-85f4-3e6139609dcd\") " pod="openshift-multus/multus-additional-cni-plugins-fbs4n" Sep 10 12:45:42.560207 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560019 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffkh2\" (UniqueName: \"kubernetes.io/projected/969c2051-92b9-4d3e-85f4-3e6139609dcd-kube-api-access-ffkh2\") pod \"multus-additional-cni-plugins-fbs4n\" (UID: \"969c2051-92b9-4d3e-85f4-3e6139609dcd\") " pod="openshift-multus/multus-additional-cni-plugins-fbs4n" Sep 10 12:45:42.560207 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560007 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1335b6c2-94c2-40c5-97a0-f588fac570e9-host-run-ovn-kubernetes\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.560207 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:42.560029 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:45:42.560207 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560047 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1335b6c2-94c2-40c5-97a0-f588fac570e9-env-overrides\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.560207 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560073 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3a2efb90-0ec4-4480-b918-1b1cfc03b658-cnibin\") pod \"multus-g8m8c\" (UID: \"3a2efb90-0ec4-4480-b918-1b1cfc03b658\") " pod="openshift-multus/multus-g8m8c" Sep 10 12:45:42.560207 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560100 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f6d266d9-2de4-4b51-9900-20e96cd6f6a7-agent-certs\") pod \"konnectivity-agent-9vttg\" (UID: \"f6d266d9-2de4-4b51-9900-20e96cd6f6a7\") " pod="kube-system/konnectivity-agent-9vttg" Sep 10 12:45:42.560207 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560124 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7cb323c0-b8cf-40fd-9931-78b8db058640-sys\") pod \"tuned-kdbsr\" (UID: \"7cb323c0-b8cf-40fd-9931-78b8db058640\") " pod="openshift-cluster-node-tuning-operator/tuned-kdbsr" Sep 10 12:45:42.560207 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560123 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1335b6c2-94c2-40c5-97a0-f588fac570e9-host-cni-netd\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.560207 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560167 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1335b6c2-94c2-40c5-97a0-f588fac570e9-run-ovn\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.560207 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560195 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/32029bf2-b2b1-4a78-ac29-1aa65ee60328-serviceca\") pod \"node-ca-8htgx\" (UID: \"32029bf2-b2b1-4a78-ac29-1aa65ee60328\") " pod="openshift-image-registry/node-ca-8htgx" Sep 10 12:45:42.560700 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560239 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/66aedc7d-c4ff-47e4-8417-5f72f4c54053-sys-fs\") pod \"aws-ebs-csi-driver-node-wtwjb\" (UID: \"66aedc7d-c4ff-47e4-8417-5f72f4c54053\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtwjb" Sep 10 12:45:42.560700 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560267 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7cb323c0-b8cf-40fd-9931-78b8db058640-sys\") pod \"tuned-kdbsr\" (UID: \"7cb323c0-b8cf-40fd-9931-78b8db058640\") " pod="openshift-cluster-node-tuning-operator/tuned-kdbsr" Sep 10 12:45:42.560700 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:42.560277 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c429ad1-3c1f-41a5-9759-671b36d5ee17-metrics-certs podName:8c429ad1-3c1f-41a5-9759-671b36d5ee17 nodeName:}" failed. No retries permitted until 2026-09-10 12:45:43.060229023 +0000 UTC m=+2.092841782 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c429ad1-3c1f-41a5-9759-671b36d5ee17-metrics-certs") pod "network-metrics-daemon-f9qs9" (UID: "8c429ad1-3c1f-41a5-9759-671b36d5ee17") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:45:42.560700 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560299 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/66aedc7d-c4ff-47e4-8417-5f72f4c54053-sys-fs\") pod \"aws-ebs-csi-driver-node-wtwjb\" (UID: \"66aedc7d-c4ff-47e4-8417-5f72f4c54053\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtwjb" Sep 10 12:45:42.560700 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560315 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1335b6c2-94c2-40c5-97a0-f588fac570e9-run-ovn\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.560700 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560343 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/969c2051-92b9-4d3e-85f4-3e6139609dcd-system-cni-dir\") pod \"multus-additional-cni-plugins-fbs4n\" (UID: \"969c2051-92b9-4d3e-85f4-3e6139609dcd\") " pod="openshift-multus/multus-additional-cni-plugins-fbs4n" Sep 10 12:45:42.560700 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560351 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3a2efb90-0ec4-4480-b918-1b1cfc03b658-cnibin\") pod \"multus-g8m8c\" (UID: \"3a2efb90-0ec4-4480-b918-1b1cfc03b658\") " pod="openshift-multus/multus-g8m8c" Sep 10 12:45:42.560700 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560316 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnzrg\" (UniqueName: \"kubernetes.io/projected/9629113a-f227-4d19-a2ce-b9e201dcefbd-kube-api-access-rnzrg\") pod \"network-check-target-qt6gw\" (UID: \"9629113a-f227-4d19-a2ce-b9e201dcefbd\") " pod="openshift-network-diagnostics/network-check-target-qt6gw" Sep 10 12:45:42.560700 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560395 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1335b6c2-94c2-40c5-97a0-f588fac570e9-systemd-units\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.560700 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560431 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1335b6c2-94c2-40c5-97a0-f588fac570e9-host-slash\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.560700 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560459 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1335b6c2-94c2-40c5-97a0-f588fac570e9-ovnkube-script-lib\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.560700 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560485 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3a2efb90-0ec4-4480-b918-1b1cfc03b658-cni-binary-copy\") pod \"multus-g8m8c\" (UID: \"3a2efb90-0ec4-4480-b918-1b1cfc03b658\") " pod="openshift-multus/multus-g8m8c" Sep 10 12:45:42.560700 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560492 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1335b6c2-94c2-40c5-97a0-f588fac570e9-host-slash\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.560700 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560460 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1335b6c2-94c2-40c5-97a0-f588fac570e9-systemd-units\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.560700 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560508 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a2efb90-0ec4-4480-b918-1b1cfc03b658-host-var-lib-kubelet\") pod \"multus-g8m8c\" (UID: \"3a2efb90-0ec4-4480-b918-1b1cfc03b658\") " pod="openshift-multus/multus-g8m8c" Sep 10 12:45:42.560700 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560531 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3a2efb90-0ec4-4480-b918-1b1cfc03b658-multus-conf-dir\") pod \"multus-g8m8c\" (UID: \"3a2efb90-0ec4-4480-b918-1b1cfc03b658\") " pod="openshift-multus/multus-g8m8c" Sep 10 12:45:42.560700 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560554 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szhzp\" (UniqueName: \"kubernetes.io/projected/3a2efb90-0ec4-4480-b918-1b1cfc03b658-kube-api-access-szhzp\") pod \"multus-g8m8c\" (UID: \"3a2efb90-0ec4-4480-b918-1b1cfc03b658\") " pod="openshift-multus/multus-g8m8c" Sep 10 12:45:42.561459 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560578 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b0dc0a6-6df7-464d-9890-3ee7814c618e-original-pull-secret\") pod \"global-pull-secret-syncer-nxpwf\" (UID: \"2b0dc0a6-6df7-464d-9890-3ee7814c618e\") " pod="kube-system/global-pull-secret-syncer-nxpwf" Sep 10 12:45:42.561459 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560604 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1335b6c2-94c2-40c5-97a0-f588fac570e9-host-kubelet\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.561459 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560627 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1335b6c2-94c2-40c5-97a0-f588fac570e9-var-lib-openvswitch\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.561459 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560628 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3a2efb90-0ec4-4480-b918-1b1cfc03b658-multus-conf-dir\") pod \"multus-g8m8c\" (UID: \"3a2efb90-0ec4-4480-b918-1b1cfc03b658\") " pod="openshift-multus/multus-g8m8c" Sep 10 12:45:42.561459 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560635 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1335b6c2-94c2-40c5-97a0-f588fac570e9-env-overrides\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.561459 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560648 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1335b6c2-94c2-40c5-97a0-f588fac570e9-log-socket\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.561459 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560576 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/969c2051-92b9-4d3e-85f4-3e6139609dcd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fbs4n\" (UID: \"969c2051-92b9-4d3e-85f4-3e6139609dcd\") " pod="openshift-multus/multus-additional-cni-plugins-fbs4n" Sep 10 12:45:42.561459 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560681 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a2efb90-0ec4-4480-b918-1b1cfc03b658-host-var-lib-kubelet\") pod \"multus-g8m8c\" (UID: \"3a2efb90-0ec4-4480-b918-1b1cfc03b658\") " pod="openshift-multus/multus-g8m8c" Sep 10 12:45:42.561459 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560671 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a2efb90-0ec4-4480-b918-1b1cfc03b658-etc-kubernetes\") pod \"multus-g8m8c\" (UID: \"3a2efb90-0ec4-4480-b918-1b1cfc03b658\") " pod="openshift-multus/multus-g8m8c" Sep 10 12:45:42.561459 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560720 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/66aedc7d-c4ff-47e4-8417-5f72f4c54053-etc-selinux\") pod \"aws-ebs-csi-driver-node-wtwjb\" (UID: \"66aedc7d-c4ff-47e4-8417-5f72f4c54053\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtwjb" Sep 10 12:45:42.561459 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560726 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1335b6c2-94c2-40c5-97a0-f588fac570e9-var-lib-openvswitch\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.561459 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560742 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/969c2051-92b9-4d3e-85f4-3e6139609dcd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fbs4n\" (UID: \"969c2051-92b9-4d3e-85f4-3e6139609dcd\") " pod="openshift-multus/multus-additional-cni-plugins-fbs4n" Sep 10 12:45:42.561459 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560765 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1335b6c2-94c2-40c5-97a0-f588fac570e9-host-kubelet\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.561459 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560769 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1335b6c2-94c2-40c5-97a0-f588fac570e9-host-cni-bin\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.561459 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560790 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/32029bf2-b2b1-4a78-ac29-1aa65ee60328-serviceca\") pod \"node-ca-8htgx\" (UID: \"32029bf2-b2b1-4a78-ac29-1aa65ee60328\") " pod="openshift-image-registry/node-ca-8htgx" Sep 10 12:45:42.561459 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560803 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3a2efb90-0ec4-4480-b918-1b1cfc03b658-host-var-lib-cni-multus\") pod \"multus-g8m8c\" (UID: \"3a2efb90-0ec4-4480-b918-1b1cfc03b658\") " pod="openshift-multus/multus-g8m8c" Sep 10 12:45:42.561459 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560807 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1335b6c2-94c2-40c5-97a0-f588fac570e9-host-cni-bin\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.562155 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560837 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3a2efb90-0ec4-4480-b918-1b1cfc03b658-host-var-lib-cni-multus\") pod \"multus-g8m8c\" (UID: \"3a2efb90-0ec4-4480-b918-1b1cfc03b658\") " pod="openshift-multus/multus-g8m8c" Sep 10 12:45:42.562155 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560842 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3a2efb90-0ec4-4480-b918-1b1cfc03b658-host-run-multus-certs\") pod \"multus-g8m8c\" (UID: \"3a2efb90-0ec4-4480-b918-1b1cfc03b658\") " pod="openshift-multus/multus-g8m8c" Sep 10 12:45:42.562155 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560871 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7cb323c0-b8cf-40fd-9931-78b8db058640-lib-modules\") pod \"tuned-kdbsr\" (UID: \"7cb323c0-b8cf-40fd-9931-78b8db058640\") " pod="openshift-cluster-node-tuning-operator/tuned-kdbsr" Sep 10 12:45:42.562155 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560875 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a2efb90-0ec4-4480-b918-1b1cfc03b658-etc-kubernetes\") pod \"multus-g8m8c\" (UID: \"3a2efb90-0ec4-4480-b918-1b1cfc03b658\") " pod="openshift-multus/multus-g8m8c" Sep 10 12:45:42.562155 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560878 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1335b6c2-94c2-40c5-97a0-f588fac570e9-log-socket\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.562155 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560903 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7cb323c0-b8cf-40fd-9931-78b8db058640-etc-tuned\") pod \"tuned-kdbsr\" (UID: \"7cb323c0-b8cf-40fd-9931-78b8db058640\") " pod="openshift-cluster-node-tuning-operator/tuned-kdbsr" Sep 10 12:45:42.562155 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560927 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1335b6c2-94c2-40c5-97a0-f588fac570e9-host-run-netns\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.562155 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:42.560940 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 12:45:42.562155 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560950 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3a2efb90-0ec4-4480-b918-1b1cfc03b658-multus-socket-dir-parent\") pod \"multus-g8m8c\" (UID: \"3a2efb90-0ec4-4480-b918-1b1cfc03b658\") " pod="openshift-multus/multus-g8m8c" Sep 10 12:45:42.562155 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560974 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3a2efb90-0ec4-4480-b918-1b1cfc03b658-host-var-lib-cni-bin\") pod \"multus-g8m8c\" (UID: \"3a2efb90-0ec4-4480-b918-1b1cfc03b658\") " pod="openshift-multus/multus-g8m8c" Sep 10 12:45:42.562155 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.560997 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/66aedc7d-c4ff-47e4-8417-5f72f4c54053-etc-selinux\") pod \"aws-ebs-csi-driver-node-wtwjb\" (UID: \"66aedc7d-c4ff-47e4-8417-5f72f4c54053\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtwjb" Sep 10 12:45:42.562155 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:42.561001 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b0dc0a6-6df7-464d-9890-3ee7814c618e-original-pull-secret podName:2b0dc0a6-6df7-464d-9890-3ee7814c618e nodeName:}" failed. No retries permitted until 2026-09-10 12:45:43.060983247 +0000 UTC m=+2.093596005 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b0dc0a6-6df7-464d-9890-3ee7814c618e-original-pull-secret") pod "global-pull-secret-syncer-nxpwf" (UID: "2b0dc0a6-6df7-464d-9890-3ee7814c618e") : object "kube-system"/"original-pull-secret" not registered Sep 10 12:45:42.562155 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.561013 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3a2efb90-0ec4-4480-b918-1b1cfc03b658-host-var-lib-cni-bin\") pod \"multus-g8m8c\" (UID: \"3a2efb90-0ec4-4480-b918-1b1cfc03b658\") " pod="openshift-multus/multus-g8m8c" Sep 10 12:45:42.562155 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.561035 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32029bf2-b2b1-4a78-ac29-1aa65ee60328-host\") pod \"node-ca-8htgx\" (UID: \"32029bf2-b2b1-4a78-ac29-1aa65ee60328\") " pod="openshift-image-registry/node-ca-8htgx" Sep 10 12:45:42.562155 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.561051 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1335b6c2-94c2-40c5-97a0-f588fac570e9-host-run-netns\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.562155 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.561057 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1335b6c2-94c2-40c5-97a0-f588fac570e9-ovnkube-script-lib\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.562155 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.561063 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xvzc\" (UniqueName: \"kubernetes.io/projected/66aedc7d-c4ff-47e4-8417-5f72f4c54053-kube-api-access-4xvzc\") pod \"aws-ebs-csi-driver-node-wtwjb\" (UID: \"66aedc7d-c4ff-47e4-8417-5f72f4c54053\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtwjb" Sep 10 12:45:42.562933 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.561087 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7cb323c0-b8cf-40fd-9931-78b8db058640-etc-systemd\") pod \"tuned-kdbsr\" (UID: \"7cb323c0-b8cf-40fd-9931-78b8db058640\") " pod="openshift-cluster-node-tuning-operator/tuned-kdbsr" Sep 10 12:45:42.562933 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.561080 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3a2efb90-0ec4-4480-b918-1b1cfc03b658-cni-binary-copy\") pod \"multus-g8m8c\" (UID: \"3a2efb90-0ec4-4480-b918-1b1cfc03b658\") " pod="openshift-multus/multus-g8m8c" Sep 10 12:45:42.562933 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.561116 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32029bf2-b2b1-4a78-ac29-1aa65ee60328-host\") pod \"node-ca-8htgx\" (UID: \"32029bf2-b2b1-4a78-ac29-1aa65ee60328\") " pod="openshift-image-registry/node-ca-8htgx" Sep 10 12:45:42.562933 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.561340 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/969c2051-92b9-4d3e-85f4-3e6139609dcd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fbs4n\" (UID: \"969c2051-92b9-4d3e-85f4-3e6139609dcd\") " pod="openshift-multus/multus-additional-cni-plugins-fbs4n" Sep 10 12:45:42.562933 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.561190 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7cb323c0-b8cf-40fd-9931-78b8db058640-etc-systemd\") pod \"tuned-kdbsr\" (UID: \"7cb323c0-b8cf-40fd-9931-78b8db058640\") " pod="openshift-cluster-node-tuning-operator/tuned-kdbsr" Sep 10 12:45:42.562933 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.561215 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3a2efb90-0ec4-4480-b918-1b1cfc03b658-multus-socket-dir-parent\") pod \"multus-g8m8c\" (UID: \"3a2efb90-0ec4-4480-b918-1b1cfc03b658\") " pod="openshift-multus/multus-g8m8c" Sep 10 12:45:42.562933 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.561226 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3a2efb90-0ec4-4480-b918-1b1cfc03b658-host-run-multus-certs\") pod \"multus-g8m8c\" (UID: \"3a2efb90-0ec4-4480-b918-1b1cfc03b658\") " pod="openshift-multus/multus-g8m8c" Sep 10 12:45:42.562933 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.561234 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7cb323c0-b8cf-40fd-9931-78b8db058640-run\") pod \"tuned-kdbsr\" (UID: \"7cb323c0-b8cf-40fd-9931-78b8db058640\") " pod="openshift-cluster-node-tuning-operator/tuned-kdbsr" Sep 10 12:45:42.562933 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.561300 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7cb323c0-b8cf-40fd-9931-78b8db058640-lib-modules\") pod \"tuned-kdbsr\" (UID: \"7cb323c0-b8cf-40fd-9931-78b8db058640\") " pod="openshift-cluster-node-tuning-operator/tuned-kdbsr" Sep 10 12:45:42.562933 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.561114 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7cb323c0-b8cf-40fd-9931-78b8db058640-run\") pod \"tuned-kdbsr\" (UID: \"7cb323c0-b8cf-40fd-9931-78b8db058640\") " pod="openshift-cluster-node-tuning-operator/tuned-kdbsr" Sep 10 12:45:42.562933 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.561420 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7cb323c0-b8cf-40fd-9931-78b8db058640-var-lib-kubelet\") pod \"tuned-kdbsr\" (UID: \"7cb323c0-b8cf-40fd-9931-78b8db058640\") " pod="openshift-cluster-node-tuning-operator/tuned-kdbsr" Sep 10 12:45:42.562933 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.561442 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7cb323c0-b8cf-40fd-9931-78b8db058640-host\") pod \"tuned-kdbsr\" (UID: \"7cb323c0-b8cf-40fd-9931-78b8db058640\") " pod="openshift-cluster-node-tuning-operator/tuned-kdbsr" Sep 10 12:45:42.562933 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.561465 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a2efb90-0ec4-4480-b918-1b1cfc03b658-system-cni-dir\") pod \"multus-g8m8c\" (UID: \"3a2efb90-0ec4-4480-b918-1b1cfc03b658\") " pod="openshift-multus/multus-g8m8c" Sep 10 12:45:42.562933 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.561505 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7cb323c0-b8cf-40fd-9931-78b8db058640-var-lib-kubelet\") pod \"tuned-kdbsr\" (UID: \"7cb323c0-b8cf-40fd-9931-78b8db058640\") " pod="openshift-cluster-node-tuning-operator/tuned-kdbsr" Sep 10 12:45:42.562933 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.561513 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7cb323c0-b8cf-40fd-9931-78b8db058640-host\") pod \"tuned-kdbsr\" (UID: \"7cb323c0-b8cf-40fd-9931-78b8db058640\") " pod="openshift-cluster-node-tuning-operator/tuned-kdbsr" Sep 10 12:45:42.562933 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.561506 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a71dc7da-816c-4cae-af16-dbdd1c3805fe-iptables-alerter-script\") pod \"iptables-alerter-rfpgn\" (UID: \"a71dc7da-816c-4cae-af16-dbdd1c3805fe\") " pod="openshift-network-operator/iptables-alerter-rfpgn" Sep 10 12:45:42.562933 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.561563 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7cb323c0-b8cf-40fd-9931-78b8db058640-etc-kubernetes\") pod \"tuned-kdbsr\" (UID: \"7cb323c0-b8cf-40fd-9931-78b8db058640\") " pod="openshift-cluster-node-tuning-operator/tuned-kdbsr" Sep 10 12:45:42.562933 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.561590 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2b0dc0a6-6df7-464d-9890-3ee7814c618e-dbus\") pod \"global-pull-secret-syncer-nxpwf\" (UID: \"2b0dc0a6-6df7-464d-9890-3ee7814c618e\") " pod="kube-system/global-pull-secret-syncer-nxpwf" Sep 10 12:45:42.563571 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.561602 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a2efb90-0ec4-4480-b918-1b1cfc03b658-system-cni-dir\") pod \"multus-g8m8c\" (UID: \"3a2efb90-0ec4-4480-b918-1b1cfc03b658\") " pod="openshift-multus/multus-g8m8c" Sep 10 12:45:42.563571 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.561612 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1335b6c2-94c2-40c5-97a0-f588fac570e9-run-systemd\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.563571 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.561636 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1335b6c2-94c2-40c5-97a0-f588fac570e9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.563571 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.561660 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3a2efb90-0ec4-4480-b918-1b1cfc03b658-host-run-netns\") pod \"multus-g8m8c\" (UID: \"3a2efb90-0ec4-4480-b918-1b1cfc03b658\") " pod="openshift-multus/multus-g8m8c" Sep 10 12:45:42.563571 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.561668 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2b0dc0a6-6df7-464d-9890-3ee7814c618e-dbus\") pod \"global-pull-secret-syncer-nxpwf\" (UID: \"2b0dc0a6-6df7-464d-9890-3ee7814c618e\") " pod="kube-system/global-pull-secret-syncer-nxpwf" Sep 10 12:45:42.563571 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.561679 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1335b6c2-94c2-40c5-97a0-f588fac570e9-run-systemd\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.563571 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.561709 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3a2efb90-0ec4-4480-b918-1b1cfc03b658-host-run-netns\") pod \"multus-g8m8c\" (UID: \"3a2efb90-0ec4-4480-b918-1b1cfc03b658\") " pod="openshift-multus/multus-g8m8c" Sep 10 12:45:42.563571 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.561660 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7cb323c0-b8cf-40fd-9931-78b8db058640-etc-kubernetes\") pod \"tuned-kdbsr\" (UID: \"7cb323c0-b8cf-40fd-9931-78b8db058640\") " pod="openshift-cluster-node-tuning-operator/tuned-kdbsr" Sep 10 12:45:42.563571 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.561693 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1335b6c2-94c2-40c5-97a0-f588fac570e9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.563571 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.561684 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f6d266d9-2de4-4b51-9900-20e96cd6f6a7-konnectivity-ca\") pod \"konnectivity-agent-9vttg\" (UID: \"f6d266d9-2de4-4b51-9900-20e96cd6f6a7\") " pod="kube-system/konnectivity-agent-9vttg" Sep 10 12:45:42.563571 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.561802 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7cb323c0-b8cf-40fd-9931-78b8db058640-etc-sysconfig\") pod \"tuned-kdbsr\" (UID: \"7cb323c0-b8cf-40fd-9931-78b8db058640\") " pod="openshift-cluster-node-tuning-operator/tuned-kdbsr" Sep 10 12:45:42.563571 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.561830 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1335b6c2-94c2-40c5-97a0-f588fac570e9-etc-openvswitch\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.563571 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.561856 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7cb323c0-b8cf-40fd-9931-78b8db058640-etc-sysctl-conf\") pod \"tuned-kdbsr\" (UID: \"7cb323c0-b8cf-40fd-9931-78b8db058640\") " pod="openshift-cluster-node-tuning-operator/tuned-kdbsr" Sep 10 12:45:42.563571 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.561905 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7cb323c0-b8cf-40fd-9931-78b8db058640-etc-sysconfig\") pod \"tuned-kdbsr\" (UID: \"7cb323c0-b8cf-40fd-9931-78b8db058640\") " pod="openshift-cluster-node-tuning-operator/tuned-kdbsr" Sep 10 12:45:42.563571 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.561950 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a71dc7da-816c-4cae-af16-dbdd1c3805fe-iptables-alerter-script\") pod \"iptables-alerter-rfpgn\" (UID: \"a71dc7da-816c-4cae-af16-dbdd1c3805fe\") " pod="openshift-network-operator/iptables-alerter-rfpgn" Sep 10 12:45:42.563571 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.561954 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7cb323c0-b8cf-40fd-9931-78b8db058640-tmp\") pod \"tuned-kdbsr\" (UID: \"7cb323c0-b8cf-40fd-9931-78b8db058640\") " pod="openshift-cluster-node-tuning-operator/tuned-kdbsr" Sep 10 12:45:42.563571 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.561995 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/66aedc7d-c4ff-47e4-8417-5f72f4c54053-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wtwjb\" (UID: \"66aedc7d-c4ff-47e4-8417-5f72f4c54053\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtwjb" Sep 10 12:45:42.564085 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.561994 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7cb323c0-b8cf-40fd-9931-78b8db058640-etc-sysctl-conf\") pod \"tuned-kdbsr\" (UID: \"7cb323c0-b8cf-40fd-9931-78b8db058640\") " pod="openshift-cluster-node-tuning-operator/tuned-kdbsr" Sep 10 12:45:42.564085 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.562027 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1335b6c2-94c2-40c5-97a0-f588fac570e9-etc-openvswitch\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.564085 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.562042 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/66aedc7d-c4ff-47e4-8417-5f72f4c54053-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wtwjb\" (UID: \"66aedc7d-c4ff-47e4-8417-5f72f4c54053\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtwjb" Sep 10 12:45:42.564085 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.562058 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/66aedc7d-c4ff-47e4-8417-5f72f4c54053-device-dir\") pod \"aws-ebs-csi-driver-node-wtwjb\" (UID: \"66aedc7d-c4ff-47e4-8417-5f72f4c54053\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtwjb" Sep 10 12:45:42.564085 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.562086 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1335b6c2-94c2-40c5-97a0-f588fac570e9-run-openvswitch\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.564085 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.562118 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7cb323c0-b8cf-40fd-9931-78b8db058640-etc-sysctl-d\") pod \"tuned-kdbsr\" (UID: \"7cb323c0-b8cf-40fd-9931-78b8db058640\") " pod="openshift-cluster-node-tuning-operator/tuned-kdbsr" Sep 10 12:45:42.564085 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.562162 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/66aedc7d-c4ff-47e4-8417-5f72f4c54053-device-dir\") pod \"aws-ebs-csi-driver-node-wtwjb\" (UID: \"66aedc7d-c4ff-47e4-8417-5f72f4c54053\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtwjb" Sep 10 12:45:42.564085 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.562165 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/969c2051-92b9-4d3e-85f4-3e6139609dcd-cni-binary-copy\") pod \"multus-additional-cni-plugins-fbs4n\" (UID: \"969c2051-92b9-4d3e-85f4-3e6139609dcd\") " pod="openshift-multus/multus-additional-cni-plugins-fbs4n" Sep 10 12:45:42.564085 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.562173 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1335b6c2-94c2-40c5-97a0-f588fac570e9-run-openvswitch\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.564085 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.562190 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8v2s\" (UniqueName: \"kubernetes.io/projected/7cb323c0-b8cf-40fd-9931-78b8db058640-kube-api-access-f8v2s\") pod \"tuned-kdbsr\" (UID: \"7cb323c0-b8cf-40fd-9931-78b8db058640\") " pod="openshift-cluster-node-tuning-operator/tuned-kdbsr" Sep 10 12:45:42.564085 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.562214 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/969c2051-92b9-4d3e-85f4-3e6139609dcd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fbs4n\" (UID: \"969c2051-92b9-4d3e-85f4-3e6139609dcd\") " pod="openshift-multus/multus-additional-cni-plugins-fbs4n" Sep 10 12:45:42.564085 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.562218 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f6d266d9-2de4-4b51-9900-20e96cd6f6a7-konnectivity-ca\") pod \"konnectivity-agent-9vttg\" (UID: \"f6d266d9-2de4-4b51-9900-20e96cd6f6a7\") " pod="kube-system/konnectivity-agent-9vttg" Sep 10 12:45:42.564085 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.562233 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7cb323c0-b8cf-40fd-9931-78b8db058640-etc-sysctl-d\") pod \"tuned-kdbsr\" (UID: \"7cb323c0-b8cf-40fd-9931-78b8db058640\") " pod="openshift-cluster-node-tuning-operator/tuned-kdbsr" Sep 10 12:45:42.564085 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.562236 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1335b6c2-94c2-40c5-97a0-f588fac570e9-node-log\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.564085 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.562266 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wzfp\" (UniqueName: \"kubernetes.io/projected/1335b6c2-94c2-40c5-97a0-f588fac570e9-kube-api-access-4wzfp\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.564085 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.562281 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a2efb90-0ec4-4480-b918-1b1cfc03b658-multus-cni-dir\") pod \"multus-g8m8c\" (UID: \"3a2efb90-0ec4-4480-b918-1b1cfc03b658\") " pod="openshift-multus/multus-g8m8c" Sep 10 12:45:42.564085 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.562294 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7cb323c0-b8cf-40fd-9931-78b8db058640-etc-modprobe-d\") pod \"tuned-kdbsr\" (UID: \"7cb323c0-b8cf-40fd-9931-78b8db058640\") " pod="openshift-cluster-node-tuning-operator/tuned-kdbsr" Sep 10 12:45:42.564671 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.562313 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/66aedc7d-c4ff-47e4-8417-5f72f4c54053-socket-dir\") pod \"aws-ebs-csi-driver-node-wtwjb\" (UID: \"66aedc7d-c4ff-47e4-8417-5f72f4c54053\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtwjb" Sep 10 12:45:42.564671 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.562336 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/66aedc7d-c4ff-47e4-8417-5f72f4c54053-registration-dir\") pod \"aws-ebs-csi-driver-node-wtwjb\" (UID: \"66aedc7d-c4ff-47e4-8417-5f72f4c54053\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtwjb" Sep 10 12:45:42.564671 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.562361 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1335b6c2-94c2-40c5-97a0-f588fac570e9-node-log\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.564671 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.562380 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/969c2051-92b9-4d3e-85f4-3e6139609dcd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fbs4n\" (UID: \"969c2051-92b9-4d3e-85f4-3e6139609dcd\") " pod="openshift-multus/multus-additional-cni-plugins-fbs4n" Sep 10 12:45:42.564671 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.562365 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2b0dc0a6-6df7-464d-9890-3ee7814c618e-kubelet-config\") pod \"global-pull-secret-syncer-nxpwf\" (UID: \"2b0dc0a6-6df7-464d-9890-3ee7814c618e\") " pod="kube-system/global-pull-secret-syncer-nxpwf" Sep 10 12:45:42.564671 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.562429 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2b0dc0a6-6df7-464d-9890-3ee7814c618e-kubelet-config\") pod \"global-pull-secret-syncer-nxpwf\" (UID: \"2b0dc0a6-6df7-464d-9890-3ee7814c618e\") " pod="kube-system/global-pull-secret-syncer-nxpwf" Sep 10 12:45:42.564671 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.562435 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1335b6c2-94c2-40c5-97a0-f588fac570e9-ovnkube-config\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.564671 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.562494 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3a2efb90-0ec4-4480-b918-1b1cfc03b658-hostroot\") pod \"multus-g8m8c\" (UID: \"3a2efb90-0ec4-4480-b918-1b1cfc03b658\") " pod="openshift-multus/multus-g8m8c" Sep 10 12:45:42.564671 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.562521 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqphs\" (UniqueName: \"kubernetes.io/projected/32029bf2-b2b1-4a78-ac29-1aa65ee60328-kube-api-access-zqphs\") pod \"node-ca-8htgx\" (UID: \"32029bf2-b2b1-4a78-ac29-1aa65ee60328\") " pod="openshift-image-registry/node-ca-8htgx" Sep 10 12:45:42.564671 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.562544 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a2efb90-0ec4-4480-b918-1b1cfc03b658-multus-cni-dir\") pod \"multus-g8m8c\" (UID: \"3a2efb90-0ec4-4480-b918-1b1cfc03b658\") " pod="openshift-multus/multus-g8m8c" Sep 10 12:45:42.564671 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.562564 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djpml\" (UniqueName: \"kubernetes.io/projected/8c429ad1-3c1f-41a5-9759-671b36d5ee17-kube-api-access-djpml\") pod \"network-metrics-daemon-f9qs9\" (UID: \"8c429ad1-3c1f-41a5-9759-671b36d5ee17\") " pod="openshift-multus/network-metrics-daemon-f9qs9" Sep 10 12:45:42.564671 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.562583 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3a2efb90-0ec4-4480-b918-1b1cfc03b658-hostroot\") pod \"multus-g8m8c\" (UID: \"3a2efb90-0ec4-4480-b918-1b1cfc03b658\") " pod="openshift-multus/multus-g8m8c" Sep 10 12:45:42.564671 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.562591 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/969c2051-92b9-4d3e-85f4-3e6139609dcd-cnibin\") pod \"multus-additional-cni-plugins-fbs4n\" (UID: \"969c2051-92b9-4d3e-85f4-3e6139609dcd\") " pod="openshift-multus/multus-additional-cni-plugins-fbs4n" Sep 10 12:45:42.564671 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.562620 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1335b6c2-94c2-40c5-97a0-f588fac570e9-ovn-node-metrics-cert\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.564671 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.562638 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/969c2051-92b9-4d3e-85f4-3e6139609dcd-cnibin\") pod \"multus-additional-cni-plugins-fbs4n\" (UID: \"969c2051-92b9-4d3e-85f4-3e6139609dcd\") " pod="openshift-multus/multus-additional-cni-plugins-fbs4n" Sep 10 12:45:42.564671 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.562493 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7cb323c0-b8cf-40fd-9931-78b8db058640-etc-modprobe-d\") pod \"tuned-kdbsr\" (UID: \"7cb323c0-b8cf-40fd-9931-78b8db058640\") " pod="openshift-cluster-node-tuning-operator/tuned-kdbsr" Sep 10 12:45:42.564671 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.562651 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/66aedc7d-c4ff-47e4-8417-5f72f4c54053-socket-dir\") pod \"aws-ebs-csi-driver-node-wtwjb\" (UID: \"66aedc7d-c4ff-47e4-8417-5f72f4c54053\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtwjb" Sep 10 12:45:42.565189 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.562673 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3a2efb90-0ec4-4480-b918-1b1cfc03b658-host-run-k8s-cni-cncf-io\") pod \"multus-g8m8c\" (UID: \"3a2efb90-0ec4-4480-b918-1b1cfc03b658\") " pod="openshift-multus/multus-g8m8c" Sep 10 12:45:42.565189 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.562703 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3a2efb90-0ec4-4480-b918-1b1cfc03b658-multus-daemon-config\") pod \"multus-g8m8c\" (UID: \"3a2efb90-0ec4-4480-b918-1b1cfc03b658\") " pod="openshift-multus/multus-g8m8c" Sep 10 12:45:42.565189 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.562697 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/66aedc7d-c4ff-47e4-8417-5f72f4c54053-registration-dir\") pod \"aws-ebs-csi-driver-node-wtwjb\" (UID: \"66aedc7d-c4ff-47e4-8417-5f72f4c54053\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtwjb" Sep 10 12:45:42.565189 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.562729 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a71dc7da-816c-4cae-af16-dbdd1c3805fe-host-slash\") pod \"iptables-alerter-rfpgn\" (UID: \"a71dc7da-816c-4cae-af16-dbdd1c3805fe\") " pod="openshift-network-operator/iptables-alerter-rfpgn" Sep 10 12:45:42.565189 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.562761 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3a2efb90-0ec4-4480-b918-1b1cfc03b658-host-run-k8s-cni-cncf-io\") pod \"multus-g8m8c\" (UID: \"3a2efb90-0ec4-4480-b918-1b1cfc03b658\") " pod="openshift-multus/multus-g8m8c" Sep 10 12:45:42.565189 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.562796 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a71dc7da-816c-4cae-af16-dbdd1c3805fe-host-slash\") pod \"iptables-alerter-rfpgn\" (UID: \"a71dc7da-816c-4cae-af16-dbdd1c3805fe\") " pod="openshift-network-operator/iptables-alerter-rfpgn" Sep 10 12:45:42.565189 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.562931 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/969c2051-92b9-4d3e-85f4-3e6139609dcd-cni-binary-copy\") pod \"multus-additional-cni-plugins-fbs4n\" (UID: \"969c2051-92b9-4d3e-85f4-3e6139609dcd\") " pod="openshift-multus/multus-additional-cni-plugins-fbs4n" Sep 10 12:45:42.565189 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.563236 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3a2efb90-0ec4-4480-b918-1b1cfc03b658-multus-daemon-config\") pod \"multus-g8m8c\" (UID: \"3a2efb90-0ec4-4480-b918-1b1cfc03b658\") " pod="openshift-multus/multus-g8m8c" Sep 10 12:45:42.565189 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.563354 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7cb323c0-b8cf-40fd-9931-78b8db058640-etc-tuned\") pod \"tuned-kdbsr\" (UID: \"7cb323c0-b8cf-40fd-9931-78b8db058640\") " pod="openshift-cluster-node-tuning-operator/tuned-kdbsr" Sep 10 12:45:42.565189 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.563412 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f6d266d9-2de4-4b51-9900-20e96cd6f6a7-agent-certs\") pod \"konnectivity-agent-9vttg\" (UID: \"f6d266d9-2de4-4b51-9900-20e96cd6f6a7\") " pod="kube-system/konnectivity-agent-9vttg" Sep 10 12:45:42.565189 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.563498 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1335b6c2-94c2-40c5-97a0-f588fac570e9-ovnkube-config\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.565189 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.564645 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7cb323c0-b8cf-40fd-9931-78b8db058640-tmp\") pod \"tuned-kdbsr\" (UID: \"7cb323c0-b8cf-40fd-9931-78b8db058640\") " pod="openshift-cluster-node-tuning-operator/tuned-kdbsr" Sep 10 12:45:42.566001 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.565982 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1335b6c2-94c2-40c5-97a0-f588fac570e9-ovn-node-metrics-cert\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.571210 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.571188 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffkh2\" (UniqueName: \"kubernetes.io/projected/969c2051-92b9-4d3e-85f4-3e6139609dcd-kube-api-access-ffkh2\") pod \"multus-additional-cni-plugins-fbs4n\" (UID: \"969c2051-92b9-4d3e-85f4-3e6139609dcd\") " pod="openshift-multus/multus-additional-cni-plugins-fbs4n" Sep 10 12:45:42.571962 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.571945 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbj8t\" (UniqueName: \"kubernetes.io/projected/a71dc7da-816c-4cae-af16-dbdd1c3805fe-kube-api-access-wbj8t\") pod \"iptables-alerter-rfpgn\" (UID: \"a71dc7da-816c-4cae-af16-dbdd1c3805fe\") " pod="openshift-network-operator/iptables-alerter-rfpgn" Sep 10 12:45:42.574675 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:42.574653 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 12:45:42.574675 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:42.574676 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 12:45:42.574844 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:42.574689 2577 projected.go:196] Error preparing data for projected volume kube-api-access-rnzrg for pod openshift-network-diagnostics/network-check-target-qt6gw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:45:42.574844 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:42.574841 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9629113a-f227-4d19-a2ce-b9e201dcefbd-kube-api-access-rnzrg podName:9629113a-f227-4d19-a2ce-b9e201dcefbd nodeName:}" failed. No retries permitted until 2026-09-10 12:45:43.074823685 +0000 UTC m=+2.107436454 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rnzrg" (UniqueName: "kubernetes.io/projected/9629113a-f227-4d19-a2ce-b9e201dcefbd-kube-api-access-rnzrg") pod "network-check-target-qt6gw" (UID: "9629113a-f227-4d19-a2ce-b9e201dcefbd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:45:42.576625 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.576596 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xvzc\" (UniqueName: \"kubernetes.io/projected/66aedc7d-c4ff-47e4-8417-5f72f4c54053-kube-api-access-4xvzc\") pod \"aws-ebs-csi-driver-node-wtwjb\" (UID: \"66aedc7d-c4ff-47e4-8417-5f72f4c54053\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtwjb" Sep 10 12:45:42.576896 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.576880 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqphs\" (UniqueName: \"kubernetes.io/projected/32029bf2-b2b1-4a78-ac29-1aa65ee60328-kube-api-access-zqphs\") pod \"node-ca-8htgx\" (UID: \"32029bf2-b2b1-4a78-ac29-1aa65ee60328\") " pod="openshift-image-registry/node-ca-8htgx" Sep 10 12:45:42.577434 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.577416 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szhzp\" (UniqueName: \"kubernetes.io/projected/3a2efb90-0ec4-4480-b918-1b1cfc03b658-kube-api-access-szhzp\") pod \"multus-g8m8c\" (UID: \"3a2efb90-0ec4-4480-b918-1b1cfc03b658\") " pod="openshift-multus/multus-g8m8c" Sep 10 12:45:42.578030 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.578012 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wzfp\" (UniqueName: \"kubernetes.io/projected/1335b6c2-94c2-40c5-97a0-f588fac570e9-kube-api-access-4wzfp\") pod \"ovnkube-node-4sphq\" (UID: \"1335b6c2-94c2-40c5-97a0-f588fac570e9\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.578782 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.578764 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8v2s\" (UniqueName: \"kubernetes.io/projected/7cb323c0-b8cf-40fd-9931-78b8db058640-kube-api-access-f8v2s\") pod \"tuned-kdbsr\" (UID: \"7cb323c0-b8cf-40fd-9931-78b8db058640\") " pod="openshift-cluster-node-tuning-operator/tuned-kdbsr" Sep 10 12:45:42.579965 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.579947 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djpml\" (UniqueName: \"kubernetes.io/projected/8c429ad1-3c1f-41a5-9759-671b36d5ee17-kube-api-access-djpml\") pod \"network-metrics-daemon-f9qs9\" (UID: \"8c429ad1-3c1f-41a5-9759-671b36d5ee17\") " pod="openshift-multus/network-metrics-daemon-f9qs9" Sep 10 12:45:42.688266 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.688188 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hnwpz" Sep 10 12:45:42.693600 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.693579 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:45:42.711268 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.711238 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtwjb" Sep 10 12:45:42.726939 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.726917 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g8m8c" Sep 10 12:45:42.731681 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.731662 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9vttg" Sep 10 12:45:42.733800 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.733775 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fbs4n" Sep 10 12:45:42.765850 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.765821 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8htgx" Sep 10 12:45:42.786499 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.786478 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rfpgn" Sep 10 12:45:42.791138 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:42.791120 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kdbsr" Sep 10 12:45:43.065829 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:43.065750 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b0dc0a6-6df7-464d-9890-3ee7814c618e-original-pull-secret\") pod \"global-pull-secret-syncer-nxpwf\" (UID: \"2b0dc0a6-6df7-464d-9890-3ee7814c618e\") " pod="kube-system/global-pull-secret-syncer-nxpwf" Sep 10 12:45:43.065829 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:43.065806 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c429ad1-3c1f-41a5-9759-671b36d5ee17-metrics-certs\") pod \"network-metrics-daemon-f9qs9\" (UID: \"8c429ad1-3c1f-41a5-9759-671b36d5ee17\") " pod="openshift-multus/network-metrics-daemon-f9qs9" Sep 10 12:45:43.066166 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:43.065906 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:45:43.066166 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:43.065931 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 12:45:43.066166 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:43.065971 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c429ad1-3c1f-41a5-9759-671b36d5ee17-metrics-certs podName:8c429ad1-3c1f-41a5-9759-671b36d5ee17 nodeName:}" failed. No retries permitted until 2026-09-10 12:45:44.065946501 +0000 UTC m=+3.098559270 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c429ad1-3c1f-41a5-9759-671b36d5ee17-metrics-certs") pod "network-metrics-daemon-f9qs9" (UID: "8c429ad1-3c1f-41a5-9759-671b36d5ee17") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:45:43.066166 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:43.065998 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b0dc0a6-6df7-464d-9890-3ee7814c618e-original-pull-secret podName:2b0dc0a6-6df7-464d-9890-3ee7814c618e nodeName:}" failed. No retries permitted until 2026-09-10 12:45:44.065981447 +0000 UTC m=+3.098594215 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b0dc0a6-6df7-464d-9890-3ee7814c618e-original-pull-secret") pod "global-pull-secret-syncer-nxpwf" (UID: "2b0dc0a6-6df7-464d-9890-3ee7814c618e") : object "kube-system"/"original-pull-secret" not registered Sep 10 12:45:43.166428 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:43.166385 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnzrg\" (UniqueName: \"kubernetes.io/projected/9629113a-f227-4d19-a2ce-b9e201dcefbd-kube-api-access-rnzrg\") pod \"network-check-target-qt6gw\" (UID: \"9629113a-f227-4d19-a2ce-b9e201dcefbd\") " pod="openshift-network-diagnostics/network-check-target-qt6gw" Sep 10 12:45:43.166621 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:43.166602 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 12:45:43.166698 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:43.166630 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 12:45:43.166698 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:43.166644 2577 projected.go:196] Error preparing data for projected volume kube-api-access-rnzrg for pod openshift-network-diagnostics/network-check-target-qt6gw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:45:43.166698 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:43.166634 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46b92e8128d979327e8571fe66873758.slice/crio-fc86c004034fa5dd7c880bbbcfced72eaf0610aeb237f7613e24c5fc2513d3d7 WatchSource:0}: Error finding container fc86c004034fa5dd7c880bbbcfced72eaf0610aeb237f7613e24c5fc2513d3d7: Status 404 returned error can't find the container with id fc86c004034fa5dd7c880bbbcfced72eaf0610aeb237f7613e24c5fc2513d3d7 Sep 10 12:45:43.166828 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:43.166720 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9629113a-f227-4d19-a2ce-b9e201dcefbd-kube-api-access-rnzrg podName:9629113a-f227-4d19-a2ce-b9e201dcefbd nodeName:}" failed. No retries permitted until 2026-09-10 12:45:44.166696301 +0000 UTC m=+3.199309081 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rnzrg" (UniqueName: "kubernetes.io/projected/9629113a-f227-4d19-a2ce-b9e201dcefbd-kube-api-access-rnzrg") pod "network-check-target-qt6gw" (UID: "9629113a-f227-4d19-a2ce-b9e201dcefbd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:45:43.173406 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:43.173383 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 12:45:43.174085 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:43.174059 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28a60915b4725d613f028290262a63dc.slice/crio-4c3fa85dc039d43b0178dbc21c31df47beb7ab5db0e3d0941b2d0893407601ab WatchSource:0}: Error finding container 4c3fa85dc039d43b0178dbc21c31df47beb7ab5db0e3d0941b2d0893407601ab: Status 404 returned error can't find the container with id 4c3fa85dc039d43b0178dbc21c31df47beb7ab5db0e3d0941b2d0893407601ab Sep 10 12:45:43.178799 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:43.178772 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode73d37ca_36d4_43f1_a967_0022bc31cc28.slice/crio-2bcc9bbfe326ddcf57ab9189d3b0dd271c082bee3b0fb5eaeae5a76c346a5e29 WatchSource:0}: Error finding container 2bcc9bbfe326ddcf57ab9189d3b0dd271c082bee3b0fb5eaeae5a76c346a5e29: Status 404 returned error can't find the container with id 2bcc9bbfe326ddcf57ab9189d3b0dd271c082bee3b0fb5eaeae5a76c346a5e29 Sep 10 12:45:43.179433 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:43.179411 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a2efb90_0ec4_4480_b918_1b1cfc03b658.slice/crio-d202af1a14976d606dd1923ab8a6ad9d173cd4be1879c671a598d671554416b3 WatchSource:0}: Error finding container d202af1a14976d606dd1923ab8a6ad9d173cd4be1879c671a598d671554416b3: Status 404 returned error can't find the container with id d202af1a14976d606dd1923ab8a6ad9d173cd4be1879c671a598d671554416b3 Sep 10 12:45:43.180251 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:43.180232 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1335b6c2_94c2_40c5_97a0_f588fac570e9.slice/crio-edfa1da328049924c13b5cee4bbbf96aa002aba4464a34b7050b53d466387bad WatchSource:0}: Error finding container edfa1da328049924c13b5cee4bbbf96aa002aba4464a34b7050b53d466387bad: Status 404 returned error can't find the container with id edfa1da328049924c13b5cee4bbbf96aa002aba4464a34b7050b53d466387bad Sep 10 12:45:43.206076 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:43.206042 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod969c2051_92b9_4d3e_85f4_3e6139609dcd.slice/crio-2d3e12fc4b06a157d1909c25fad8ae0747f83c25cb40c1e2fd16ba748f392976 WatchSource:0}: Error finding container 2d3e12fc4b06a157d1909c25fad8ae0747f83c25cb40c1e2fd16ba748f392976: Status 404 returned error can't find the container with id 2d3e12fc4b06a157d1909c25fad8ae0747f83c25cb40c1e2fd16ba748f392976 Sep 10 12:45:43.225630 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:43.225591 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6d266d9_2de4_4b51_9900_20e96cd6f6a7.slice/crio-5646bd2ee56c29bbca3bb26d3624cbcfb4c84788c484373575f682e997ff679d WatchSource:0}: Error finding container 5646bd2ee56c29bbca3bb26d3624cbcfb4c84788c484373575f682e997ff679d: Status 404 returned error can't find the container with id 5646bd2ee56c29bbca3bb26d3624cbcfb4c84788c484373575f682e997ff679d Sep 10 12:45:43.232034 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:43.232010 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66aedc7d_c4ff_47e4_8417_5f72f4c54053.slice/crio-0b4015a6e3c0f1d267725e07673538947723d7f24be1f40b6c179092536272bc WatchSource:0}: Error finding container 0b4015a6e3c0f1d267725e07673538947723d7f24be1f40b6c179092536272bc: Status 404 returned error can't find the container with id 0b4015a6e3c0f1d267725e07673538947723d7f24be1f40b6c179092536272bc Sep 10 12:45:43.280635 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:43.280606 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32029bf2_b2b1_4a78_ac29_1aa65ee60328.slice/crio-e3219e5e080c5e0cf53bdaef0c057c731d87f30d021b48eec64a993d78282396 WatchSource:0}: Error finding container e3219e5e080c5e0cf53bdaef0c057c731d87f30d021b48eec64a993d78282396: Status 404 returned error can't find the container with id e3219e5e080c5e0cf53bdaef0c057c731d87f30d021b48eec64a993d78282396 Sep 10 12:45:43.412758 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:43.412651 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 12:40:42 +0000 UTC" deadline="2028-06-09 21:54:56.547751864 +0000 UTC" Sep 10 12:45:43.412758 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:43.412699 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15321h9m13.135055654s" Sep 10 12:45:43.492294 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:43.492267 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxpwf" Sep 10 12:45:43.492438 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:43.492396 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxpwf" podUID="2b0dc0a6-6df7-464d-9890-3ee7814c618e" Sep 10 12:45:43.495405 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:43.495361 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8htgx" event={"ID":"32029bf2-b2b1-4a78-ac29-1aa65ee60328","Type":"ContainerStarted","Data":"e3219e5e080c5e0cf53bdaef0c057c731d87f30d021b48eec64a993d78282396"} Sep 10 12:45:43.496405 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:43.496381 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9vttg" event={"ID":"f6d266d9-2de4-4b51-9900-20e96cd6f6a7","Type":"ContainerStarted","Data":"5646bd2ee56c29bbca3bb26d3624cbcfb4c84788c484373575f682e997ff679d"} Sep 10 12:45:43.497427 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:43.497405 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g8m8c" event={"ID":"3a2efb90-0ec4-4480-b918-1b1cfc03b658","Type":"ContainerStarted","Data":"d202af1a14976d606dd1923ab8a6ad9d173cd4be1879c671a598d671554416b3"} Sep 10 12:45:43.498577 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:43.498553 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hnwpz" event={"ID":"e73d37ca-36d4-43f1-a967-0022bc31cc28","Type":"ContainerStarted","Data":"2bcc9bbfe326ddcf57ab9189d3b0dd271c082bee3b0fb5eaeae5a76c346a5e29"} Sep 10 12:45:43.499504 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:43.499484 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-146.ec2.internal" event={"ID":"46b92e8128d979327e8571fe66873758","Type":"ContainerStarted","Data":"fc86c004034fa5dd7c880bbbcfced72eaf0610aeb237f7613e24c5fc2513d3d7"} Sep 10 12:45:43.500508 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:43.500490 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtwjb" event={"ID":"66aedc7d-c4ff-47e4-8417-5f72f4c54053","Type":"ContainerStarted","Data":"0b4015a6e3c0f1d267725e07673538947723d7f24be1f40b6c179092536272bc"} Sep 10 12:45:43.501700 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:43.501681 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbs4n" event={"ID":"969c2051-92b9-4d3e-85f4-3e6139609dcd","Type":"ContainerStarted","Data":"2d3e12fc4b06a157d1909c25fad8ae0747f83c25cb40c1e2fd16ba748f392976"} Sep 10 12:45:43.502889 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:43.502865 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" event={"ID":"1335b6c2-94c2-40c5-97a0-f588fac570e9","Type":"ContainerStarted","Data":"edfa1da328049924c13b5cee4bbbf96aa002aba4464a34b7050b53d466387bad"} Sep 10 12:45:43.503980 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:43.503961 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-146.ec2.internal" event={"ID":"28a60915b4725d613f028290262a63dc","Type":"ContainerStarted","Data":"4c3fa85dc039d43b0178dbc21c31df47beb7ab5db0e3d0941b2d0893407601ab"} Sep 10 12:45:43.531254 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:43.531226 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 12:45:44.072872 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:44.072786 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c429ad1-3c1f-41a5-9759-671b36d5ee17-metrics-certs\") pod \"network-metrics-daemon-f9qs9\" (UID: \"8c429ad1-3c1f-41a5-9759-671b36d5ee17\") " pod="openshift-multus/network-metrics-daemon-f9qs9" Sep 10 12:45:44.072872 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:44.072870 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b0dc0a6-6df7-464d-9890-3ee7814c618e-original-pull-secret\") pod \"global-pull-secret-syncer-nxpwf\" (UID: \"2b0dc0a6-6df7-464d-9890-3ee7814c618e\") " pod="kube-system/global-pull-secret-syncer-nxpwf" Sep 10 12:45:44.073121 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:44.073020 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 12:45:44.073121 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:44.073083 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b0dc0a6-6df7-464d-9890-3ee7814c618e-original-pull-secret podName:2b0dc0a6-6df7-464d-9890-3ee7814c618e nodeName:}" failed. No retries permitted until 2026-09-10 12:45:46.073064664 +0000 UTC m=+5.105677443 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b0dc0a6-6df7-464d-9890-3ee7814c618e-original-pull-secret") pod "global-pull-secret-syncer-nxpwf" (UID: "2b0dc0a6-6df7-464d-9890-3ee7814c618e") : object "kube-system"/"original-pull-secret" not registered Sep 10 12:45:44.073271 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:44.073173 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:45:44.073271 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:44.073212 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c429ad1-3c1f-41a5-9759-671b36d5ee17-metrics-certs podName:8c429ad1-3c1f-41a5-9759-671b36d5ee17 nodeName:}" failed. No retries permitted until 2026-09-10 12:45:46.073200002 +0000 UTC m=+5.105812758 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c429ad1-3c1f-41a5-9759-671b36d5ee17-metrics-certs") pod "network-metrics-daemon-f9qs9" (UID: "8c429ad1-3c1f-41a5-9759-671b36d5ee17") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:45:44.175139 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:44.175104 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnzrg\" (UniqueName: \"kubernetes.io/projected/9629113a-f227-4d19-a2ce-b9e201dcefbd-kube-api-access-rnzrg\") pod \"network-check-target-qt6gw\" (UID: \"9629113a-f227-4d19-a2ce-b9e201dcefbd\") " pod="openshift-network-diagnostics/network-check-target-qt6gw" Sep 10 12:45:44.175333 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:44.175295 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 12:45:44.175333 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:44.175323 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 12:45:44.175442 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:44.175337 2577 projected.go:196] Error preparing data for projected volume kube-api-access-rnzrg for pod openshift-network-diagnostics/network-check-target-qt6gw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:45:44.175442 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:44.175398 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9629113a-f227-4d19-a2ce-b9e201dcefbd-kube-api-access-rnzrg podName:9629113a-f227-4d19-a2ce-b9e201dcefbd nodeName:}" failed. No retries permitted until 2026-09-10 12:45:46.175380334 +0000 UTC m=+5.207993095 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rnzrg" (UniqueName: "kubernetes.io/projected/9629113a-f227-4d19-a2ce-b9e201dcefbd-kube-api-access-rnzrg") pod "network-check-target-qt6gw" (UID: "9629113a-f227-4d19-a2ce-b9e201dcefbd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:45:44.344722 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:45:44.344602 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda71dc7da_816c_4cae_af16_dbdd1c3805fe.slice/crio-6f8da6a84244223b99b4ee5a2fbcf84f554a0e0148492e9fd52b06406d828030 WatchSource:0}: Error finding container 6f8da6a84244223b99b4ee5a2fbcf84f554a0e0148492e9fd52b06406d828030: Status 404 returned error can't find the container with id 6f8da6a84244223b99b4ee5a2fbcf84f554a0e0148492e9fd52b06406d828030 Sep 10 12:45:44.413091 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:44.413029 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 12:40:42 +0000 UTC" deadline="2028-05-31 19:05:24.33394137 +0000 UTC" Sep 10 12:45:44.413091 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:44.413071 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15102h19m39.920875796s" Sep 10 12:45:44.457123 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:44.457087 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 12:45:44.491997 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:44.491964 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qt6gw" Sep 10 12:45:44.492194 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:44.492114 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qt6gw" podUID="9629113a-f227-4d19-a2ce-b9e201dcefbd" Sep 10 12:45:44.492575 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:44.492555 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f9qs9" Sep 10 12:45:44.492692 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:44.492671 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f9qs9" podUID="8c429ad1-3c1f-41a5-9759-671b36d5ee17" Sep 10 12:45:44.511078 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:44.511043 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rfpgn" event={"ID":"a71dc7da-816c-4cae-af16-dbdd1c3805fe","Type":"ContainerStarted","Data":"6f8da6a84244223b99b4ee5a2fbcf84f554a0e0148492e9fd52b06406d828030"} Sep 10 12:45:44.515136 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:44.515105 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kdbsr" event={"ID":"7cb323c0-b8cf-40fd-9931-78b8db058640","Type":"ContainerStarted","Data":"49b4d3c179b42fa5411b99cf055359a84bb9d031f42326798835f067db2ea3f7"} Sep 10 12:45:45.108751 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:45.108703 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 12:45:45.493283 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:45.493200 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxpwf" Sep 10 12:45:45.493730 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:45.493363 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxpwf" podUID="2b0dc0a6-6df7-464d-9890-3ee7814c618e" Sep 10 12:45:46.093164 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:46.093116 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c429ad1-3c1f-41a5-9759-671b36d5ee17-metrics-certs\") pod \"network-metrics-daemon-f9qs9\" (UID: \"8c429ad1-3c1f-41a5-9759-671b36d5ee17\") " pod="openshift-multus/network-metrics-daemon-f9qs9" Sep 10 12:45:46.093334 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:46.093296 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b0dc0a6-6df7-464d-9890-3ee7814c618e-original-pull-secret\") pod \"global-pull-secret-syncer-nxpwf\" (UID: \"2b0dc0a6-6df7-464d-9890-3ee7814c618e\") " pod="kube-system/global-pull-secret-syncer-nxpwf" Sep 10 12:45:46.093334 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:46.093314 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:45:46.093460 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:46.093399 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c429ad1-3c1f-41a5-9759-671b36d5ee17-metrics-certs podName:8c429ad1-3c1f-41a5-9759-671b36d5ee17 nodeName:}" failed. No retries permitted until 2026-09-10 12:45:50.093378271 +0000 UTC m=+9.125991032 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c429ad1-3c1f-41a5-9759-671b36d5ee17-metrics-certs") pod "network-metrics-daemon-f9qs9" (UID: "8c429ad1-3c1f-41a5-9759-671b36d5ee17") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:45:46.093460 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:46.093433 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 12:45:46.093569 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:46.093502 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b0dc0a6-6df7-464d-9890-3ee7814c618e-original-pull-secret podName:2b0dc0a6-6df7-464d-9890-3ee7814c618e nodeName:}" failed. No retries permitted until 2026-09-10 12:45:50.093482722 +0000 UTC m=+9.126095483 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b0dc0a6-6df7-464d-9890-3ee7814c618e-original-pull-secret") pod "global-pull-secret-syncer-nxpwf" (UID: "2b0dc0a6-6df7-464d-9890-3ee7814c618e") : object "kube-system"/"original-pull-secret" not registered Sep 10 12:45:46.194627 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:46.194538 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnzrg\" (UniqueName: \"kubernetes.io/projected/9629113a-f227-4d19-a2ce-b9e201dcefbd-kube-api-access-rnzrg\") pod \"network-check-target-qt6gw\" (UID: \"9629113a-f227-4d19-a2ce-b9e201dcefbd\") " pod="openshift-network-diagnostics/network-check-target-qt6gw" Sep 10 12:45:46.194857 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:46.194766 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 12:45:46.194857 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:46.194788 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 12:45:46.194857 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:46.194800 2577 projected.go:196] Error preparing data for projected volume kube-api-access-rnzrg for pod openshift-network-diagnostics/network-check-target-qt6gw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:45:46.195041 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:46.194862 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9629113a-f227-4d19-a2ce-b9e201dcefbd-kube-api-access-rnzrg podName:9629113a-f227-4d19-a2ce-b9e201dcefbd nodeName:}" failed. No retries permitted until 2026-09-10 12:45:50.1948396 +0000 UTC m=+9.227452373 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rnzrg" (UniqueName: "kubernetes.io/projected/9629113a-f227-4d19-a2ce-b9e201dcefbd-kube-api-access-rnzrg") pod "network-check-target-qt6gw" (UID: "9629113a-f227-4d19-a2ce-b9e201dcefbd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:45:46.491989 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:46.491902 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qt6gw" Sep 10 12:45:46.492174 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:46.492037 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qt6gw" podUID="9629113a-f227-4d19-a2ce-b9e201dcefbd" Sep 10 12:45:46.492267 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:46.492239 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f9qs9" Sep 10 12:45:46.492360 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:46.492339 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f9qs9" podUID="8c429ad1-3c1f-41a5-9759-671b36d5ee17" Sep 10 12:45:47.494494 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:47.494456 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxpwf" Sep 10 12:45:47.495086 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:47.494592 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxpwf" podUID="2b0dc0a6-6df7-464d-9890-3ee7814c618e" Sep 10 12:45:48.492246 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:48.492193 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qt6gw" Sep 10 12:45:48.492421 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:48.492326 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qt6gw" podUID="9629113a-f227-4d19-a2ce-b9e201dcefbd" Sep 10 12:45:48.492976 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:48.492804 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f9qs9" Sep 10 12:45:48.492976 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:48.492919 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f9qs9" podUID="8c429ad1-3c1f-41a5-9759-671b36d5ee17" Sep 10 12:45:49.491530 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:49.491497 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxpwf" Sep 10 12:45:49.491942 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:49.491635 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxpwf" podUID="2b0dc0a6-6df7-464d-9890-3ee7814c618e" Sep 10 12:45:50.126641 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:50.126599 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b0dc0a6-6df7-464d-9890-3ee7814c618e-original-pull-secret\") pod \"global-pull-secret-syncer-nxpwf\" (UID: \"2b0dc0a6-6df7-464d-9890-3ee7814c618e\") " pod="kube-system/global-pull-secret-syncer-nxpwf" Sep 10 12:45:50.126835 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:50.126685 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c429ad1-3c1f-41a5-9759-671b36d5ee17-metrics-certs\") pod \"network-metrics-daemon-f9qs9\" (UID: \"8c429ad1-3c1f-41a5-9759-671b36d5ee17\") " pod="openshift-multus/network-metrics-daemon-f9qs9" Sep 10 12:45:50.126835 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:50.126771 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 12:45:50.126835 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:50.126811 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:45:50.126977 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:50.126852 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b0dc0a6-6df7-464d-9890-3ee7814c618e-original-pull-secret podName:2b0dc0a6-6df7-464d-9890-3ee7814c618e nodeName:}" failed. No retries permitted until 2026-09-10 12:45:58.126829163 +0000 UTC m=+17.159441918 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b0dc0a6-6df7-464d-9890-3ee7814c618e-original-pull-secret") pod "global-pull-secret-syncer-nxpwf" (UID: "2b0dc0a6-6df7-464d-9890-3ee7814c618e") : object "kube-system"/"original-pull-secret" not registered Sep 10 12:45:50.126977 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:50.126876 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c429ad1-3c1f-41a5-9759-671b36d5ee17-metrics-certs podName:8c429ad1-3c1f-41a5-9759-671b36d5ee17 nodeName:}" failed. No retries permitted until 2026-09-10 12:45:58.126863423 +0000 UTC m=+17.159476178 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c429ad1-3c1f-41a5-9759-671b36d5ee17-metrics-certs") pod "network-metrics-daemon-f9qs9" (UID: "8c429ad1-3c1f-41a5-9759-671b36d5ee17") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:45:50.227676 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:50.227636 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnzrg\" (UniqueName: \"kubernetes.io/projected/9629113a-f227-4d19-a2ce-b9e201dcefbd-kube-api-access-rnzrg\") pod \"network-check-target-qt6gw\" (UID: \"9629113a-f227-4d19-a2ce-b9e201dcefbd\") " pod="openshift-network-diagnostics/network-check-target-qt6gw" Sep 10 12:45:50.227855 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:50.227832 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 12:45:50.227914 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:50.227860 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 12:45:50.227914 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:50.227874 2577 projected.go:196] Error preparing data for projected volume kube-api-access-rnzrg for pod openshift-network-diagnostics/network-check-target-qt6gw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:45:50.228003 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:50.227937 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9629113a-f227-4d19-a2ce-b9e201dcefbd-kube-api-access-rnzrg podName:9629113a-f227-4d19-a2ce-b9e201dcefbd nodeName:}" failed. No retries permitted until 2026-09-10 12:45:58.22791694 +0000 UTC m=+17.260529712 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rnzrg" (UniqueName: "kubernetes.io/projected/9629113a-f227-4d19-a2ce-b9e201dcefbd-kube-api-access-rnzrg") pod "network-check-target-qt6gw" (UID: "9629113a-f227-4d19-a2ce-b9e201dcefbd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:45:50.492636 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:50.492074 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qt6gw" Sep 10 12:45:50.492636 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:50.492249 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f9qs9" Sep 10 12:45:50.492636 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:50.492381 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f9qs9" podUID="8c429ad1-3c1f-41a5-9759-671b36d5ee17" Sep 10 12:45:50.492636 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:50.492243 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qt6gw" podUID="9629113a-f227-4d19-a2ce-b9e201dcefbd" Sep 10 12:45:51.497361 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:51.497324 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxpwf" Sep 10 12:45:51.498132 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:51.498077 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxpwf" podUID="2b0dc0a6-6df7-464d-9890-3ee7814c618e" Sep 10 12:45:52.492309 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:52.492277 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qt6gw" Sep 10 12:45:52.492479 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:52.492404 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qt6gw" podUID="9629113a-f227-4d19-a2ce-b9e201dcefbd" Sep 10 12:45:52.492479 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:52.492465 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f9qs9" Sep 10 12:45:52.492623 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:52.492593 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f9qs9" podUID="8c429ad1-3c1f-41a5-9759-671b36d5ee17" Sep 10 12:45:53.492244 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:53.492206 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxpwf" Sep 10 12:45:53.492634 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:53.492372 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxpwf" podUID="2b0dc0a6-6df7-464d-9890-3ee7814c618e" Sep 10 12:45:54.491631 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:54.491596 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qt6gw" Sep 10 12:45:54.491790 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:54.491600 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f9qs9" Sep 10 12:45:54.491790 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:54.491698 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qt6gw" podUID="9629113a-f227-4d19-a2ce-b9e201dcefbd" Sep 10 12:45:54.491907 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:54.491809 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f9qs9" podUID="8c429ad1-3c1f-41a5-9759-671b36d5ee17" Sep 10 12:45:55.491662 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:55.491626 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxpwf" Sep 10 12:45:55.492137 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:55.491758 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxpwf" podUID="2b0dc0a6-6df7-464d-9890-3ee7814c618e" Sep 10 12:45:56.491456 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:56.491416 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qt6gw" Sep 10 12:45:56.491635 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:56.491466 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f9qs9" Sep 10 12:45:56.491635 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:56.491555 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qt6gw" podUID="9629113a-f227-4d19-a2ce-b9e201dcefbd" Sep 10 12:45:56.492067 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:56.491667 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f9qs9" podUID="8c429ad1-3c1f-41a5-9759-671b36d5ee17" Sep 10 12:45:57.492301 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:57.492263 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxpwf" Sep 10 12:45:57.492775 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:57.492395 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxpwf" podUID="2b0dc0a6-6df7-464d-9890-3ee7814c618e" Sep 10 12:45:58.189937 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:58.189911 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b0dc0a6-6df7-464d-9890-3ee7814c618e-original-pull-secret\") pod \"global-pull-secret-syncer-nxpwf\" (UID: \"2b0dc0a6-6df7-464d-9890-3ee7814c618e\") " pod="kube-system/global-pull-secret-syncer-nxpwf" Sep 10 12:45:58.190091 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:58.189958 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c429ad1-3c1f-41a5-9759-671b36d5ee17-metrics-certs\") pod \"network-metrics-daemon-f9qs9\" (UID: \"8c429ad1-3c1f-41a5-9759-671b36d5ee17\") " pod="openshift-multus/network-metrics-daemon-f9qs9" Sep 10 12:45:58.190091 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:58.190073 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 12:45:58.190091 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:58.190087 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:45:58.190247 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:58.190159 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b0dc0a6-6df7-464d-9890-3ee7814c618e-original-pull-secret podName:2b0dc0a6-6df7-464d-9890-3ee7814c618e nodeName:}" failed. No retries permitted until 2026-09-10 12:46:14.190128336 +0000 UTC m=+33.222741095 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b0dc0a6-6df7-464d-9890-3ee7814c618e-original-pull-secret") pod "global-pull-secret-syncer-nxpwf" (UID: "2b0dc0a6-6df7-464d-9890-3ee7814c618e") : object "kube-system"/"original-pull-secret" not registered Sep 10 12:45:58.190247 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:58.190179 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c429ad1-3c1f-41a5-9759-671b36d5ee17-metrics-certs podName:8c429ad1-3c1f-41a5-9759-671b36d5ee17 nodeName:}" failed. No retries permitted until 2026-09-10 12:46:14.190168622 +0000 UTC m=+33.222781377 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c429ad1-3c1f-41a5-9759-671b36d5ee17-metrics-certs") pod "network-metrics-daemon-f9qs9" (UID: "8c429ad1-3c1f-41a5-9759-671b36d5ee17") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:45:58.290317 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:58.290285 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnzrg\" (UniqueName: \"kubernetes.io/projected/9629113a-f227-4d19-a2ce-b9e201dcefbd-kube-api-access-rnzrg\") pod \"network-check-target-qt6gw\" (UID: \"9629113a-f227-4d19-a2ce-b9e201dcefbd\") " pod="openshift-network-diagnostics/network-check-target-qt6gw" Sep 10 12:45:58.290484 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:58.290452 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 12:45:58.290484 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:58.290479 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 12:45:58.290568 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:58.290495 2577 projected.go:196] Error preparing data for projected volume kube-api-access-rnzrg for pod openshift-network-diagnostics/network-check-target-qt6gw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:45:58.290568 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:58.290546 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9629113a-f227-4d19-a2ce-b9e201dcefbd-kube-api-access-rnzrg podName:9629113a-f227-4d19-a2ce-b9e201dcefbd nodeName:}" failed. No retries permitted until 2026-09-10 12:46:14.290531444 +0000 UTC m=+33.323144217 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rnzrg" (UniqueName: "kubernetes.io/projected/9629113a-f227-4d19-a2ce-b9e201dcefbd-kube-api-access-rnzrg") pod "network-check-target-qt6gw" (UID: "9629113a-f227-4d19-a2ce-b9e201dcefbd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:45:58.491822 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:58.491742 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f9qs9" Sep 10 12:45:58.491993 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:58.491884 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f9qs9" podUID="8c429ad1-3c1f-41a5-9759-671b36d5ee17" Sep 10 12:45:58.491993 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:58.491903 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qt6gw" Sep 10 12:45:58.492172 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:58.492026 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qt6gw" podUID="9629113a-f227-4d19-a2ce-b9e201dcefbd" Sep 10 12:45:59.491647 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:45:59.491607 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxpwf" Sep 10 12:45:59.492055 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:45:59.491746 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxpwf" podUID="2b0dc0a6-6df7-464d-9890-3ee7814c618e" Sep 10 12:46:00.492277 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:00.492242 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qt6gw" Sep 10 12:46:00.492690 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:00.492243 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f9qs9" Sep 10 12:46:00.492690 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:00.492373 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qt6gw" podUID="9629113a-f227-4d19-a2ce-b9e201dcefbd" Sep 10 12:46:00.492690 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:00.492441 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f9qs9" podUID="8c429ad1-3c1f-41a5-9759-671b36d5ee17" Sep 10 12:46:01.492979 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:01.492937 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxpwf" Sep 10 12:46:01.493450 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:01.493061 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxpwf" podUID="2b0dc0a6-6df7-464d-9890-3ee7814c618e" Sep 10 12:46:02.492506 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:02.491737 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qt6gw" Sep 10 12:46:02.492506 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:02.492325 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qt6gw" podUID="9629113a-f227-4d19-a2ce-b9e201dcefbd" Sep 10 12:46:02.492699 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:02.491789 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f9qs9" Sep 10 12:46:02.492810 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:02.492784 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f9qs9" podUID="8c429ad1-3c1f-41a5-9759-671b36d5ee17" Sep 10 12:46:02.563124 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:02.562837 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" event={"ID":"1335b6c2-94c2-40c5-97a0-f588fac570e9","Type":"ContainerStarted","Data":"b61a631dbe404c395c86cec435358470f7ce85d726d5eeabd71e38b8c3ce0bf3"} Sep 10 12:46:02.563124 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:02.562972 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" event={"ID":"1335b6c2-94c2-40c5-97a0-f588fac570e9","Type":"ContainerStarted","Data":"36c0bd0096eb62fdd4783db14dc356a979467e7076450b03d87d3cae87f2307c"} Sep 10 12:46:02.563124 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:02.563026 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" event={"ID":"1335b6c2-94c2-40c5-97a0-f588fac570e9","Type":"ContainerStarted","Data":"dc01d3408543d95f8ba077c15af62f690dbfa8c46108f16f975e901392ef62d3"} Sep 10 12:46:02.563970 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:02.563076 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" event={"ID":"1335b6c2-94c2-40c5-97a0-f588fac570e9","Type":"ContainerStarted","Data":"b1e7c1324dfe4d50f099260b87025d0efe1dfaeaff4a91fa19aa77c6ada81c9d"} Sep 10 12:46:02.566705 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:02.566428 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-146.ec2.internal" event={"ID":"28a60915b4725d613f028290262a63dc","Type":"ContainerStarted","Data":"f41ab402542846b514a8eb43f0dcf8b574b6cd0bc652d308f9f14bcd5dd6c08a"} Sep 10 12:46:02.570799 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:02.570766 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kdbsr" event={"ID":"7cb323c0-b8cf-40fd-9931-78b8db058640","Type":"ContainerStarted","Data":"4722557f49e05ebff8f5b5a509e2d9b839db4f5744b3a62a4617f08e36d5c2cf"} Sep 10 12:46:02.576172 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:02.575529 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g8m8c" event={"ID":"3a2efb90-0ec4-4480-b918-1b1cfc03b658","Type":"ContainerStarted","Data":"24547b5da934c1c0585470e70733b1b84756f545c2a598398f6f7fea4b627a0b"} Sep 10 12:46:02.605599 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:02.604504 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-146.ec2.internal" podStartSLOduration=20.604486815 podStartE2EDuration="20.604486815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:45:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:46:02.585739852 +0000 UTC m=+21.618352630" watchObservedRunningTime="2026-09-10 12:46:02.604486815 +0000 UTC m=+21.637099621" Sep 10 12:46:02.629506 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:02.629454 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kdbsr" podStartSLOduration=3.300271057 podStartE2EDuration="21.62943828s" totalImagesPullingTime="18.329167223s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:45:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:46:02.605519021 +0000 UTC m=+21.638131798" watchObservedRunningTime="2026-09-10 12:46:02.62943828 +0000 UTC m=+21.662051054" Sep 10 12:46:02.629705 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:02.629675 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-g8m8c" podStartSLOduration=2.673838969 podStartE2EDuration="21.629669093s" totalImagesPullingTime="18.955830124s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:45:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:46:02.629208746 +0000 UTC m=+21.661821520" watchObservedRunningTime="2026-09-10 12:46:02.629669093 +0000 UTC m=+21.662281870" Sep 10 12:46:03.492436 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:03.492362 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxpwf" Sep 10 12:46:03.492586 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:03.492498 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxpwf" podUID="2b0dc0a6-6df7-464d-9890-3ee7814c618e" Sep 10 12:46:03.578497 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:03.578465 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8htgx" event={"ID":"32029bf2-b2b1-4a78-ac29-1aa65ee60328","Type":"ContainerStarted","Data":"12b15cdd0c73d1093113d0f79e8de36a67c5222401ab811687058f2e493cb3da"} Sep 10 12:46:03.580094 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:03.580070 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9vttg" event={"ID":"f6d266d9-2de4-4b51-9900-20e96cd6f6a7","Type":"ContainerStarted","Data":"eaeb1a203fc615bb14a5b0577a6b68c9dc069b8f1603661a4e614aeb07e74b8f"} Sep 10 12:46:03.581845 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:03.581569 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hnwpz" event={"ID":"e73d37ca-36d4-43f1-a967-0022bc31cc28","Type":"ContainerStarted","Data":"789135829a021dd2f2efcac35275f8fc9a76e1e0cc50501e5b515d68d94657d6"} Sep 10 12:46:03.583086 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:03.583062 2577 generic.go:356] "Generic (PLEG): container finished" podID="46b92e8128d979327e8571fe66873758" containerID="a22af1f02165b2e536ba11a024276836132afaff54bc8b1479e70a3eef3e6887" exitCode=0 Sep 10 12:46:03.583214 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:03.583194 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-146.ec2.internal" event={"ID":"46b92e8128d979327e8571fe66873758","Type":"ContainerDied","Data":"a22af1f02165b2e536ba11a024276836132afaff54bc8b1479e70a3eef3e6887"} Sep 10 12:46:03.584627 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:03.584608 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtwjb" event={"ID":"66aedc7d-c4ff-47e4-8417-5f72f4c54053","Type":"ContainerStarted","Data":"3d7a08ac52b6b711c8826b40cb7d39849238377a5118763dfc413b331d600c07"} Sep 10 12:46:03.586158 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:03.586101 2577 generic.go:356] "Generic (PLEG): container finished" podID="969c2051-92b9-4d3e-85f4-3e6139609dcd" containerID="8d6d32f8c34d0d278e379cc0fce630bb562cd4371937c0edfbd0d6e92feedf4a" exitCode=0 Sep 10 12:46:03.586207 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:03.586170 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbs4n" event={"ID":"969c2051-92b9-4d3e-85f4-3e6139609dcd","Type":"ContainerDied","Data":"8d6d32f8c34d0d278e379cc0fce630bb562cd4371937c0edfbd0d6e92feedf4a"} Sep 10 12:46:03.589481 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:03.589460 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" event={"ID":"1335b6c2-94c2-40c5-97a0-f588fac570e9","Type":"ContainerStarted","Data":"35fce32314d763be1e6cef98967d5041188bef2ce8fe3a6e6cc8d39bf747a079"} Sep 10 12:46:03.589551 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:03.589534 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" event={"ID":"1335b6c2-94c2-40c5-97a0-f588fac570e9","Type":"ContainerStarted","Data":"3eee3ed7550fc712a8e36993049d390572d8cbde9ccb9a0dfef8bcecd082186d"} Sep 10 12:46:03.594351 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:03.594315 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8htgx" podStartSLOduration=3.764641206 podStartE2EDuration="22.594300637s" totalImagesPullingTime="18.829659431s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:45:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:46:03.593861479 +0000 UTC m=+22.626474260" watchObservedRunningTime="2026-09-10 12:46:03.594300637 +0000 UTC m=+22.626913414" Sep 10 12:46:03.654795 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:03.654082 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hnwpz" podStartSLOduration=3.768105699 podStartE2EDuration="22.654066861s" totalImagesPullingTime="18.885961162s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:45:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:46:03.653624918 +0000 UTC m=+22.686237696" watchObservedRunningTime="2026-09-10 12:46:03.654066861 +0000 UTC m=+22.686679638" Sep 10 12:46:03.669004 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:03.668955 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9vttg" podStartSLOduration=3.829562375 podStartE2EDuration="22.668940174s" totalImagesPullingTime="18.839377799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:45:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:46:03.668839449 +0000 UTC m=+22.701452226" watchObservedRunningTime="2026-09-10 12:46:03.668940174 +0000 UTC m=+22.701553226" Sep 10 12:46:03.691696 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:03.691660 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 10 12:46:04.422522 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:04.422425 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T12:46:03.691678654Z","UUID":"935ff53d-c041-49a2-922d-d601b5f62140","Handler":null,"Name":"","Endpoint":""} Sep 10 12:46:04.424323 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:04.424293 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 10 12:46:04.424447 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:04.424332 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 10 12:46:04.492063 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:04.492030 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f9qs9" Sep 10 12:46:04.492265 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:04.492196 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f9qs9" podUID="8c429ad1-3c1f-41a5-9759-671b36d5ee17" Sep 10 12:46:04.492331 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:04.492286 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qt6gw" Sep 10 12:46:04.492384 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:04.492358 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qt6gw" podUID="9629113a-f227-4d19-a2ce-b9e201dcefbd" Sep 10 12:46:04.594313 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:04.594232 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtwjb" event={"ID":"66aedc7d-c4ff-47e4-8417-5f72f4c54053","Type":"ContainerStarted","Data":"431bb1284afb9621cf7c21a663151b3e6920d7428f64edb0fa8f0bbfa09db3c5"} Sep 10 12:46:04.596202 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:04.596177 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rfpgn" event={"ID":"a71dc7da-816c-4cae-af16-dbdd1c3805fe","Type":"ContainerStarted","Data":"069f53955efa503a7f0b30b477cfc19d44b7f90a01bd84eefba0f595950b2789"} Sep 10 12:46:04.598225 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:04.598199 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-146.ec2.internal" event={"ID":"46b92e8128d979327e8571fe66873758","Type":"ContainerStarted","Data":"8ea4bda282dc8b1b31815f90f25457fe0bc20c775859df2f6c7bde3fd5841bdb"} Sep 10 12:46:04.615573 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:04.615519 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rfpgn" podStartSLOduration=5.864318678 podStartE2EDuration="23.615499677s" totalImagesPullingTime="17.751180999s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:45:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:46:04.615233881 +0000 UTC m=+23.647846659" watchObservedRunningTime="2026-09-10 12:46:04.615499677 +0000 UTC m=+23.648112456" Sep 10 12:46:04.633034 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:04.632979 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-146.ec2.internal" podStartSLOduration=22.632959616 podStartE2EDuration="22.632959616s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:45:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:46:04.632692672 +0000 UTC m=+23.665305452" watchObservedRunningTime="2026-09-10 12:46:04.632959616 +0000 UTC m=+23.665572396" Sep 10 12:46:05.491955 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:05.491916 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxpwf" Sep 10 12:46:05.492139 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:05.492047 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxpwf" podUID="2b0dc0a6-6df7-464d-9890-3ee7814c618e" Sep 10 12:46:05.603571 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:05.603533 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtwjb" event={"ID":"66aedc7d-c4ff-47e4-8417-5f72f4c54053","Type":"ContainerStarted","Data":"c4e762c2aaa3dba2b95b3f3883ab48b94f04227461a4d6165d29d6e263dab679"} Sep 10 12:46:05.607044 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:05.607009 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" event={"ID":"1335b6c2-94c2-40c5-97a0-f588fac570e9","Type":"ContainerStarted","Data":"abdbbbdb24f3d8b33129f13ef69a3d5207ed67832c924c704ec1c967401abc66"} Sep 10 12:46:05.626926 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:05.626878 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtwjb" podStartSLOduration=3.601766477 podStartE2EDuration="24.626862407s" totalImagesPullingTime="21.02509593s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:45:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:46:05.625489505 +0000 UTC m=+24.658102286" watchObservedRunningTime="2026-09-10 12:46:05.626862407 +0000 UTC m=+24.659475206" Sep 10 12:46:06.491600 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:06.491567 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qt6gw" Sep 10 12:46:06.491798 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:06.491683 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qt6gw" podUID="9629113a-f227-4d19-a2ce-b9e201dcefbd" Sep 10 12:46:06.491798 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:06.491733 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f9qs9" Sep 10 12:46:06.491881 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:06.491833 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f9qs9" podUID="8c429ad1-3c1f-41a5-9759-671b36d5ee17" Sep 10 12:46:06.584986 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:06.584950 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9vttg" Sep 10 12:46:06.585572 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:06.585555 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9vttg" Sep 10 12:46:06.609743 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:06.609700 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9vttg" Sep 10 12:46:06.610201 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:06.609988 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9vttg" Sep 10 12:46:07.492435 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:07.491783 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxpwf" Sep 10 12:46:07.492435 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:07.492087 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxpwf" podUID="2b0dc0a6-6df7-464d-9890-3ee7814c618e" Sep 10 12:46:07.616428 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:07.616391 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" event={"ID":"1335b6c2-94c2-40c5-97a0-f588fac570e9","Type":"ContainerStarted","Data":"d36c048e8972b23d6996537ee79abd66f5427333e299ca329cb1aca1c8779ff8"} Sep 10 12:46:07.616878 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:07.616766 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:46:07.633213 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:07.633190 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:46:07.648785 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:07.648723 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" podStartSLOduration=7.638107777 podStartE2EDuration="26.64870312s" totalImagesPullingTime="19.010595343s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:45:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:46:07.646410154 +0000 UTC m=+26.679022933" watchObservedRunningTime="2026-09-10 12:46:07.64870312 +0000 UTC m=+26.681315902" Sep 10 12:46:08.491788 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:08.491752 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qt6gw" Sep 10 12:46:08.491961 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:08.491865 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qt6gw" podUID="9629113a-f227-4d19-a2ce-b9e201dcefbd" Sep 10 12:46:08.491961 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:08.491756 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f9qs9" Sep 10 12:46:08.492077 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:08.492033 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f9qs9" podUID="8c429ad1-3c1f-41a5-9759-671b36d5ee17" Sep 10 12:46:08.620217 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:08.620186 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:46:08.620632 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:08.620292 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:46:08.636574 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:08.636546 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:46:09.002307 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:09.002274 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nxpwf"] Sep 10 12:46:09.002497 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:09.002417 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxpwf" Sep 10 12:46:09.002567 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:09.002531 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxpwf" podUID="2b0dc0a6-6df7-464d-9890-3ee7814c618e" Sep 10 12:46:09.005046 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:09.005009 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qt6gw"] Sep 10 12:46:09.005195 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:09.005097 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qt6gw" Sep 10 12:46:09.005297 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:09.005200 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qt6gw" podUID="9629113a-f227-4d19-a2ce-b9e201dcefbd" Sep 10 12:46:09.017730 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:09.017667 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-f9qs9"] Sep 10 12:46:09.017860 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:09.017804 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f9qs9" Sep 10 12:46:09.017942 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:09.017915 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f9qs9" podUID="8c429ad1-3c1f-41a5-9759-671b36d5ee17" Sep 10 12:46:10.491373 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:10.491351 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxpwf" Sep 10 12:46:10.491373 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:10.491366 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qt6gw" Sep 10 12:46:10.492106 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:10.491445 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxpwf" podUID="2b0dc0a6-6df7-464d-9890-3ee7814c618e" Sep 10 12:46:10.492106 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:10.491559 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qt6gw" podUID="9629113a-f227-4d19-a2ce-b9e201dcefbd" Sep 10 12:46:10.625603 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:10.625574 2577 generic.go:356] "Generic (PLEG): container finished" podID="969c2051-92b9-4d3e-85f4-3e6139609dcd" containerID="a130b27ea79808308e950ac685f45b3de2841d0b6030bbb29aa1d52c2b23cc51" exitCode=0 Sep 10 12:46:10.625775 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:10.625659 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbs4n" event={"ID":"969c2051-92b9-4d3e-85f4-3e6139609dcd","Type":"ContainerDied","Data":"a130b27ea79808308e950ac685f45b3de2841d0b6030bbb29aa1d52c2b23cc51"} Sep 10 12:46:11.492903 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:11.492730 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f9qs9" Sep 10 12:46:11.493344 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:11.492976 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f9qs9" podUID="8c429ad1-3c1f-41a5-9759-671b36d5ee17" Sep 10 12:46:11.629909 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:11.629807 2577 generic.go:356] "Generic (PLEG): container finished" podID="969c2051-92b9-4d3e-85f4-3e6139609dcd" containerID="088ead81b76e8941b73732d95a7ca7be1b6a1cafe269ff7d7fecbe9855f123d4" exitCode=0 Sep 10 12:46:11.629909 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:11.629867 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbs4n" event={"ID":"969c2051-92b9-4d3e-85f4-3e6139609dcd","Type":"ContainerDied","Data":"088ead81b76e8941b73732d95a7ca7be1b6a1cafe269ff7d7fecbe9855f123d4"} Sep 10 12:46:12.492272 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:12.492181 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxpwf" Sep 10 12:46:12.492272 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:12.492227 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qt6gw" Sep 10 12:46:12.492465 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:12.492299 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxpwf" podUID="2b0dc0a6-6df7-464d-9890-3ee7814c618e" Sep 10 12:46:12.492465 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:12.492416 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qt6gw" podUID="9629113a-f227-4d19-a2ce-b9e201dcefbd" Sep 10 12:46:12.637062 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:12.637027 2577 generic.go:356] "Generic (PLEG): container finished" podID="969c2051-92b9-4d3e-85f4-3e6139609dcd" containerID="106cba6894f504c6c06e95c3c2932dace584ffe3d83524c6dac863e3007f5f85" exitCode=0 Sep 10 12:46:12.637062 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:12.637063 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbs4n" event={"ID":"969c2051-92b9-4d3e-85f4-3e6139609dcd","Type":"ContainerDied","Data":"106cba6894f504c6c06e95c3c2932dace584ffe3d83524c6dac863e3007f5f85"} Sep 10 12:46:13.491703 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:13.491670 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f9qs9" Sep 10 12:46:13.491882 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:13.491819 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f9qs9" podUID="8c429ad1-3c1f-41a5-9759-671b36d5ee17" Sep 10 12:46:14.201486 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:14.201455 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c429ad1-3c1f-41a5-9759-671b36d5ee17-metrics-certs\") pod \"network-metrics-daemon-f9qs9\" (UID: \"8c429ad1-3c1f-41a5-9759-671b36d5ee17\") " pod="openshift-multus/network-metrics-daemon-f9qs9" Sep 10 12:46:14.201952 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:14.201504 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b0dc0a6-6df7-464d-9890-3ee7814c618e-original-pull-secret\") pod \"global-pull-secret-syncer-nxpwf\" (UID: \"2b0dc0a6-6df7-464d-9890-3ee7814c618e\") " pod="kube-system/global-pull-secret-syncer-nxpwf" Sep 10 12:46:14.201952 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:14.201619 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 12:46:14.201952 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:14.201681 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b0dc0a6-6df7-464d-9890-3ee7814c618e-original-pull-secret podName:2b0dc0a6-6df7-464d-9890-3ee7814c618e nodeName:}" failed. No retries permitted until 2026-09-10 12:46:46.201667446 +0000 UTC m=+65.234280201 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b0dc0a6-6df7-464d-9890-3ee7814c618e-original-pull-secret") pod "global-pull-secret-syncer-nxpwf" (UID: "2b0dc0a6-6df7-464d-9890-3ee7814c618e") : object "kube-system"/"original-pull-secret" not registered Sep 10 12:46:14.201952 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:14.201620 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:46:14.201952 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:14.201749 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c429ad1-3c1f-41a5-9759-671b36d5ee17-metrics-certs podName:8c429ad1-3c1f-41a5-9759-671b36d5ee17 nodeName:}" failed. No retries permitted until 2026-09-10 12:46:46.20173776 +0000 UTC m=+65.234350529 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c429ad1-3c1f-41a5-9759-671b36d5ee17-metrics-certs") pod "network-metrics-daemon-f9qs9" (UID: "8c429ad1-3c1f-41a5-9759-671b36d5ee17") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:46:14.302303 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:14.302246 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnzrg\" (UniqueName: \"kubernetes.io/projected/9629113a-f227-4d19-a2ce-b9e201dcefbd-kube-api-access-rnzrg\") pod \"network-check-target-qt6gw\" (UID: \"9629113a-f227-4d19-a2ce-b9e201dcefbd\") " pod="openshift-network-diagnostics/network-check-target-qt6gw" Sep 10 12:46:14.302490 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:14.302468 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 12:46:14.302535 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:14.302500 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 12:46:14.302535 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:14.302513 2577 projected.go:196] Error preparing data for projected volume kube-api-access-rnzrg for pod openshift-network-diagnostics/network-check-target-qt6gw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:46:14.302606 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:14.302595 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9629113a-f227-4d19-a2ce-b9e201dcefbd-kube-api-access-rnzrg podName:9629113a-f227-4d19-a2ce-b9e201dcefbd nodeName:}" failed. No retries permitted until 2026-09-10 12:46:46.302566849 +0000 UTC m=+65.335179622 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rnzrg" (UniqueName: "kubernetes.io/projected/9629113a-f227-4d19-a2ce-b9e201dcefbd-kube-api-access-rnzrg") pod "network-check-target-qt6gw" (UID: "9629113a-f227-4d19-a2ce-b9e201dcefbd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:46:14.492296 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:14.492212 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxpwf" Sep 10 12:46:14.492449 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:14.492221 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qt6gw" Sep 10 12:46:14.492449 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:14.492330 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nxpwf" podUID="2b0dc0a6-6df7-464d-9890-3ee7814c618e" Sep 10 12:46:14.492449 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:14.492393 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qt6gw" podUID="9629113a-f227-4d19-a2ce-b9e201dcefbd" Sep 10 12:46:15.264427 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:15.264398 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-146.ec2.internal" event="NodeReady" Sep 10 12:46:15.264778 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:15.264515 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 10 12:46:15.318343 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:15.318260 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pl69q"] Sep 10 12:46:15.322012 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:15.321975 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qlhzv"] Sep 10 12:46:15.322204 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:15.322112 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pl69q" Sep 10 12:46:15.324343 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:15.324315 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 10 12:46:15.324471 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:15.324349 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ns5lz\"" Sep 10 12:46:15.324639 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:15.324622 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 10 12:46:15.325775 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:15.325756 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qlhzv" Sep 10 12:46:15.329517 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:15.329492 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-c5hjg\"" Sep 10 12:46:15.329766 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:15.329750 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 10 12:46:15.329854 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:15.329750 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 10 12:46:15.330801 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:15.330406 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 10 12:46:15.341733 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:15.341709 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pl69q"] Sep 10 12:46:15.342336 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:15.342316 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qlhzv"] Sep 10 12:46:15.411598 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:15.411565 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29dbffec-6ed7-4409-b5fa-c2a8de733e92-cert\") pod \"ingress-canary-qlhzv\" (UID: \"29dbffec-6ed7-4409-b5fa-c2a8de733e92\") " pod="openshift-ingress-canary/ingress-canary-qlhzv" Sep 10 12:46:15.411797 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:15.411626 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8bbef592-ec3a-418e-b64f-a783b5205a24-metrics-tls\") pod \"dns-default-pl69q\" (UID: \"8bbef592-ec3a-418e-b64f-a783b5205a24\") " pod="openshift-dns/dns-default-pl69q" Sep 10 12:46:15.411797 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:15.411661 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9jm9\" (UniqueName: \"kubernetes.io/projected/8bbef592-ec3a-418e-b64f-a783b5205a24-kube-api-access-s9jm9\") pod \"dns-default-pl69q\" (UID: \"8bbef592-ec3a-418e-b64f-a783b5205a24\") " pod="openshift-dns/dns-default-pl69q" Sep 10 12:46:15.411797 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:15.411684 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-696h5\" (UniqueName: \"kubernetes.io/projected/29dbffec-6ed7-4409-b5fa-c2a8de733e92-kube-api-access-696h5\") pod \"ingress-canary-qlhzv\" (UID: \"29dbffec-6ed7-4409-b5fa-c2a8de733e92\") " pod="openshift-ingress-canary/ingress-canary-qlhzv" Sep 10 12:46:15.411797 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:15.411723 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8bbef592-ec3a-418e-b64f-a783b5205a24-config-volume\") pod \"dns-default-pl69q\" (UID: \"8bbef592-ec3a-418e-b64f-a783b5205a24\") " pod="openshift-dns/dns-default-pl69q" Sep 10 12:46:15.412050 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:15.411976 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bbef592-ec3a-418e-b64f-a783b5205a24-tmp-dir\") pod \"dns-default-pl69q\" (UID: \"8bbef592-ec3a-418e-b64f-a783b5205a24\") " pod="openshift-dns/dns-default-pl69q" Sep 10 12:46:15.491794 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:15.491756 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f9qs9" Sep 10 12:46:15.494182 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:15.494128 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sbqsw\"" Sep 10 12:46:15.494182 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:15.494166 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 12:46:15.513174 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:15.513122 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8bbef592-ec3a-418e-b64f-a783b5205a24-config-volume\") pod \"dns-default-pl69q\" (UID: \"8bbef592-ec3a-418e-b64f-a783b5205a24\") " pod="openshift-dns/dns-default-pl69q" Sep 10 12:46:15.513336 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:15.513297 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bbef592-ec3a-418e-b64f-a783b5205a24-tmp-dir\") pod \"dns-default-pl69q\" (UID: \"8bbef592-ec3a-418e-b64f-a783b5205a24\") " pod="openshift-dns/dns-default-pl69q" Sep 10 12:46:15.513396 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:15.513362 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29dbffec-6ed7-4409-b5fa-c2a8de733e92-cert\") pod \"ingress-canary-qlhzv\" (UID: \"29dbffec-6ed7-4409-b5fa-c2a8de733e92\") " pod="openshift-ingress-canary/ingress-canary-qlhzv" Sep 10 12:46:15.513511 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:15.513488 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8bbef592-ec3a-418e-b64f-a783b5205a24-metrics-tls\") pod \"dns-default-pl69q\" (UID: \"8bbef592-ec3a-418e-b64f-a783b5205a24\") " pod="openshift-dns/dns-default-pl69q" Sep 10 12:46:15.513585 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:15.513536 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9jm9\" (UniqueName: \"kubernetes.io/projected/8bbef592-ec3a-418e-b64f-a783b5205a24-kube-api-access-s9jm9\") pod \"dns-default-pl69q\" (UID: \"8bbef592-ec3a-418e-b64f-a783b5205a24\") " pod="openshift-dns/dns-default-pl69q" Sep 10 12:46:15.513585 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:15.513562 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-696h5\" (UniqueName: \"kubernetes.io/projected/29dbffec-6ed7-4409-b5fa-c2a8de733e92-kube-api-access-696h5\") pod \"ingress-canary-qlhzv\" (UID: \"29dbffec-6ed7-4409-b5fa-c2a8de733e92\") " pod="openshift-ingress-canary/ingress-canary-qlhzv" Sep 10 12:46:15.513677 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:15.513656 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bbef592-ec3a-418e-b64f-a783b5205a24-tmp-dir\") pod \"dns-default-pl69q\" (UID: \"8bbef592-ec3a-418e-b64f-a783b5205a24\") " pod="openshift-dns/dns-default-pl69q" Sep 10 12:46:15.513731 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:15.513682 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 12:46:15.513779 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:15.513752 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bbef592-ec3a-418e-b64f-a783b5205a24-metrics-tls podName:8bbef592-ec3a-418e-b64f-a783b5205a24 nodeName:}" failed. No retries permitted until 2026-09-10 12:46:16.013730741 +0000 UTC m=+35.046343496 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8bbef592-ec3a-418e-b64f-a783b5205a24-metrics-tls") pod "dns-default-pl69q" (UID: "8bbef592-ec3a-418e-b64f-a783b5205a24") : secret "dns-default-metrics-tls" not found Sep 10 12:46:15.513840 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:15.513785 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8bbef592-ec3a-418e-b64f-a783b5205a24-config-volume\") pod \"dns-default-pl69q\" (UID: \"8bbef592-ec3a-418e-b64f-a783b5205a24\") " pod="openshift-dns/dns-default-pl69q" Sep 10 12:46:15.518389 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:15.518368 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29dbffec-6ed7-4409-b5fa-c2a8de733e92-cert\") pod \"ingress-canary-qlhzv\" (UID: \"29dbffec-6ed7-4409-b5fa-c2a8de733e92\") " pod="openshift-ingress-canary/ingress-canary-qlhzv" Sep 10 12:46:15.523628 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:15.523603 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-696h5\" (UniqueName: \"kubernetes.io/projected/29dbffec-6ed7-4409-b5fa-c2a8de733e92-kube-api-access-696h5\") pod \"ingress-canary-qlhzv\" (UID: \"29dbffec-6ed7-4409-b5fa-c2a8de733e92\") " pod="openshift-ingress-canary/ingress-canary-qlhzv" Sep 10 12:46:15.524002 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:15.523975 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9jm9\" (UniqueName: \"kubernetes.io/projected/8bbef592-ec3a-418e-b64f-a783b5205a24-kube-api-access-s9jm9\") pod \"dns-default-pl69q\" (UID: \"8bbef592-ec3a-418e-b64f-a783b5205a24\") " pod="openshift-dns/dns-default-pl69q" Sep 10 12:46:15.639816 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:15.639732 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qlhzv" Sep 10 12:46:15.936576 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:15.936292 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qlhzv"] Sep 10 12:46:16.023771 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:16.023728 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8bbef592-ec3a-418e-b64f-a783b5205a24-metrics-tls\") pod \"dns-default-pl69q\" (UID: \"8bbef592-ec3a-418e-b64f-a783b5205a24\") " pod="openshift-dns/dns-default-pl69q" Sep 10 12:46:16.023957 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:16.023912 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 12:46:16.024009 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:16.023981 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bbef592-ec3a-418e-b64f-a783b5205a24-metrics-tls podName:8bbef592-ec3a-418e-b64f-a783b5205a24 nodeName:}" failed. No retries permitted until 2026-09-10 12:46:17.023965448 +0000 UTC m=+36.056578209 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8bbef592-ec3a-418e-b64f-a783b5205a24-metrics-tls") pod "dns-default-pl69q" (UID: "8bbef592-ec3a-418e-b64f-a783b5205a24") : secret "dns-default-metrics-tls" not found Sep 10 12:46:16.492125 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:16.492081 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxpwf" Sep 10 12:46:16.492125 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:16.492110 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qt6gw" Sep 10 12:46:16.494985 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:16.494959 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 12:46:16.495134 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:16.495116 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4vqn4\"" Sep 10 12:46:16.495233 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:16.495217 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 12:46:16.495792 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:16.495773 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 12:46:17.030980 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:17.030946 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8bbef592-ec3a-418e-b64f-a783b5205a24-metrics-tls\") pod \"dns-default-pl69q\" (UID: \"8bbef592-ec3a-418e-b64f-a783b5205a24\") " pod="openshift-dns/dns-default-pl69q" Sep 10 12:46:17.031193 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:17.031079 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 12:46:17.031256 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:17.031212 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bbef592-ec3a-418e-b64f-a783b5205a24-metrics-tls podName:8bbef592-ec3a-418e-b64f-a783b5205a24 nodeName:}" failed. No retries permitted until 2026-09-10 12:46:19.03118811 +0000 UTC m=+38.063800881 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8bbef592-ec3a-418e-b64f-a783b5205a24-metrics-tls") pod "dns-default-pl69q" (UID: "8bbef592-ec3a-418e-b64f-a783b5205a24") : secret "dns-default-metrics-tls" not found Sep 10 12:46:17.460878 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:46:17.460804 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29dbffec_6ed7_4409_b5fa_c2a8de733e92.slice/crio-16fff8f74d6f72385fb739334534cac46d35b3045c1bbc02d5a55903835adecf WatchSource:0}: Error finding container 16fff8f74d6f72385fb739334534cac46d35b3045c1bbc02d5a55903835adecf: Status 404 returned error can't find the container with id 16fff8f74d6f72385fb739334534cac46d35b3045c1bbc02d5a55903835adecf Sep 10 12:46:17.650310 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:17.650278 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qlhzv" event={"ID":"29dbffec-6ed7-4409-b5fa-c2a8de733e92","Type":"ContainerStarted","Data":"16fff8f74d6f72385fb739334534cac46d35b3045c1bbc02d5a55903835adecf"} Sep 10 12:46:18.655895 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:18.655860 2577 generic.go:356] "Generic (PLEG): container finished" podID="969c2051-92b9-4d3e-85f4-3e6139609dcd" containerID="5b75a5c9a69c6555a78ee5dd0483615ac470d2b561649dc19df9073dd059a34b" exitCode=0 Sep 10 12:46:18.656491 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:18.655924 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbs4n" event={"ID":"969c2051-92b9-4d3e-85f4-3e6139609dcd","Type":"ContainerDied","Data":"5b75a5c9a69c6555a78ee5dd0483615ac470d2b561649dc19df9073dd059a34b"} Sep 10 12:46:19.044823 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:19.044778 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8bbef592-ec3a-418e-b64f-a783b5205a24-metrics-tls\") pod \"dns-default-pl69q\" (UID: \"8bbef592-ec3a-418e-b64f-a783b5205a24\") " pod="openshift-dns/dns-default-pl69q" Sep 10 12:46:19.044978 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:19.044904 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 12:46:19.044978 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:19.044975 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bbef592-ec3a-418e-b64f-a783b5205a24-metrics-tls podName:8bbef592-ec3a-418e-b64f-a783b5205a24 nodeName:}" failed. No retries permitted until 2026-09-10 12:46:23.044958137 +0000 UTC m=+42.077570892 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8bbef592-ec3a-418e-b64f-a783b5205a24-metrics-tls") pod "dns-default-pl69q" (UID: "8bbef592-ec3a-418e-b64f-a783b5205a24") : secret "dns-default-metrics-tls" not found Sep 10 12:46:19.662577 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:19.662541 2577 generic.go:356] "Generic (PLEG): container finished" podID="969c2051-92b9-4d3e-85f4-3e6139609dcd" containerID="83bbd24875386b7e47d5044889b7084b6dffd261ec391daa40d1b65a55d439aa" exitCode=0 Sep 10 12:46:19.662982 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:19.662620 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbs4n" event={"ID":"969c2051-92b9-4d3e-85f4-3e6139609dcd","Type":"ContainerDied","Data":"83bbd24875386b7e47d5044889b7084b6dffd261ec391daa40d1b65a55d439aa"} Sep 10 12:46:20.666828 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:20.666734 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qlhzv" event={"ID":"29dbffec-6ed7-4409-b5fa-c2a8de733e92","Type":"ContainerStarted","Data":"04ac1d48b275a4afb49be28918ab7b586c5e3f9b18af981cc714db3d08ac267a"} Sep 10 12:46:20.670188 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:20.670157 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbs4n" event={"ID":"969c2051-92b9-4d3e-85f4-3e6139609dcd","Type":"ContainerStarted","Data":"cf8e0e10df2b6d9a565f3eaa02f07d352edba66b52263a4e199b4bde5da0742c"} Sep 10 12:46:20.688056 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:20.688009 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qlhzv" podStartSLOduration=2.8605987170000002 podStartE2EDuration="5.687965061s" totalImagesPullingTime="2.827366344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:46:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:46:20.686993664 +0000 UTC m=+39.719606442" watchObservedRunningTime="2026-09-10 12:46:20.687965061 +0000 UTC m=+39.720577838" Sep 10 12:46:20.716384 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:20.716320 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fbs4n" podStartSLOduration=8.624073495 podStartE2EDuration="39.716297925s" totalImagesPullingTime="31.09222443s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:45:41 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:46:20.714891646 +0000 UTC m=+39.747504435" watchObservedRunningTime="2026-09-10 12:46:20.716297925 +0000 UTC m=+39.748910706" Sep 10 12:46:23.074654 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:23.074608 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8bbef592-ec3a-418e-b64f-a783b5205a24-metrics-tls\") pod \"dns-default-pl69q\" (UID: \"8bbef592-ec3a-418e-b64f-a783b5205a24\") " pod="openshift-dns/dns-default-pl69q" Sep 10 12:46:23.075035 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:23.074726 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 12:46:23.075035 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:23.074779 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bbef592-ec3a-418e-b64f-a783b5205a24-metrics-tls podName:8bbef592-ec3a-418e-b64f-a783b5205a24 nodeName:}" failed. No retries permitted until 2026-09-10 12:46:31.074765731 +0000 UTC m=+50.107378486 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8bbef592-ec3a-418e-b64f-a783b5205a24-metrics-tls") pod "dns-default-pl69q" (UID: "8bbef592-ec3a-418e-b64f-a783b5205a24") : secret "dns-default-metrics-tls" not found Sep 10 12:46:31.129289 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:31.129245 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8bbef592-ec3a-418e-b64f-a783b5205a24-metrics-tls\") pod \"dns-default-pl69q\" (UID: \"8bbef592-ec3a-418e-b64f-a783b5205a24\") " pod="openshift-dns/dns-default-pl69q" Sep 10 12:46:31.129708 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:31.129419 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 12:46:31.129708 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:31.129489 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bbef592-ec3a-418e-b64f-a783b5205a24-metrics-tls podName:8bbef592-ec3a-418e-b64f-a783b5205a24 nodeName:}" failed. No retries permitted until 2026-09-10 12:46:47.129471737 +0000 UTC m=+66.162084492 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8bbef592-ec3a-418e-b64f-a783b5205a24-metrics-tls") pod "dns-default-pl69q" (UID: "8bbef592-ec3a-418e-b64f-a783b5205a24") : secret "dns-default-metrics-tls" not found Sep 10 12:46:40.636271 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:40.636242 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4sphq" Sep 10 12:46:46.244622 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:46.244577 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b0dc0a6-6df7-464d-9890-3ee7814c618e-original-pull-secret\") pod \"global-pull-secret-syncer-nxpwf\" (UID: \"2b0dc0a6-6df7-464d-9890-3ee7814c618e\") " pod="kube-system/global-pull-secret-syncer-nxpwf" Sep 10 12:46:46.245084 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:46.244646 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c429ad1-3c1f-41a5-9759-671b36d5ee17-metrics-certs\") pod \"network-metrics-daemon-f9qs9\" (UID: \"8c429ad1-3c1f-41a5-9759-671b36d5ee17\") " pod="openshift-multus/network-metrics-daemon-f9qs9" Sep 10 12:46:46.247335 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:46.247314 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 12:46:46.248133 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:46.248111 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 12:46:46.255830 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:46.255808 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 10 12:46:46.255907 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:46.255882 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c429ad1-3c1f-41a5-9759-671b36d5ee17-metrics-certs podName:8c429ad1-3c1f-41a5-9759-671b36d5ee17 nodeName:}" failed. No retries permitted until 2026-09-10 12:47:50.255862323 +0000 UTC m=+129.288475081 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c429ad1-3c1f-41a5-9759-671b36d5ee17-metrics-certs") pod "network-metrics-daemon-f9qs9" (UID: "8c429ad1-3c1f-41a5-9759-671b36d5ee17") : secret "metrics-daemon-secret" not found Sep 10 12:46:46.258364 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:46.258348 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b0dc0a6-6df7-464d-9890-3ee7814c618e-original-pull-secret\") pod \"global-pull-secret-syncer-nxpwf\" (UID: \"2b0dc0a6-6df7-464d-9890-3ee7814c618e\") " pod="kube-system/global-pull-secret-syncer-nxpwf" Sep 10 12:46:46.344987 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:46.344930 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnzrg\" (UniqueName: \"kubernetes.io/projected/9629113a-f227-4d19-a2ce-b9e201dcefbd-kube-api-access-rnzrg\") pod \"network-check-target-qt6gw\" (UID: \"9629113a-f227-4d19-a2ce-b9e201dcefbd\") " pod="openshift-network-diagnostics/network-check-target-qt6gw" Sep 10 12:46:46.347586 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:46.347565 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 12:46:46.358412 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:46.358388 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 12:46:46.369190 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:46.369164 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnzrg\" (UniqueName: \"kubernetes.io/projected/9629113a-f227-4d19-a2ce-b9e201dcefbd-kube-api-access-rnzrg\") pod \"network-check-target-qt6gw\" (UID: \"9629113a-f227-4d19-a2ce-b9e201dcefbd\") " pod="openshift-network-diagnostics/network-check-target-qt6gw" Sep 10 12:46:46.505801 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:46.505717 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4vqn4\"" Sep 10 12:46:46.509761 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:46.509745 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nxpwf" Sep 10 12:46:46.514284 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:46.514257 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qt6gw" Sep 10 12:46:46.780051 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:46.779980 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nxpwf"] Sep 10 12:46:46.783452 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:46:46.783415 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b0dc0a6_6df7_464d_9890_3ee7814c618e.slice/crio-fc9d7610fe5b0bf75e8f697e564c1f0d3d0fa9179b8c8a07d916fcaeb54ee8ae WatchSource:0}: Error finding container fc9d7610fe5b0bf75e8f697e564c1f0d3d0fa9179b8c8a07d916fcaeb54ee8ae: Status 404 returned error can't find the container with id fc9d7610fe5b0bf75e8f697e564c1f0d3d0fa9179b8c8a07d916fcaeb54ee8ae Sep 10 12:46:46.797247 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:46.797205 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qt6gw"] Sep 10 12:46:46.801766 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:46:46.801738 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9629113a_f227_4d19_a2ce_b9e201dcefbd.slice/crio-d5822a921f4a977ce57aa29be3116deb80db13519ec2063d48b1c9ac089de8bd WatchSource:0}: Error finding container d5822a921f4a977ce57aa29be3116deb80db13519ec2063d48b1c9ac089de8bd: Status 404 returned error can't find the container with id d5822a921f4a977ce57aa29be3116deb80db13519ec2063d48b1c9ac089de8bd Sep 10 12:46:47.150600 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:47.150512 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8bbef592-ec3a-418e-b64f-a783b5205a24-metrics-tls\") pod \"dns-default-pl69q\" (UID: \"8bbef592-ec3a-418e-b64f-a783b5205a24\") " pod="openshift-dns/dns-default-pl69q" Sep 10 12:46:47.150746 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:47.150623 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 12:46:47.150746 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:47.150682 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bbef592-ec3a-418e-b64f-a783b5205a24-metrics-tls podName:8bbef592-ec3a-418e-b64f-a783b5205a24 nodeName:}" failed. No retries permitted until 2026-09-10 12:47:19.150665998 +0000 UTC m=+98.183278757 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8bbef592-ec3a-418e-b64f-a783b5205a24-metrics-tls") pod "dns-default-pl69q" (UID: "8bbef592-ec3a-418e-b64f-a783b5205a24") : secret "dns-default-metrics-tls" not found Sep 10 12:46:47.731864 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:47.731827 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qt6gw" event={"ID":"9629113a-f227-4d19-a2ce-b9e201dcefbd","Type":"ContainerStarted","Data":"d5822a921f4a977ce57aa29be3116deb80db13519ec2063d48b1c9ac089de8bd"} Sep 10 12:46:47.733918 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:47.733859 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nxpwf" event={"ID":"2b0dc0a6-6df7-464d-9890-3ee7814c618e","Type":"ContainerStarted","Data":"fc9d7610fe5b0bf75e8f697e564c1f0d3d0fa9179b8c8a07d916fcaeb54ee8ae"} Sep 10 12:46:52.747509 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:52.747468 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qt6gw" event={"ID":"9629113a-f227-4d19-a2ce-b9e201dcefbd","Type":"ContainerStarted","Data":"ae47ad5091c412d9e2fe0debd484e73b668c7b120b633805ed00f965de22f1fa"} Sep 10 12:46:52.747997 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:52.747605 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qt6gw" Sep 10 12:46:52.749046 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:52.749023 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nxpwf" event={"ID":"2b0dc0a6-6df7-464d-9890-3ee7814c618e","Type":"ContainerStarted","Data":"22554550bfe995136d97e11f6f6c4d1fb980d0289b7266b4c43b4cfe16b0f987"} Sep 10 12:46:52.770347 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:52.770303 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qt6gw" podStartSLOduration=66.749787828 podStartE2EDuration="1m11.770288737s" totalImagesPullingTime="5.020500909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:45:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:46:52.769894771 +0000 UTC m=+71.802507548" watchObservedRunningTime="2026-09-10 12:46:52.770288737 +0000 UTC m=+71.802901505" Sep 10 12:46:52.796862 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:52.796808 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-nxpwf" podStartSLOduration=66.747116692 podStartE2EDuration="1m11.796793303s" totalImagesPullingTime="5.049676611s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:45:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:46:52.796246683 +0000 UTC m=+71.828859460" watchObservedRunningTime="2026-09-10 12:46:52.796793303 +0000 UTC m=+71.829406130" Sep 10 12:46:57.283579 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.283543 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85b454874b-dvf22"] Sep 10 12:46:57.285355 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.285340 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-dvf22" Sep 10 12:46:57.287807 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.287764 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Sep 10 12:46:57.287807 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.287788 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Sep 10 12:46:57.288096 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.288083 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Sep 10 12:46:57.289045 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.289021 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-6p8ks\"" Sep 10 12:46:57.289045 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.289037 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Sep 10 12:46:57.293730 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.293707 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Sep 10 12:46:57.301131 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.301107 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-dvf22"] Sep 10 12:46:57.314715 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.314689 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/765454f6-c879-42b5-8e20-f19a691f6a34-serving-cert\") pod \"console-operator-85b454874b-dvf22\" (UID: \"765454f6-c879-42b5-8e20-f19a691f6a34\") " pod="openshift-console-operator/console-operator-85b454874b-dvf22" Sep 10 12:46:57.314832 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.314733 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9282\" (UniqueName: \"kubernetes.io/projected/765454f6-c879-42b5-8e20-f19a691f6a34-kube-api-access-x9282\") pod \"console-operator-85b454874b-dvf22\" (UID: \"765454f6-c879-42b5-8e20-f19a691f6a34\") " pod="openshift-console-operator/console-operator-85b454874b-dvf22" Sep 10 12:46:57.314832 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.314779 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/765454f6-c879-42b5-8e20-f19a691f6a34-config\") pod \"console-operator-85b454874b-dvf22\" (UID: \"765454f6-c879-42b5-8e20-f19a691f6a34\") " pod="openshift-console-operator/console-operator-85b454874b-dvf22" Sep 10 12:46:57.314919 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.314834 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/765454f6-c879-42b5-8e20-f19a691f6a34-trusted-ca\") pod \"console-operator-85b454874b-dvf22\" (UID: \"765454f6-c879-42b5-8e20-f19a691f6a34\") " pod="openshift-console-operator/console-operator-85b454874b-dvf22" Sep 10 12:46:57.412722 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.412683 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-n927p"] Sep 10 12:46:57.414852 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.414835 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-g6mq9"] Sep 10 12:46:57.414977 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.414959 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-n927p" Sep 10 12:46:57.415190 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.415138 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/765454f6-c879-42b5-8e20-f19a691f6a34-serving-cert\") pod \"console-operator-85b454874b-dvf22\" (UID: \"765454f6-c879-42b5-8e20-f19a691f6a34\") " pod="openshift-console-operator/console-operator-85b454874b-dvf22" Sep 10 12:46:57.415332 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.415224 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9282\" (UniqueName: \"kubernetes.io/projected/765454f6-c879-42b5-8e20-f19a691f6a34-kube-api-access-x9282\") pod \"console-operator-85b454874b-dvf22\" (UID: \"765454f6-c879-42b5-8e20-f19a691f6a34\") " pod="openshift-console-operator/console-operator-85b454874b-dvf22" Sep 10 12:46:57.415332 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.415272 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/765454f6-c879-42b5-8e20-f19a691f6a34-config\") pod \"console-operator-85b454874b-dvf22\" (UID: \"765454f6-c879-42b5-8e20-f19a691f6a34\") " pod="openshift-console-operator/console-operator-85b454874b-dvf22" Sep 10 12:46:57.415445 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.415340 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/765454f6-c879-42b5-8e20-f19a691f6a34-trusted-ca\") pod \"console-operator-85b454874b-dvf22\" (UID: \"765454f6-c879-42b5-8e20-f19a691f6a34\") " pod="openshift-console-operator/console-operator-85b454874b-dvf22" Sep 10 12:46:57.416005 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.415984 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/765454f6-c879-42b5-8e20-f19a691f6a34-config\") pod \"console-operator-85b454874b-dvf22\" (UID: \"765454f6-c879-42b5-8e20-f19a691f6a34\") " pod="openshift-console-operator/console-operator-85b454874b-dvf22" Sep 10 12:46:57.416355 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.416336 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/765454f6-c879-42b5-8e20-f19a691f6a34-trusted-ca\") pod \"console-operator-85b454874b-dvf22\" (UID: \"765454f6-c879-42b5-8e20-f19a691f6a34\") " pod="openshift-console-operator/console-operator-85b454874b-dvf22" Sep 10 12:46:57.417486 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.417466 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-g6mq9" Sep 10 12:46:57.417607 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.417584 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/765454f6-c879-42b5-8e20-f19a691f6a34-serving-cert\") pod \"console-operator-85b454874b-dvf22\" (UID: \"765454f6-c879-42b5-8e20-f19a691f6a34\") " pod="openshift-console-operator/console-operator-85b454874b-dvf22" Sep 10 12:46:57.418727 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.418709 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 10 12:46:57.418948 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.418934 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 10 12:46:57.419372 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.419356 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Sep 10 12:46:57.419452 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.419423 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-kk5bp\"" Sep 10 12:46:57.419547 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.419533 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Sep 10 12:46:57.419622 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.419606 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Sep 10 12:46:57.420000 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.419985 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Sep 10 12:46:57.422341 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.422321 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-nqj58\"" Sep 10 12:46:57.432391 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.432357 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-g6mq9"] Sep 10 12:46:57.432715 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.432689 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9282\" (UniqueName: \"kubernetes.io/projected/765454f6-c879-42b5-8e20-f19a691f6a34-kube-api-access-x9282\") pod \"console-operator-85b454874b-dvf22\" (UID: \"765454f6-c879-42b5-8e20-f19a691f6a34\") " pod="openshift-console-operator/console-operator-85b454874b-dvf22" Sep 10 12:46:57.433371 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.433349 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-n927p"] Sep 10 12:46:57.507847 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.507819 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-8j2jv"] Sep 10 12:46:57.509853 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.509837 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-85bf8594b-kh4mj"] Sep 10 12:46:57.509936 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.509917 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-8j2jv" Sep 10 12:46:57.511626 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.511605 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85bf8594b-kh4mj" Sep 10 12:46:57.512723 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.512702 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Sep 10 12:46:57.512834 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.512702 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Sep 10 12:46:57.512834 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.512768 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-qsbts\"" Sep 10 12:46:57.514387 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.514370 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 10 12:46:57.514578 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.514563 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 10 12:46:57.514639 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.514608 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 10 12:46:57.514690 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.514641 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-q22f8\"" Sep 10 12:46:57.515745 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.515722 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a2202efa-bdce-43d6-9472-d148b6f085fe-nginx-conf\") pod \"networking-console-plugin-79977f9844-8j2jv\" (UID: \"a2202efa-bdce-43d6-9472-d148b6f085fe\") " pod="openshift-network-console/networking-console-plugin-79977f9844-8j2jv" Sep 10 12:46:57.515845 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.515825 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/29ea1f07-01f3-4c53-b31f-fe44107e44de-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-g6mq9\" (UID: \"29ea1f07-01f3-4c53-b31f-fe44107e44de\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-g6mq9" Sep 10 12:46:57.515904 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.515864 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrxq4\" (UniqueName: \"kubernetes.io/projected/29ea1f07-01f3-4c53-b31f-fe44107e44de-kube-api-access-lrxq4\") pod \"kube-storage-version-migrator-operator-8d7dd4675-g6mq9\" (UID: \"29ea1f07-01f3-4c53-b31f-fe44107e44de\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-g6mq9" Sep 10 12:46:57.516022 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.515909 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/29ea1f07-01f3-4c53-b31f-fe44107e44de-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-g6mq9\" (UID: \"29ea1f07-01f3-4c53-b31f-fe44107e44de\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-g6mq9" Sep 10 12:46:57.516022 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.515991 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a2202efa-bdce-43d6-9472-d148b6f085fe-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-8j2jv\" (UID: \"a2202efa-bdce-43d6-9472-d148b6f085fe\") " pod="openshift-network-console/networking-console-plugin-79977f9844-8j2jv" Sep 10 12:46:57.516204 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.516029 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vw566\" (UniqueName: \"kubernetes.io/projected/274481a5-adbe-428d-9381-2a98b78f1f43-kube-api-access-vw566\") pod \"volume-data-source-validator-695c895bd6-n927p\" (UID: \"274481a5-adbe-428d-9381-2a98b78f1f43\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-n927p" Sep 10 12:46:57.519308 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.519291 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 10 12:46:57.526682 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.526661 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-8j2jv"] Sep 10 12:46:57.541021 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.540946 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-85bf8594b-kh4mj"] Sep 10 12:46:57.595000 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.594970 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-dvf22" Sep 10 12:46:57.602778 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.602752 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bmjbj"] Sep 10 12:46:57.604877 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.604855 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bmjbj" Sep 10 12:46:57.608450 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.608425 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 10 12:46:57.608450 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.608437 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 10 12:46:57.609091 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.609057 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-27pms\"" Sep 10 12:46:57.609091 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.609081 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 10 12:46:57.616410 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.616386 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw566\" (UniqueName: \"kubernetes.io/projected/274481a5-adbe-428d-9381-2a98b78f1f43-kube-api-access-vw566\") pod \"volume-data-source-validator-695c895bd6-n927p\" (UID: \"274481a5-adbe-428d-9381-2a98b78f1f43\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-n927p" Sep 10 12:46:57.616508 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.616439 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a2202efa-bdce-43d6-9472-d148b6f085fe-nginx-conf\") pod \"networking-console-plugin-79977f9844-8j2jv\" (UID: \"a2202efa-bdce-43d6-9472-d148b6f085fe\") " pod="openshift-network-console/networking-console-plugin-79977f9844-8j2jv" Sep 10 12:46:57.616508 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.616475 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p54d\" (UniqueName: \"kubernetes.io/projected/d08de005-27fa-45f4-a887-83d0e7fefe7b-kube-api-access-5p54d\") pod \"cluster-samples-operator-7cdcfcf76c-bmjbj\" (UID: \"d08de005-27fa-45f4-a887-83d0e7fefe7b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bmjbj" Sep 10 12:46:57.616605 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.616505 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bcc23540-e3a4-4cc7-8f66-59e250b39f23-image-registry-private-configuration\") pod \"image-registry-85bf8594b-kh4mj\" (UID: \"bcc23540-e3a4-4cc7-8f66-59e250b39f23\") " pod="openshift-image-registry/image-registry-85bf8594b-kh4mj" Sep 10 12:46:57.616605 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.616549 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d08de005-27fa-45f4-a887-83d0e7fefe7b-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-bmjbj\" (UID: \"d08de005-27fa-45f4-a887-83d0e7fefe7b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bmjbj" Sep 10 12:46:57.616677 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.616615 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bcc23540-e3a4-4cc7-8f66-59e250b39f23-ca-trust-extracted\") pod \"image-registry-85bf8594b-kh4mj\" (UID: \"bcc23540-e3a4-4cc7-8f66-59e250b39f23\") " pod="openshift-image-registry/image-registry-85bf8594b-kh4mj" Sep 10 12:46:57.616677 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.616655 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbznh\" (UniqueName: \"kubernetes.io/projected/bcc23540-e3a4-4cc7-8f66-59e250b39f23-kube-api-access-gbznh\") pod \"image-registry-85bf8594b-kh4mj\" (UID: \"bcc23540-e3a4-4cc7-8f66-59e250b39f23\") " pod="openshift-image-registry/image-registry-85bf8594b-kh4mj" Sep 10 12:46:57.616773 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.616686 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bcc23540-e3a4-4cc7-8f66-59e250b39f23-registry-certificates\") pod \"image-registry-85bf8594b-kh4mj\" (UID: \"bcc23540-e3a4-4cc7-8f66-59e250b39f23\") " pod="openshift-image-registry/image-registry-85bf8594b-kh4mj" Sep 10 12:46:57.616773 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.616728 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bcc23540-e3a4-4cc7-8f66-59e250b39f23-trusted-ca\") pod \"image-registry-85bf8594b-kh4mj\" (UID: \"bcc23540-e3a4-4cc7-8f66-59e250b39f23\") " pod="openshift-image-registry/image-registry-85bf8594b-kh4mj" Sep 10 12:46:57.616871 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.616809 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/29ea1f07-01f3-4c53-b31f-fe44107e44de-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-g6mq9\" (UID: \"29ea1f07-01f3-4c53-b31f-fe44107e44de\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-g6mq9" Sep 10 12:46:57.616923 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.616873 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrxq4\" (UniqueName: \"kubernetes.io/projected/29ea1f07-01f3-4c53-b31f-fe44107e44de-kube-api-access-lrxq4\") pod \"kube-storage-version-migrator-operator-8d7dd4675-g6mq9\" (UID: \"29ea1f07-01f3-4c53-b31f-fe44107e44de\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-g6mq9" Sep 10 12:46:57.616923 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.616907 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bcc23540-e3a4-4cc7-8f66-59e250b39f23-registry-tls\") pod \"image-registry-85bf8594b-kh4mj\" (UID: \"bcc23540-e3a4-4cc7-8f66-59e250b39f23\") " pod="openshift-image-registry/image-registry-85bf8594b-kh4mj" Sep 10 12:46:57.617026 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.616946 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/29ea1f07-01f3-4c53-b31f-fe44107e44de-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-g6mq9\" (UID: \"29ea1f07-01f3-4c53-b31f-fe44107e44de\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-g6mq9" Sep 10 12:46:57.617026 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.616998 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a2202efa-bdce-43d6-9472-d148b6f085fe-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-8j2jv\" (UID: \"a2202efa-bdce-43d6-9472-d148b6f085fe\") " pod="openshift-network-console/networking-console-plugin-79977f9844-8j2jv" Sep 10 12:46:57.617126 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.617027 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bcc23540-e3a4-4cc7-8f66-59e250b39f23-installation-pull-secrets\") pod \"image-registry-85bf8594b-kh4mj\" (UID: \"bcc23540-e3a4-4cc7-8f66-59e250b39f23\") " pod="openshift-image-registry/image-registry-85bf8594b-kh4mj" Sep 10 12:46:57.617126 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.617050 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bcc23540-e3a4-4cc7-8f66-59e250b39f23-bound-sa-token\") pod \"image-registry-85bf8594b-kh4mj\" (UID: \"bcc23540-e3a4-4cc7-8f66-59e250b39f23\") " pod="openshift-image-registry/image-registry-85bf8594b-kh4mj" Sep 10 12:46:57.617126 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.617103 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a2202efa-bdce-43d6-9472-d148b6f085fe-nginx-conf\") pod \"networking-console-plugin-79977f9844-8j2jv\" (UID: \"a2202efa-bdce-43d6-9472-d148b6f085fe\") " pod="openshift-network-console/networking-console-plugin-79977f9844-8j2jv" Sep 10 12:46:57.617357 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:57.617344 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 10 12:46:57.617433 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.617408 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/29ea1f07-01f3-4c53-b31f-fe44107e44de-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-g6mq9\" (UID: \"29ea1f07-01f3-4c53-b31f-fe44107e44de\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-g6mq9" Sep 10 12:46:57.617484 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:57.617416 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2202efa-bdce-43d6-9472-d148b6f085fe-networking-console-plugin-cert podName:a2202efa-bdce-43d6-9472-d148b6f085fe nodeName:}" failed. No retries permitted until 2026-09-10 12:46:58.117400481 +0000 UTC m=+77.150013243 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a2202efa-bdce-43d6-9472-d148b6f085fe-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-8j2jv" (UID: "a2202efa-bdce-43d6-9472-d148b6f085fe") : secret "networking-console-plugin-cert" not found Sep 10 12:46:57.619636 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.619590 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/29ea1f07-01f3-4c53-b31f-fe44107e44de-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-g6mq9\" (UID: \"29ea1f07-01f3-4c53-b31f-fe44107e44de\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-g6mq9" Sep 10 12:46:57.621627 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.621590 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bmjbj"] Sep 10 12:46:57.627331 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.627306 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vw566\" (UniqueName: \"kubernetes.io/projected/274481a5-adbe-428d-9381-2a98b78f1f43-kube-api-access-vw566\") pod \"volume-data-source-validator-695c895bd6-n927p\" (UID: \"274481a5-adbe-428d-9381-2a98b78f1f43\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-n927p" Sep 10 12:46:57.627690 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.627672 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrxq4\" (UniqueName: \"kubernetes.io/projected/29ea1f07-01f3-4c53-b31f-fe44107e44de-kube-api-access-lrxq4\") pod \"kube-storage-version-migrator-operator-8d7dd4675-g6mq9\" (UID: \"29ea1f07-01f3-4c53-b31f-fe44107e44de\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-g6mq9" Sep 10 12:46:57.718345 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.718302 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bcc23540-e3a4-4cc7-8f66-59e250b39f23-image-registry-private-configuration\") pod \"image-registry-85bf8594b-kh4mj\" (UID: \"bcc23540-e3a4-4cc7-8f66-59e250b39f23\") " pod="openshift-image-registry/image-registry-85bf8594b-kh4mj" Sep 10 12:46:57.718524 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.718361 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d08de005-27fa-45f4-a887-83d0e7fefe7b-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-bmjbj\" (UID: \"d08de005-27fa-45f4-a887-83d0e7fefe7b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bmjbj" Sep 10 12:46:57.718524 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.718381 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bcc23540-e3a4-4cc7-8f66-59e250b39f23-ca-trust-extracted\") pod \"image-registry-85bf8594b-kh4mj\" (UID: \"bcc23540-e3a4-4cc7-8f66-59e250b39f23\") " pod="openshift-image-registry/image-registry-85bf8594b-kh4mj" Sep 10 12:46:57.718524 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.718406 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbznh\" (UniqueName: \"kubernetes.io/projected/bcc23540-e3a4-4cc7-8f66-59e250b39f23-kube-api-access-gbznh\") pod \"image-registry-85bf8594b-kh4mj\" (UID: \"bcc23540-e3a4-4cc7-8f66-59e250b39f23\") " pod="openshift-image-registry/image-registry-85bf8594b-kh4mj" Sep 10 12:46:57.718524 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.718424 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bcc23540-e3a4-4cc7-8f66-59e250b39f23-registry-certificates\") pod \"image-registry-85bf8594b-kh4mj\" (UID: \"bcc23540-e3a4-4cc7-8f66-59e250b39f23\") " pod="openshift-image-registry/image-registry-85bf8594b-kh4mj" Sep 10 12:46:57.718524 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.718441 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bcc23540-e3a4-4cc7-8f66-59e250b39f23-trusted-ca\") pod \"image-registry-85bf8594b-kh4mj\" (UID: \"bcc23540-e3a4-4cc7-8f66-59e250b39f23\") " pod="openshift-image-registry/image-registry-85bf8594b-kh4mj" Sep 10 12:46:57.718524 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.718460 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bcc23540-e3a4-4cc7-8f66-59e250b39f23-registry-tls\") pod \"image-registry-85bf8594b-kh4mj\" (UID: \"bcc23540-e3a4-4cc7-8f66-59e250b39f23\") " pod="openshift-image-registry/image-registry-85bf8594b-kh4mj" Sep 10 12:46:57.718524 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.718520 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bcc23540-e3a4-4cc7-8f66-59e250b39f23-installation-pull-secrets\") pod \"image-registry-85bf8594b-kh4mj\" (UID: \"bcc23540-e3a4-4cc7-8f66-59e250b39f23\") " pod="openshift-image-registry/image-registry-85bf8594b-kh4mj" Sep 10 12:46:57.718730 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.718542 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bcc23540-e3a4-4cc7-8f66-59e250b39f23-bound-sa-token\") pod \"image-registry-85bf8594b-kh4mj\" (UID: \"bcc23540-e3a4-4cc7-8f66-59e250b39f23\") " pod="openshift-image-registry/image-registry-85bf8594b-kh4mj" Sep 10 12:46:57.718730 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.718594 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p54d\" (UniqueName: \"kubernetes.io/projected/d08de005-27fa-45f4-a887-83d0e7fefe7b-kube-api-access-5p54d\") pod \"cluster-samples-operator-7cdcfcf76c-bmjbj\" (UID: \"d08de005-27fa-45f4-a887-83d0e7fefe7b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bmjbj" Sep 10 12:46:57.718730 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:57.718618 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 12:46:57.718730 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:57.718635 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85bf8594b-kh4mj: secret "image-registry-tls" not found Sep 10 12:46:57.718730 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:57.718690 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bcc23540-e3a4-4cc7-8f66-59e250b39f23-registry-tls podName:bcc23540-e3a4-4cc7-8f66-59e250b39f23 nodeName:}" failed. No retries permitted until 2026-09-10 12:46:58.218671199 +0000 UTC m=+77.251283961 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bcc23540-e3a4-4cc7-8f66-59e250b39f23-registry-tls") pod "image-registry-85bf8594b-kh4mj" (UID: "bcc23540-e3a4-4cc7-8f66-59e250b39f23") : secret "image-registry-tls" not found Sep 10 12:46:57.718939 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.718741 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bcc23540-e3a4-4cc7-8f66-59e250b39f23-ca-trust-extracted\") pod \"image-registry-85bf8594b-kh4mj\" (UID: \"bcc23540-e3a4-4cc7-8f66-59e250b39f23\") " pod="openshift-image-registry/image-registry-85bf8594b-kh4mj" Sep 10 12:46:57.718939 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:57.718806 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 12:46:57.718939 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:57.718847 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d08de005-27fa-45f4-a887-83d0e7fefe7b-samples-operator-tls podName:d08de005-27fa-45f4-a887-83d0e7fefe7b nodeName:}" failed. No retries permitted until 2026-09-10 12:46:58.218834033 +0000 UTC m=+77.251446793 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d08de005-27fa-45f4-a887-83d0e7fefe7b-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-bmjbj" (UID: "d08de005-27fa-45f4-a887-83d0e7fefe7b") : secret "samples-operator-tls" not found Sep 10 12:46:57.719343 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.719316 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bcc23540-e3a4-4cc7-8f66-59e250b39f23-registry-certificates\") pod \"image-registry-85bf8594b-kh4mj\" (UID: \"bcc23540-e3a4-4cc7-8f66-59e250b39f23\") " pod="openshift-image-registry/image-registry-85bf8594b-kh4mj" Sep 10 12:46:57.719760 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.719740 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bcc23540-e3a4-4cc7-8f66-59e250b39f23-trusted-ca\") pod \"image-registry-85bf8594b-kh4mj\" (UID: \"bcc23540-e3a4-4cc7-8f66-59e250b39f23\") " pod="openshift-image-registry/image-registry-85bf8594b-kh4mj" Sep 10 12:46:57.720870 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.720850 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bcc23540-e3a4-4cc7-8f66-59e250b39f23-image-registry-private-configuration\") pod \"image-registry-85bf8594b-kh4mj\" (UID: \"bcc23540-e3a4-4cc7-8f66-59e250b39f23\") " pod="openshift-image-registry/image-registry-85bf8594b-kh4mj" Sep 10 12:46:57.720953 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.720937 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bcc23540-e3a4-4cc7-8f66-59e250b39f23-installation-pull-secrets\") pod \"image-registry-85bf8594b-kh4mj\" (UID: \"bcc23540-e3a4-4cc7-8f66-59e250b39f23\") " pod="openshift-image-registry/image-registry-85bf8594b-kh4mj" Sep 10 12:46:57.731249 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.728626 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p54d\" (UniqueName: \"kubernetes.io/projected/d08de005-27fa-45f4-a887-83d0e7fefe7b-kube-api-access-5p54d\") pod \"cluster-samples-operator-7cdcfcf76c-bmjbj\" (UID: \"d08de005-27fa-45f4-a887-83d0e7fefe7b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bmjbj" Sep 10 12:46:57.731681 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.731629 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-n927p" Sep 10 12:46:57.734119 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.734099 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbznh\" (UniqueName: \"kubernetes.io/projected/bcc23540-e3a4-4cc7-8f66-59e250b39f23-kube-api-access-gbznh\") pod \"image-registry-85bf8594b-kh4mj\" (UID: \"bcc23540-e3a4-4cc7-8f66-59e250b39f23\") " pod="openshift-image-registry/image-registry-85bf8594b-kh4mj" Sep 10 12:46:57.734394 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.734368 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bcc23540-e3a4-4cc7-8f66-59e250b39f23-bound-sa-token\") pod \"image-registry-85bf8594b-kh4mj\" (UID: \"bcc23540-e3a4-4cc7-8f66-59e250b39f23\") " pod="openshift-image-registry/image-registry-85bf8594b-kh4mj" Sep 10 12:46:57.739748 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.739732 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-g6mq9" Sep 10 12:46:57.871524 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:57.871492 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-dvf22"] Sep 10 12:46:57.877396 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:46:57.877367 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod765454f6_c879_42b5_8e20_f19a691f6a34.slice/crio-5c899e17c17a3851a678ef1115c226d1144743e413601e16967e2860635a2906 WatchSource:0}: Error finding container 5c899e17c17a3851a678ef1115c226d1144743e413601e16967e2860635a2906: Status 404 returned error can't find the container with id 5c899e17c17a3851a678ef1115c226d1144743e413601e16967e2860635a2906 Sep 10 12:46:58.020967 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:58.020935 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-g6mq9"] Sep 10 12:46:58.024025 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:46:58.023994 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29ea1f07_01f3_4c53_b31f_fe44107e44de.slice/crio-168d27511a36786075be85128d3f7189a3b8368596e3834518aa6f13b7b40a44 WatchSource:0}: Error finding container 168d27511a36786075be85128d3f7189a3b8368596e3834518aa6f13b7b40a44: Status 404 returned error can't find the container with id 168d27511a36786075be85128d3f7189a3b8368596e3834518aa6f13b7b40a44 Sep 10 12:46:58.029839 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:58.029818 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-n927p"] Sep 10 12:46:58.031060 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:46:58.031035 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod274481a5_adbe_428d_9381_2a98b78f1f43.slice/crio-999c43917c57d1a0babfc1be3125ad106180b7492c08ac3e664dd1ebd498958e WatchSource:0}: Error finding container 999c43917c57d1a0babfc1be3125ad106180b7492c08ac3e664dd1ebd498958e: Status 404 returned error can't find the container with id 999c43917c57d1a0babfc1be3125ad106180b7492c08ac3e664dd1ebd498958e Sep 10 12:46:58.122303 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:58.122211 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a2202efa-bdce-43d6-9472-d148b6f085fe-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-8j2jv\" (UID: \"a2202efa-bdce-43d6-9472-d148b6f085fe\") " pod="openshift-network-console/networking-console-plugin-79977f9844-8j2jv" Sep 10 12:46:58.122445 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:58.122352 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 10 12:46:58.122445 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:58.122411 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2202efa-bdce-43d6-9472-d148b6f085fe-networking-console-plugin-cert podName:a2202efa-bdce-43d6-9472-d148b6f085fe nodeName:}" failed. No retries permitted until 2026-09-10 12:46:59.122398096 +0000 UTC m=+78.155010855 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a2202efa-bdce-43d6-9472-d148b6f085fe-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-8j2jv" (UID: "a2202efa-bdce-43d6-9472-d148b6f085fe") : secret "networking-console-plugin-cert" not found Sep 10 12:46:58.223189 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:58.223128 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bcc23540-e3a4-4cc7-8f66-59e250b39f23-registry-tls\") pod \"image-registry-85bf8594b-kh4mj\" (UID: \"bcc23540-e3a4-4cc7-8f66-59e250b39f23\") " pod="openshift-image-registry/image-registry-85bf8594b-kh4mj" Sep 10 12:46:58.223325 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:58.223243 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d08de005-27fa-45f4-a887-83d0e7fefe7b-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-bmjbj\" (UID: \"d08de005-27fa-45f4-a887-83d0e7fefe7b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bmjbj" Sep 10 12:46:58.223325 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:58.223280 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 12:46:58.223325 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:58.223298 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85bf8594b-kh4mj: secret "image-registry-tls" not found Sep 10 12:46:58.223427 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:58.223328 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 12:46:58.223427 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:58.223351 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bcc23540-e3a4-4cc7-8f66-59e250b39f23-registry-tls podName:bcc23540-e3a4-4cc7-8f66-59e250b39f23 nodeName:}" failed. No retries permitted until 2026-09-10 12:46:59.223336314 +0000 UTC m=+78.255949070 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bcc23540-e3a4-4cc7-8f66-59e250b39f23-registry-tls") pod "image-registry-85bf8594b-kh4mj" (UID: "bcc23540-e3a4-4cc7-8f66-59e250b39f23") : secret "image-registry-tls" not found Sep 10 12:46:58.223427 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:58.223369 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d08de005-27fa-45f4-a887-83d0e7fefe7b-samples-operator-tls podName:d08de005-27fa-45f4-a887-83d0e7fefe7b nodeName:}" failed. No retries permitted until 2026-09-10 12:46:59.223363455 +0000 UTC m=+78.255976210 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d08de005-27fa-45f4-a887-83d0e7fefe7b-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-bmjbj" (UID: "d08de005-27fa-45f4-a887-83d0e7fefe7b") : secret "samples-operator-tls" not found Sep 10 12:46:58.765010 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:58.764963 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-dvf22" event={"ID":"765454f6-c879-42b5-8e20-f19a691f6a34","Type":"ContainerStarted","Data":"5c899e17c17a3851a678ef1115c226d1144743e413601e16967e2860635a2906"} Sep 10 12:46:58.766603 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:58.766522 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-g6mq9" event={"ID":"29ea1f07-01f3-4c53-b31f-fe44107e44de","Type":"ContainerStarted","Data":"168d27511a36786075be85128d3f7189a3b8368596e3834518aa6f13b7b40a44"} Sep 10 12:46:58.768039 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:58.768006 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-n927p" event={"ID":"274481a5-adbe-428d-9381-2a98b78f1f43","Type":"ContainerStarted","Data":"999c43917c57d1a0babfc1be3125ad106180b7492c08ac3e664dd1ebd498958e"} Sep 10 12:46:59.130036 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:59.129992 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a2202efa-bdce-43d6-9472-d148b6f085fe-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-8j2jv\" (UID: \"a2202efa-bdce-43d6-9472-d148b6f085fe\") " pod="openshift-network-console/networking-console-plugin-79977f9844-8j2jv" Sep 10 12:46:59.130227 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:59.130163 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 10 12:46:59.130297 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:59.130235 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2202efa-bdce-43d6-9472-d148b6f085fe-networking-console-plugin-cert podName:a2202efa-bdce-43d6-9472-d148b6f085fe nodeName:}" failed. No retries permitted until 2026-09-10 12:47:01.130216512 +0000 UTC m=+80.162829273 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a2202efa-bdce-43d6-9472-d148b6f085fe-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-8j2jv" (UID: "a2202efa-bdce-43d6-9472-d148b6f085fe") : secret "networking-console-plugin-cert" not found Sep 10 12:46:59.230557 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:59.230519 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d08de005-27fa-45f4-a887-83d0e7fefe7b-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-bmjbj\" (UID: \"d08de005-27fa-45f4-a887-83d0e7fefe7b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bmjbj" Sep 10 12:46:59.230740 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:59.230585 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bcc23540-e3a4-4cc7-8f66-59e250b39f23-registry-tls\") pod \"image-registry-85bf8594b-kh4mj\" (UID: \"bcc23540-e3a4-4cc7-8f66-59e250b39f23\") " pod="openshift-image-registry/image-registry-85bf8594b-kh4mj" Sep 10 12:46:59.230740 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:59.230707 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 12:46:59.230856 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:59.230787 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d08de005-27fa-45f4-a887-83d0e7fefe7b-samples-operator-tls podName:d08de005-27fa-45f4-a887-83d0e7fefe7b nodeName:}" failed. No retries permitted until 2026-09-10 12:47:01.230766028 +0000 UTC m=+80.263378806 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d08de005-27fa-45f4-a887-83d0e7fefe7b-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-bmjbj" (UID: "d08de005-27fa-45f4-a887-83d0e7fefe7b") : secret "samples-operator-tls" not found Sep 10 12:46:59.230856 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:59.230713 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 12:46:59.230856 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:59.230816 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85bf8594b-kh4mj: secret "image-registry-tls" not found Sep 10 12:46:59.230856 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:46:59.230850 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bcc23540-e3a4-4cc7-8f66-59e250b39f23-registry-tls podName:bcc23540-e3a4-4cc7-8f66-59e250b39f23 nodeName:}" failed. No retries permitted until 2026-09-10 12:47:01.230839642 +0000 UTC m=+80.263452419 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bcc23540-e3a4-4cc7-8f66-59e250b39f23-registry-tls") pod "image-registry-85bf8594b-kh4mj" (UID: "bcc23540-e3a4-4cc7-8f66-59e250b39f23") : secret "image-registry-tls" not found Sep 10 12:46:59.772564 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:59.772471 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-n927p" event={"ID":"274481a5-adbe-428d-9381-2a98b78f1f43","Type":"ContainerStarted","Data":"f57a6e73cea2fca76f8b0d5b793b0eba1c8a7eecffe1f52b1638ccd7bd05e22e"} Sep 10 12:46:59.793747 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:46:59.793693 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-n927p" podStartSLOduration=1.443844951 podStartE2EDuration="2.793675604s" totalImagesPullingTime="1.349830653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:46:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:46:59.793087508 +0000 UTC m=+78.825700286" watchObservedRunningTime="2026-09-10 12:46:59.793675604 +0000 UTC m=+78.826288378" Sep 10 12:47:00.777075 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:00.777028 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-g6mq9" event={"ID":"29ea1f07-01f3-4c53-b31f-fe44107e44de","Type":"ContainerStarted","Data":"0e1c569266af150349ee82377ad8cf2a72dd2091e41aabba4575c3dcd7cd7798"} Sep 10 12:47:00.778683 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:00.778664 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-dvf22_765454f6-c879-42b5-8e20-f19a691f6a34/console-operator/0.log" Sep 10 12:47:00.778814 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:00.778698 2577 generic.go:356] "Generic (PLEG): container finished" podID="765454f6-c879-42b5-8e20-f19a691f6a34" containerID="94bed568eab3c108a3cb6f7acb19e5dcadfecac7eebcf1e1fefefb0130e0c89a" exitCode=255 Sep 10 12:47:00.778814 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:00.778766 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-dvf22" event={"ID":"765454f6-c879-42b5-8e20-f19a691f6a34","Type":"ContainerDied","Data":"94bed568eab3c108a3cb6f7acb19e5dcadfecac7eebcf1e1fefefb0130e0c89a"} Sep 10 12:47:00.778948 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:00.778935 2577 scope.go:117] "RemoveContainer" containerID="94bed568eab3c108a3cb6f7acb19e5dcadfecac7eebcf1e1fefefb0130e0c89a" Sep 10 12:47:00.813474 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:00.813369 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-g6mq9" podStartSLOduration=1.277935466 podStartE2EDuration="3.813350045s" totalImagesPullingTime="2.535414579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:46:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:47:00.812702117 +0000 UTC m=+79.845314895" watchObservedRunningTime="2026-09-10 12:47:00.813350045 +0000 UTC m=+79.845962823" Sep 10 12:47:00.970153 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:00.970121 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-72gpf"] Sep 10 12:47:00.972120 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:00.972102 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-72gpf" Sep 10 12:47:00.975584 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:00.975551 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 10 12:47:00.975725 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:00.975590 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 10 12:47:00.975725 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:00.975615 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8p6pv\"" Sep 10 12:47:00.976586 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:00.976568 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 10 12:47:00.980714 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:00.980691 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 10 12:47:01.033989 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:01.033955 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-72gpf"] Sep 10 12:47:01.048797 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:01.048765 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dfd3fa37-09e7-46a1-b67e-57e760dbde61-data-volume\") pod \"insights-runtime-extractor-72gpf\" (UID: \"dfd3fa37-09e7-46a1-b67e-57e760dbde61\") " pod="openshift-insights/insights-runtime-extractor-72gpf" Sep 10 12:47:01.048961 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:01.048829 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhdxj\" (UniqueName: \"kubernetes.io/projected/dfd3fa37-09e7-46a1-b67e-57e760dbde61-kube-api-access-rhdxj\") pod \"insights-runtime-extractor-72gpf\" (UID: \"dfd3fa37-09e7-46a1-b67e-57e760dbde61\") " pod="openshift-insights/insights-runtime-extractor-72gpf" Sep 10 12:47:01.048961 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:01.048869 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dfd3fa37-09e7-46a1-b67e-57e760dbde61-crio-socket\") pod \"insights-runtime-extractor-72gpf\" (UID: \"dfd3fa37-09e7-46a1-b67e-57e760dbde61\") " pod="openshift-insights/insights-runtime-extractor-72gpf" Sep 10 12:47:01.048961 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:01.048896 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dfd3fa37-09e7-46a1-b67e-57e760dbde61-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-72gpf\" (UID: \"dfd3fa37-09e7-46a1-b67e-57e760dbde61\") " pod="openshift-insights/insights-runtime-extractor-72gpf" Sep 10 12:47:01.048961 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:01.048921 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dfd3fa37-09e7-46a1-b67e-57e760dbde61-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-72gpf\" (UID: \"dfd3fa37-09e7-46a1-b67e-57e760dbde61\") " pod="openshift-insights/insights-runtime-extractor-72gpf" Sep 10 12:47:01.150183 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:01.150058 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhdxj\" (UniqueName: \"kubernetes.io/projected/dfd3fa37-09e7-46a1-b67e-57e760dbde61-kube-api-access-rhdxj\") pod \"insights-runtime-extractor-72gpf\" (UID: \"dfd3fa37-09e7-46a1-b67e-57e760dbde61\") " pod="openshift-insights/insights-runtime-extractor-72gpf" Sep 10 12:47:01.150183 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:01.150107 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dfd3fa37-09e7-46a1-b67e-57e760dbde61-crio-socket\") pod \"insights-runtime-extractor-72gpf\" (UID: \"dfd3fa37-09e7-46a1-b67e-57e760dbde61\") " pod="openshift-insights/insights-runtime-extractor-72gpf" Sep 10 12:47:01.150183 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:01.150161 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dfd3fa37-09e7-46a1-b67e-57e760dbde61-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-72gpf\" (UID: \"dfd3fa37-09e7-46a1-b67e-57e760dbde61\") " pod="openshift-insights/insights-runtime-extractor-72gpf" Sep 10 12:47:01.150454 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:01.150196 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dfd3fa37-09e7-46a1-b67e-57e760dbde61-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-72gpf\" (UID: \"dfd3fa37-09e7-46a1-b67e-57e760dbde61\") " pod="openshift-insights/insights-runtime-extractor-72gpf" Sep 10 12:47:01.150454 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:01.150253 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dfd3fa37-09e7-46a1-b67e-57e760dbde61-data-volume\") pod \"insights-runtime-extractor-72gpf\" (UID: \"dfd3fa37-09e7-46a1-b67e-57e760dbde61\") " pod="openshift-insights/insights-runtime-extractor-72gpf" Sep 10 12:47:01.150454 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:01.150267 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dfd3fa37-09e7-46a1-b67e-57e760dbde61-crio-socket\") pod \"insights-runtime-extractor-72gpf\" (UID: \"dfd3fa37-09e7-46a1-b67e-57e760dbde61\") " pod="openshift-insights/insights-runtime-extractor-72gpf" Sep 10 12:47:01.150454 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:47:01.150285 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 12:47:01.150454 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:01.150280 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a2202efa-bdce-43d6-9472-d148b6f085fe-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-8j2jv\" (UID: \"a2202efa-bdce-43d6-9472-d148b6f085fe\") " pod="openshift-network-console/networking-console-plugin-79977f9844-8j2jv" Sep 10 12:47:01.150454 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:47:01.150359 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 10 12:47:01.150454 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:47:01.150366 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dfd3fa37-09e7-46a1-b67e-57e760dbde61-kube-rbac-proxy-cm podName:dfd3fa37-09e7-46a1-b67e-57e760dbde61 nodeName:}" failed. No retries permitted until 2026-09-10 12:47:01.650345167 +0000 UTC m=+80.682957950 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dfd3fa37-09e7-46a1-b67e-57e760dbde61-kube-rbac-proxy-cm") pod "insights-runtime-extractor-72gpf" (UID: "dfd3fa37-09e7-46a1-b67e-57e760dbde61") : configmap "kube-rbac-proxy" not found Sep 10 12:47:01.150454 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:47:01.150380 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 12:47:01.150454 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:47:01.150409 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2202efa-bdce-43d6-9472-d148b6f085fe-networking-console-plugin-cert podName:a2202efa-bdce-43d6-9472-d148b6f085fe nodeName:}" failed. No retries permitted until 2026-09-10 12:47:05.150393136 +0000 UTC m=+84.183005909 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a2202efa-bdce-43d6-9472-d148b6f085fe-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-8j2jv" (UID: "a2202efa-bdce-43d6-9472-d148b6f085fe") : secret "networking-console-plugin-cert" not found Sep 10 12:47:01.150454 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:47:01.150437 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfd3fa37-09e7-46a1-b67e-57e760dbde61-insights-runtime-extractor-tls podName:dfd3fa37-09e7-46a1-b67e-57e760dbde61 nodeName:}" failed. No retries permitted until 2026-09-10 12:47:01.650420626 +0000 UTC m=+80.683033389 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dfd3fa37-09e7-46a1-b67e-57e760dbde61-insights-runtime-extractor-tls") pod "insights-runtime-extractor-72gpf" (UID: "dfd3fa37-09e7-46a1-b67e-57e760dbde61") : secret "insights-runtime-extractor-tls" not found Sep 10 12:47:01.150761 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:01.150598 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dfd3fa37-09e7-46a1-b67e-57e760dbde61-data-volume\") pod \"insights-runtime-extractor-72gpf\" (UID: \"dfd3fa37-09e7-46a1-b67e-57e760dbde61\") " pod="openshift-insights/insights-runtime-extractor-72gpf" Sep 10 12:47:01.163129 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:01.163100 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhdxj\" (UniqueName: \"kubernetes.io/projected/dfd3fa37-09e7-46a1-b67e-57e760dbde61-kube-api-access-rhdxj\") pod \"insights-runtime-extractor-72gpf\" (UID: \"dfd3fa37-09e7-46a1-b67e-57e760dbde61\") " pod="openshift-insights/insights-runtime-extractor-72gpf" Sep 10 12:47:01.251566 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:01.251517 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bcc23540-e3a4-4cc7-8f66-59e250b39f23-registry-tls\") pod \"image-registry-85bf8594b-kh4mj\" (UID: \"bcc23540-e3a4-4cc7-8f66-59e250b39f23\") " pod="openshift-image-registry/image-registry-85bf8594b-kh4mj" Sep 10 12:47:01.251714 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:47:01.251664 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 12:47:01.251714 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:47:01.251684 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85bf8594b-kh4mj: secret "image-registry-tls" not found Sep 10 12:47:01.251714 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:01.251696 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d08de005-27fa-45f4-a887-83d0e7fefe7b-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-bmjbj\" (UID: \"d08de005-27fa-45f4-a887-83d0e7fefe7b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bmjbj" Sep 10 12:47:01.251836 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:47:01.251743 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bcc23540-e3a4-4cc7-8f66-59e250b39f23-registry-tls podName:bcc23540-e3a4-4cc7-8f66-59e250b39f23 nodeName:}" failed. No retries permitted until 2026-09-10 12:47:05.251727508 +0000 UTC m=+84.284340263 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bcc23540-e3a4-4cc7-8f66-59e250b39f23-registry-tls") pod "image-registry-85bf8594b-kh4mj" (UID: "bcc23540-e3a4-4cc7-8f66-59e250b39f23") : secret "image-registry-tls" not found Sep 10 12:47:01.251836 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:47:01.251808 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 12:47:01.251898 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:47:01.251862 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d08de005-27fa-45f4-a887-83d0e7fefe7b-samples-operator-tls podName:d08de005-27fa-45f4-a887-83d0e7fefe7b nodeName:}" failed. No retries permitted until 2026-09-10 12:47:05.251847381 +0000 UTC m=+84.284460154 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d08de005-27fa-45f4-a887-83d0e7fefe7b-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-bmjbj" (UID: "d08de005-27fa-45f4-a887-83d0e7fefe7b") : secret "samples-operator-tls" not found Sep 10 12:47:01.655917 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:01.655858 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dfd3fa37-09e7-46a1-b67e-57e760dbde61-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-72gpf\" (UID: \"dfd3fa37-09e7-46a1-b67e-57e760dbde61\") " pod="openshift-insights/insights-runtime-extractor-72gpf" Sep 10 12:47:01.656102 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:01.655927 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dfd3fa37-09e7-46a1-b67e-57e760dbde61-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-72gpf\" (UID: \"dfd3fa37-09e7-46a1-b67e-57e760dbde61\") " pod="openshift-insights/insights-runtime-extractor-72gpf" Sep 10 12:47:01.656102 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:47:01.655974 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 12:47:01.656102 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:47:01.656046 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dfd3fa37-09e7-46a1-b67e-57e760dbde61-kube-rbac-proxy-cm podName:dfd3fa37-09e7-46a1-b67e-57e760dbde61 nodeName:}" failed. No retries permitted until 2026-09-10 12:47:02.65602554 +0000 UTC m=+81.688638316 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dfd3fa37-09e7-46a1-b67e-57e760dbde61-kube-rbac-proxy-cm") pod "insights-runtime-extractor-72gpf" (UID: "dfd3fa37-09e7-46a1-b67e-57e760dbde61") : configmap "kube-rbac-proxy" not found Sep 10 12:47:01.656102 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:47:01.656088 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 12:47:01.656349 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:47:01.656173 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfd3fa37-09e7-46a1-b67e-57e760dbde61-insights-runtime-extractor-tls podName:dfd3fa37-09e7-46a1-b67e-57e760dbde61 nodeName:}" failed. No retries permitted until 2026-09-10 12:47:02.656137126 +0000 UTC m=+81.688749881 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dfd3fa37-09e7-46a1-b67e-57e760dbde61-insights-runtime-extractor-tls") pod "insights-runtime-extractor-72gpf" (UID: "dfd3fa37-09e7-46a1-b67e-57e760dbde61") : secret "insights-runtime-extractor-tls" not found Sep 10 12:47:01.785233 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:01.785207 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-dvf22_765454f6-c879-42b5-8e20-f19a691f6a34/console-operator/1.log" Sep 10 12:47:01.785633 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:01.785618 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-dvf22_765454f6-c879-42b5-8e20-f19a691f6a34/console-operator/0.log" Sep 10 12:47:01.785672 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:01.785657 2577 generic.go:356] "Generic (PLEG): container finished" podID="765454f6-c879-42b5-8e20-f19a691f6a34" containerID="feaa1f2b8d958d3dbdd6b16e042a14e2fe506fb818085e9f094765af474c8fd0" exitCode=255 Sep 10 12:47:01.785731 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:01.785690 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-dvf22" event={"ID":"765454f6-c879-42b5-8e20-f19a691f6a34","Type":"ContainerDied","Data":"feaa1f2b8d958d3dbdd6b16e042a14e2fe506fb818085e9f094765af474c8fd0"} Sep 10 12:47:01.785773 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:01.785748 2577 scope.go:117] "RemoveContainer" containerID="94bed568eab3c108a3cb6f7acb19e5dcadfecac7eebcf1e1fefefb0130e0c89a" Sep 10 12:47:01.785988 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:01.785966 2577 scope.go:117] "RemoveContainer" containerID="feaa1f2b8d958d3dbdd6b16e042a14e2fe506fb818085e9f094765af474c8fd0" Sep 10 12:47:01.786156 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:47:01.786124 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-dvf22_openshift-console-operator(765454f6-c879-42b5-8e20-f19a691f6a34)\"" pod="openshift-console-operator/console-operator-85b454874b-dvf22" podUID="765454f6-c879-42b5-8e20-f19a691f6a34" Sep 10 12:47:02.664768 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:02.664727 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dfd3fa37-09e7-46a1-b67e-57e760dbde61-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-72gpf\" (UID: \"dfd3fa37-09e7-46a1-b67e-57e760dbde61\") " pod="openshift-insights/insights-runtime-extractor-72gpf" Sep 10 12:47:02.665018 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:02.664856 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dfd3fa37-09e7-46a1-b67e-57e760dbde61-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-72gpf\" (UID: \"dfd3fa37-09e7-46a1-b67e-57e760dbde61\") " pod="openshift-insights/insights-runtime-extractor-72gpf" Sep 10 12:47:02.665018 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:47:02.664881 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 12:47:02.665018 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:47:02.664924 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 12:47:02.665018 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:47:02.664946 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfd3fa37-09e7-46a1-b67e-57e760dbde61-insights-runtime-extractor-tls podName:dfd3fa37-09e7-46a1-b67e-57e760dbde61 nodeName:}" failed. No retries permitted until 2026-09-10 12:47:04.664930747 +0000 UTC m=+83.697543506 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dfd3fa37-09e7-46a1-b67e-57e760dbde61-insights-runtime-extractor-tls") pod "insights-runtime-extractor-72gpf" (UID: "dfd3fa37-09e7-46a1-b67e-57e760dbde61") : secret "insights-runtime-extractor-tls" not found Sep 10 12:47:02.665018 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:47:02.664966 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dfd3fa37-09e7-46a1-b67e-57e760dbde61-kube-rbac-proxy-cm podName:dfd3fa37-09e7-46a1-b67e-57e760dbde61 nodeName:}" failed. No retries permitted until 2026-09-10 12:47:04.664954706 +0000 UTC m=+83.697567461 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dfd3fa37-09e7-46a1-b67e-57e760dbde61-kube-rbac-proxy-cm") pod "insights-runtime-extractor-72gpf" (UID: "dfd3fa37-09e7-46a1-b67e-57e760dbde61") : configmap "kube-rbac-proxy" not found Sep 10 12:47:02.790589 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:02.790562 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-dvf22_765454f6-c879-42b5-8e20-f19a691f6a34/console-operator/1.log" Sep 10 12:47:02.790960 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:02.790881 2577 scope.go:117] "RemoveContainer" containerID="feaa1f2b8d958d3dbdd6b16e042a14e2fe506fb818085e9f094765af474c8fd0" Sep 10 12:47:02.791038 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:47:02.791020 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-dvf22_openshift-console-operator(765454f6-c879-42b5-8e20-f19a691f6a34)\"" pod="openshift-console-operator/console-operator-85b454874b-dvf22" podUID="765454f6-c879-42b5-8e20-f19a691f6a34" Sep 10 12:47:03.039311 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:03.039287 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hnwpz_e73d37ca-36d4-43f1-a967-0022bc31cc28/dns-node-resolver/0.log" Sep 10 12:47:03.838897 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:03.838867 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8htgx_32029bf2-b2b1-4a78-ac29-1aa65ee60328/node-ca/0.log" Sep 10 12:47:04.685120 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:04.685065 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dfd3fa37-09e7-46a1-b67e-57e760dbde61-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-72gpf\" (UID: \"dfd3fa37-09e7-46a1-b67e-57e760dbde61\") " pod="openshift-insights/insights-runtime-extractor-72gpf" Sep 10 12:47:04.685120 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:04.685120 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dfd3fa37-09e7-46a1-b67e-57e760dbde61-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-72gpf\" (UID: \"dfd3fa37-09e7-46a1-b67e-57e760dbde61\") " pod="openshift-insights/insights-runtime-extractor-72gpf" Sep 10 12:47:04.685389 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:47:04.685236 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 12:47:04.685389 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:47:04.685263 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 12:47:04.685389 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:47:04.685305 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dfd3fa37-09e7-46a1-b67e-57e760dbde61-kube-rbac-proxy-cm podName:dfd3fa37-09e7-46a1-b67e-57e760dbde61 nodeName:}" failed. No retries permitted until 2026-09-10 12:47:08.685289305 +0000 UTC m=+87.717902059 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dfd3fa37-09e7-46a1-b67e-57e760dbde61-kube-rbac-proxy-cm") pod "insights-runtime-extractor-72gpf" (UID: "dfd3fa37-09e7-46a1-b67e-57e760dbde61") : configmap "kube-rbac-proxy" not found Sep 10 12:47:04.685389 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:47:04.685321 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfd3fa37-09e7-46a1-b67e-57e760dbde61-insights-runtime-extractor-tls podName:dfd3fa37-09e7-46a1-b67e-57e760dbde61 nodeName:}" failed. No retries permitted until 2026-09-10 12:47:08.685314722 +0000 UTC m=+87.717927477 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dfd3fa37-09e7-46a1-b67e-57e760dbde61-insights-runtime-extractor-tls") pod "insights-runtime-extractor-72gpf" (UID: "dfd3fa37-09e7-46a1-b67e-57e760dbde61") : secret "insights-runtime-extractor-tls" not found Sep 10 12:47:04.839865 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:04.839838 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qlhzv_29dbffec-6ed7-4409-b5fa-c2a8de733e92/serve-healthcheck-canary/0.log" Sep 10 12:47:05.188705 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:05.188667 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a2202efa-bdce-43d6-9472-d148b6f085fe-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-8j2jv\" (UID: \"a2202efa-bdce-43d6-9472-d148b6f085fe\") " pod="openshift-network-console/networking-console-plugin-79977f9844-8j2jv" Sep 10 12:47:05.188878 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:47:05.188813 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 10 12:47:05.188919 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:47:05.188892 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2202efa-bdce-43d6-9472-d148b6f085fe-networking-console-plugin-cert podName:a2202efa-bdce-43d6-9472-d148b6f085fe nodeName:}" failed. No retries permitted until 2026-09-10 12:47:13.188876481 +0000 UTC m=+92.221489236 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a2202efa-bdce-43d6-9472-d148b6f085fe-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-8j2jv" (UID: "a2202efa-bdce-43d6-9472-d148b6f085fe") : secret "networking-console-plugin-cert" not found Sep 10 12:47:05.289250 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:05.289212 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d08de005-27fa-45f4-a887-83d0e7fefe7b-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-bmjbj\" (UID: \"d08de005-27fa-45f4-a887-83d0e7fefe7b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bmjbj" Sep 10 12:47:05.289355 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:05.289333 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bcc23540-e3a4-4cc7-8f66-59e250b39f23-registry-tls\") pod \"image-registry-85bf8594b-kh4mj\" (UID: \"bcc23540-e3a4-4cc7-8f66-59e250b39f23\") " pod="openshift-image-registry/image-registry-85bf8594b-kh4mj" Sep 10 12:47:05.289394 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:47:05.289370 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 12:47:05.289445 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:47:05.289434 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d08de005-27fa-45f4-a887-83d0e7fefe7b-samples-operator-tls podName:d08de005-27fa-45f4-a887-83d0e7fefe7b nodeName:}" failed. No retries permitted until 2026-09-10 12:47:13.289418701 +0000 UTC m=+92.322031468 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d08de005-27fa-45f4-a887-83d0e7fefe7b-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-bmjbj" (UID: "d08de005-27fa-45f4-a887-83d0e7fefe7b") : secret "samples-operator-tls" not found Sep 10 12:47:05.289496 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:47:05.289475 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 12:47:05.289535 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:47:05.289498 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85bf8594b-kh4mj: secret "image-registry-tls" not found Sep 10 12:47:05.289571 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:47:05.289543 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bcc23540-e3a4-4cc7-8f66-59e250b39f23-registry-tls podName:bcc23540-e3a4-4cc7-8f66-59e250b39f23 nodeName:}" failed. No retries permitted until 2026-09-10 12:47:13.289530198 +0000 UTC m=+92.322142953 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bcc23540-e3a4-4cc7-8f66-59e250b39f23-registry-tls") pod "image-registry-85bf8594b-kh4mj" (UID: "bcc23540-e3a4-4cc7-8f66-59e250b39f23") : secret "image-registry-tls" not found Sep 10 12:47:07.595414 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:07.595372 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-dvf22" Sep 10 12:47:07.595802 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:07.595439 2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-dvf22" Sep 10 12:47:07.595802 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:07.595784 2577 scope.go:117] "RemoveContainer" containerID="feaa1f2b8d958d3dbdd6b16e042a14e2fe506fb818085e9f094765af474c8fd0" Sep 10 12:47:07.595946 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:47:07.595928 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-dvf22_openshift-console-operator(765454f6-c879-42b5-8e20-f19a691f6a34)\"" pod="openshift-console-operator/console-operator-85b454874b-dvf22" podUID="765454f6-c879-42b5-8e20-f19a691f6a34" Sep 10 12:47:08.716708 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:08.716675 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dfd3fa37-09e7-46a1-b67e-57e760dbde61-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-72gpf\" (UID: \"dfd3fa37-09e7-46a1-b67e-57e760dbde61\") " pod="openshift-insights/insights-runtime-extractor-72gpf" Sep 10 12:47:08.716708 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:08.716713 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dfd3fa37-09e7-46a1-b67e-57e760dbde61-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-72gpf\" (UID: \"dfd3fa37-09e7-46a1-b67e-57e760dbde61\") " pod="openshift-insights/insights-runtime-extractor-72gpf" Sep 10 12:47:08.717197 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:47:08.716800 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 12:47:08.717197 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:47:08.716867 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dfd3fa37-09e7-46a1-b67e-57e760dbde61-kube-rbac-proxy-cm podName:dfd3fa37-09e7-46a1-b67e-57e760dbde61 nodeName:}" failed. No retries permitted until 2026-09-10 12:47:16.716850367 +0000 UTC m=+95.749463126 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dfd3fa37-09e7-46a1-b67e-57e760dbde61-kube-rbac-proxy-cm") pod "insights-runtime-extractor-72gpf" (UID: "dfd3fa37-09e7-46a1-b67e-57e760dbde61") : configmap "kube-rbac-proxy" not found Sep 10 12:47:08.717197 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:47:08.716891 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 12:47:08.717197 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:47:08.716943 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfd3fa37-09e7-46a1-b67e-57e760dbde61-insights-runtime-extractor-tls podName:dfd3fa37-09e7-46a1-b67e-57e760dbde61 nodeName:}" failed. No retries permitted until 2026-09-10 12:47:16.716931438 +0000 UTC m=+95.749544198 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dfd3fa37-09e7-46a1-b67e-57e760dbde61-insights-runtime-extractor-tls") pod "insights-runtime-extractor-72gpf" (UID: "dfd3fa37-09e7-46a1-b67e-57e760dbde61") : secret "insights-runtime-extractor-tls" not found Sep 10 12:47:13.254554 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:13.254494 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a2202efa-bdce-43d6-9472-d148b6f085fe-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-8j2jv\" (UID: \"a2202efa-bdce-43d6-9472-d148b6f085fe\") " pod="openshift-network-console/networking-console-plugin-79977f9844-8j2jv" Sep 10 12:47:13.254987 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:47:13.254658 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 10 12:47:13.254987 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:47:13.254726 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2202efa-bdce-43d6-9472-d148b6f085fe-networking-console-plugin-cert podName:a2202efa-bdce-43d6-9472-d148b6f085fe nodeName:}" failed. No retries permitted until 2026-09-10 12:47:29.254709817 +0000 UTC m=+108.287322572 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a2202efa-bdce-43d6-9472-d148b6f085fe-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-8j2jv" (UID: "a2202efa-bdce-43d6-9472-d148b6f085fe") : secret "networking-console-plugin-cert" not found Sep 10 12:47:13.355586 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:13.355519 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bcc23540-e3a4-4cc7-8f66-59e250b39f23-registry-tls\") pod \"image-registry-85bf8594b-kh4mj\" (UID: \"bcc23540-e3a4-4cc7-8f66-59e250b39f23\") " pod="openshift-image-registry/image-registry-85bf8594b-kh4mj" Sep 10 12:47:13.355762 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:13.355609 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d08de005-27fa-45f4-a887-83d0e7fefe7b-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-bmjbj\" (UID: \"d08de005-27fa-45f4-a887-83d0e7fefe7b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bmjbj" Sep 10 12:47:13.357895 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:13.357865 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d08de005-27fa-45f4-a887-83d0e7fefe7b-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-bmjbj\" (UID: \"d08de005-27fa-45f4-a887-83d0e7fefe7b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bmjbj" Sep 10 12:47:13.358028 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:13.358008 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bcc23540-e3a4-4cc7-8f66-59e250b39f23-registry-tls\") pod \"image-registry-85bf8594b-kh4mj\" (UID: \"bcc23540-e3a4-4cc7-8f66-59e250b39f23\") " pod="openshift-image-registry/image-registry-85bf8594b-kh4mj" Sep 10 12:47:13.423958 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:13.423921 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85bf8594b-kh4mj" Sep 10 12:47:13.519277 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:13.519204 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bmjbj" Sep 10 12:47:13.704241 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:47:13.704209 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcc23540_e3a4_4cc7_8f66_59e250b39f23.slice/crio-96ba966a9b3fa518ecd178c3ec16f46caa270bade1a4cb7cf1f32f0d8894f6fd WatchSource:0}: Error finding container 96ba966a9b3fa518ecd178c3ec16f46caa270bade1a4cb7cf1f32f0d8894f6fd: Status 404 returned error can't find the container with id 96ba966a9b3fa518ecd178c3ec16f46caa270bade1a4cb7cf1f32f0d8894f6fd Sep 10 12:47:13.704454 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:13.704434 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-85bf8594b-kh4mj"] Sep 10 12:47:13.794549 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:13.794523 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bmjbj"] Sep 10 12:47:13.825266 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:13.825232 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85bf8594b-kh4mj" event={"ID":"bcc23540-e3a4-4cc7-8f66-59e250b39f23","Type":"ContainerStarted","Data":"7ea13eb6f7ccd61f73458bd3e6906054c9cb00b942d9bff177b2e0d998487a92"} Sep 10 12:47:13.825411 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:13.825294 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85bf8594b-kh4mj" event={"ID":"bcc23540-e3a4-4cc7-8f66-59e250b39f23","Type":"ContainerStarted","Data":"96ba966a9b3fa518ecd178c3ec16f46caa270bade1a4cb7cf1f32f0d8894f6fd"} Sep 10 12:47:13.825411 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:13.825372 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-85bf8594b-kh4mj" Sep 10 12:47:13.850218 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:13.850067 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-85bf8594b-kh4mj" podStartSLOduration=16.850048058 podStartE2EDuration="16.850048058s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:46:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:47:13.849423625 +0000 UTC m=+92.882036401" watchObservedRunningTime="2026-09-10 12:47:13.850048058 +0000 UTC m=+92.882660837" Sep 10 12:47:14.830082 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:14.830033 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bmjbj" event={"ID":"d08de005-27fa-45f4-a887-83d0e7fefe7b","Type":"ContainerStarted","Data":"cf061d7505bfbd28121e6bc5db1554cd85a0430580e6469bac76d0208c48fce7"} Sep 10 12:47:15.835560 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:15.835485 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bmjbj" event={"ID":"d08de005-27fa-45f4-a887-83d0e7fefe7b","Type":"ContainerStarted","Data":"fa4db252cf08713a579bd0356484648a38704bd6f9bbb74d48db1e34a8a116f2"} Sep 10 12:47:15.835560 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:15.835535 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bmjbj" event={"ID":"d08de005-27fa-45f4-a887-83d0e7fefe7b","Type":"ContainerStarted","Data":"4eb5a5406afcf9e16be8d356b50d41e8e74293260743600154d14013432ddbd5"} Sep 10 12:47:15.856986 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:15.856931 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-bmjbj" podStartSLOduration=17.13441727 podStartE2EDuration="18.856911252s" totalImagesPullingTime="1.722493982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:46:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:47:15.856537719 +0000 UTC m=+94.889150490" watchObservedRunningTime="2026-09-10 12:47:15.856911252 +0000 UTC m=+94.889524031" Sep 10 12:47:16.789256 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:16.789215 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dfd3fa37-09e7-46a1-b67e-57e760dbde61-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-72gpf\" (UID: \"dfd3fa37-09e7-46a1-b67e-57e760dbde61\") " pod="openshift-insights/insights-runtime-extractor-72gpf" Sep 10 12:47:16.789256 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:16.789263 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dfd3fa37-09e7-46a1-b67e-57e760dbde61-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-72gpf\" (UID: \"dfd3fa37-09e7-46a1-b67e-57e760dbde61\") " pod="openshift-insights/insights-runtime-extractor-72gpf" Sep 10 12:47:16.789466 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:47:16.789372 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 12:47:16.789466 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:47:16.789431 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfd3fa37-09e7-46a1-b67e-57e760dbde61-insights-runtime-extractor-tls podName:dfd3fa37-09e7-46a1-b67e-57e760dbde61 nodeName:}" failed. No retries permitted until 2026-09-10 12:47:32.789415421 +0000 UTC m=+111.822028192 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dfd3fa37-09e7-46a1-b67e-57e760dbde61-insights-runtime-extractor-tls") pod "insights-runtime-extractor-72gpf" (UID: "dfd3fa37-09e7-46a1-b67e-57e760dbde61") : secret "insights-runtime-extractor-tls" not found Sep 10 12:47:16.789752 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:16.789726 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dfd3fa37-09e7-46a1-b67e-57e760dbde61-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-72gpf\" (UID: \"dfd3fa37-09e7-46a1-b67e-57e760dbde61\") " pod="openshift-insights/insights-runtime-extractor-72gpf" Sep 10 12:47:19.208310 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:19.208269 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8bbef592-ec3a-418e-b64f-a783b5205a24-metrics-tls\") pod \"dns-default-pl69q\" (UID: \"8bbef592-ec3a-418e-b64f-a783b5205a24\") " pod="openshift-dns/dns-default-pl69q" Sep 10 12:47:19.210586 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:19.210567 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8bbef592-ec3a-418e-b64f-a783b5205a24-metrics-tls\") pod \"dns-default-pl69q\" (UID: \"8bbef592-ec3a-418e-b64f-a783b5205a24\") " pod="openshift-dns/dns-default-pl69q" Sep 10 12:47:19.236678 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:19.236653 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ns5lz\"" Sep 10 12:47:19.244902 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:19.244883 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pl69q" Sep 10 12:47:19.517344 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:19.517258 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pl69q"] Sep 10 12:47:19.520303 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:47:19.520277 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bbef592_ec3a_418e_b64f_a783b5205a24.slice/crio-4e8cee6e23a988cddadfc0ff3f3141fb33d8df1d6d204ee85e5565e3a8f38aed WatchSource:0}: Error finding container 4e8cee6e23a988cddadfc0ff3f3141fb33d8df1d6d204ee85e5565e3a8f38aed: Status 404 returned error can't find the container with id 4e8cee6e23a988cddadfc0ff3f3141fb33d8df1d6d204ee85e5565e3a8f38aed Sep 10 12:47:19.850985 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:19.850954 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pl69q" event={"ID":"8bbef592-ec3a-418e-b64f-a783b5205a24","Type":"ContainerStarted","Data":"4e8cee6e23a988cddadfc0ff3f3141fb33d8df1d6d204ee85e5565e3a8f38aed"} Sep 10 12:47:21.859018 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:21.858984 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pl69q" event={"ID":"8bbef592-ec3a-418e-b64f-a783b5205a24","Type":"ContainerStarted","Data":"aab9fc1f518f7aa2b3800344f988dd6ee7850d63b449ba0b7e9e7c5b32a85323"} Sep 10 12:47:21.859411 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:21.859038 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pl69q" event={"ID":"8bbef592-ec3a-418e-b64f-a783b5205a24","Type":"ContainerStarted","Data":"c7bd6f522e7413a2efcdbb4328c63beea31c862d23ddba22ad2e8e45b815d7b3"} Sep 10 12:47:21.859411 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:21.859067 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pl69q" Sep 10 12:47:21.880502 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:21.880452 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pl69q" podStartSLOduration=64.94858562 podStartE2EDuration="1m6.880434983s" totalImagesPullingTime="1.931849363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:46:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:47:21.879639558 +0000 UTC m=+100.912252347" watchObservedRunningTime="2026-09-10 12:47:21.880434983 +0000 UTC m=+100.913047773" Sep 10 12:47:22.492233 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:22.492206 2577 scope.go:117] "RemoveContainer" containerID="feaa1f2b8d958d3dbdd6b16e042a14e2fe506fb818085e9f094765af474c8fd0" Sep 10 12:47:22.867484 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:22.867447 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-dvf22_765454f6-c879-42b5-8e20-f19a691f6a34/console-operator/2.log" Sep 10 12:47:22.867914 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:22.867899 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-dvf22_765454f6-c879-42b5-8e20-f19a691f6a34/console-operator/1.log" Sep 10 12:47:22.867973 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:22.867933 2577 generic.go:356] "Generic (PLEG): container finished" podID="765454f6-c879-42b5-8e20-f19a691f6a34" containerID="25ab1ca965aef7314f2ca78264958c41f30316c5b307617a6db6d6ad08f799df" exitCode=255 Sep 10 12:47:22.868032 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:22.868012 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-dvf22" event={"ID":"765454f6-c879-42b5-8e20-f19a691f6a34","Type":"ContainerDied","Data":"25ab1ca965aef7314f2ca78264958c41f30316c5b307617a6db6d6ad08f799df"} Sep 10 12:47:22.868101 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:22.868088 2577 scope.go:117] "RemoveContainer" containerID="feaa1f2b8d958d3dbdd6b16e042a14e2fe506fb818085e9f094765af474c8fd0" Sep 10 12:47:22.868449 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:22.868426 2577 scope.go:117] "RemoveContainer" containerID="25ab1ca965aef7314f2ca78264958c41f30316c5b307617a6db6d6ad08f799df" Sep 10 12:47:22.868647 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:47:22.868604 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-dvf22_openshift-console-operator(765454f6-c879-42b5-8e20-f19a691f6a34)\"" pod="openshift-console-operator/console-operator-85b454874b-dvf22" podUID="765454f6-c879-42b5-8e20-f19a691f6a34" Sep 10 12:47:23.753086 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:23.753057 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qt6gw" Sep 10 12:47:23.873136 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:23.873111 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-dvf22_765454f6-c879-42b5-8e20-f19a691f6a34/console-operator/2.log" Sep 10 12:47:27.595678 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:27.595643 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-dvf22" Sep 10 12:47:27.596073 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:27.595712 2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-dvf22" Sep 10 12:47:27.596073 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:27.596048 2577 scope.go:117] "RemoveContainer" containerID="25ab1ca965aef7314f2ca78264958c41f30316c5b307617a6db6d6ad08f799df" Sep 10 12:47:27.596274 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:47:27.596247 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-dvf22_openshift-console-operator(765454f6-c879-42b5-8e20-f19a691f6a34)\"" pod="openshift-console-operator/console-operator-85b454874b-dvf22" podUID="765454f6-c879-42b5-8e20-f19a691f6a34" Sep 10 12:47:29.286453 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:29.286407 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a2202efa-bdce-43d6-9472-d148b6f085fe-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-8j2jv\" (UID: \"a2202efa-bdce-43d6-9472-d148b6f085fe\") " pod="openshift-network-console/networking-console-plugin-79977f9844-8j2jv" Sep 10 12:47:29.288826 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:29.288797 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a2202efa-bdce-43d6-9472-d148b6f085fe-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-8j2jv\" (UID: \"a2202efa-bdce-43d6-9472-d148b6f085fe\") " pod="openshift-network-console/networking-console-plugin-79977f9844-8j2jv" Sep 10 12:47:29.320028 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:29.319990 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-8j2jv" Sep 10 12:47:29.602436 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:29.602360 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-8j2jv"] Sep 10 12:47:29.605356 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:47:29.605330 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2202efa_bdce_43d6_9472_d148b6f085fe.slice/crio-219af87c12494d44f207d176f3d94501f67d6f2189ca52d3eb657bbfa654a7da WatchSource:0}: Error finding container 219af87c12494d44f207d176f3d94501f67d6f2189ca52d3eb657bbfa654a7da: Status 404 returned error can't find the container with id 219af87c12494d44f207d176f3d94501f67d6f2189ca52d3eb657bbfa654a7da Sep 10 12:47:29.893393 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:29.893298 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-8j2jv" event={"ID":"a2202efa-bdce-43d6-9472-d148b6f085fe","Type":"ContainerStarted","Data":"219af87c12494d44f207d176f3d94501f67d6f2189ca52d3eb657bbfa654a7da"} Sep 10 12:47:30.055868 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:30.055824 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-85bf8594b-kh4mj"] Sep 10 12:47:30.060226 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:30.060184 2577 patch_prober.go:28] interesting pod/image-registry-85bf8594b-kh4mj container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 10 12:47:30.060356 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:30.060295 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-85bf8594b-kh4mj" podUID="bcc23540-e3a4-4cc7-8f66-59e250b39f23" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 10 12:47:30.132220 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:30.132187 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7855485fb9-dnrcr"] Sep 10 12:47:30.134879 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:30.134862 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7855485fb9-dnrcr" Sep 10 12:47:30.139225 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:30.139199 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 10 12:47:30.139878 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:30.139856 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Sep 10 12:47:30.139958 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:30.139856 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 10 12:47:30.142002 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:30.141982 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 10 12:47:30.168880 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:30.168811 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7855485fb9-dnrcr"] Sep 10 12:47:30.294049 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:30.294005 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc49j\" (UniqueName: \"kubernetes.io/projected/bb32aa00-efeb-498e-a16a-76f123f48433-kube-api-access-tc49j\") pod \"klusterlet-addon-workmgr-7855485fb9-dnrcr\" (UID: \"bb32aa00-efeb-498e-a16a-76f123f48433\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7855485fb9-dnrcr" Sep 10 12:47:30.294477 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:30.294091 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bb32aa00-efeb-498e-a16a-76f123f48433-klusterlet-config\") pod \"klusterlet-addon-workmgr-7855485fb9-dnrcr\" (UID: \"bb32aa00-efeb-498e-a16a-76f123f48433\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7855485fb9-dnrcr" Sep 10 12:47:30.294477 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:30.294183 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb32aa00-efeb-498e-a16a-76f123f48433-tmp\") pod \"klusterlet-addon-workmgr-7855485fb9-dnrcr\" (UID: \"bb32aa00-efeb-498e-a16a-76f123f48433\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7855485fb9-dnrcr" Sep 10 12:47:30.394749 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:30.394716 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bb32aa00-efeb-498e-a16a-76f123f48433-klusterlet-config\") pod \"klusterlet-addon-workmgr-7855485fb9-dnrcr\" (UID: \"bb32aa00-efeb-498e-a16a-76f123f48433\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7855485fb9-dnrcr" Sep 10 12:47:30.394943 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:30.394784 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb32aa00-efeb-498e-a16a-76f123f48433-tmp\") pod \"klusterlet-addon-workmgr-7855485fb9-dnrcr\" (UID: \"bb32aa00-efeb-498e-a16a-76f123f48433\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7855485fb9-dnrcr" Sep 10 12:47:30.394943 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:30.394835 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc49j\" (UniqueName: \"kubernetes.io/projected/bb32aa00-efeb-498e-a16a-76f123f48433-kube-api-access-tc49j\") pod \"klusterlet-addon-workmgr-7855485fb9-dnrcr\" (UID: \"bb32aa00-efeb-498e-a16a-76f123f48433\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7855485fb9-dnrcr" Sep 10 12:47:30.395344 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:30.395313 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb32aa00-efeb-498e-a16a-76f123f48433-tmp\") pod \"klusterlet-addon-workmgr-7855485fb9-dnrcr\" (UID: \"bb32aa00-efeb-498e-a16a-76f123f48433\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7855485fb9-dnrcr" Sep 10 12:47:30.397554 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:30.397531 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bb32aa00-efeb-498e-a16a-76f123f48433-klusterlet-config\") pod \"klusterlet-addon-workmgr-7855485fb9-dnrcr\" (UID: \"bb32aa00-efeb-498e-a16a-76f123f48433\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7855485fb9-dnrcr" Sep 10 12:47:30.428714 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:30.428640 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc49j\" (UniqueName: \"kubernetes.io/projected/bb32aa00-efeb-498e-a16a-76f123f48433-kube-api-access-tc49j\") pod \"klusterlet-addon-workmgr-7855485fb9-dnrcr\" (UID: \"bb32aa00-efeb-498e-a16a-76f123f48433\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7855485fb9-dnrcr" Sep 10 12:47:30.444497 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:30.444466 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7855485fb9-dnrcr" Sep 10 12:47:30.726235 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:30.726200 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7855485fb9-dnrcr"] Sep 10 12:47:30.839912 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:47:30.839882 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb32aa00_efeb_498e_a16a_76f123f48433.slice/crio-c4858086387350cc2d03e9980ccab029fa87aa9bc944d10f4ebe682c44385fc8 WatchSource:0}: Error finding container c4858086387350cc2d03e9980ccab029fa87aa9bc944d10f4ebe682c44385fc8: Status 404 returned error can't find the container with id c4858086387350cc2d03e9980ccab029fa87aa9bc944d10f4ebe682c44385fc8 Sep 10 12:47:30.897326 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:30.897297 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7855485fb9-dnrcr" event={"ID":"bb32aa00-efeb-498e-a16a-76f123f48433","Type":"ContainerStarted","Data":"c4858086387350cc2d03e9980ccab029fa87aa9bc944d10f4ebe682c44385fc8"} Sep 10 12:47:31.870354 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:31.870317 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pl69q" Sep 10 12:47:31.902001 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:31.901942 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-8j2jv" event={"ID":"a2202efa-bdce-43d6-9472-d148b6f085fe","Type":"ContainerStarted","Data":"86defde05acd37383afcdef413e5a98e52829cb5c1866ad313a78993c263d161"} Sep 10 12:47:31.935464 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:31.935398 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-79977f9844-8j2jv" podStartSLOduration=33.679282735 podStartE2EDuration="34.935372891s" totalImagesPullingTime="1.256090156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:46:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:47:31.933741889 +0000 UTC m=+110.966354666" watchObservedRunningTime="2026-09-10 12:47:31.935372891 +0000 UTC m=+110.967985670" Sep 10 12:47:32.557983 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:32.557946 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-tpxqw"] Sep 10 12:47:32.560108 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:32.560087 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-tpxqw" Sep 10 12:47:32.562685 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:32.562655 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 10 12:47:32.563294 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:32.563271 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-8kslb\"" Sep 10 12:47:32.576575 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:32.576354 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-tpxqw"] Sep 10 12:47:32.715566 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:32.715518 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3fd51cb2-2dc9-4317-a503-1926ff0d7bfe-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-tpxqw\" (UID: \"3fd51cb2-2dc9-4317-a503-1926ff0d7bfe\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-tpxqw" Sep 10 12:47:32.816325 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:32.816236 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dfd3fa37-09e7-46a1-b67e-57e760dbde61-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-72gpf\" (UID: \"dfd3fa37-09e7-46a1-b67e-57e760dbde61\") " pod="openshift-insights/insights-runtime-extractor-72gpf" Sep 10 12:47:32.816325 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:32.816298 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3fd51cb2-2dc9-4317-a503-1926ff0d7bfe-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-tpxqw\" (UID: \"3fd51cb2-2dc9-4317-a503-1926ff0d7bfe\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-tpxqw" Sep 10 12:47:32.816552 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:47:32.816440 2577 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Sep 10 12:47:32.816552 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:47:32.816505 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fd51cb2-2dc9-4317-a503-1926ff0d7bfe-tls-certificates podName:3fd51cb2-2dc9-4317-a503-1926ff0d7bfe nodeName:}" failed. No retries permitted until 2026-09-10 12:47:33.316485684 +0000 UTC m=+112.349098444 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/3fd51cb2-2dc9-4317-a503-1926ff0d7bfe-tls-certificates") pod "prometheus-operator-admission-webhook-78f599db79-tpxqw" (UID: "3fd51cb2-2dc9-4317-a503-1926ff0d7bfe") : secret "prometheus-operator-admission-webhook-tls" not found Sep 10 12:47:32.819096 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:32.819060 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dfd3fa37-09e7-46a1-b67e-57e760dbde61-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-72gpf\" (UID: \"dfd3fa37-09e7-46a1-b67e-57e760dbde61\") " pod="openshift-insights/insights-runtime-extractor-72gpf" Sep 10 12:47:33.084342 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:33.084263 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-72gpf" Sep 10 12:47:33.320992 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:33.320887 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3fd51cb2-2dc9-4317-a503-1926ff0d7bfe-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-tpxqw\" (UID: \"3fd51cb2-2dc9-4317-a503-1926ff0d7bfe\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-tpxqw" Sep 10 12:47:33.323904 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:33.323869 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3fd51cb2-2dc9-4317-a503-1926ff0d7bfe-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-tpxqw\" (UID: \"3fd51cb2-2dc9-4317-a503-1926ff0d7bfe\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-tpxqw" Sep 10 12:47:33.471886 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:33.471841 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-tpxqw" Sep 10 12:47:33.674515 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:33.674437 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-72gpf"] Sep 10 12:47:33.677237 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:47:33.677212 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfd3fa37_09e7_46a1_b67e_57e760dbde61.slice/crio-f54d6ad9f2dc6cfa8429961a17f748b557902b81ce9086a89295df4f9edb839e WatchSource:0}: Error finding container f54d6ad9f2dc6cfa8429961a17f748b557902b81ce9086a89295df4f9edb839e: Status 404 returned error can't find the container with id f54d6ad9f2dc6cfa8429961a17f748b557902b81ce9086a89295df4f9edb839e Sep 10 12:47:33.756188 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:33.756137 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-tpxqw"] Sep 10 12:47:33.911828 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:33.911786 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-72gpf" event={"ID":"dfd3fa37-09e7-46a1-b67e-57e760dbde61","Type":"ContainerStarted","Data":"f54d6ad9f2dc6cfa8429961a17f748b557902b81ce9086a89295df4f9edb839e"} Sep 10 12:47:34.810050 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:47:34.810020 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fd51cb2_2dc9_4317_a503_1926ff0d7bfe.slice/crio-808a0d56aa5842e617402bdf9dedd7d7351ba9b0615587b238c0e608255c956a WatchSource:0}: Error finding container 808a0d56aa5842e617402bdf9dedd7d7351ba9b0615587b238c0e608255c956a: Status 404 returned error can't find the container with id 808a0d56aa5842e617402bdf9dedd7d7351ba9b0615587b238c0e608255c956a Sep 10 12:47:34.917850 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:34.917819 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-tpxqw" event={"ID":"3fd51cb2-2dc9-4317-a503-1926ff0d7bfe","Type":"ContainerStarted","Data":"808a0d56aa5842e617402bdf9dedd7d7351ba9b0615587b238c0e608255c956a"} Sep 10 12:47:34.919200 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:34.919176 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-72gpf" event={"ID":"dfd3fa37-09e7-46a1-b67e-57e760dbde61","Type":"ContainerStarted","Data":"1d2d244fb1f3ffb57b8608a9592e4d74d3593e5290565cd9ea91bce7444f3cea"} Sep 10 12:47:35.926193 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:35.926129 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7855485fb9-dnrcr" event={"ID":"bb32aa00-efeb-498e-a16a-76f123f48433","Type":"ContainerStarted","Data":"60698d5eb3b484c3aa3b47dc6861101021c4967e2b08bd2d1a3223ee12bf6024"} Sep 10 12:47:35.926635 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:35.926536 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7855485fb9-dnrcr" Sep 10 12:47:35.928307 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:35.928281 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-72gpf" event={"ID":"dfd3fa37-09e7-46a1-b67e-57e760dbde61","Type":"ContainerStarted","Data":"7eaa62bcd906062e29d9472153883047096a333f78c067794ba4bae251c7aaf8"} Sep 10 12:47:35.928478 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:35.928466 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7855485fb9-dnrcr" Sep 10 12:47:35.949772 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:35.949671 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7855485fb9-dnrcr" podStartSLOduration=1.928283403 podStartE2EDuration="5.949641417s" totalImagesPullingTime="4.021358014s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:47:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:47:35.949524186 +0000 UTC m=+114.982136964" watchObservedRunningTime="2026-09-10 12:47:35.949641417 +0000 UTC m=+114.982254196" Sep 10 12:47:36.934235 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:36.934185 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-tpxqw" event={"ID":"3fd51cb2-2dc9-4317-a503-1926ff0d7bfe","Type":"ContainerStarted","Data":"471810e3f9241c479a5422ae311502b74277a06716cc5e2d7c9121e458a0e913"} Sep 10 12:47:36.934665 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:36.934588 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-tpxqw" Sep 10 12:47:36.939967 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:36.939937 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-tpxqw" Sep 10 12:47:36.953548 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:36.953496 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-tpxqw" podStartSLOduration=3.814808201 podStartE2EDuration="4.95348025s" totalImagesPullingTime="1.138672049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:47:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:47:36.952764608 +0000 UTC m=+115.985377385" watchObservedRunningTime="2026-09-10 12:47:36.95348025 +0000 UTC m=+115.986093027" Sep 10 12:47:37.685867 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:37.685832 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-vqwkf"] Sep 10 12:47:37.688826 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:37.688810 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-vqwkf" Sep 10 12:47:37.691409 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:37.691382 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 10 12:47:37.692292 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:37.692269 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 10 12:47:37.692410 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:37.692289 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 10 12:47:37.692410 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:37.692335 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 10 12:47:37.692410 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:37.692387 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 10 12:47:37.692552 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:37.692542 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-9spzf\"" Sep 10 12:47:37.701210 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:37.701189 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-vqwkf"] Sep 10 12:47:37.864479 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:37.864439 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m88hm\" (UniqueName: \"kubernetes.io/projected/4bd832c4-0e62-410c-8bea-c063fc04006e-kube-api-access-m88hm\") pod \"prometheus-operator-6f4946db56-vqwkf\" (UID: \"4bd832c4-0e62-410c-8bea-c063fc04006e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-vqwkf" Sep 10 12:47:37.864670 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:37.864525 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4bd832c4-0e62-410c-8bea-c063fc04006e-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-vqwkf\" (UID: \"4bd832c4-0e62-410c-8bea-c063fc04006e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-vqwkf" Sep 10 12:47:37.864670 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:37.864571 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4bd832c4-0e62-410c-8bea-c063fc04006e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-vqwkf\" (UID: \"4bd832c4-0e62-410c-8bea-c063fc04006e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-vqwkf" Sep 10 12:47:37.864739 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:37.864663 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4bd832c4-0e62-410c-8bea-c063fc04006e-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-vqwkf\" (UID: \"4bd832c4-0e62-410c-8bea-c063fc04006e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-vqwkf" Sep 10 12:47:37.940281 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:37.940184 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-72gpf" event={"ID":"dfd3fa37-09e7-46a1-b67e-57e760dbde61","Type":"ContainerStarted","Data":"b24f28c78db33b2a6b8a945a97b3ad39ce919e98b78cb17852924b77607b24dd"} Sep 10 12:47:37.960997 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:37.960946 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-72gpf" podStartSLOduration=35.660031135 podStartE2EDuration="37.960927893s" totalImagesPullingTime="2.300896758s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:47:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:47:37.959701067 +0000 UTC m=+116.992313848" watchObservedRunningTime="2026-09-10 12:47:37.960927893 +0000 UTC m=+116.993540669" Sep 10 12:47:37.965626 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:37.965604 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4bd832c4-0e62-410c-8bea-c063fc04006e-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-vqwkf\" (UID: \"4bd832c4-0e62-410c-8bea-c063fc04006e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-vqwkf" Sep 10 12:47:37.965679 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:37.965638 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4bd832c4-0e62-410c-8bea-c063fc04006e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-vqwkf\" (UID: \"4bd832c4-0e62-410c-8bea-c063fc04006e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-vqwkf" Sep 10 12:47:37.965679 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:37.965663 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4bd832c4-0e62-410c-8bea-c063fc04006e-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-vqwkf\" (UID: \"4bd832c4-0e62-410c-8bea-c063fc04006e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-vqwkf" Sep 10 12:47:37.965752 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:37.965687 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m88hm\" (UniqueName: \"kubernetes.io/projected/4bd832c4-0e62-410c-8bea-c063fc04006e-kube-api-access-m88hm\") pod \"prometheus-operator-6f4946db56-vqwkf\" (UID: \"4bd832c4-0e62-410c-8bea-c063fc04006e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-vqwkf" Sep 10 12:47:37.966462 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:37.966439 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4bd832c4-0e62-410c-8bea-c063fc04006e-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-vqwkf\" (UID: \"4bd832c4-0e62-410c-8bea-c063fc04006e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-vqwkf" Sep 10 12:47:37.968089 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:37.968069 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4bd832c4-0e62-410c-8bea-c063fc04006e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-vqwkf\" (UID: \"4bd832c4-0e62-410c-8bea-c063fc04006e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-vqwkf" Sep 10 12:47:37.968190 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:37.968133 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4bd832c4-0e62-410c-8bea-c063fc04006e-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-vqwkf\" (UID: \"4bd832c4-0e62-410c-8bea-c063fc04006e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-vqwkf" Sep 10 12:47:37.975176 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:37.975131 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m88hm\" (UniqueName: \"kubernetes.io/projected/4bd832c4-0e62-410c-8bea-c063fc04006e-kube-api-access-m88hm\") pod \"prometheus-operator-6f4946db56-vqwkf\" (UID: \"4bd832c4-0e62-410c-8bea-c063fc04006e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-vqwkf" Sep 10 12:47:37.997990 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:37.997963 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-vqwkf" Sep 10 12:47:38.276254 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:38.276185 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-vqwkf"] Sep 10 12:47:38.279843 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:47:38.279810 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bd832c4_0e62_410c_8bea_c063fc04006e.slice/crio-d45ab52d7b04e6e91ea25bfd37453dcd85e881437bbfc12d199127d514856e05 WatchSource:0}: Error finding container d45ab52d7b04e6e91ea25bfd37453dcd85e881437bbfc12d199127d514856e05: Status 404 returned error can't find the container with id d45ab52d7b04e6e91ea25bfd37453dcd85e881437bbfc12d199127d514856e05 Sep 10 12:47:38.944980 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:38.944946 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-vqwkf" event={"ID":"4bd832c4-0e62-410c-8bea-c063fc04006e","Type":"ContainerStarted","Data":"d45ab52d7b04e6e91ea25bfd37453dcd85e881437bbfc12d199127d514856e05"} Sep 10 12:47:39.950590 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:39.950559 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-vqwkf" event={"ID":"4bd832c4-0e62-410c-8bea-c063fc04006e","Type":"ContainerStarted","Data":"62fbdf86d0b680f7f1ab85ca9a446f5f2528736f044997441079d1b8bd5c18d7"} Sep 10 12:47:40.060800 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:40.060772 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-85bf8594b-kh4mj" Sep 10 12:47:40.955846 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:40.955810 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-vqwkf" event={"ID":"4bd832c4-0e62-410c-8bea-c063fc04006e","Type":"ContainerStarted","Data":"7080c2796d95c9cb116b766ad313137c7983033d9ceb6643b9564ccb1508def4"} Sep 10 12:47:40.976048 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:40.975999 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-vqwkf" podStartSLOduration=2.383112639 podStartE2EDuration="3.975981871s" totalImagesPullingTime="1.592869232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:47:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:47:40.975062664 +0000 UTC m=+120.007675440" watchObservedRunningTime="2026-09-10 12:47:40.975981871 +0000 UTC m=+120.008594648" Sep 10 12:47:42.492720 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:42.492631 2577 scope.go:117] "RemoveContainer" containerID="25ab1ca965aef7314f2ca78264958c41f30316c5b307617a6db6d6ad08f799df" Sep 10 12:47:42.493191 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:47:42.492840 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-dvf22_openshift-console-operator(765454f6-c879-42b5-8e20-f19a691f6a34)\"" pod="openshift-console-operator/console-operator-85b454874b-dvf22" podUID="765454f6-c879-42b5-8e20-f19a691f6a34" Sep 10 12:47:43.196603 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.196564 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-xzssw"] Sep 10 12:47:43.203652 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.203624 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-xzssw" Sep 10 12:47:43.206889 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.206865 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 10 12:47:43.207041 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.206938 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 10 12:47:43.207041 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.206874 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 10 12:47:43.207041 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.206964 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-jdsxg\"" Sep 10 12:47:43.215885 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.215863 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4tbxj"] Sep 10 12:47:43.218893 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.218879 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4tbxj" Sep 10 12:47:43.223549 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.223529 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xp7s7\"" Sep 10 12:47:43.223774 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.223759 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 10 12:47:43.223839 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.223822 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 10 12:47:43.223891 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.223841 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 10 12:47:43.239932 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.239897 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-xzssw"] Sep 10 12:47:43.306536 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.306504 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wppkd\" (UniqueName: \"kubernetes.io/projected/8f463359-0563-45ff-83ef-eb224c06d1d9-kube-api-access-wppkd\") pod \"node-exporter-4tbxj\" (UID: \"8f463359-0563-45ff-83ef-eb224c06d1d9\") " pod="openshift-monitoring/node-exporter-4tbxj" Sep 10 12:47:43.306727 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.306541 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f1c08bc4-6f77-4cff-980f-c92aa693df27-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-xzssw\" (UID: \"f1c08bc4-6f77-4cff-980f-c92aa693df27\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xzssw" Sep 10 12:47:43.306727 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.306563 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f463359-0563-45ff-83ef-eb224c06d1d9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4tbxj\" (UID: \"8f463359-0563-45ff-83ef-eb224c06d1d9\") " pod="openshift-monitoring/node-exporter-4tbxj" Sep 10 12:47:43.306727 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.306584 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f1c08bc4-6f77-4cff-980f-c92aa693df27-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-xzssw\" (UID: \"f1c08bc4-6f77-4cff-980f-c92aa693df27\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xzssw" Sep 10 12:47:43.306727 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.306607 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f463359-0563-45ff-83ef-eb224c06d1d9-metrics-client-ca\") pod \"node-exporter-4tbxj\" (UID: \"8f463359-0563-45ff-83ef-eb224c06d1d9\") " pod="openshift-monitoring/node-exporter-4tbxj" Sep 10 12:47:43.306727 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.306624 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f463359-0563-45ff-83ef-eb224c06d1d9-sys\") pod \"node-exporter-4tbxj\" (UID: \"8f463359-0563-45ff-83ef-eb224c06d1d9\") " pod="openshift-monitoring/node-exporter-4tbxj" Sep 10 12:47:43.306727 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.306644 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8f463359-0563-45ff-83ef-eb224c06d1d9-root\") pod \"node-exporter-4tbxj\" (UID: \"8f463359-0563-45ff-83ef-eb224c06d1d9\") " pod="openshift-monitoring/node-exporter-4tbxj" Sep 10 12:47:43.306727 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.306667 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1c08bc4-6f77-4cff-980f-c92aa693df27-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-xzssw\" (UID: \"f1c08bc4-6f77-4cff-980f-c92aa693df27\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xzssw" Sep 10 12:47:43.306959 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.306751 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1c08bc4-6f77-4cff-980f-c92aa693df27-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-xzssw\" (UID: \"f1c08bc4-6f77-4cff-980f-c92aa693df27\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xzssw" Sep 10 12:47:43.306959 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.306782 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8f463359-0563-45ff-83ef-eb224c06d1d9-node-exporter-accelerators-collector-config\") pod \"node-exporter-4tbxj\" (UID: \"8f463359-0563-45ff-83ef-eb224c06d1d9\") " pod="openshift-monitoring/node-exporter-4tbxj" Sep 10 12:47:43.306959 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.306802 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8f463359-0563-45ff-83ef-eb224c06d1d9-node-exporter-wtmp\") pod \"node-exporter-4tbxj\" (UID: \"8f463359-0563-45ff-83ef-eb224c06d1d9\") " pod="openshift-monitoring/node-exporter-4tbxj" Sep 10 12:47:43.306959 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.306845 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8f463359-0563-45ff-83ef-eb224c06d1d9-node-exporter-tls\") pod \"node-exporter-4tbxj\" (UID: \"8f463359-0563-45ff-83ef-eb224c06d1d9\") " pod="openshift-monitoring/node-exporter-4tbxj" Sep 10 12:47:43.306959 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.306874 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbjzh\" (UniqueName: \"kubernetes.io/projected/f1c08bc4-6f77-4cff-980f-c92aa693df27-kube-api-access-pbjzh\") pod \"kube-state-metrics-74cb57df7-xzssw\" (UID: \"f1c08bc4-6f77-4cff-980f-c92aa693df27\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xzssw" Sep 10 12:47:43.306959 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.306888 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8f463359-0563-45ff-83ef-eb224c06d1d9-node-exporter-textfile\") pod \"node-exporter-4tbxj\" (UID: \"8f463359-0563-45ff-83ef-eb224c06d1d9\") " pod="openshift-monitoring/node-exporter-4tbxj" Sep 10 12:47:43.306959 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.306934 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1c08bc4-6f77-4cff-980f-c92aa693df27-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-xzssw\" (UID: \"f1c08bc4-6f77-4cff-980f-c92aa693df27\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xzssw" Sep 10 12:47:43.408123 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.408083 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f463359-0563-45ff-83ef-eb224c06d1d9-sys\") pod \"node-exporter-4tbxj\" (UID: \"8f463359-0563-45ff-83ef-eb224c06d1d9\") " pod="openshift-monitoring/node-exporter-4tbxj" Sep 10 12:47:43.408123 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.408123 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8f463359-0563-45ff-83ef-eb224c06d1d9-root\") pod \"node-exporter-4tbxj\" (UID: \"8f463359-0563-45ff-83ef-eb224c06d1d9\") " pod="openshift-monitoring/node-exporter-4tbxj" Sep 10 12:47:43.408373 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.408166 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1c08bc4-6f77-4cff-980f-c92aa693df27-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-xzssw\" (UID: \"f1c08bc4-6f77-4cff-980f-c92aa693df27\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xzssw" Sep 10 12:47:43.408373 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.408189 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1c08bc4-6f77-4cff-980f-c92aa693df27-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-xzssw\" (UID: \"f1c08bc4-6f77-4cff-980f-c92aa693df27\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xzssw" Sep 10 12:47:43.408373 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.408213 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f463359-0563-45ff-83ef-eb224c06d1d9-sys\") pod \"node-exporter-4tbxj\" (UID: \"8f463359-0563-45ff-83ef-eb224c06d1d9\") " pod="openshift-monitoring/node-exporter-4tbxj" Sep 10 12:47:43.408373 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.408218 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8f463359-0563-45ff-83ef-eb224c06d1d9-root\") pod \"node-exporter-4tbxj\" (UID: \"8f463359-0563-45ff-83ef-eb224c06d1d9\") " pod="openshift-monitoring/node-exporter-4tbxj" Sep 10 12:47:43.408373 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.408225 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8f463359-0563-45ff-83ef-eb224c06d1d9-node-exporter-accelerators-collector-config\") pod \"node-exporter-4tbxj\" (UID: \"8f463359-0563-45ff-83ef-eb224c06d1d9\") " pod="openshift-monitoring/node-exporter-4tbxj" Sep 10 12:47:43.408373 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.408313 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8f463359-0563-45ff-83ef-eb224c06d1d9-node-exporter-wtmp\") pod \"node-exporter-4tbxj\" (UID: \"8f463359-0563-45ff-83ef-eb224c06d1d9\") " pod="openshift-monitoring/node-exporter-4tbxj" Sep 10 12:47:43.408373 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.408361 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8f463359-0563-45ff-83ef-eb224c06d1d9-node-exporter-tls\") pod \"node-exporter-4tbxj\" (UID: \"8f463359-0563-45ff-83ef-eb224c06d1d9\") " pod="openshift-monitoring/node-exporter-4tbxj" Sep 10 12:47:43.408694 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.408390 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbjzh\" (UniqueName: \"kubernetes.io/projected/f1c08bc4-6f77-4cff-980f-c92aa693df27-kube-api-access-pbjzh\") pod \"kube-state-metrics-74cb57df7-xzssw\" (UID: \"f1c08bc4-6f77-4cff-980f-c92aa693df27\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xzssw" Sep 10 12:47:43.408694 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.408416 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8f463359-0563-45ff-83ef-eb224c06d1d9-node-exporter-textfile\") pod \"node-exporter-4tbxj\" (UID: \"8f463359-0563-45ff-83ef-eb224c06d1d9\") " pod="openshift-monitoring/node-exporter-4tbxj" Sep 10 12:47:43.408694 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.408470 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1c08bc4-6f77-4cff-980f-c92aa693df27-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-xzssw\" (UID: \"f1c08bc4-6f77-4cff-980f-c92aa693df27\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xzssw" Sep 10 12:47:43.408694 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.408499 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wppkd\" (UniqueName: \"kubernetes.io/projected/8f463359-0563-45ff-83ef-eb224c06d1d9-kube-api-access-wppkd\") pod \"node-exporter-4tbxj\" (UID: \"8f463359-0563-45ff-83ef-eb224c06d1d9\") " pod="openshift-monitoring/node-exporter-4tbxj" Sep 10 12:47:43.408694 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.408532 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f1c08bc4-6f77-4cff-980f-c92aa693df27-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-xzssw\" (UID: \"f1c08bc4-6f77-4cff-980f-c92aa693df27\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xzssw" Sep 10 12:47:43.408694 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.408559 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f463359-0563-45ff-83ef-eb224c06d1d9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4tbxj\" (UID: \"8f463359-0563-45ff-83ef-eb224c06d1d9\") " pod="openshift-monitoring/node-exporter-4tbxj" Sep 10 12:47:43.408694 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.408594 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f1c08bc4-6f77-4cff-980f-c92aa693df27-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-xzssw\" (UID: \"f1c08bc4-6f77-4cff-980f-c92aa693df27\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xzssw" Sep 10 12:47:43.408694 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.408617 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f463359-0563-45ff-83ef-eb224c06d1d9-metrics-client-ca\") pod \"node-exporter-4tbxj\" (UID: \"8f463359-0563-45ff-83ef-eb224c06d1d9\") " pod="openshift-monitoring/node-exporter-4tbxj" Sep 10 12:47:43.409078 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.408827 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8f463359-0563-45ff-83ef-eb224c06d1d9-node-exporter-textfile\") pod \"node-exporter-4tbxj\" (UID: \"8f463359-0563-45ff-83ef-eb224c06d1d9\") " pod="openshift-monitoring/node-exporter-4tbxj" Sep 10 12:47:43.409078 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.408887 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8f463359-0563-45ff-83ef-eb224c06d1d9-node-exporter-accelerators-collector-config\") pod \"node-exporter-4tbxj\" (UID: \"8f463359-0563-45ff-83ef-eb224c06d1d9\") " pod="openshift-monitoring/node-exporter-4tbxj" Sep 10 12:47:43.409078 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.408912 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8f463359-0563-45ff-83ef-eb224c06d1d9-node-exporter-wtmp\") pod \"node-exporter-4tbxj\" (UID: \"8f463359-0563-45ff-83ef-eb224c06d1d9\") " pod="openshift-monitoring/node-exporter-4tbxj" Sep 10 12:47:43.409078 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.409049 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f1c08bc4-6f77-4cff-980f-c92aa693df27-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-xzssw\" (UID: \"f1c08bc4-6f77-4cff-980f-c92aa693df27\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xzssw" Sep 10 12:47:43.409322 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.409212 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f463359-0563-45ff-83ef-eb224c06d1d9-metrics-client-ca\") pod \"node-exporter-4tbxj\" (UID: \"8f463359-0563-45ff-83ef-eb224c06d1d9\") " pod="openshift-monitoring/node-exporter-4tbxj" Sep 10 12:47:43.409641 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.409610 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f1c08bc4-6f77-4cff-980f-c92aa693df27-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-xzssw\" (UID: \"f1c08bc4-6f77-4cff-980f-c92aa693df27\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xzssw" Sep 10 12:47:43.409800 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.409610 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1c08bc4-6f77-4cff-980f-c92aa693df27-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-xzssw\" (UID: \"f1c08bc4-6f77-4cff-980f-c92aa693df27\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xzssw" Sep 10 12:47:43.411022 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.410991 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1c08bc4-6f77-4cff-980f-c92aa693df27-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-xzssw\" (UID: \"f1c08bc4-6f77-4cff-980f-c92aa693df27\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xzssw" Sep 10 12:47:43.411180 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.411129 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f463359-0563-45ff-83ef-eb224c06d1d9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4tbxj\" (UID: \"8f463359-0563-45ff-83ef-eb224c06d1d9\") " pod="openshift-monitoring/node-exporter-4tbxj" Sep 10 12:47:43.411249 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.411233 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1c08bc4-6f77-4cff-980f-c92aa693df27-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-xzssw\" (UID: \"f1c08bc4-6f77-4cff-980f-c92aa693df27\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xzssw" Sep 10 12:47:43.411503 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.411486 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8f463359-0563-45ff-83ef-eb224c06d1d9-node-exporter-tls\") pod \"node-exporter-4tbxj\" (UID: \"8f463359-0563-45ff-83ef-eb224c06d1d9\") " pod="openshift-monitoring/node-exporter-4tbxj" Sep 10 12:47:43.417014 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.416988 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbjzh\" (UniqueName: \"kubernetes.io/projected/f1c08bc4-6f77-4cff-980f-c92aa693df27-kube-api-access-pbjzh\") pod \"kube-state-metrics-74cb57df7-xzssw\" (UID: \"f1c08bc4-6f77-4cff-980f-c92aa693df27\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xzssw" Sep 10 12:47:43.417354 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.417334 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wppkd\" (UniqueName: \"kubernetes.io/projected/8f463359-0563-45ff-83ef-eb224c06d1d9-kube-api-access-wppkd\") pod \"node-exporter-4tbxj\" (UID: \"8f463359-0563-45ff-83ef-eb224c06d1d9\") " pod="openshift-monitoring/node-exporter-4tbxj" Sep 10 12:47:43.513244 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.513168 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-xzssw" Sep 10 12:47:43.527495 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.527466 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4tbxj" Sep 10 12:47:43.540329 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:47:43.540289 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f463359_0563_45ff_83ef_eb224c06d1d9.slice/crio-1194ef41d95115a09a1104c18685814df07472a5144c769af974b170acc77821 WatchSource:0}: Error finding container 1194ef41d95115a09a1104c18685814df07472a5144c769af974b170acc77821: Status 404 returned error can't find the container with id 1194ef41d95115a09a1104c18685814df07472a5144c769af974b170acc77821 Sep 10 12:47:43.815668 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.815637 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-xzssw"] Sep 10 12:47:43.819015 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:47:43.818990 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1c08bc4_6f77_4cff_980f_c92aa693df27.slice/crio-6d3f7a9cda1c37bf6e5c26281ccaf6cacf569cfd0fc32b6ce8817e5235a2abb9 WatchSource:0}: Error finding container 6d3f7a9cda1c37bf6e5c26281ccaf6cacf569cfd0fc32b6ce8817e5235a2abb9: Status 404 returned error can't find the container with id 6d3f7a9cda1c37bf6e5c26281ccaf6cacf569cfd0fc32b6ce8817e5235a2abb9 Sep 10 12:47:43.967567 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.967532 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-xzssw" event={"ID":"f1c08bc4-6f77-4cff-980f-c92aa693df27","Type":"ContainerStarted","Data":"6d3f7a9cda1c37bf6e5c26281ccaf6cacf569cfd0fc32b6ce8817e5235a2abb9"} Sep 10 12:47:43.968653 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:43.968623 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4tbxj" event={"ID":"8f463359-0563-45ff-83ef-eb224c06d1d9","Type":"ContainerStarted","Data":"1194ef41d95115a09a1104c18685814df07472a5144c769af974b170acc77821"} Sep 10 12:47:44.307242 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.307205 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 12:47:44.311256 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.311227 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:47:44.314915 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.314741 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 10 12:47:44.315612 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.315589 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 10 12:47:44.315734 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.315685 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rvd47\"" Sep 10 12:47:44.315734 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.315727 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 10 12:47:44.315845 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.315685 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 10 12:47:44.316058 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.316040 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 10 12:47:44.316136 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.316107 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 10 12:47:44.316136 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.316126 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 10 12:47:44.316275 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.316260 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 10 12:47:44.316378 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.316345 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 10 12:47:44.340855 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.339679 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 12:47:44.416172 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.416123 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0392b167-e78a-4a04-9fa6-8228a14d544b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:47:44.416368 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.416182 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0392b167-e78a-4a04-9fa6-8228a14d544b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:47:44.416368 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.416210 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zxlz\" (UniqueName: \"kubernetes.io/projected/0392b167-e78a-4a04-9fa6-8228a14d544b-kube-api-access-7zxlz\") pod \"alertmanager-main-0\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:47:44.416368 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.416236 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0392b167-e78a-4a04-9fa6-8228a14d544b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:47:44.416368 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.416339 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0392b167-e78a-4a04-9fa6-8228a14d544b-web-config\") pod \"alertmanager-main-0\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:47:44.416582 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.416380 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0392b167-e78a-4a04-9fa6-8228a14d544b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:47:44.416582 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.416414 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0392b167-e78a-4a04-9fa6-8228a14d544b-config-out\") pod \"alertmanager-main-0\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:47:44.416582 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.416436 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0392b167-e78a-4a04-9fa6-8228a14d544b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:47:44.416582 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.416467 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0392b167-e78a-4a04-9fa6-8228a14d544b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:47:44.416582 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.416531 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0392b167-e78a-4a04-9fa6-8228a14d544b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:47:44.416582 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.416578 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0392b167-e78a-4a04-9fa6-8228a14d544b-config-volume\") pod \"alertmanager-main-0\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:47:44.416867 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.416604 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0392b167-e78a-4a04-9fa6-8228a14d544b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:47:44.416867 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.416636 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0392b167-e78a-4a04-9fa6-8228a14d544b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:47:44.517537 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.517225 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0392b167-e78a-4a04-9fa6-8228a14d544b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:47:44.517537 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.517281 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0392b167-e78a-4a04-9fa6-8228a14d544b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:47:44.517537 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.517312 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0392b167-e78a-4a04-9fa6-8228a14d544b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:47:44.517537 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.517339 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zxlz\" (UniqueName: \"kubernetes.io/projected/0392b167-e78a-4a04-9fa6-8228a14d544b-kube-api-access-7zxlz\") pod \"alertmanager-main-0\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:47:44.517537 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.517366 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0392b167-e78a-4a04-9fa6-8228a14d544b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:47:44.517537 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.517391 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0392b167-e78a-4a04-9fa6-8228a14d544b-web-config\") pod \"alertmanager-main-0\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:47:44.517537 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.517416 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0392b167-e78a-4a04-9fa6-8228a14d544b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:47:44.517537 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.517453 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0392b167-e78a-4a04-9fa6-8228a14d544b-config-out\") pod \"alertmanager-main-0\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:47:44.517537 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.517481 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0392b167-e78a-4a04-9fa6-8228a14d544b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:47:44.518427 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.517544 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0392b167-e78a-4a04-9fa6-8228a14d544b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:47:44.518427 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.517633 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0392b167-e78a-4a04-9fa6-8228a14d544b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:47:44.519493 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.518818 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0392b167-e78a-4a04-9fa6-8228a14d544b-config-volume\") pod \"alertmanager-main-0\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:47:44.519493 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.518873 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0392b167-e78a-4a04-9fa6-8228a14d544b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:47:44.519493 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.519138 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0392b167-e78a-4a04-9fa6-8228a14d544b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:47:44.519724 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.519677 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0392b167-e78a-4a04-9fa6-8228a14d544b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:47:44.520398 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.520371 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0392b167-e78a-4a04-9fa6-8228a14d544b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:47:44.520987 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.520959 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0392b167-e78a-4a04-9fa6-8228a14d544b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:47:44.521353 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.521331 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0392b167-e78a-4a04-9fa6-8228a14d544b-config-out\") pod \"alertmanager-main-0\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:47:44.521545 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.521524 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0392b167-e78a-4a04-9fa6-8228a14d544b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:47:44.522504 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.522465 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0392b167-e78a-4a04-9fa6-8228a14d544b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:47:44.523656 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.523630 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0392b167-e78a-4a04-9fa6-8228a14d544b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:47:44.523888 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.523859 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0392b167-e78a-4a04-9fa6-8228a14d544b-config-volume\") pod \"alertmanager-main-0\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:47:44.524328 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.524295 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0392b167-e78a-4a04-9fa6-8228a14d544b-web-config\") pod \"alertmanager-main-0\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:47:44.524688 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.524659 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0392b167-e78a-4a04-9fa6-8228a14d544b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:47:44.527878 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.527848 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0392b167-e78a-4a04-9fa6-8228a14d544b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:47:44.530608 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.530588 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zxlz\" (UniqueName: \"kubernetes.io/projected/0392b167-e78a-4a04-9fa6-8228a14d544b-kube-api-access-7zxlz\") pod \"alertmanager-main-0\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:47:44.622976 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.622899 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:47:44.931235 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.931154 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 12:47:44.975091 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.975056 2577 generic.go:356] "Generic (PLEG): container finished" podID="8f463359-0563-45ff-83ef-eb224c06d1d9" containerID="382f78e76ed16d781ee4ffc38ed46b3981c6862eb4d35a0855eb24bc52f9c4ea" exitCode=0 Sep 10 12:47:44.975296 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:44.975099 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4tbxj" event={"ID":"8f463359-0563-45ff-83ef-eb224c06d1d9","Type":"ContainerDied","Data":"382f78e76ed16d781ee4ffc38ed46b3981c6862eb4d35a0855eb24bc52f9c4ea"} Sep 10 12:47:45.207404 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:47:45.207313 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0392b167_e78a_4a04_9fa6_8228a14d544b.slice/crio-9418f9e80fba96d9d0a268b2563c4c2c51524ccbadcd01175de1562fd227d776 WatchSource:0}: Error finding container 9418f9e80fba96d9d0a268b2563c4c2c51524ccbadcd01175de1562fd227d776: Status 404 returned error can't find the container with id 9418f9e80fba96d9d0a268b2563c4c2c51524ccbadcd01175de1562fd227d776 Sep 10 12:47:45.982019 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:45.981978 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4tbxj" event={"ID":"8f463359-0563-45ff-83ef-eb224c06d1d9","Type":"ContainerStarted","Data":"3a18ccaf4453ca887970c053b4cb67876dd03bf9051759af1e708c203489743f"} Sep 10 12:47:45.982507 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:45.982038 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4tbxj" event={"ID":"8f463359-0563-45ff-83ef-eb224c06d1d9","Type":"ContainerStarted","Data":"87f8bdc67cbbe09cea5328849f4e0185367e2d5a1f8e211c04ae7e7558d91053"} Sep 10 12:47:45.983309 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:45.983284 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0392b167-e78a-4a04-9fa6-8228a14d544b","Type":"ContainerStarted","Data":"9418f9e80fba96d9d0a268b2563c4c2c51524ccbadcd01175de1562fd227d776"} Sep 10 12:47:45.985261 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:45.985237 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-xzssw" event={"ID":"f1c08bc4-6f77-4cff-980f-c92aa693df27","Type":"ContainerStarted","Data":"aedea153b9a979a566f2693d06ff50a9bc25d641eac2dc1fab2a7af750418b8b"} Sep 10 12:47:45.985338 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:45.985282 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-xzssw" event={"ID":"f1c08bc4-6f77-4cff-980f-c92aa693df27","Type":"ContainerStarted","Data":"34c6683a7e1e0dfce53508db944bd3574f0425b3d25dac79aa855e2946839c8a"} Sep 10 12:47:45.985338 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:45.985300 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-xzssw" event={"ID":"f1c08bc4-6f77-4cff-980f-c92aa693df27","Type":"ContainerStarted","Data":"844c13e53a2cc65e76d846f6ca23fa6c25cd1d7b2c92a3275b6112167ac65ce7"} Sep 10 12:47:46.015444 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:46.015396 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4tbxj" podStartSLOduration=1.799822921 podStartE2EDuration="3.015381277s" totalImagesPullingTime="1.142496047s" totalInitContainerRuntime="73.062309ms" isStatefulPod=true podCreationTimestamp="2026-09-10 12:47:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:47:46.014033642 +0000 UTC m=+125.046646444" watchObservedRunningTime="2026-09-10 12:47:46.015381277 +0000 UTC m=+125.047994045" Sep 10 12:47:46.039681 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:46.039634 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-xzssw" podStartSLOduration=1.5952181090000002 podStartE2EDuration="3.039618513s" totalImagesPullingTime="1.444400404s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:47:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:47:46.038919194 +0000 UTC m=+125.071531971" watchObservedRunningTime="2026-09-10 12:47:46.039618513 +0000 UTC m=+125.072231289" Sep 10 12:47:46.991058 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:46.991025 2577 generic.go:356] "Generic (PLEG): container finished" podID="0392b167-e78a-4a04-9fa6-8228a14d544b" containerID="6329ea974cf17944ff1be27ed5b2a5ef28102a1652a4118fad84a46cf03eb49b" exitCode=0 Sep 10 12:47:46.991484 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:46.991111 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0392b167-e78a-4a04-9fa6-8228a14d544b","Type":"ContainerDied","Data":"6329ea974cf17944ff1be27ed5b2a5ef28102a1652a4118fad84a46cf03eb49b"} Sep 10 12:47:49.002393 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.002358 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0392b167-e78a-4a04-9fa6-8228a14d544b","Type":"ContainerStarted","Data":"1e7cf17d6f14c32148d6e7f275604e6c8999c3232a1fad8062d08f508aa2a7bc"} Sep 10 12:47:49.002774 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.002446 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0392b167-e78a-4a04-9fa6-8228a14d544b","Type":"ContainerStarted","Data":"69e3e5c5b0cef2b829882f7d08474bf935b7ef7f9ebb96d19c18c2183b2110ec"} Sep 10 12:47:49.002774 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.002473 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0392b167-e78a-4a04-9fa6-8228a14d544b","Type":"ContainerStarted","Data":"ec09e26b75fd6267c37fb31605a02e57d4e228ec29998bfe558fd64d961bb5bb"} Sep 10 12:47:49.002774 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.002499 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0392b167-e78a-4a04-9fa6-8228a14d544b","Type":"ContainerStarted","Data":"9388fe59b26c4e620b037c59dc4d0e6077378e107deaf0bc3247e839be6dc460"} Sep 10 12:47:49.002774 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.002523 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0392b167-e78a-4a04-9fa6-8228a14d544b","Type":"ContainerStarted","Data":"36fb539424db0d3784cf8ac489902c53ca0b8ba014d47ab21c62fdab22c9a538"} Sep 10 12:47:49.703695 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.703655 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 12:47:49.708296 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.708264 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.713283 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.712582 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 10 12:47:49.713283 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.712679 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 10 12:47:49.713283 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.712981 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 10 12:47:49.713283 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.712998 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 10 12:47:49.713283 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.713052 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 10 12:47:49.713997 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.713974 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 10 12:47:49.714124 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.714051 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 10 12:47:49.714236 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.714214 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 10 12:47:49.714524 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.714501 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2ep2jdkisslq2\"" Sep 10 12:47:49.714750 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.714735 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-mwzhm\"" Sep 10 12:47:49.715281 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.715259 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 10 12:47:49.715376 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.715341 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 10 12:47:49.715727 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.715710 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 10 12:47:49.717298 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.717173 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 10 12:47:49.717298 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.717184 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 10 12:47:49.718356 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.718335 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 10 12:47:49.721881 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.721855 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 10 12:47:49.741218 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.741177 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 12:47:49.770966 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.770928 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3221bef2-54cd-4653-9510-4df74cb87bd7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.770966 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.770977 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3221bef2-54cd-4653-9510-4df74cb87bd7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.771239 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.771014 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.771239 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.771132 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.771239 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.771196 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3221bef2-54cd-4653-9510-4df74cb87bd7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.771239 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.771220 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.771462 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.771244 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nbbg\" (UniqueName: \"kubernetes.io/projected/3221bef2-54cd-4653-9510-4df74cb87bd7-kube-api-access-5nbbg\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.771462 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.771272 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.771462 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.771302 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3221bef2-54cd-4653-9510-4df74cb87bd7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.771462 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.771326 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-config\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.771462 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.771349 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3221bef2-54cd-4653-9510-4df74cb87bd7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.771462 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.771376 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3221bef2-54cd-4653-9510-4df74cb87bd7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.771462 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.771405 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3221bef2-54cd-4653-9510-4df74cb87bd7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.771462 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.771432 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3221bef2-54cd-4653-9510-4df74cb87bd7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.771462 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.771457 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3221bef2-54cd-4653-9510-4df74cb87bd7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.771867 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.771495 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.771905 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.771866 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3221bef2-54cd-4653-9510-4df74cb87bd7-config-out\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.771952 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.771936 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.772332 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.772195 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-web-config\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.772332 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.772246 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.873477 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.873438 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3221bef2-54cd-4653-9510-4df74cb87bd7-config-out\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.873748 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.873486 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.873748 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.873522 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-web-config\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.873748 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.873542 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.873935 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.873884 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3221bef2-54cd-4653-9510-4df74cb87bd7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.873935 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.873928 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3221bef2-54cd-4653-9510-4df74cb87bd7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.874041 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.873956 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.874041 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.873983 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.874041 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.874008 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3221bef2-54cd-4653-9510-4df74cb87bd7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.874041 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.874030 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.874411 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.874070 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nbbg\" (UniqueName: \"kubernetes.io/projected/3221bef2-54cd-4653-9510-4df74cb87bd7-kube-api-access-5nbbg\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.874411 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.874103 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.874411 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.874165 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3221bef2-54cd-4653-9510-4df74cb87bd7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.874411 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.874193 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-config\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.874411 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.874242 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3221bef2-54cd-4653-9510-4df74cb87bd7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.874411 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.874273 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3221bef2-54cd-4653-9510-4df74cb87bd7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.874411 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.874301 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3221bef2-54cd-4653-9510-4df74cb87bd7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.874411 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.874330 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3221bef2-54cd-4653-9510-4df74cb87bd7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.874411 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.874355 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3221bef2-54cd-4653-9510-4df74cb87bd7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.874411 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.874393 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.874950 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.874786 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3221bef2-54cd-4653-9510-4df74cb87bd7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.877171 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.876838 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3221bef2-54cd-4653-9510-4df74cb87bd7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.877171 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.877029 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3221bef2-54cd-4653-9510-4df74cb87bd7-config-out\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.877496 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.877471 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.877599 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.877510 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3221bef2-54cd-4653-9510-4df74cb87bd7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.877599 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.877567 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.878571 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.878066 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-web-config\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.878571 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.878418 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3221bef2-54cd-4653-9510-4df74cb87bd7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.878571 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.878440 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3221bef2-54cd-4653-9510-4df74cb87bd7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.878571 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.878489 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.878828 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.878747 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3221bef2-54cd-4653-9510-4df74cb87bd7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.878887 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.878869 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.879748 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.879642 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3221bef2-54cd-4653-9510-4df74cb87bd7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.880473 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.880058 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.880473 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.880377 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3221bef2-54cd-4653-9510-4df74cb87bd7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.880473 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.880435 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.880473 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.880439 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.881714 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.881693 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3221bef2-54cd-4653-9510-4df74cb87bd7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.882063 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.882038 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-config\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:49.895574 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:49.895545 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nbbg\" (UniqueName: \"kubernetes.io/projected/3221bef2-54cd-4653-9510-4df74cb87bd7-kube-api-access-5nbbg\") pod \"prometheus-k8s-0\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:50.023483 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:50.023402 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:47:50.278196 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:50.278134 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c429ad1-3c1f-41a5-9759-671b36d5ee17-metrics-certs\") pod \"network-metrics-daemon-f9qs9\" (UID: \"8c429ad1-3c1f-41a5-9759-671b36d5ee17\") " pod="openshift-multus/network-metrics-daemon-f9qs9" Sep 10 12:47:50.280641 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:50.280615 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c429ad1-3c1f-41a5-9759-671b36d5ee17-metrics-certs\") pod \"network-metrics-daemon-f9qs9\" (UID: \"8c429ad1-3c1f-41a5-9759-671b36d5ee17\") " pod="openshift-multus/network-metrics-daemon-f9qs9" Sep 10 12:47:50.304039 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:50.304013 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sbqsw\"" Sep 10 12:47:50.312016 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:50.311994 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f9qs9" Sep 10 12:47:50.320237 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:50.320209 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 12:47:50.322994 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:47:50.322959 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3221bef2_54cd_4653_9510_4df74cb87bd7.slice/crio-326fce80c8c413a6662f2b58251668e286216308b56aa9ac2ca2fa7bddb2eb30 WatchSource:0}: Error finding container 326fce80c8c413a6662f2b58251668e286216308b56aa9ac2ca2fa7bddb2eb30: Status 404 returned error can't find the container with id 326fce80c8c413a6662f2b58251668e286216308b56aa9ac2ca2fa7bddb2eb30 Sep 10 12:47:50.595554 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:50.595465 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-f9qs9"] Sep 10 12:47:50.597454 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:47:50.597430 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c429ad1_3c1f_41a5_9759_671b36d5ee17.slice/crio-314a392486ff3a696dabe8dde986009f2fb9b54ba7bf07edd22fc10417721e95 WatchSource:0}: Error finding container 314a392486ff3a696dabe8dde986009f2fb9b54ba7bf07edd22fc10417721e95: Status 404 returned error can't find the container with id 314a392486ff3a696dabe8dde986009f2fb9b54ba7bf07edd22fc10417721e95 Sep 10 12:47:51.014713 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:51.014614 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0392b167-e78a-4a04-9fa6-8228a14d544b","Type":"ContainerStarted","Data":"3656577bd5c08130811c5692752714a7539d2d302be14cbe9ed98c5f95680ac3"} Sep 10 12:47:51.015893 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:51.015867 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f9qs9" event={"ID":"8c429ad1-3c1f-41a5-9759-671b36d5ee17","Type":"ContainerStarted","Data":"314a392486ff3a696dabe8dde986009f2fb9b54ba7bf07edd22fc10417721e95"} Sep 10 12:47:51.017341 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:51.017317 2577 generic.go:356] "Generic (PLEG): container finished" podID="3221bef2-54cd-4653-9510-4df74cb87bd7" containerID="068756dd792be28c71c83bc82258ad481b6d9f14b86a822f91580b5fee093aa1" exitCode=0 Sep 10 12:47:51.017415 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:51.017391 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3221bef2-54cd-4653-9510-4df74cb87bd7","Type":"ContainerDied","Data":"068756dd792be28c71c83bc82258ad481b6d9f14b86a822f91580b5fee093aa1"} Sep 10 12:47:51.017450 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:51.017437 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3221bef2-54cd-4653-9510-4df74cb87bd7","Type":"ContainerStarted","Data":"326fce80c8c413a6662f2b58251668e286216308b56aa9ac2ca2fa7bddb2eb30"} Sep 10 12:47:51.058551 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:51.058500 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.775854003 podStartE2EDuration="7.05848197s" totalImagesPullingTime="4.267036279s" totalInitContainerRuntime="15.591688ms" isStatefulPod=false podCreationTimestamp="2026-09-10 12:47:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:47:51.057099316 +0000 UTC m=+130.089712100" watchObservedRunningTime="2026-09-10 12:47:51.05848197 +0000 UTC m=+130.091094751" Sep 10 12:47:52.022903 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:52.022867 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f9qs9" event={"ID":"8c429ad1-3c1f-41a5-9759-671b36d5ee17","Type":"ContainerStarted","Data":"35004f7b72b940ccba552090b8d1d1aa7c94151c8dd2fe36d18ed4e3b99c4084"} Sep 10 12:47:52.023083 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:52.022926 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f9qs9" event={"ID":"8c429ad1-3c1f-41a5-9759-671b36d5ee17","Type":"ContainerStarted","Data":"e60ffda3ea01ac48b70875079eee480a310c34d3557d85ac85c1c22974069690"} Sep 10 12:47:52.043755 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:52.043672 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-f9qs9" podStartSLOduration=130.113846942 podStartE2EDuration="2m11.043649469s" totalImagesPullingTime="929.802527ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:45:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:47:52.043053505 +0000 UTC m=+131.075666283" watchObservedRunningTime="2026-09-10 12:47:52.043649469 +0000 UTC m=+131.076262249" Sep 10 12:47:53.491880 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:53.491844 2577 scope.go:117] "RemoveContainer" containerID="25ab1ca965aef7314f2ca78264958c41f30316c5b307617a6db6d6ad08f799df" Sep 10 12:47:55.041016 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:55.040982 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3221bef2-54cd-4653-9510-4df74cb87bd7","Type":"ContainerStarted","Data":"fe56f89086bc91b4685ca18cf59faf14de1ef8214b04ed413ec95c5bf07d7698"} Sep 10 12:47:55.041584 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:55.041060 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3221bef2-54cd-4653-9510-4df74cb87bd7","Type":"ContainerStarted","Data":"36ed9912dbdd1b01c6c8e8db933c30ce74d18e6dcff60099ae3738c75ef87a35"} Sep 10 12:47:55.042818 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:55.042800 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-dvf22_765454f6-c879-42b5-8e20-f19a691f6a34/console-operator/2.log" Sep 10 12:47:55.042913 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:55.042878 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-dvf22" event={"ID":"765454f6-c879-42b5-8e20-f19a691f6a34","Type":"ContainerStarted","Data":"5ea27e58a4615a4dd8b7b0cbae37e089d54a3372d87eb3114530cc65af621c64"} Sep 10 12:47:55.043153 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:55.043121 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-dvf22" Sep 10 12:47:55.066622 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:55.066573 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85b454874b-dvf22" podStartSLOduration=55.383539947 podStartE2EDuration="58.066557662s" totalImagesPullingTime="2.683017715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:46:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:47:55.065540979 +0000 UTC m=+134.098153757" watchObservedRunningTime="2026-09-10 12:47:55.066557662 +0000 UTC m=+134.099170438" Sep 10 12:47:55.075006 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:55.074972 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-85bf8594b-kh4mj" podUID="bcc23540-e3a4-4cc7-8f66-59e250b39f23" containerName="registry" containerID="cri-o://7ea13eb6f7ccd61f73458bd3e6906054c9cb00b942d9bff177b2e0d998487a92" gracePeriod=30 Sep 10 12:47:55.312770 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:55.312746 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85bf8594b-kh4mj" Sep 10 12:47:55.431124 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:55.431073 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bcc23540-e3a4-4cc7-8f66-59e250b39f23-image-registry-private-configuration\") pod \"bcc23540-e3a4-4cc7-8f66-59e250b39f23\" (UID: \"bcc23540-e3a4-4cc7-8f66-59e250b39f23\") " Sep 10 12:47:55.431323 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:55.431182 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bcc23540-e3a4-4cc7-8f66-59e250b39f23-registry-certificates\") pod \"bcc23540-e3a4-4cc7-8f66-59e250b39f23\" (UID: \"bcc23540-e3a4-4cc7-8f66-59e250b39f23\") " Sep 10 12:47:55.431323 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:55.431207 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bcc23540-e3a4-4cc7-8f66-59e250b39f23-registry-tls\") pod \"bcc23540-e3a4-4cc7-8f66-59e250b39f23\" (UID: \"bcc23540-e3a4-4cc7-8f66-59e250b39f23\") " Sep 10 12:47:55.431323 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:55.431236 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gbznh\" (UniqueName: \"kubernetes.io/projected/bcc23540-e3a4-4cc7-8f66-59e250b39f23-kube-api-access-gbznh\") pod \"bcc23540-e3a4-4cc7-8f66-59e250b39f23\" (UID: \"bcc23540-e3a4-4cc7-8f66-59e250b39f23\") " Sep 10 12:47:55.431323 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:55.431265 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bcc23540-e3a4-4cc7-8f66-59e250b39f23-bound-sa-token\") pod \"bcc23540-e3a4-4cc7-8f66-59e250b39f23\" (UID: \"bcc23540-e3a4-4cc7-8f66-59e250b39f23\") " Sep 10 12:47:55.431323 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:55.431290 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bcc23540-e3a4-4cc7-8f66-59e250b39f23-trusted-ca\") pod \"bcc23540-e3a4-4cc7-8f66-59e250b39f23\" (UID: \"bcc23540-e3a4-4cc7-8f66-59e250b39f23\") " Sep 10 12:47:55.431572 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:55.431338 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bcc23540-e3a4-4cc7-8f66-59e250b39f23-ca-trust-extracted\") pod \"bcc23540-e3a4-4cc7-8f66-59e250b39f23\" (UID: \"bcc23540-e3a4-4cc7-8f66-59e250b39f23\") " Sep 10 12:47:55.431572 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:55.431378 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bcc23540-e3a4-4cc7-8f66-59e250b39f23-installation-pull-secrets\") pod \"bcc23540-e3a4-4cc7-8f66-59e250b39f23\" (UID: \"bcc23540-e3a4-4cc7-8f66-59e250b39f23\") " Sep 10 12:47:55.431664 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:55.431618 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcc23540-e3a4-4cc7-8f66-59e250b39f23-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "bcc23540-e3a4-4cc7-8f66-59e250b39f23" (UID: "bcc23540-e3a4-4cc7-8f66-59e250b39f23"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:47:55.431718 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:55.431700 2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bcc23540-e3a4-4cc7-8f66-59e250b39f23-registry-certificates\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" Sep 10 12:47:55.431979 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:55.431933 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcc23540-e3a4-4cc7-8f66-59e250b39f23-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "bcc23540-e3a4-4cc7-8f66-59e250b39f23" (UID: "bcc23540-e3a4-4cc7-8f66-59e250b39f23"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:47:55.434672 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:55.434624 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcc23540-e3a4-4cc7-8f66-59e250b39f23-kube-api-access-gbznh" (OuterVolumeSpecName: "kube-api-access-gbznh") pod "bcc23540-e3a4-4cc7-8f66-59e250b39f23" (UID: "bcc23540-e3a4-4cc7-8f66-59e250b39f23"). InnerVolumeSpecName "kube-api-access-gbznh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:47:55.434672 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:55.434643 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcc23540-e3a4-4cc7-8f66-59e250b39f23-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "bcc23540-e3a4-4cc7-8f66-59e250b39f23" (UID: "bcc23540-e3a4-4cc7-8f66-59e250b39f23"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:47:55.434893 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:55.434782 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcc23540-e3a4-4cc7-8f66-59e250b39f23-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "bcc23540-e3a4-4cc7-8f66-59e250b39f23" (UID: "bcc23540-e3a4-4cc7-8f66-59e250b39f23"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:47:55.434977 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:55.434917 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcc23540-e3a4-4cc7-8f66-59e250b39f23-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "bcc23540-e3a4-4cc7-8f66-59e250b39f23" (UID: "bcc23540-e3a4-4cc7-8f66-59e250b39f23"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:47:55.436310 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:55.436287 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcc23540-e3a4-4cc7-8f66-59e250b39f23-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "bcc23540-e3a4-4cc7-8f66-59e250b39f23" (UID: "bcc23540-e3a4-4cc7-8f66-59e250b39f23"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:47:55.443080 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:55.443046 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcc23540-e3a4-4cc7-8f66-59e250b39f23-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "bcc23540-e3a4-4cc7-8f66-59e250b39f23" (UID: "bcc23540-e3a4-4cc7-8f66-59e250b39f23"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:47:55.500220 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:55.500191 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85b454874b-dvf22" Sep 10 12:47:55.532744 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:55.532693 2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bcc23540-e3a4-4cc7-8f66-59e250b39f23-ca-trust-extracted\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" Sep 10 12:47:55.532744 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:55.532743 2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bcc23540-e3a4-4cc7-8f66-59e250b39f23-installation-pull-secrets\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" Sep 10 12:47:55.532985 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:55.532755 2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bcc23540-e3a4-4cc7-8f66-59e250b39f23-image-registry-private-configuration\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" Sep 10 12:47:55.532985 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:55.532768 2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bcc23540-e3a4-4cc7-8f66-59e250b39f23-registry-tls\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" Sep 10 12:47:55.532985 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:55.532782 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbznh\" (UniqueName: \"kubernetes.io/projected/bcc23540-e3a4-4cc7-8f66-59e250b39f23-kube-api-access-gbznh\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" Sep 10 12:47:55.532985 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:55.532793 2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bcc23540-e3a4-4cc7-8f66-59e250b39f23-bound-sa-token\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" Sep 10 12:47:55.532985 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:55.532801 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bcc23540-e3a4-4cc7-8f66-59e250b39f23-trusted-ca\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" Sep 10 12:47:56.047511 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:56.047481 2577 generic.go:356] "Generic (PLEG): container finished" podID="bcc23540-e3a4-4cc7-8f66-59e250b39f23" containerID="7ea13eb6f7ccd61f73458bd3e6906054c9cb00b942d9bff177b2e0d998487a92" exitCode=0 Sep 10 12:47:56.047915 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:56.047525 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85bf8594b-kh4mj" Sep 10 12:47:56.047915 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:56.047571 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85bf8594b-kh4mj" event={"ID":"bcc23540-e3a4-4cc7-8f66-59e250b39f23","Type":"ContainerDied","Data":"7ea13eb6f7ccd61f73458bd3e6906054c9cb00b942d9bff177b2e0d998487a92"} Sep 10 12:47:56.047915 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:56.047620 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85bf8594b-kh4mj" event={"ID":"bcc23540-e3a4-4cc7-8f66-59e250b39f23","Type":"ContainerDied","Data":"96ba966a9b3fa518ecd178c3ec16f46caa270bade1a4cb7cf1f32f0d8894f6fd"} Sep 10 12:47:56.047915 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:56.047648 2577 scope.go:117] "RemoveContainer" containerID="7ea13eb6f7ccd61f73458bd3e6906054c9cb00b942d9bff177b2e0d998487a92" Sep 10 12:47:56.060508 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:56.060490 2577 scope.go:117] "RemoveContainer" containerID="7ea13eb6f7ccd61f73458bd3e6906054c9cb00b942d9bff177b2e0d998487a92" Sep 10 12:47:56.060799 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:47:56.060778 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ea13eb6f7ccd61f73458bd3e6906054c9cb00b942d9bff177b2e0d998487a92\": container with ID starting with 7ea13eb6f7ccd61f73458bd3e6906054c9cb00b942d9bff177b2e0d998487a92 not found: ID does not exist" containerID="7ea13eb6f7ccd61f73458bd3e6906054c9cb00b942d9bff177b2e0d998487a92" Sep 10 12:47:56.060855 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:56.060808 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ea13eb6f7ccd61f73458bd3e6906054c9cb00b942d9bff177b2e0d998487a92"} err="failed to get container status \"7ea13eb6f7ccd61f73458bd3e6906054c9cb00b942d9bff177b2e0d998487a92\": rpc error: code = NotFound desc = could not find container \"7ea13eb6f7ccd61f73458bd3e6906054c9cb00b942d9bff177b2e0d998487a92\": container with ID starting with 7ea13eb6f7ccd61f73458bd3e6906054c9cb00b942d9bff177b2e0d998487a92 not found: ID does not exist" Sep 10 12:47:56.068761 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:56.068731 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-85bf8594b-kh4mj"] Sep 10 12:47:56.071301 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:56.071279 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-85bf8594b-kh4mj"] Sep 10 12:47:57.055760 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:57.055720 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3221bef2-54cd-4653-9510-4df74cb87bd7","Type":"ContainerStarted","Data":"301a57a2d4889c110ad6a382ee5120b9d3327e05a2c8d4c7bc80415c57f3934c"} Sep 10 12:47:57.056174 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:57.055797 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3221bef2-54cd-4653-9510-4df74cb87bd7","Type":"ContainerStarted","Data":"b54f93e0c57b8c93358aca23936b7d574c89c228ea564a9514071604d0ecac3f"} Sep 10 12:47:57.056174 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:57.055833 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3221bef2-54cd-4653-9510-4df74cb87bd7","Type":"ContainerStarted","Data":"b9146567acc10e034786f006490ea89220f5235645ca60c64502e41a09588223"} Sep 10 12:47:57.056174 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:57.055856 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3221bef2-54cd-4653-9510-4df74cb87bd7","Type":"ContainerStarted","Data":"30cb8f131017f7117ead78f46f6b90e2cb952e2c1cebd2b3caaf3d0f0705eb8d"} Sep 10 12:47:57.097529 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:57.097120 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.558602772 podStartE2EDuration="8.097096411s" totalImagesPullingTime="5.51879696s" totalInitContainerRuntime="19.696679ms" isStatefulPod=false podCreationTimestamp="2026-09-10 12:47:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:47:57.094642559 +0000 UTC m=+136.127255353" watchObservedRunningTime="2026-09-10 12:47:57.097096411 +0000 UTC m=+136.129709191" Sep 10 12:47:57.497463 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:47:57.497370 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcc23540-e3a4-4cc7-8f66-59e250b39f23" path="/var/lib/kubelet/pods/bcc23540-e3a4-4cc7-8f66-59e250b39f23/volumes" Sep 10 12:48:00.024264 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:48:00.024221 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:48:36.223068 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:48:36.223032 2577 generic.go:356] "Generic (PLEG): container finished" podID="29ea1f07-01f3-4c53-b31f-fe44107e44de" containerID="0e1c569266af150349ee82377ad8cf2a72dd2091e41aabba4575c3dcd7cd7798" exitCode=0 Sep 10 12:48:36.223500 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:48:36.223091 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-g6mq9" event={"ID":"29ea1f07-01f3-4c53-b31f-fe44107e44de","Type":"ContainerDied","Data":"0e1c569266af150349ee82377ad8cf2a72dd2091e41aabba4575c3dcd7cd7798"} Sep 10 12:48:36.223500 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:48:36.223400 2577 scope.go:117] "RemoveContainer" containerID="0e1c569266af150349ee82377ad8cf2a72dd2091e41aabba4575c3dcd7cd7798" Sep 10 12:48:37.228831 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:48:37.228798 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-g6mq9" event={"ID":"29ea1f07-01f3-4c53-b31f-fe44107e44de","Type":"ContainerStarted","Data":"35085187b1a12fd5a665a2a0e6bb47a0c6e22620af753b2bf2520396d8092037"} Sep 10 12:48:50.024109 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:48:50.024066 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:48:50.043990 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:48:50.043957 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:48:50.294072 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:48:50.294045 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:03.837136 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:03.837097 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 12:49:03.837658 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:03.837408 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0392b167-e78a-4a04-9fa6-8228a14d544b" containerName="alertmanager" containerID="cri-o://36fb539424db0d3784cf8ac489902c53ca0b8ba014d47ab21c62fdab22c9a538" gracePeriod=120 Sep 10 12:49:03.837658 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:03.837499 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0392b167-e78a-4a04-9fa6-8228a14d544b" containerName="kube-rbac-proxy-metric" containerID="cri-o://1e7cf17d6f14c32148d6e7f275604e6c8999c3232a1fad8062d08f508aa2a7bc" gracePeriod=120 Sep 10 12:49:03.837658 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:03.837551 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0392b167-e78a-4a04-9fa6-8228a14d544b" containerName="kube-rbac-proxy" containerID="cri-o://69e3e5c5b0cef2b829882f7d08474bf935b7ef7f9ebb96d19c18c2183b2110ec" gracePeriod=120 Sep 10 12:49:03.837658 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:03.837568 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0392b167-e78a-4a04-9fa6-8228a14d544b" containerName="prom-label-proxy" containerID="cri-o://3656577bd5c08130811c5692752714a7539d2d302be14cbe9ed98c5f95680ac3" gracePeriod=120 Sep 10 12:49:03.837658 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:03.837513 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0392b167-e78a-4a04-9fa6-8228a14d544b" containerName="kube-rbac-proxy-web" containerID="cri-o://ec09e26b75fd6267c37fb31605a02e57d4e228ec29998bfe558fd64d961bb5bb" gracePeriod=120 Sep 10 12:49:03.837878 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:03.837550 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0392b167-e78a-4a04-9fa6-8228a14d544b" containerName="config-reloader" containerID="cri-o://9388fe59b26c4e620b037c59dc4d0e6077378e107deaf0bc3247e839be6dc460" gracePeriod=120 Sep 10 12:49:04.338401 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:04.338367 2577 generic.go:356] "Generic (PLEG): container finished" podID="0392b167-e78a-4a04-9fa6-8228a14d544b" containerID="3656577bd5c08130811c5692752714a7539d2d302be14cbe9ed98c5f95680ac3" exitCode=0 Sep 10 12:49:04.338401 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:04.338392 2577 generic.go:356] "Generic (PLEG): container finished" podID="0392b167-e78a-4a04-9fa6-8228a14d544b" containerID="69e3e5c5b0cef2b829882f7d08474bf935b7ef7f9ebb96d19c18c2183b2110ec" exitCode=0 Sep 10 12:49:04.338401 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:04.338399 2577 generic.go:356] "Generic (PLEG): container finished" podID="0392b167-e78a-4a04-9fa6-8228a14d544b" containerID="9388fe59b26c4e620b037c59dc4d0e6077378e107deaf0bc3247e839be6dc460" exitCode=0 Sep 10 12:49:04.338401 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:04.338406 2577 generic.go:356] "Generic (PLEG): container finished" podID="0392b167-e78a-4a04-9fa6-8228a14d544b" containerID="36fb539424db0d3784cf8ac489902c53ca0b8ba014d47ab21c62fdab22c9a538" exitCode=0 Sep 10 12:49:04.338710 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:04.338445 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0392b167-e78a-4a04-9fa6-8228a14d544b","Type":"ContainerDied","Data":"3656577bd5c08130811c5692752714a7539d2d302be14cbe9ed98c5f95680ac3"} Sep 10 12:49:04.338710 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:04.338526 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0392b167-e78a-4a04-9fa6-8228a14d544b","Type":"ContainerDied","Data":"69e3e5c5b0cef2b829882f7d08474bf935b7ef7f9ebb96d19c18c2183b2110ec"} Sep 10 12:49:04.338710 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:04.338563 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0392b167-e78a-4a04-9fa6-8228a14d544b","Type":"ContainerDied","Data":"9388fe59b26c4e620b037c59dc4d0e6077378e107deaf0bc3247e839be6dc460"} Sep 10 12:49:04.338710 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:04.338604 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0392b167-e78a-4a04-9fa6-8228a14d544b","Type":"ContainerDied","Data":"36fb539424db0d3784cf8ac489902c53ca0b8ba014d47ab21c62fdab22c9a538"} Sep 10 12:49:05.090966 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.090939 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:49:05.166848 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.166774 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zxlz\" (UniqueName: \"kubernetes.io/projected/0392b167-e78a-4a04-9fa6-8228a14d544b-kube-api-access-7zxlz\") pod \"0392b167-e78a-4a04-9fa6-8228a14d544b\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " Sep 10 12:49:05.166848 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.166813 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0392b167-e78a-4a04-9fa6-8228a14d544b-config-out\") pod \"0392b167-e78a-4a04-9fa6-8228a14d544b\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " Sep 10 12:49:05.166848 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.166843 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0392b167-e78a-4a04-9fa6-8228a14d544b-alertmanager-main-db\") pod \"0392b167-e78a-4a04-9fa6-8228a14d544b\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " Sep 10 12:49:05.167076 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.167012 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0392b167-e78a-4a04-9fa6-8228a14d544b-config-volume\") pod \"0392b167-e78a-4a04-9fa6-8228a14d544b\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " Sep 10 12:49:05.167076 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.167059 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0392b167-e78a-4a04-9fa6-8228a14d544b-cluster-tls-config\") pod \"0392b167-e78a-4a04-9fa6-8228a14d544b\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " Sep 10 12:49:05.167197 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.167090 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0392b167-e78a-4a04-9fa6-8228a14d544b-secret-alertmanager-kube-rbac-proxy\") pod \"0392b167-e78a-4a04-9fa6-8228a14d544b\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " Sep 10 12:49:05.167197 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.167121 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0392b167-e78a-4a04-9fa6-8228a14d544b-web-config\") pod \"0392b167-e78a-4a04-9fa6-8228a14d544b\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " Sep 10 12:49:05.167197 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.167168 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0392b167-e78a-4a04-9fa6-8228a14d544b-tls-assets\") pod \"0392b167-e78a-4a04-9fa6-8228a14d544b\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " Sep 10 12:49:05.167358 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.167201 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0392b167-e78a-4a04-9fa6-8228a14d544b-secret-alertmanager-kube-rbac-proxy-web\") pod \"0392b167-e78a-4a04-9fa6-8228a14d544b\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " Sep 10 12:49:05.167358 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.167232 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0392b167-e78a-4a04-9fa6-8228a14d544b-secret-alertmanager-main-tls\") pod \"0392b167-e78a-4a04-9fa6-8228a14d544b\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " Sep 10 12:49:05.167358 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.167258 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0392b167-e78a-4a04-9fa6-8228a14d544b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"0392b167-e78a-4a04-9fa6-8228a14d544b\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " Sep 10 12:49:05.167358 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.167311 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0392b167-e78a-4a04-9fa6-8228a14d544b-metrics-client-ca\") pod \"0392b167-e78a-4a04-9fa6-8228a14d544b\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " Sep 10 12:49:05.167358 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.167346 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0392b167-e78a-4a04-9fa6-8228a14d544b-alertmanager-trusted-ca-bundle\") pod \"0392b167-e78a-4a04-9fa6-8228a14d544b\" (UID: \"0392b167-e78a-4a04-9fa6-8228a14d544b\") " Sep 10 12:49:05.168026 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.167996 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0392b167-e78a-4a04-9fa6-8228a14d544b-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "0392b167-e78a-4a04-9fa6-8228a14d544b" (UID: "0392b167-e78a-4a04-9fa6-8228a14d544b"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:49:05.168154 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.167994 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0392b167-e78a-4a04-9fa6-8228a14d544b-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "0392b167-e78a-4a04-9fa6-8228a14d544b" (UID: "0392b167-e78a-4a04-9fa6-8228a14d544b"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:49:05.168392 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.168365 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0392b167-e78a-4a04-9fa6-8228a14d544b-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "0392b167-e78a-4a04-9fa6-8228a14d544b" (UID: "0392b167-e78a-4a04-9fa6-8228a14d544b"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:49:05.171648 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.171618 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0392b167-e78a-4a04-9fa6-8228a14d544b-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "0392b167-e78a-4a04-9fa6-8228a14d544b" (UID: "0392b167-e78a-4a04-9fa6-8228a14d544b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:49:05.171758 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.171646 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0392b167-e78a-4a04-9fa6-8228a14d544b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "0392b167-e78a-4a04-9fa6-8228a14d544b" (UID: "0392b167-e78a-4a04-9fa6-8228a14d544b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:49:05.171758 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.171725 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0392b167-e78a-4a04-9fa6-8228a14d544b-config-out" (OuterVolumeSpecName: "config-out") pod "0392b167-e78a-4a04-9fa6-8228a14d544b" (UID: "0392b167-e78a-4a04-9fa6-8228a14d544b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:49:05.171758 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.171744 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0392b167-e78a-4a04-9fa6-8228a14d544b-config-volume" (OuterVolumeSpecName: "config-volume") pod "0392b167-e78a-4a04-9fa6-8228a14d544b" (UID: "0392b167-e78a-4a04-9fa6-8228a14d544b"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:49:05.171921 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.171772 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0392b167-e78a-4a04-9fa6-8228a14d544b-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "0392b167-e78a-4a04-9fa6-8228a14d544b" (UID: "0392b167-e78a-4a04-9fa6-8228a14d544b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:49:05.172127 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.172101 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0392b167-e78a-4a04-9fa6-8228a14d544b-kube-api-access-7zxlz" (OuterVolumeSpecName: "kube-api-access-7zxlz") pod "0392b167-e78a-4a04-9fa6-8228a14d544b" (UID: "0392b167-e78a-4a04-9fa6-8228a14d544b"). InnerVolumeSpecName "kube-api-access-7zxlz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:49:05.172420 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.172390 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0392b167-e78a-4a04-9fa6-8228a14d544b-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "0392b167-e78a-4a04-9fa6-8228a14d544b" (UID: "0392b167-e78a-4a04-9fa6-8228a14d544b"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:49:05.173134 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.173105 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0392b167-e78a-4a04-9fa6-8228a14d544b-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "0392b167-e78a-4a04-9fa6-8228a14d544b" (UID: "0392b167-e78a-4a04-9fa6-8228a14d544b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:49:05.179594 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.179566 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0392b167-e78a-4a04-9fa6-8228a14d544b-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "0392b167-e78a-4a04-9fa6-8228a14d544b" (UID: "0392b167-e78a-4a04-9fa6-8228a14d544b"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:49:05.187392 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.187354 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0392b167-e78a-4a04-9fa6-8228a14d544b-web-config" (OuterVolumeSpecName: "web-config") pod "0392b167-e78a-4a04-9fa6-8228a14d544b" (UID: "0392b167-e78a-4a04-9fa6-8228a14d544b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:49:05.268797 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.268759 2577 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0392b167-e78a-4a04-9fa6-8228a14d544b-metrics-client-ca\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" Sep 10 12:49:05.268797 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.268793 2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0392b167-e78a-4a04-9fa6-8228a14d544b-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" Sep 10 12:49:05.268797 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.268805 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zxlz\" (UniqueName: \"kubernetes.io/projected/0392b167-e78a-4a04-9fa6-8228a14d544b-kube-api-access-7zxlz\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" Sep 10 12:49:05.269029 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.268816 2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0392b167-e78a-4a04-9fa6-8228a14d544b-config-out\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" Sep 10 12:49:05.269029 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.268825 2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0392b167-e78a-4a04-9fa6-8228a14d544b-alertmanager-main-db\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" Sep 10 12:49:05.269029 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.268833 2577 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0392b167-e78a-4a04-9fa6-8228a14d544b-config-volume\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" Sep 10 12:49:05.269029 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.268842 2577 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0392b167-e78a-4a04-9fa6-8228a14d544b-cluster-tls-config\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" Sep 10 12:49:05.269029 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.268850 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0392b167-e78a-4a04-9fa6-8228a14d544b-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" Sep 10 12:49:05.269029 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.268859 2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0392b167-e78a-4a04-9fa6-8228a14d544b-web-config\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" Sep 10 12:49:05.269029 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.268866 2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0392b167-e78a-4a04-9fa6-8228a14d544b-tls-assets\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" Sep 10 12:49:05.269029 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.268874 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0392b167-e78a-4a04-9fa6-8228a14d544b-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" Sep 10 12:49:05.269029 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.268882 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0392b167-e78a-4a04-9fa6-8228a14d544b-secret-alertmanager-main-tls\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" Sep 10 12:49:05.269029 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.268890 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0392b167-e78a-4a04-9fa6-8228a14d544b-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" Sep 10 12:49:05.346522 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.346486 2577 generic.go:356] "Generic (PLEG): container finished" podID="0392b167-e78a-4a04-9fa6-8228a14d544b" containerID="1e7cf17d6f14c32148d6e7f275604e6c8999c3232a1fad8062d08f508aa2a7bc" exitCode=0 Sep 10 12:49:05.346522 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.346514 2577 generic.go:356] "Generic (PLEG): container finished" podID="0392b167-e78a-4a04-9fa6-8228a14d544b" containerID="ec09e26b75fd6267c37fb31605a02e57d4e228ec29998bfe558fd64d961bb5bb" exitCode=0 Sep 10 12:49:05.346729 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.346564 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:49:05.346729 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.346563 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0392b167-e78a-4a04-9fa6-8228a14d544b","Type":"ContainerDied","Data":"1e7cf17d6f14c32148d6e7f275604e6c8999c3232a1fad8062d08f508aa2a7bc"} Sep 10 12:49:05.346729 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.346632 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0392b167-e78a-4a04-9fa6-8228a14d544b","Type":"ContainerDied","Data":"ec09e26b75fd6267c37fb31605a02e57d4e228ec29998bfe558fd64d961bb5bb"} Sep 10 12:49:05.346729 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.346663 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0392b167-e78a-4a04-9fa6-8228a14d544b","Type":"ContainerDied","Data":"9418f9e80fba96d9d0a268b2563c4c2c51524ccbadcd01175de1562fd227d776"} Sep 10 12:49:05.346729 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.346699 2577 scope.go:117] "RemoveContainer" containerID="3656577bd5c08130811c5692752714a7539d2d302be14cbe9ed98c5f95680ac3" Sep 10 12:49:05.355460 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.355443 2577 scope.go:117] "RemoveContainer" containerID="1e7cf17d6f14c32148d6e7f275604e6c8999c3232a1fad8062d08f508aa2a7bc" Sep 10 12:49:05.362597 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.362582 2577 scope.go:117] "RemoveContainer" containerID="69e3e5c5b0cef2b829882f7d08474bf935b7ef7f9ebb96d19c18c2183b2110ec" Sep 10 12:49:05.369242 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.369223 2577 scope.go:117] "RemoveContainer" containerID="ec09e26b75fd6267c37fb31605a02e57d4e228ec29998bfe558fd64d961bb5bb" Sep 10 12:49:05.373223 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.373175 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 12:49:05.377961 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.377931 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 12:49:05.381867 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.381847 2577 scope.go:117] "RemoveContainer" containerID="9388fe59b26c4e620b037c59dc4d0e6077378e107deaf0bc3247e839be6dc460" Sep 10 12:49:05.391597 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.389070 2577 scope.go:117] "RemoveContainer" containerID="36fb539424db0d3784cf8ac489902c53ca0b8ba014d47ab21c62fdab22c9a538" Sep 10 12:49:05.397009 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.396989 2577 scope.go:117] "RemoveContainer" containerID="6329ea974cf17944ff1be27ed5b2a5ef28102a1652a4118fad84a46cf03eb49b" Sep 10 12:49:05.404004 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.403987 2577 scope.go:117] "RemoveContainer" containerID="3656577bd5c08130811c5692752714a7539d2d302be14cbe9ed98c5f95680ac3" Sep 10 12:49:05.404324 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:49:05.404301 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3656577bd5c08130811c5692752714a7539d2d302be14cbe9ed98c5f95680ac3\": container with ID starting with 3656577bd5c08130811c5692752714a7539d2d302be14cbe9ed98c5f95680ac3 not found: ID does not exist" containerID="3656577bd5c08130811c5692752714a7539d2d302be14cbe9ed98c5f95680ac3" Sep 10 12:49:05.404403 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.404331 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3656577bd5c08130811c5692752714a7539d2d302be14cbe9ed98c5f95680ac3"} err="failed to get container status \"3656577bd5c08130811c5692752714a7539d2d302be14cbe9ed98c5f95680ac3\": rpc error: code = NotFound desc = could not find container \"3656577bd5c08130811c5692752714a7539d2d302be14cbe9ed98c5f95680ac3\": container with ID starting with 3656577bd5c08130811c5692752714a7539d2d302be14cbe9ed98c5f95680ac3 not found: ID does not exist" Sep 10 12:49:05.404403 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.404352 2577 scope.go:117] "RemoveContainer" containerID="1e7cf17d6f14c32148d6e7f275604e6c8999c3232a1fad8062d08f508aa2a7bc" Sep 10 12:49:05.404575 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:49:05.404562 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e7cf17d6f14c32148d6e7f275604e6c8999c3232a1fad8062d08f508aa2a7bc\": container with ID starting with 1e7cf17d6f14c32148d6e7f275604e6c8999c3232a1fad8062d08f508aa2a7bc not found: ID does not exist" containerID="1e7cf17d6f14c32148d6e7f275604e6c8999c3232a1fad8062d08f508aa2a7bc" Sep 10 12:49:05.404627 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.404578 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e7cf17d6f14c32148d6e7f275604e6c8999c3232a1fad8062d08f508aa2a7bc"} err="failed to get container status \"1e7cf17d6f14c32148d6e7f275604e6c8999c3232a1fad8062d08f508aa2a7bc\": rpc error: code = NotFound desc = could not find container \"1e7cf17d6f14c32148d6e7f275604e6c8999c3232a1fad8062d08f508aa2a7bc\": container with ID starting with 1e7cf17d6f14c32148d6e7f275604e6c8999c3232a1fad8062d08f508aa2a7bc not found: ID does not exist" Sep 10 12:49:05.404627 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.404590 2577 scope.go:117] "RemoveContainer" containerID="69e3e5c5b0cef2b829882f7d08474bf935b7ef7f9ebb96d19c18c2183b2110ec" Sep 10 12:49:05.404849 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:49:05.404830 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69e3e5c5b0cef2b829882f7d08474bf935b7ef7f9ebb96d19c18c2183b2110ec\": container with ID starting with 69e3e5c5b0cef2b829882f7d08474bf935b7ef7f9ebb96d19c18c2183b2110ec not found: ID does not exist" containerID="69e3e5c5b0cef2b829882f7d08474bf935b7ef7f9ebb96d19c18c2183b2110ec" Sep 10 12:49:05.404916 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.404852 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69e3e5c5b0cef2b829882f7d08474bf935b7ef7f9ebb96d19c18c2183b2110ec"} err="failed to get container status \"69e3e5c5b0cef2b829882f7d08474bf935b7ef7f9ebb96d19c18c2183b2110ec\": rpc error: code = NotFound desc = could not find container \"69e3e5c5b0cef2b829882f7d08474bf935b7ef7f9ebb96d19c18c2183b2110ec\": container with ID starting with 69e3e5c5b0cef2b829882f7d08474bf935b7ef7f9ebb96d19c18c2183b2110ec not found: ID does not exist" Sep 10 12:49:05.404916 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.404865 2577 scope.go:117] "RemoveContainer" containerID="ec09e26b75fd6267c37fb31605a02e57d4e228ec29998bfe558fd64d961bb5bb" Sep 10 12:49:05.405066 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:49:05.405051 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec09e26b75fd6267c37fb31605a02e57d4e228ec29998bfe558fd64d961bb5bb\": container with ID starting with ec09e26b75fd6267c37fb31605a02e57d4e228ec29998bfe558fd64d961bb5bb not found: ID does not exist" containerID="ec09e26b75fd6267c37fb31605a02e57d4e228ec29998bfe558fd64d961bb5bb" Sep 10 12:49:05.405106 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.405069 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec09e26b75fd6267c37fb31605a02e57d4e228ec29998bfe558fd64d961bb5bb"} err="failed to get container status \"ec09e26b75fd6267c37fb31605a02e57d4e228ec29998bfe558fd64d961bb5bb\": rpc error: code = NotFound desc = could not find container \"ec09e26b75fd6267c37fb31605a02e57d4e228ec29998bfe558fd64d961bb5bb\": container with ID starting with ec09e26b75fd6267c37fb31605a02e57d4e228ec29998bfe558fd64d961bb5bb not found: ID does not exist" Sep 10 12:49:05.405106 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.405082 2577 scope.go:117] "RemoveContainer" containerID="9388fe59b26c4e620b037c59dc4d0e6077378e107deaf0bc3247e839be6dc460" Sep 10 12:49:05.405328 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:49:05.405308 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9388fe59b26c4e620b037c59dc4d0e6077378e107deaf0bc3247e839be6dc460\": container with ID starting with 9388fe59b26c4e620b037c59dc4d0e6077378e107deaf0bc3247e839be6dc460 not found: ID does not exist" containerID="9388fe59b26c4e620b037c59dc4d0e6077378e107deaf0bc3247e839be6dc460" Sep 10 12:49:05.405377 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.405333 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9388fe59b26c4e620b037c59dc4d0e6077378e107deaf0bc3247e839be6dc460"} err="failed to get container status \"9388fe59b26c4e620b037c59dc4d0e6077378e107deaf0bc3247e839be6dc460\": rpc error: code = NotFound desc = could not find container \"9388fe59b26c4e620b037c59dc4d0e6077378e107deaf0bc3247e839be6dc460\": container with ID starting with 9388fe59b26c4e620b037c59dc4d0e6077378e107deaf0bc3247e839be6dc460 not found: ID does not exist" Sep 10 12:49:05.405377 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.405349 2577 scope.go:117] "RemoveContainer" containerID="36fb539424db0d3784cf8ac489902c53ca0b8ba014d47ab21c62fdab22c9a538" Sep 10 12:49:05.405574 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:49:05.405555 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36fb539424db0d3784cf8ac489902c53ca0b8ba014d47ab21c62fdab22c9a538\": container with ID starting with 36fb539424db0d3784cf8ac489902c53ca0b8ba014d47ab21c62fdab22c9a538 not found: ID does not exist" containerID="36fb539424db0d3784cf8ac489902c53ca0b8ba014d47ab21c62fdab22c9a538" Sep 10 12:49:05.405622 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.405572 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36fb539424db0d3784cf8ac489902c53ca0b8ba014d47ab21c62fdab22c9a538"} err="failed to get container status \"36fb539424db0d3784cf8ac489902c53ca0b8ba014d47ab21c62fdab22c9a538\": rpc error: code = NotFound desc = could not find container \"36fb539424db0d3784cf8ac489902c53ca0b8ba014d47ab21c62fdab22c9a538\": container with ID starting with 36fb539424db0d3784cf8ac489902c53ca0b8ba014d47ab21c62fdab22c9a538 not found: ID does not exist" Sep 10 12:49:05.405622 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.405584 2577 scope.go:117] "RemoveContainer" containerID="6329ea974cf17944ff1be27ed5b2a5ef28102a1652a4118fad84a46cf03eb49b" Sep 10 12:49:05.405787 ip-10-0-139-146 kubenswrapper[2577]: E0910 12:49:05.405772 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6329ea974cf17944ff1be27ed5b2a5ef28102a1652a4118fad84a46cf03eb49b\": container with ID starting with 6329ea974cf17944ff1be27ed5b2a5ef28102a1652a4118fad84a46cf03eb49b not found: ID does not exist" containerID="6329ea974cf17944ff1be27ed5b2a5ef28102a1652a4118fad84a46cf03eb49b" Sep 10 12:49:05.405827 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.405789 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6329ea974cf17944ff1be27ed5b2a5ef28102a1652a4118fad84a46cf03eb49b"} err="failed to get container status \"6329ea974cf17944ff1be27ed5b2a5ef28102a1652a4118fad84a46cf03eb49b\": rpc error: code = NotFound desc = could not find container \"6329ea974cf17944ff1be27ed5b2a5ef28102a1652a4118fad84a46cf03eb49b\": container with ID starting with 6329ea974cf17944ff1be27ed5b2a5ef28102a1652a4118fad84a46cf03eb49b not found: ID does not exist" Sep 10 12:49:05.405827 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.405800 2577 scope.go:117] "RemoveContainer" containerID="3656577bd5c08130811c5692752714a7539d2d302be14cbe9ed98c5f95680ac3" Sep 10 12:49:05.405990 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.405975 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3656577bd5c08130811c5692752714a7539d2d302be14cbe9ed98c5f95680ac3"} err="failed to get container status \"3656577bd5c08130811c5692752714a7539d2d302be14cbe9ed98c5f95680ac3\": rpc error: code = NotFound desc = could not find container \"3656577bd5c08130811c5692752714a7539d2d302be14cbe9ed98c5f95680ac3\": container with ID starting with 3656577bd5c08130811c5692752714a7539d2d302be14cbe9ed98c5f95680ac3 not found: ID does not exist" Sep 10 12:49:05.406032 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.405992 2577 scope.go:117] "RemoveContainer" containerID="1e7cf17d6f14c32148d6e7f275604e6c8999c3232a1fad8062d08f508aa2a7bc" Sep 10 12:49:05.406284 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.406261 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e7cf17d6f14c32148d6e7f275604e6c8999c3232a1fad8062d08f508aa2a7bc"} err="failed to get container status \"1e7cf17d6f14c32148d6e7f275604e6c8999c3232a1fad8062d08f508aa2a7bc\": rpc error: code = NotFound desc = could not find container \"1e7cf17d6f14c32148d6e7f275604e6c8999c3232a1fad8062d08f508aa2a7bc\": container with ID starting with 1e7cf17d6f14c32148d6e7f275604e6c8999c3232a1fad8062d08f508aa2a7bc not found: ID does not exist" Sep 10 12:49:05.406391 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.406293 2577 scope.go:117] "RemoveContainer" containerID="69e3e5c5b0cef2b829882f7d08474bf935b7ef7f9ebb96d19c18c2183b2110ec" Sep 10 12:49:05.406593 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.406574 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69e3e5c5b0cef2b829882f7d08474bf935b7ef7f9ebb96d19c18c2183b2110ec"} err="failed to get container status \"69e3e5c5b0cef2b829882f7d08474bf935b7ef7f9ebb96d19c18c2183b2110ec\": rpc error: code = NotFound desc = could not find container \"69e3e5c5b0cef2b829882f7d08474bf935b7ef7f9ebb96d19c18c2183b2110ec\": container with ID starting with 69e3e5c5b0cef2b829882f7d08474bf935b7ef7f9ebb96d19c18c2183b2110ec not found: ID does not exist" Sep 10 12:49:05.406593 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.406593 2577 scope.go:117] "RemoveContainer" containerID="ec09e26b75fd6267c37fb31605a02e57d4e228ec29998bfe558fd64d961bb5bb" Sep 10 12:49:05.406930 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.406892 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec09e26b75fd6267c37fb31605a02e57d4e228ec29998bfe558fd64d961bb5bb"} err="failed to get container status \"ec09e26b75fd6267c37fb31605a02e57d4e228ec29998bfe558fd64d961bb5bb\": rpc error: code = NotFound desc = could not find container \"ec09e26b75fd6267c37fb31605a02e57d4e228ec29998bfe558fd64d961bb5bb\": container with ID starting with ec09e26b75fd6267c37fb31605a02e57d4e228ec29998bfe558fd64d961bb5bb not found: ID does not exist" Sep 10 12:49:05.406930 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.406917 2577 scope.go:117] "RemoveContainer" containerID="9388fe59b26c4e620b037c59dc4d0e6077378e107deaf0bc3247e839be6dc460" Sep 10 12:49:05.407302 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.407194 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9388fe59b26c4e620b037c59dc4d0e6077378e107deaf0bc3247e839be6dc460"} err="failed to get container status \"9388fe59b26c4e620b037c59dc4d0e6077378e107deaf0bc3247e839be6dc460\": rpc error: code = NotFound desc = could not find container \"9388fe59b26c4e620b037c59dc4d0e6077378e107deaf0bc3247e839be6dc460\": container with ID starting with 9388fe59b26c4e620b037c59dc4d0e6077378e107deaf0bc3247e839be6dc460 not found: ID does not exist" Sep 10 12:49:05.407302 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.407219 2577 scope.go:117] "RemoveContainer" containerID="36fb539424db0d3784cf8ac489902c53ca0b8ba014d47ab21c62fdab22c9a538" Sep 10 12:49:05.407569 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.407540 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36fb539424db0d3784cf8ac489902c53ca0b8ba014d47ab21c62fdab22c9a538"} err="failed to get container status \"36fb539424db0d3784cf8ac489902c53ca0b8ba014d47ab21c62fdab22c9a538\": rpc error: code = NotFound desc = could not find container \"36fb539424db0d3784cf8ac489902c53ca0b8ba014d47ab21c62fdab22c9a538\": container with ID starting with 36fb539424db0d3784cf8ac489902c53ca0b8ba014d47ab21c62fdab22c9a538 not found: ID does not exist" Sep 10 12:49:05.407666 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.407570 2577 scope.go:117] "RemoveContainer" containerID="6329ea974cf17944ff1be27ed5b2a5ef28102a1652a4118fad84a46cf03eb49b" Sep 10 12:49:05.407875 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.407855 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6329ea974cf17944ff1be27ed5b2a5ef28102a1652a4118fad84a46cf03eb49b"} err="failed to get container status \"6329ea974cf17944ff1be27ed5b2a5ef28102a1652a4118fad84a46cf03eb49b\": rpc error: code = NotFound desc = could not find container \"6329ea974cf17944ff1be27ed5b2a5ef28102a1652a4118fad84a46cf03eb49b\": container with ID starting with 6329ea974cf17944ff1be27ed5b2a5ef28102a1652a4118fad84a46cf03eb49b not found: ID does not exist" Sep 10 12:49:05.417897 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.417831 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 12:49:05.418121 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.418109 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcc23540-e3a4-4cc7-8f66-59e250b39f23" containerName="registry" Sep 10 12:49:05.418196 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.418122 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcc23540-e3a4-4cc7-8f66-59e250b39f23" containerName="registry" Sep 10 12:49:05.418196 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.418133 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0392b167-e78a-4a04-9fa6-8228a14d544b" containerName="init-config-reloader" Sep 10 12:49:05.418196 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.418154 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0392b167-e78a-4a04-9fa6-8228a14d544b" containerName="init-config-reloader" Sep 10 12:49:05.418196 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.418169 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0392b167-e78a-4a04-9fa6-8228a14d544b" containerName="config-reloader" Sep 10 12:49:05.418196 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.418174 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0392b167-e78a-4a04-9fa6-8228a14d544b" containerName="config-reloader" Sep 10 12:49:05.418196 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.418180 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0392b167-e78a-4a04-9fa6-8228a14d544b" containerName="kube-rbac-proxy" Sep 10 12:49:05.418196 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.418185 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0392b167-e78a-4a04-9fa6-8228a14d544b" containerName="kube-rbac-proxy" Sep 10 12:49:05.418196 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.418197 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0392b167-e78a-4a04-9fa6-8228a14d544b" containerName="alertmanager" Sep 10 12:49:05.418440 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.418203 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0392b167-e78a-4a04-9fa6-8228a14d544b" containerName="alertmanager" Sep 10 12:49:05.418440 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.418209 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0392b167-e78a-4a04-9fa6-8228a14d544b" containerName="kube-rbac-proxy-web" Sep 10 12:49:05.418440 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.418214 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0392b167-e78a-4a04-9fa6-8228a14d544b" containerName="kube-rbac-proxy-web" Sep 10 12:49:05.418440 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.418221 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0392b167-e78a-4a04-9fa6-8228a14d544b" containerName="kube-rbac-proxy-metric" Sep 10 12:49:05.418440 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.418226 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0392b167-e78a-4a04-9fa6-8228a14d544b" containerName="kube-rbac-proxy-metric" Sep 10 12:49:05.418440 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.418232 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0392b167-e78a-4a04-9fa6-8228a14d544b" containerName="prom-label-proxy" Sep 10 12:49:05.418440 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.418237 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0392b167-e78a-4a04-9fa6-8228a14d544b" containerName="prom-label-proxy" Sep 10 12:49:05.418440 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.418284 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0392b167-e78a-4a04-9fa6-8228a14d544b" containerName="prom-label-proxy" Sep 10 12:49:05.418440 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.418299 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0392b167-e78a-4a04-9fa6-8228a14d544b" containerName="kube-rbac-proxy" Sep 10 12:49:05.418440 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.418304 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0392b167-e78a-4a04-9fa6-8228a14d544b" containerName="config-reloader" Sep 10 12:49:05.418440 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.418310 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0392b167-e78a-4a04-9fa6-8228a14d544b" containerName="kube-rbac-proxy-web" Sep 10 12:49:05.418440 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.418316 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcc23540-e3a4-4cc7-8f66-59e250b39f23" containerName="registry" Sep 10 12:49:05.418440 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.418321 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0392b167-e78a-4a04-9fa6-8228a14d544b" containerName="kube-rbac-proxy-metric" Sep 10 12:49:05.418440 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.418327 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0392b167-e78a-4a04-9fa6-8228a14d544b" containerName="alertmanager" Sep 10 12:49:05.423463 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.423441 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:49:05.428043 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.428018 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 10 12:49:05.428192 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.428088 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 10 12:49:05.428192 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.428109 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 10 12:49:05.428192 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.428112 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 10 12:49:05.428516 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.428499 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 10 12:49:05.428516 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.428512 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 10 12:49:05.428658 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.428642 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rvd47\"" Sep 10 12:49:05.428750 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.428734 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 10 12:49:05.428828 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.428740 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 10 12:49:05.435263 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.435241 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 10 12:49:05.445762 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.445739 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 12:49:05.470390 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.470358 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfslk\" (UniqueName: \"kubernetes.io/projected/aaebd1a9-1e7d-4481-80bc-42065e2e38f3-kube-api-access-kfslk\") pod \"alertmanager-main-0\" (UID: \"aaebd1a9-1e7d-4481-80bc-42065e2e38f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:49:05.470536 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.470395 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aaebd1a9-1e7d-4481-80bc-42065e2e38f3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"aaebd1a9-1e7d-4481-80bc-42065e2e38f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:49:05.470536 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.470426 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aaebd1a9-1e7d-4481-80bc-42065e2e38f3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"aaebd1a9-1e7d-4481-80bc-42065e2e38f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:49:05.470536 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.470502 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aaebd1a9-1e7d-4481-80bc-42065e2e38f3-config-out\") pod \"alertmanager-main-0\" (UID: \"aaebd1a9-1e7d-4481-80bc-42065e2e38f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:49:05.470680 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.470534 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/aaebd1a9-1e7d-4481-80bc-42065e2e38f3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"aaebd1a9-1e7d-4481-80bc-42065e2e38f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:49:05.470680 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.470552 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aaebd1a9-1e7d-4481-80bc-42065e2e38f3-web-config\") pod \"alertmanager-main-0\" (UID: \"aaebd1a9-1e7d-4481-80bc-42065e2e38f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:49:05.470680 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.470570 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/aaebd1a9-1e7d-4481-80bc-42065e2e38f3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"aaebd1a9-1e7d-4481-80bc-42065e2e38f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:49:05.470680 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.470598 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aaebd1a9-1e7d-4481-80bc-42065e2e38f3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"aaebd1a9-1e7d-4481-80bc-42065e2e38f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:49:05.470680 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.470616 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaebd1a9-1e7d-4481-80bc-42065e2e38f3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"aaebd1a9-1e7d-4481-80bc-42065e2e38f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:49:05.470827 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.470684 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/aaebd1a9-1e7d-4481-80bc-42065e2e38f3-config-volume\") pod \"alertmanager-main-0\" (UID: \"aaebd1a9-1e7d-4481-80bc-42065e2e38f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:49:05.470827 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.470723 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aaebd1a9-1e7d-4481-80bc-42065e2e38f3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"aaebd1a9-1e7d-4481-80bc-42065e2e38f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:49:05.470827 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.470755 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/aaebd1a9-1e7d-4481-80bc-42065e2e38f3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"aaebd1a9-1e7d-4481-80bc-42065e2e38f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:49:05.470827 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.470776 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aaebd1a9-1e7d-4481-80bc-42065e2e38f3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"aaebd1a9-1e7d-4481-80bc-42065e2e38f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:49:05.496262 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.496230 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0392b167-e78a-4a04-9fa6-8228a14d544b" path="/var/lib/kubelet/pods/0392b167-e78a-4a04-9fa6-8228a14d544b/volumes" Sep 10 12:49:05.571825 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.571790 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aaebd1a9-1e7d-4481-80bc-42065e2e38f3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"aaebd1a9-1e7d-4481-80bc-42065e2e38f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:49:05.572026 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.571836 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/aaebd1a9-1e7d-4481-80bc-42065e2e38f3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"aaebd1a9-1e7d-4481-80bc-42065e2e38f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:49:05.572026 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.571866 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aaebd1a9-1e7d-4481-80bc-42065e2e38f3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"aaebd1a9-1e7d-4481-80bc-42065e2e38f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:49:05.572026 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.571918 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfslk\" (UniqueName: \"kubernetes.io/projected/aaebd1a9-1e7d-4481-80bc-42065e2e38f3-kube-api-access-kfslk\") pod \"alertmanager-main-0\" (UID: \"aaebd1a9-1e7d-4481-80bc-42065e2e38f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:49:05.572026 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.571943 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aaebd1a9-1e7d-4481-80bc-42065e2e38f3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"aaebd1a9-1e7d-4481-80bc-42065e2e38f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:49:05.572026 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.571971 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aaebd1a9-1e7d-4481-80bc-42065e2e38f3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"aaebd1a9-1e7d-4481-80bc-42065e2e38f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:49:05.572026 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.572000 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aaebd1a9-1e7d-4481-80bc-42065e2e38f3-config-out\") pod \"alertmanager-main-0\" (UID: \"aaebd1a9-1e7d-4481-80bc-42065e2e38f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:49:05.572359 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.572026 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/aaebd1a9-1e7d-4481-80bc-42065e2e38f3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"aaebd1a9-1e7d-4481-80bc-42065e2e38f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:49:05.572359 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.572078 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aaebd1a9-1e7d-4481-80bc-42065e2e38f3-web-config\") pod \"alertmanager-main-0\" (UID: \"aaebd1a9-1e7d-4481-80bc-42065e2e38f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:49:05.572359 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.572122 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/aaebd1a9-1e7d-4481-80bc-42065e2e38f3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"aaebd1a9-1e7d-4481-80bc-42065e2e38f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:49:05.572359 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.572189 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aaebd1a9-1e7d-4481-80bc-42065e2e38f3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"aaebd1a9-1e7d-4481-80bc-42065e2e38f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:49:05.572359 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.572217 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaebd1a9-1e7d-4481-80bc-42065e2e38f3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"aaebd1a9-1e7d-4481-80bc-42065e2e38f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:49:05.572359 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.572280 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/aaebd1a9-1e7d-4481-80bc-42065e2e38f3-config-volume\") pod \"alertmanager-main-0\" (UID: \"aaebd1a9-1e7d-4481-80bc-42065e2e38f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:49:05.572650 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.572420 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/aaebd1a9-1e7d-4481-80bc-42065e2e38f3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"aaebd1a9-1e7d-4481-80bc-42065e2e38f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:49:05.574208 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.573345 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aaebd1a9-1e7d-4481-80bc-42065e2e38f3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"aaebd1a9-1e7d-4481-80bc-42065e2e38f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:49:05.574208 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.574028 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaebd1a9-1e7d-4481-80bc-42065e2e38f3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"aaebd1a9-1e7d-4481-80bc-42065e2e38f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:49:05.575542 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.575496 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/aaebd1a9-1e7d-4481-80bc-42065e2e38f3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"aaebd1a9-1e7d-4481-80bc-42065e2e38f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:49:05.575542 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.575496 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/aaebd1a9-1e7d-4481-80bc-42065e2e38f3-config-volume\") pod \"alertmanager-main-0\" (UID: \"aaebd1a9-1e7d-4481-80bc-42065e2e38f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:49:05.575693 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.575532 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aaebd1a9-1e7d-4481-80bc-42065e2e38f3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"aaebd1a9-1e7d-4481-80bc-42065e2e38f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:49:05.575693 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.575572 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aaebd1a9-1e7d-4481-80bc-42065e2e38f3-web-config\") pod \"alertmanager-main-0\" (UID: \"aaebd1a9-1e7d-4481-80bc-42065e2e38f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:49:05.575837 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.575817 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/aaebd1a9-1e7d-4481-80bc-42065e2e38f3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"aaebd1a9-1e7d-4481-80bc-42065e2e38f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:49:05.575911 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.575888 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aaebd1a9-1e7d-4481-80bc-42065e2e38f3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"aaebd1a9-1e7d-4481-80bc-42065e2e38f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:49:05.576014 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.575999 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aaebd1a9-1e7d-4481-80bc-42065e2e38f3-config-out\") pod \"alertmanager-main-0\" (UID: \"aaebd1a9-1e7d-4481-80bc-42065e2e38f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:49:05.576320 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.576305 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aaebd1a9-1e7d-4481-80bc-42065e2e38f3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"aaebd1a9-1e7d-4481-80bc-42065e2e38f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:49:05.576774 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.576753 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aaebd1a9-1e7d-4481-80bc-42065e2e38f3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"aaebd1a9-1e7d-4481-80bc-42065e2e38f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:49:05.581539 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.581520 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfslk\" (UniqueName: \"kubernetes.io/projected/aaebd1a9-1e7d-4481-80bc-42065e2e38f3-kube-api-access-kfslk\") pod \"alertmanager-main-0\" (UID: \"aaebd1a9-1e7d-4481-80bc-42065e2e38f3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:49:05.732524 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:05.732431 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:49:06.032168 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:06.032114 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 12:49:06.035705 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:49:06.035678 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaebd1a9_1e7d_4481_80bc_42065e2e38f3.slice/crio-63238d7a38d867d58d2d1e1b19c7ed734423e8a1c583f0a863a1c72a01fd3011 WatchSource:0}: Error finding container 63238d7a38d867d58d2d1e1b19c7ed734423e8a1c583f0a863a1c72a01fd3011: Status 404 returned error can't find the container with id 63238d7a38d867d58d2d1e1b19c7ed734423e8a1c583f0a863a1c72a01fd3011 Sep 10 12:49:06.352539 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:06.352452 2577 generic.go:356] "Generic (PLEG): container finished" podID="aaebd1a9-1e7d-4481-80bc-42065e2e38f3" containerID="1bc2771bf45d2c13209ed5187efecb2fea8010b186cb63ad19dc62e304638fe5" exitCode=0 Sep 10 12:49:06.352944 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:06.352536 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aaebd1a9-1e7d-4481-80bc-42065e2e38f3","Type":"ContainerDied","Data":"1bc2771bf45d2c13209ed5187efecb2fea8010b186cb63ad19dc62e304638fe5"} Sep 10 12:49:06.352944 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:06.352663 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aaebd1a9-1e7d-4481-80bc-42065e2e38f3","Type":"ContainerStarted","Data":"63238d7a38d867d58d2d1e1b19c7ed734423e8a1c583f0a863a1c72a01fd3011"} Sep 10 12:49:07.360721 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:07.360677 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aaebd1a9-1e7d-4481-80bc-42065e2e38f3","Type":"ContainerStarted","Data":"c35f4882b2afd671d73392d56dc92d3f04fa31b5b03dea3641f0c5967420ea13"} Sep 10 12:49:07.361117 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:07.360764 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aaebd1a9-1e7d-4481-80bc-42065e2e38f3","Type":"ContainerStarted","Data":"0017acb5e4f127784089593b6a8cf2316b11b29f8e944943f0815de341af776e"} Sep 10 12:49:07.361117 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:07.360809 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aaebd1a9-1e7d-4481-80bc-42065e2e38f3","Type":"ContainerStarted","Data":"5068bec083d8fcec6eb6c75eaca7c4a16ddcb85bcb00189d471b4a525ce0fd72"} Sep 10 12:49:07.361117 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:07.360846 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aaebd1a9-1e7d-4481-80bc-42065e2e38f3","Type":"ContainerStarted","Data":"1d3e4ba296f5f6847298796783eaec9020fc4c282d67a44bd209a483511f36e8"} Sep 10 12:49:07.361117 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:07.360882 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aaebd1a9-1e7d-4481-80bc-42065e2e38f3","Type":"ContainerStarted","Data":"9d13efb94f0e9f8144a2354ecbf6316219792b5f820b1e09e3796b0e0b464e23"} Sep 10 12:49:07.361117 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:07.360917 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aaebd1a9-1e7d-4481-80bc-42065e2e38f3","Type":"ContainerStarted","Data":"51c0fbdaea88912be7e8fd842a8572b5a1149627bfe4ac3dd39a1eca33f7c8cc"} Sep 10 12:49:07.389822 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:07.389773 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.372981665 podStartE2EDuration="2.389757539s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.775874ms" isStatefulPod=false podCreationTimestamp="2026-09-10 12:49:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:49:07.388867093 +0000 UTC m=+206.421479871" watchObservedRunningTime="2026-09-10 12:49:07.389757539 +0000 UTC m=+206.422370316" Sep 10 12:49:08.191059 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.191018 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 12:49:08.191389 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.191355 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3221bef2-54cd-4653-9510-4df74cb87bd7" containerName="prometheus" containerID="cri-o://36ed9912dbdd1b01c6c8e8db933c30ce74d18e6dcff60099ae3738c75ef87a35" gracePeriod=600 Sep 10 12:49:08.191389 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.191381 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3221bef2-54cd-4653-9510-4df74cb87bd7" containerName="kube-rbac-proxy-web" containerID="cri-o://b9146567acc10e034786f006490ea89220f5235645ca60c64502e41a09588223" gracePeriod=600 Sep 10 12:49:08.191602 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.191412 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3221bef2-54cd-4653-9510-4df74cb87bd7" containerName="thanos-sidecar" containerID="cri-o://30cb8f131017f7117ead78f46f6b90e2cb952e2c1cebd2b3caaf3d0f0705eb8d" gracePeriod=600 Sep 10 12:49:08.191602 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.191439 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3221bef2-54cd-4653-9510-4df74cb87bd7" containerName="kube-rbac-proxy" containerID="cri-o://b54f93e0c57b8c93358aca23936b7d574c89c228ea564a9514071604d0ecac3f" gracePeriod=600 Sep 10 12:49:08.191602 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.191361 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3221bef2-54cd-4653-9510-4df74cb87bd7" containerName="kube-rbac-proxy-thanos" containerID="cri-o://301a57a2d4889c110ad6a382ee5120b9d3327e05a2c8d4c7bc80415c57f3934c" gracePeriod=600 Sep 10 12:49:08.191602 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.191412 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3221bef2-54cd-4653-9510-4df74cb87bd7" containerName="config-reloader" containerID="cri-o://fe56f89086bc91b4685ca18cf59faf14de1ef8214b04ed413ec95c5bf07d7698" gracePeriod=600 Sep 10 12:49:08.370245 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.370213 2577 generic.go:356] "Generic (PLEG): container finished" podID="3221bef2-54cd-4653-9510-4df74cb87bd7" containerID="301a57a2d4889c110ad6a382ee5120b9d3327e05a2c8d4c7bc80415c57f3934c" exitCode=0 Sep 10 12:49:08.370245 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.370245 2577 generic.go:356] "Generic (PLEG): container finished" podID="3221bef2-54cd-4653-9510-4df74cb87bd7" containerID="b54f93e0c57b8c93358aca23936b7d574c89c228ea564a9514071604d0ecac3f" exitCode=0 Sep 10 12:49:08.370632 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.370254 2577 generic.go:356] "Generic (PLEG): container finished" podID="3221bef2-54cd-4653-9510-4df74cb87bd7" containerID="b9146567acc10e034786f006490ea89220f5235645ca60c64502e41a09588223" exitCode=0 Sep 10 12:49:08.370632 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.370263 2577 generic.go:356] "Generic (PLEG): container finished" podID="3221bef2-54cd-4653-9510-4df74cb87bd7" containerID="30cb8f131017f7117ead78f46f6b90e2cb952e2c1cebd2b3caaf3d0f0705eb8d" exitCode=0 Sep 10 12:49:08.370632 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.370270 2577 generic.go:356] "Generic (PLEG): container finished" podID="3221bef2-54cd-4653-9510-4df74cb87bd7" containerID="fe56f89086bc91b4685ca18cf59faf14de1ef8214b04ed413ec95c5bf07d7698" exitCode=0 Sep 10 12:49:08.370632 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.370278 2577 generic.go:356] "Generic (PLEG): container finished" podID="3221bef2-54cd-4653-9510-4df74cb87bd7" containerID="36ed9912dbdd1b01c6c8e8db933c30ce74d18e6dcff60099ae3738c75ef87a35" exitCode=0 Sep 10 12:49:08.370632 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.370278 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3221bef2-54cd-4653-9510-4df74cb87bd7","Type":"ContainerDied","Data":"301a57a2d4889c110ad6a382ee5120b9d3327e05a2c8d4c7bc80415c57f3934c"} Sep 10 12:49:08.370632 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.370353 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3221bef2-54cd-4653-9510-4df74cb87bd7","Type":"ContainerDied","Data":"b54f93e0c57b8c93358aca23936b7d574c89c228ea564a9514071604d0ecac3f"} Sep 10 12:49:08.370632 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.370403 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3221bef2-54cd-4653-9510-4df74cb87bd7","Type":"ContainerDied","Data":"b9146567acc10e034786f006490ea89220f5235645ca60c64502e41a09588223"} Sep 10 12:49:08.370632 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.370462 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3221bef2-54cd-4653-9510-4df74cb87bd7","Type":"ContainerDied","Data":"30cb8f131017f7117ead78f46f6b90e2cb952e2c1cebd2b3caaf3d0f0705eb8d"} Sep 10 12:49:08.370632 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.370503 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3221bef2-54cd-4653-9510-4df74cb87bd7","Type":"ContainerDied","Data":"fe56f89086bc91b4685ca18cf59faf14de1ef8214b04ed413ec95c5bf07d7698"} Sep 10 12:49:08.370632 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.370546 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3221bef2-54cd-4653-9510-4df74cb87bd7","Type":"ContainerDied","Data":"36ed9912dbdd1b01c6c8e8db933c30ce74d18e6dcff60099ae3738c75ef87a35"} Sep 10 12:49:08.452298 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.452221 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:08.496294 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.496257 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5nbbg\" (UniqueName: \"kubernetes.io/projected/3221bef2-54cd-4653-9510-4df74cb87bd7-kube-api-access-5nbbg\") pod \"3221bef2-54cd-4653-9510-4df74cb87bd7\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " Sep 10 12:49:08.496294 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.496306 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-secret-kube-rbac-proxy\") pod \"3221bef2-54cd-4653-9510-4df74cb87bd7\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " Sep 10 12:49:08.496573 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.496344 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3221bef2-54cd-4653-9510-4df74cb87bd7-configmap-serving-certs-ca-bundle\") pod \"3221bef2-54cd-4653-9510-4df74cb87bd7\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " Sep 10 12:49:08.496573 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.496488 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3221bef2-54cd-4653-9510-4df74cb87bd7-prometheus-k8s-rulefiles-0\") pod \"3221bef2-54cd-4653-9510-4df74cb87bd7\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " Sep 10 12:49:08.496573 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.496543 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3221bef2-54cd-4653-9510-4df74cb87bd7-configmap-kubelet-serving-ca-bundle\") pod \"3221bef2-54cd-4653-9510-4df74cb87bd7\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " Sep 10 12:49:08.496744 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.496602 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"3221bef2-54cd-4653-9510-4df74cb87bd7\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " Sep 10 12:49:08.496744 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.496628 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3221bef2-54cd-4653-9510-4df74cb87bd7-prometheus-k8s-rulefiles-1\") pod \"3221bef2-54cd-4653-9510-4df74cb87bd7\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " Sep 10 12:49:08.496744 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.496657 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3221bef2-54cd-4653-9510-4df74cb87bd7-prometheus-k8s-db\") pod \"3221bef2-54cd-4653-9510-4df74cb87bd7\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " Sep 10 12:49:08.496744 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.496691 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-secret-metrics-client-certs\") pod \"3221bef2-54cd-4653-9510-4df74cb87bd7\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " Sep 10 12:49:08.496977 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.496761 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3221bef2-54cd-4653-9510-4df74cb87bd7-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "3221bef2-54cd-4653-9510-4df74cb87bd7" (UID: "3221bef2-54cd-4653-9510-4df74cb87bd7"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:49:08.498644 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.497283 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3221bef2-54cd-4653-9510-4df74cb87bd7-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "3221bef2-54cd-4653-9510-4df74cb87bd7" (UID: "3221bef2-54cd-4653-9510-4df74cb87bd7"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:49:08.498644 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.497596 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3221bef2-54cd-4653-9510-4df74cb87bd7-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "3221bef2-54cd-4653-9510-4df74cb87bd7" (UID: "3221bef2-54cd-4653-9510-4df74cb87bd7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:49:08.498644 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.497651 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-thanos-prometheus-http-client-file\") pod \"3221bef2-54cd-4653-9510-4df74cb87bd7\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " Sep 10 12:49:08.498644 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.497689 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"3221bef2-54cd-4653-9510-4df74cb87bd7\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " Sep 10 12:49:08.498644 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.497730 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3221bef2-54cd-4653-9510-4df74cb87bd7-configmap-metrics-client-ca\") pod \"3221bef2-54cd-4653-9510-4df74cb87bd7\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " Sep 10 12:49:08.498644 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.497762 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3221bef2-54cd-4653-9510-4df74cb87bd7-prometheus-k8s-rulefiles-2\") pod \"3221bef2-54cd-4653-9510-4df74cb87bd7\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " Sep 10 12:49:08.498644 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.497796 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-secret-prometheus-k8s-tls\") pod \"3221bef2-54cd-4653-9510-4df74cb87bd7\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " Sep 10 12:49:08.498644 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.497825 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-secret-grpc-tls\") pod \"3221bef2-54cd-4653-9510-4df74cb87bd7\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " Sep 10 12:49:08.498644 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.497849 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3221bef2-54cd-4653-9510-4df74cb87bd7-config-out\") pod \"3221bef2-54cd-4653-9510-4df74cb87bd7\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " Sep 10 12:49:08.498644 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.497884 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3221bef2-54cd-4653-9510-4df74cb87bd7-prometheus-trusted-ca-bundle\") pod \"3221bef2-54cd-4653-9510-4df74cb87bd7\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " Sep 10 12:49:08.498644 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.497908 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-web-config\") pod \"3221bef2-54cd-4653-9510-4df74cb87bd7\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " Sep 10 12:49:08.498644 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.497939 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3221bef2-54cd-4653-9510-4df74cb87bd7-tls-assets\") pod \"3221bef2-54cd-4653-9510-4df74cb87bd7\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " Sep 10 12:49:08.498644 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.497985 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-config\") pod \"3221bef2-54cd-4653-9510-4df74cb87bd7\" (UID: \"3221bef2-54cd-4653-9510-4df74cb87bd7\") " Sep 10 12:49:08.498644 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.498484 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3221bef2-54cd-4653-9510-4df74cb87bd7-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" Sep 10 12:49:08.498644 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.498504 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3221bef2-54cd-4653-9510-4df74cb87bd7-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" Sep 10 12:49:08.498644 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.498518 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3221bef2-54cd-4653-9510-4df74cb87bd7-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" Sep 10 12:49:08.499510 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.498819 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3221bef2-54cd-4653-9510-4df74cb87bd7-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "3221bef2-54cd-4653-9510-4df74cb87bd7" (UID: "3221bef2-54cd-4653-9510-4df74cb87bd7"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:49:08.499510 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.499138 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3221bef2-54cd-4653-9510-4df74cb87bd7-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "3221bef2-54cd-4653-9510-4df74cb87bd7" (UID: "3221bef2-54cd-4653-9510-4df74cb87bd7"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:49:08.499510 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.499272 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3221bef2-54cd-4653-9510-4df74cb87bd7-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "3221bef2-54cd-4653-9510-4df74cb87bd7" (UID: "3221bef2-54cd-4653-9510-4df74cb87bd7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:49:08.500663 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.500320 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3221bef2-54cd-4653-9510-4df74cb87bd7-kube-api-access-5nbbg" (OuterVolumeSpecName: "kube-api-access-5nbbg") pod "3221bef2-54cd-4653-9510-4df74cb87bd7" (UID: "3221bef2-54cd-4653-9510-4df74cb87bd7"). InnerVolumeSpecName "kube-api-access-5nbbg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:49:08.500663 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.500390 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "3221bef2-54cd-4653-9510-4df74cb87bd7" (UID: "3221bef2-54cd-4653-9510-4df74cb87bd7"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:49:08.500663 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.500442 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "3221bef2-54cd-4653-9510-4df74cb87bd7" (UID: "3221bef2-54cd-4653-9510-4df74cb87bd7"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:49:08.500663 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.500521 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3221bef2-54cd-4653-9510-4df74cb87bd7-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "3221bef2-54cd-4653-9510-4df74cb87bd7" (UID: "3221bef2-54cd-4653-9510-4df74cb87bd7"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:49:08.501291 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.501050 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3221bef2-54cd-4653-9510-4df74cb87bd7-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "3221bef2-54cd-4653-9510-4df74cb87bd7" (UID: "3221bef2-54cd-4653-9510-4df74cb87bd7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:49:08.504365 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.504330 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "3221bef2-54cd-4653-9510-4df74cb87bd7" (UID: "3221bef2-54cd-4653-9510-4df74cb87bd7"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:49:08.504777 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.504750 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "3221bef2-54cd-4653-9510-4df74cb87bd7" (UID: "3221bef2-54cd-4653-9510-4df74cb87bd7"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:49:08.504865 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.504808 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-config" (OuterVolumeSpecName: "config") pod "3221bef2-54cd-4653-9510-4df74cb87bd7" (UID: "3221bef2-54cd-4653-9510-4df74cb87bd7"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:49:08.505058 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.505021 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3221bef2-54cd-4653-9510-4df74cb87bd7-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "3221bef2-54cd-4653-9510-4df74cb87bd7" (UID: "3221bef2-54cd-4653-9510-4df74cb87bd7"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:49:08.505135 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.505082 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "3221bef2-54cd-4653-9510-4df74cb87bd7" (UID: "3221bef2-54cd-4653-9510-4df74cb87bd7"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:49:08.505260 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.505235 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3221bef2-54cd-4653-9510-4df74cb87bd7-config-out" (OuterVolumeSpecName: "config-out") pod "3221bef2-54cd-4653-9510-4df74cb87bd7" (UID: "3221bef2-54cd-4653-9510-4df74cb87bd7"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:49:08.505726 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.505700 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "3221bef2-54cd-4653-9510-4df74cb87bd7" (UID: "3221bef2-54cd-4653-9510-4df74cb87bd7"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:49:08.506456 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.506430 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "3221bef2-54cd-4653-9510-4df74cb87bd7" (UID: "3221bef2-54cd-4653-9510-4df74cb87bd7"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:49:08.519888 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.519830 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-web-config" (OuterVolumeSpecName: "web-config") pod "3221bef2-54cd-4653-9510-4df74cb87bd7" (UID: "3221bef2-54cd-4653-9510-4df74cb87bd7"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:49:08.599323 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.599287 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" Sep 10 12:49:08.599323 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.599319 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3221bef2-54cd-4653-9510-4df74cb87bd7-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" Sep 10 12:49:08.599323 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.599333 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3221bef2-54cd-4653-9510-4df74cb87bd7-prometheus-k8s-db\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" Sep 10 12:49:08.599588 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.599345 2577 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-secret-metrics-client-certs\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" Sep 10 12:49:08.599588 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.599359 2577 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" Sep 10 12:49:08.599588 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.599372 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" Sep 10 12:49:08.599588 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.599383 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3221bef2-54cd-4653-9510-4df74cb87bd7-configmap-metrics-client-ca\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" Sep 10 12:49:08.599588 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.599394 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3221bef2-54cd-4653-9510-4df74cb87bd7-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" Sep 10 12:49:08.599588 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.599406 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" Sep 10 12:49:08.599588 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.599417 2577 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-secret-grpc-tls\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" Sep 10 12:49:08.599588 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.599428 2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3221bef2-54cd-4653-9510-4df74cb87bd7-config-out\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" Sep 10 12:49:08.599588 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.599438 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3221bef2-54cd-4653-9510-4df74cb87bd7-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" Sep 10 12:49:08.599588 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.599451 2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-web-config\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" Sep 10 12:49:08.599588 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.599464 2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3221bef2-54cd-4653-9510-4df74cb87bd7-tls-assets\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" Sep 10 12:49:08.599588 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.599475 2577 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-config\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" Sep 10 12:49:08.599588 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.599485 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5nbbg\" (UniqueName: \"kubernetes.io/projected/3221bef2-54cd-4653-9510-4df74cb87bd7-kube-api-access-5nbbg\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" Sep 10 12:49:08.599588 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:08.599496 2577 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3221bef2-54cd-4653-9510-4df74cb87bd7-secret-kube-rbac-proxy\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" Sep 10 12:49:09.377706 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.377668 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3221bef2-54cd-4653-9510-4df74cb87bd7","Type":"ContainerDied","Data":"326fce80c8c413a6662f2b58251668e286216308b56aa9ac2ca2fa7bddb2eb30"} Sep 10 12:49:09.378214 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.377728 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.378214 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.377759 2577 scope.go:117] "RemoveContainer" containerID="301a57a2d4889c110ad6a382ee5120b9d3327e05a2c8d4c7bc80415c57f3934c" Sep 10 12:49:09.385812 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.385790 2577 scope.go:117] "RemoveContainer" containerID="b54f93e0c57b8c93358aca23936b7d574c89c228ea564a9514071604d0ecac3f" Sep 10 12:49:09.393777 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.393761 2577 scope.go:117] "RemoveContainer" containerID="b9146567acc10e034786f006490ea89220f5235645ca60c64502e41a09588223" Sep 10 12:49:09.400500 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.400483 2577 scope.go:117] "RemoveContainer" containerID="30cb8f131017f7117ead78f46f6b90e2cb952e2c1cebd2b3caaf3d0f0705eb8d" Sep 10 12:49:09.407113 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.407094 2577 scope.go:117] "RemoveContainer" containerID="fe56f89086bc91b4685ca18cf59faf14de1ef8214b04ed413ec95c5bf07d7698" Sep 10 12:49:09.413870 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.413848 2577 scope.go:117] "RemoveContainer" containerID="36ed9912dbdd1b01c6c8e8db933c30ce74d18e6dcff60099ae3738c75ef87a35" Sep 10 12:49:09.419427 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.419400 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 12:49:09.423126 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.423108 2577 scope.go:117] "RemoveContainer" containerID="068756dd792be28c71c83bc82258ad481b6d9f14b86a822f91580b5fee093aa1" Sep 10 12:49:09.424224 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.424202 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 12:49:09.481554 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.481472 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 12:49:09.481776 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.481764 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3221bef2-54cd-4653-9510-4df74cb87bd7" containerName="kube-rbac-proxy-web" Sep 10 12:49:09.481816 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.481778 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3221bef2-54cd-4653-9510-4df74cb87bd7" containerName="kube-rbac-proxy-web" Sep 10 12:49:09.481816 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.481789 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3221bef2-54cd-4653-9510-4df74cb87bd7" containerName="prometheus" Sep 10 12:49:09.481816 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.481796 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3221bef2-54cd-4653-9510-4df74cb87bd7" containerName="prometheus" Sep 10 12:49:09.481816 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.481807 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3221bef2-54cd-4653-9510-4df74cb87bd7" containerName="init-config-reloader" Sep 10 12:49:09.481816 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.481813 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3221bef2-54cd-4653-9510-4df74cb87bd7" containerName="init-config-reloader" Sep 10 12:49:09.481964 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.481822 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3221bef2-54cd-4653-9510-4df74cb87bd7" containerName="kube-rbac-proxy" Sep 10 12:49:09.481964 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.481827 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3221bef2-54cd-4653-9510-4df74cb87bd7" containerName="kube-rbac-proxy" Sep 10 12:49:09.481964 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.481834 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3221bef2-54cd-4653-9510-4df74cb87bd7" containerName="config-reloader" Sep 10 12:49:09.481964 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.481839 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3221bef2-54cd-4653-9510-4df74cb87bd7" containerName="config-reloader" Sep 10 12:49:09.481964 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.481850 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3221bef2-54cd-4653-9510-4df74cb87bd7" containerName="kube-rbac-proxy-thanos" Sep 10 12:49:09.481964 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.481855 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3221bef2-54cd-4653-9510-4df74cb87bd7" containerName="kube-rbac-proxy-thanos" Sep 10 12:49:09.481964 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.481866 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3221bef2-54cd-4653-9510-4df74cb87bd7" containerName="thanos-sidecar" Sep 10 12:49:09.481964 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.481871 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3221bef2-54cd-4653-9510-4df74cb87bd7" containerName="thanos-sidecar" Sep 10 12:49:09.481964 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.481914 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3221bef2-54cd-4653-9510-4df74cb87bd7" containerName="config-reloader" Sep 10 12:49:09.481964 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.481923 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3221bef2-54cd-4653-9510-4df74cb87bd7" containerName="thanos-sidecar" Sep 10 12:49:09.481964 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.481930 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3221bef2-54cd-4653-9510-4df74cb87bd7" containerName="prometheus" Sep 10 12:49:09.481964 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.481935 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3221bef2-54cd-4653-9510-4df74cb87bd7" containerName="kube-rbac-proxy-web" Sep 10 12:49:09.481964 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.481941 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3221bef2-54cd-4653-9510-4df74cb87bd7" containerName="kube-rbac-proxy-thanos" Sep 10 12:49:09.481964 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.481948 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3221bef2-54cd-4653-9510-4df74cb87bd7" containerName="kube-rbac-proxy" Sep 10 12:49:09.487261 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.487238 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.494097 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.494076 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 10 12:49:09.494263 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.494097 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 10 12:49:09.494899 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.494883 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 10 12:49:09.497053 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.497026 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3221bef2-54cd-4653-9510-4df74cb87bd7" path="/var/lib/kubelet/pods/3221bef2-54cd-4653-9510-4df74cb87bd7/volumes" Sep 10 12:49:09.497303 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.497288 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 10 12:49:09.497374 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.497328 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 10 12:49:09.497587 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.497550 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 10 12:49:09.497913 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.497894 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 10 12:49:09.497913 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.497908 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 10 12:49:09.498065 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.497977 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 10 12:49:09.509703 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.509673 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 10 12:49:09.510493 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.510477 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2ep2jdkisslq2\"" Sep 10 12:49:09.516314 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.516290 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 10 12:49:09.518890 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.518871 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 10 12:49:09.518967 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.518890 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-mwzhm\"" Sep 10 12:49:09.520281 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.520265 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 10 12:49:09.529379 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.529346 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 10 12:49:09.532127 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.532105 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 12:49:09.539551 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.539530 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 10 12:49:09.608317 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.608275 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fe64b28e-fac3-4edc-befe-bb299bc643a9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.608317 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.608317 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fe64b28e-fac3-4edc-befe-bb299bc643a9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.608547 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.608355 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fe64b28e-fac3-4edc-befe-bb299bc643a9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.608547 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.608391 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fe64b28e-fac3-4edc-befe-bb299bc643a9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.608547 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.608426 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fe64b28e-fac3-4edc-befe-bb299bc643a9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.608547 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.608461 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fe64b28e-fac3-4edc-befe-bb299bc643a9-config-out\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.608547 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.608489 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fe64b28e-fac3-4edc-befe-bb299bc643a9-config\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.608547 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.608504 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe64b28e-fac3-4edc-befe-bb299bc643a9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.608547 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.608531 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fe64b28e-fac3-4edc-befe-bb299bc643a9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.608547 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.608548 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fe64b28e-fac3-4edc-befe-bb299bc643a9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.608865 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.608568 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fe64b28e-fac3-4edc-befe-bb299bc643a9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.608865 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.608644 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fe64b28e-fac3-4edc-befe-bb299bc643a9-web-config\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.608865 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.608669 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fe64b28e-fac3-4edc-befe-bb299bc643a9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.608865 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.608692 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fe64b28e-fac3-4edc-befe-bb299bc643a9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.608865 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.608712 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe64b28e-fac3-4edc-befe-bb299bc643a9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.608865 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.608728 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9rmw\" (UniqueName: \"kubernetes.io/projected/fe64b28e-fac3-4edc-befe-bb299bc643a9-kube-api-access-c9rmw\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.608865 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.608758 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fe64b28e-fac3-4edc-befe-bb299bc643a9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.608865 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.608783 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe64b28e-fac3-4edc-befe-bb299bc643a9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.608865 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.608833 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe64b28e-fac3-4edc-befe-bb299bc643a9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.609165 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.608908 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fe64b28e-fac3-4edc-befe-bb299bc643a9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.709681 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.709641 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fe64b28e-fac3-4edc-befe-bb299bc643a9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.709681 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.709681 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fe64b28e-fac3-4edc-befe-bb299bc643a9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.709955 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.709700 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fe64b28e-fac3-4edc-befe-bb299bc643a9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.709955 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.709717 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fe64b28e-fac3-4edc-befe-bb299bc643a9-web-config\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.709955 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.709927 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fe64b28e-fac3-4edc-befe-bb299bc643a9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.710107 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.709983 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fe64b28e-fac3-4edc-befe-bb299bc643a9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.710107 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.710017 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe64b28e-fac3-4edc-befe-bb299bc643a9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.710107 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.710046 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9rmw\" (UniqueName: \"kubernetes.io/projected/fe64b28e-fac3-4edc-befe-bb299bc643a9-kube-api-access-c9rmw\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.710107 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.710097 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fe64b28e-fac3-4edc-befe-bb299bc643a9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.710388 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.710170 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe64b28e-fac3-4edc-befe-bb299bc643a9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.710388 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.710216 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe64b28e-fac3-4edc-befe-bb299bc643a9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.710388 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.710314 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fe64b28e-fac3-4edc-befe-bb299bc643a9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.710388 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.710322 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fe64b28e-fac3-4edc-befe-bb299bc643a9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.710388 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.710349 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fe64b28e-fac3-4edc-befe-bb299bc643a9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.710388 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.710373 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fe64b28e-fac3-4edc-befe-bb299bc643a9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.710712 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.710408 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fe64b28e-fac3-4edc-befe-bb299bc643a9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.710712 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.710432 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fe64b28e-fac3-4edc-befe-bb299bc643a9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.710712 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.710458 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fe64b28e-fac3-4edc-befe-bb299bc643a9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.710712 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.710509 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fe64b28e-fac3-4edc-befe-bb299bc643a9-config-out\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.710712 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.710545 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fe64b28e-fac3-4edc-befe-bb299bc643a9-config\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.710712 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.710573 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe64b28e-fac3-4edc-befe-bb299bc643a9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.711418 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.711391 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe64b28e-fac3-4edc-befe-bb299bc643a9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.711522 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.711466 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fe64b28e-fac3-4edc-befe-bb299bc643a9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.711783 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.710947 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe64b28e-fac3-4edc-befe-bb299bc643a9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.712805 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.712438 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fe64b28e-fac3-4edc-befe-bb299bc643a9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.714046 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.713652 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fe64b28e-fac3-4edc-befe-bb299bc643a9-web-config\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.714046 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.713840 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe64b28e-fac3-4edc-befe-bb299bc643a9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.714046 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.713896 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fe64b28e-fac3-4edc-befe-bb299bc643a9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.714046 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.713933 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe64b28e-fac3-4edc-befe-bb299bc643a9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.714046 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.713994 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fe64b28e-fac3-4edc-befe-bb299bc643a9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.714406 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.714136 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fe64b28e-fac3-4edc-befe-bb299bc643a9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.714469 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.714403 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fe64b28e-fac3-4edc-befe-bb299bc643a9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.714469 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.714422 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fe64b28e-fac3-4edc-befe-bb299bc643a9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.715008 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.714983 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fe64b28e-fac3-4edc-befe-bb299bc643a9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.715398 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.715371 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fe64b28e-fac3-4edc-befe-bb299bc643a9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.715622 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.715603 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fe64b28e-fac3-4edc-befe-bb299bc643a9-config-out\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.716366 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.716345 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fe64b28e-fac3-4edc-befe-bb299bc643a9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.716474 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.716456 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fe64b28e-fac3-4edc-befe-bb299bc643a9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.716829 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.716814 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/fe64b28e-fac3-4edc-befe-bb299bc643a9-config\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.719211 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.719193 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9rmw\" (UniqueName: \"kubernetes.io/projected/fe64b28e-fac3-4edc-befe-bb299bc643a9-kube-api-access-c9rmw\") pod \"prometheus-k8s-0\" (UID: \"fe64b28e-fac3-4edc-befe-bb299bc643a9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:09.797118 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:09.797082 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:49:10.085974 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:10.085902 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 12:49:10.088764 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:49:10.088739 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe64b28e_fac3_4edc_befe_bb299bc643a9.slice/crio-e4981eef8a8371c68a1b370c2aab4fe3699d14651d69a5b3181d209c59454548 WatchSource:0}: Error finding container e4981eef8a8371c68a1b370c2aab4fe3699d14651d69a5b3181d209c59454548: Status 404 returned error can't find the container with id e4981eef8a8371c68a1b370c2aab4fe3699d14651d69a5b3181d209c59454548 Sep 10 12:49:10.383312 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:10.383221 2577 generic.go:356] "Generic (PLEG): container finished" podID="fe64b28e-fac3-4edc-befe-bb299bc643a9" containerID="8055e4df673759fc6b0ea9cc9e72e66985c54a59073a373f4fc01fb00b5267ae" exitCode=0 Sep 10 12:49:10.383714 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:10.383306 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe64b28e-fac3-4edc-befe-bb299bc643a9","Type":"ContainerDied","Data":"8055e4df673759fc6b0ea9cc9e72e66985c54a59073a373f4fc01fb00b5267ae"} Sep 10 12:49:10.383714 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:10.383391 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe64b28e-fac3-4edc-befe-bb299bc643a9","Type":"ContainerStarted","Data":"e4981eef8a8371c68a1b370c2aab4fe3699d14651d69a5b3181d209c59454548"} Sep 10 12:49:11.391808 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:11.391769 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe64b28e-fac3-4edc-befe-bb299bc643a9","Type":"ContainerStarted","Data":"ab3657b1e13c683f6dc3ec2f40d0c15280045ca103a0baeeebd14980af48724b"} Sep 10 12:49:11.392271 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:11.391862 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe64b28e-fac3-4edc-befe-bb299bc643a9","Type":"ContainerStarted","Data":"92fde4331e5a794fcd5bd983645ef432808332de8cb41284ffa0019d4f8cc781"} Sep 10 12:49:11.392271 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:11.391888 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe64b28e-fac3-4edc-befe-bb299bc643a9","Type":"ContainerStarted","Data":"dd4bb8dd2bc5ee8edd10d1e9c383edf325be4a83f3c21c40a707714f5208c2d9"} Sep 10 12:49:11.392271 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:11.391915 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe64b28e-fac3-4edc-befe-bb299bc643a9","Type":"ContainerStarted","Data":"97fc6f3a13d2b0e322f0a89e7a52f2f9a2e41fdfd024a44b168662c26ce99391"} Sep 10 12:49:11.392271 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:11.391940 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe64b28e-fac3-4edc-befe-bb299bc643a9","Type":"ContainerStarted","Data":"ff2a09b7f3901788a2694d25f905cd74af757a1dc1810c63e33a94bc548eecb8"} Sep 10 12:49:11.392271 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:11.391962 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe64b28e-fac3-4edc-befe-bb299bc643a9","Type":"ContainerStarted","Data":"e46056c9647fd9225fe04916194b2dc9ca544621c51b9d24a60d652d13764310"} Sep 10 12:49:11.430222 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:11.430160 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.410441696 podStartE2EDuration="2.430122753s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.681057ms" isStatefulPod=false podCreationTimestamp="2026-09-10 12:49:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:49:11.428862286 +0000 UTC m=+210.461475084" watchObservedRunningTime="2026-09-10 12:49:11.430122753 +0000 UTC m=+210.462735531" Sep 10 12:49:14.797965 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:49:14.797924 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:50:09.797608 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:50:09.797504 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:50:09.813238 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:50:09.813210 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:50:10.642702 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:50:10.642674 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:50:41.366511 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:50:41.366482 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-dvf22_765454f6-c879-42b5-8e20-f19a691f6a34/console-operator/2.log" Sep 10 12:50:41.367096 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:50:41.367041 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-dvf22_765454f6-c879-42b5-8e20-f19a691f6a34/console-operator/2.log" Sep 10 12:50:41.377082 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:50:41.377062 2577 kubelet.go:1648] "Image garbage collection succeeded" Sep 10 12:53:28.530770 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:53:28.530732 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-6468cb556d-swg4k"] Sep 10 12:53:28.534079 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:53:28.534062 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-6468cb556d-swg4k" Sep 10 12:53:28.537688 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:53:28.537663 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Sep 10 12:53:28.538297 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:53:28.538274 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Sep 10 12:53:28.538486 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:53:28.538342 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 10 12:53:28.538616 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:53:28.538593 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 10 12:53:28.539332 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:53:28.539313 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-kmmzc\"" Sep 10 12:53:28.548115 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:53:28.548093 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-6468cb556d-swg4k"] Sep 10 12:53:28.584551 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:53:28.584514 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9a6c9f43-3340-45de-90e0-ddafcc346e2a-cert\") pod \"kubeflow-trainer-controller-manager-6468cb556d-swg4k\" (UID: \"9a6c9f43-3340-45de-90e0-ddafcc346e2a\") " pod="opendatahub/kubeflow-trainer-controller-manager-6468cb556d-swg4k" Sep 10 12:53:28.584551 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:53:28.584556 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c922z\" (UniqueName: \"kubernetes.io/projected/9a6c9f43-3340-45de-90e0-ddafcc346e2a-kube-api-access-c922z\") pod \"kubeflow-trainer-controller-manager-6468cb556d-swg4k\" (UID: \"9a6c9f43-3340-45de-90e0-ddafcc346e2a\") " pod="opendatahub/kubeflow-trainer-controller-manager-6468cb556d-swg4k" Sep 10 12:53:28.584771 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:53:28.584577 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/9a6c9f43-3340-45de-90e0-ddafcc346e2a-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-6468cb556d-swg4k\" (UID: \"9a6c9f43-3340-45de-90e0-ddafcc346e2a\") " pod="opendatahub/kubeflow-trainer-controller-manager-6468cb556d-swg4k" Sep 10 12:53:28.685227 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:53:28.685196 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9a6c9f43-3340-45de-90e0-ddafcc346e2a-cert\") pod \"kubeflow-trainer-controller-manager-6468cb556d-swg4k\" (UID: \"9a6c9f43-3340-45de-90e0-ddafcc346e2a\") " pod="opendatahub/kubeflow-trainer-controller-manager-6468cb556d-swg4k" Sep 10 12:53:28.685398 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:53:28.685238 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c922z\" (UniqueName: \"kubernetes.io/projected/9a6c9f43-3340-45de-90e0-ddafcc346e2a-kube-api-access-c922z\") pod \"kubeflow-trainer-controller-manager-6468cb556d-swg4k\" (UID: \"9a6c9f43-3340-45de-90e0-ddafcc346e2a\") " pod="opendatahub/kubeflow-trainer-controller-manager-6468cb556d-swg4k" Sep 10 12:53:28.685398 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:53:28.685256 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/9a6c9f43-3340-45de-90e0-ddafcc346e2a-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-6468cb556d-swg4k\" (UID: \"9a6c9f43-3340-45de-90e0-ddafcc346e2a\") " pod="opendatahub/kubeflow-trainer-controller-manager-6468cb556d-swg4k" Sep 10 12:53:28.686096 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:53:28.686071 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/9a6c9f43-3340-45de-90e0-ddafcc346e2a-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-6468cb556d-swg4k\" (UID: \"9a6c9f43-3340-45de-90e0-ddafcc346e2a\") " pod="opendatahub/kubeflow-trainer-controller-manager-6468cb556d-swg4k" Sep 10 12:53:28.687679 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:53:28.687653 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9a6c9f43-3340-45de-90e0-ddafcc346e2a-cert\") pod \"kubeflow-trainer-controller-manager-6468cb556d-swg4k\" (UID: \"9a6c9f43-3340-45de-90e0-ddafcc346e2a\") " pod="opendatahub/kubeflow-trainer-controller-manager-6468cb556d-swg4k" Sep 10 12:53:28.696474 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:53:28.696446 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c922z\" (UniqueName: \"kubernetes.io/projected/9a6c9f43-3340-45de-90e0-ddafcc346e2a-kube-api-access-c922z\") pod \"kubeflow-trainer-controller-manager-6468cb556d-swg4k\" (UID: \"9a6c9f43-3340-45de-90e0-ddafcc346e2a\") " pod="opendatahub/kubeflow-trainer-controller-manager-6468cb556d-swg4k" Sep 10 12:53:28.857074 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:53:28.856982 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-6468cb556d-swg4k" Sep 10 12:53:29.137397 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:53:29.137311 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-6468cb556d-swg4k"] Sep 10 12:53:29.140287 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:53:29.140261 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9a6c9f43_3340_45de_90e0_ddafcc346e2a.slice/crio-14e1d541e35f0302ba888986c1afc27943900e5707187bc8488814eaf9797fcf WatchSource:0}: Error finding container 14e1d541e35f0302ba888986c1afc27943900e5707187bc8488814eaf9797fcf: Status 404 returned error can't find the container with id 14e1d541e35f0302ba888986c1afc27943900e5707187bc8488814eaf9797fcf Sep 10 12:53:29.142113 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:53:29.142090 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 12:53:29.394502 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:53:29.394418 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-6468cb556d-swg4k" event={"ID":"9a6c9f43-3340-45de-90e0-ddafcc346e2a","Type":"ContainerStarted","Data":"14e1d541e35f0302ba888986c1afc27943900e5707187bc8488814eaf9797fcf"} Sep 10 12:53:32.409558 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:53:32.409521 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-6468cb556d-swg4k" event={"ID":"9a6c9f43-3340-45de-90e0-ddafcc346e2a","Type":"ContainerStarted","Data":"2fd6753082b38c273aea5187bea59c780bd4ac50e3ff0b7852bbb3e3ca5a4ac5"} Sep 10 12:53:32.409959 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:53:32.409649 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-6468cb556d-swg4k" Sep 10 12:53:32.435345 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:53:32.435294 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-6468cb556d-swg4k" podStartSLOduration=1.96546326 podStartE2EDuration="4.435277531s" totalImagesPullingTime="2.469814271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:53:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:53:32.43457242 +0000 UTC m=+471.467185198" watchObservedRunningTime="2026-09-10 12:53:32.435277531 +0000 UTC m=+471.467890329" Sep 10 12:53:48.420072 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:53:48.420038 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-6468cb556d-swg4k" Sep 10 12:54:47.476322 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:54:47.476286 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-5gf6w/progression-enabled-node-0-0-r55xl"] Sep 10 12:54:47.479613 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:54:47.479596 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-5gf6w/progression-enabled-node-0-0-r55xl" Sep 10 12:54:47.484914 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:54:47.484885 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-5gf6w\"/\"openshift-service-ca.crt\"" Sep 10 12:54:47.486965 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:54:47.486945 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-5gf6w\"/\"default-dockercfg-8tzn9\"" Sep 10 12:54:47.487867 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:54:47.487852 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-5gf6w\"/\"kube-root-ca.crt\"" Sep 10 12:54:47.502850 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:54:47.502824 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-5gf6w/progression-enabled-node-0-0-r55xl"] Sep 10 12:54:47.563748 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:54:47.563706 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mqqx\" (UniqueName: \"kubernetes.io/projected/c4bf152f-42ab-4f41-864c-f3d418c729ac-kube-api-access-8mqqx\") pod \"progression-enabled-node-0-0-r55xl\" (UID: \"c4bf152f-42ab-4f41-864c-f3d418c729ac\") " pod="rhai-e2e-progression-5gf6w/progression-enabled-node-0-0-r55xl" Sep 10 12:54:47.664938 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:54:47.664890 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mqqx\" (UniqueName: \"kubernetes.io/projected/c4bf152f-42ab-4f41-864c-f3d418c729ac-kube-api-access-8mqqx\") pod \"progression-enabled-node-0-0-r55xl\" (UID: \"c4bf152f-42ab-4f41-864c-f3d418c729ac\") " pod="rhai-e2e-progression-5gf6w/progression-enabled-node-0-0-r55xl" Sep 10 12:54:47.674427 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:54:47.674384 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mqqx\" (UniqueName: \"kubernetes.io/projected/c4bf152f-42ab-4f41-864c-f3d418c729ac-kube-api-access-8mqqx\") pod \"progression-enabled-node-0-0-r55xl\" (UID: \"c4bf152f-42ab-4f41-864c-f3d418c729ac\") " pod="rhai-e2e-progression-5gf6w/progression-enabled-node-0-0-r55xl" Sep 10 12:54:47.789936 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:54:47.789903 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-5gf6w/progression-enabled-node-0-0-r55xl" Sep 10 12:54:48.063612 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:54:48.063588 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-5gf6w/progression-enabled-node-0-0-r55xl"] Sep 10 12:54:48.066404 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:54:48.066357 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4bf152f_42ab_4f41_864c_f3d418c729ac.slice/crio-5c3972565015e631732be6377714b6672f3b6ec78f6b9e0016191f38b438276f WatchSource:0}: Error finding container 5c3972565015e631732be6377714b6672f3b6ec78f6b9e0016191f38b438276f: Status 404 returned error can't find the container with id 5c3972565015e631732be6377714b6672f3b6ec78f6b9e0016191f38b438276f Sep 10 12:54:48.706467 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:54:48.706419 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-5gf6w/progression-enabled-node-0-0-r55xl" event={"ID":"c4bf152f-42ab-4f41-864c-f3d418c729ac","Type":"ContainerStarted","Data":"5c3972565015e631732be6377714b6672f3b6ec78f6b9e0016191f38b438276f"} Sep 10 12:55:41.404066 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:55:41.404033 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-dvf22_765454f6-c879-42b5-8e20-f19a691f6a34/console-operator/2.log" Sep 10 12:55:41.404066 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:55:41.404064 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-dvf22_765454f6-c879-42b5-8e20-f19a691f6a34/console-operator/2.log" Sep 10 12:56:31.172713 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:56:31.172673 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-5gf6w/progression-enabled-node-0-0-r55xl" event={"ID":"c4bf152f-42ab-4f41-864c-f3d418c729ac","Type":"ContainerStarted","Data":"d2130237056c4556e3c99bd880b07bd066cd89944548c550cbac6587b5089227"} Sep 10 12:56:31.173192 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:56:31.172805 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-5gf6w/progression-enabled-node-0-0-r55xl" Sep 10 12:56:31.205439 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:56:31.205368 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-5gf6w/progression-enabled-node-0-0-r55xl" podStartSLOduration=1.9783702490000001 podStartE2EDuration="1m44.205345073s" totalImagesPullingTime="1m42.226974824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:54:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:56:31.201867645 +0000 UTC m=+650.234480422" watchObservedRunningTime="2026-09-10 12:56:31.205345073 +0000 UTC m=+650.237957852" Sep 10 12:56:32.175767 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:56:32.175733 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-5gf6w/progression-enabled-node-0-0-r55xl" Sep 10 12:56:54.173823 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:56:54.173776 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-5gf6w/progression-enabled-node-0-0-r55xl" podUID="c4bf152f-42ab-4f41-864c-f3d418c729ac" containerName="node" probeResult="failure" output="Get \"http://10.133.0.24:28080/metrics\": dial tcp 10.133.0.24:28080: connect: connection refused" Sep 10 12:56:54.268539 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:56:54.268506 2577 generic.go:356] "Generic (PLEG): container finished" podID="c4bf152f-42ab-4f41-864c-f3d418c729ac" containerID="d2130237056c4556e3c99bd880b07bd066cd89944548c550cbac6587b5089227" exitCode=0 Sep 10 12:56:54.268717 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:56:54.268585 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-5gf6w/progression-enabled-node-0-0-r55xl" event={"ID":"c4bf152f-42ab-4f41-864c-f3d418c729ac","Type":"ContainerDied","Data":"d2130237056c4556e3c99bd880b07bd066cd89944548c550cbac6587b5089227"} Sep 10 12:56:55.418229 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:56:55.418196 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-5gf6w/progression-enabled-node-0-0-r55xl" Sep 10 12:56:55.488315 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:56:55.488272 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mqqx\" (UniqueName: \"kubernetes.io/projected/c4bf152f-42ab-4f41-864c-f3d418c729ac-kube-api-access-8mqqx\") pod \"c4bf152f-42ab-4f41-864c-f3d418c729ac\" (UID: \"c4bf152f-42ab-4f41-864c-f3d418c729ac\") " Sep 10 12:56:55.490506 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:56:55.490476 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4bf152f-42ab-4f41-864c-f3d418c729ac-kube-api-access-8mqqx" (OuterVolumeSpecName: "kube-api-access-8mqqx") pod "c4bf152f-42ab-4f41-864c-f3d418c729ac" (UID: "c4bf152f-42ab-4f41-864c-f3d418c729ac"). InnerVolumeSpecName "kube-api-access-8mqqx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:56:55.589159 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:56:55.589119 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mqqx\" (UniqueName: \"kubernetes.io/projected/c4bf152f-42ab-4f41-864c-f3d418c729ac-kube-api-access-8mqqx\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" Sep 10 12:56:56.276871 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:56:56.276836 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-5gf6w/progression-enabled-node-0-0-r55xl" event={"ID":"c4bf152f-42ab-4f41-864c-f3d418c729ac","Type":"ContainerDied","Data":"5c3972565015e631732be6377714b6672f3b6ec78f6b9e0016191f38b438276f"} Sep 10 12:56:56.276871 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:56:56.276870 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-5gf6w/progression-enabled-node-0-0-r55xl" Sep 10 12:56:56.277094 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:56:56.276885 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5c3972565015e631732be6377714b6672f3b6ec78f6b9e0016191f38b438276f" Sep 10 12:56:57.912650 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:56:57.912611 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-5gf6w/progression-disabled-node-0-0-c2n2w"] Sep 10 12:56:57.913032 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:56:57.912956 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4bf152f-42ab-4f41-864c-f3d418c729ac" containerName="node" Sep 10 12:56:57.913032 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:56:57.912968 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4bf152f-42ab-4f41-864c-f3d418c729ac" containerName="node" Sep 10 12:56:57.913107 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:56:57.913038 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4bf152f-42ab-4f41-864c-f3d418c729ac" containerName="node" Sep 10 12:56:57.929478 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:56:57.929451 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-5gf6w/progression-disabled-node-0-0-c2n2w" Sep 10 12:56:57.931955 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:56:57.931929 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-5gf6w\"/\"kube-root-ca.crt\"" Sep 10 12:56:57.932182 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:56:57.931967 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-5gf6w\"/\"openshift-service-ca.crt\"" Sep 10 12:56:57.932377 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:56:57.931985 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-5gf6w\"/\"default-dockercfg-8tzn9\"" Sep 10 12:56:57.933157 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:56:57.933125 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-5gf6w/progression-disabled-node-0-0-c2n2w"] Sep 10 12:56:58.011841 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:56:58.011801 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsvzz\" (UniqueName: \"kubernetes.io/projected/fa18dbc2-b002-430d-a690-9866ee5d5911-kube-api-access-gsvzz\") pod \"progression-disabled-node-0-0-c2n2w\" (UID: \"fa18dbc2-b002-430d-a690-9866ee5d5911\") " pod="rhai-e2e-progression-5gf6w/progression-disabled-node-0-0-c2n2w" Sep 10 12:56:58.112918 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:56:58.112879 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsvzz\" (UniqueName: \"kubernetes.io/projected/fa18dbc2-b002-430d-a690-9866ee5d5911-kube-api-access-gsvzz\") pod \"progression-disabled-node-0-0-c2n2w\" (UID: \"fa18dbc2-b002-430d-a690-9866ee5d5911\") " pod="rhai-e2e-progression-5gf6w/progression-disabled-node-0-0-c2n2w" Sep 10 12:56:58.122688 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:56:58.122658 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsvzz\" (UniqueName: \"kubernetes.io/projected/fa18dbc2-b002-430d-a690-9866ee5d5911-kube-api-access-gsvzz\") pod \"progression-disabled-node-0-0-c2n2w\" (UID: \"fa18dbc2-b002-430d-a690-9866ee5d5911\") " pod="rhai-e2e-progression-5gf6w/progression-disabled-node-0-0-c2n2w" Sep 10 12:56:58.240340 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:56:58.240248 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-5gf6w/progression-disabled-node-0-0-c2n2w" Sep 10 12:56:58.536703 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:56:58.536672 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-5gf6w/progression-disabled-node-0-0-c2n2w"] Sep 10 12:56:58.540008 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:56:58.539979 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa18dbc2_b002_430d_a690_9866ee5d5911.slice/crio-268b0f846b8de7e14cdf43377b7d461f709a2c60f3e5dbb8ce803b2eb295b9bf WatchSource:0}: Error finding container 268b0f846b8de7e14cdf43377b7d461f709a2c60f3e5dbb8ce803b2eb295b9bf: Status 404 returned error can't find the container with id 268b0f846b8de7e14cdf43377b7d461f709a2c60f3e5dbb8ce803b2eb295b9bf Sep 10 12:56:59.293044 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:56:59.293001 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-5gf6w/progression-disabled-node-0-0-c2n2w" event={"ID":"fa18dbc2-b002-430d-a690-9866ee5d5911","Type":"ContainerStarted","Data":"523102a4ea698064931f1a43e56a67126c0e9f349a4ceb686a2dbce1fd675652"} Sep 10 12:56:59.293629 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:56:59.293071 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-5gf6w/progression-disabled-node-0-0-c2n2w" event={"ID":"fa18dbc2-b002-430d-a690-9866ee5d5911","Type":"ContainerStarted","Data":"268b0f846b8de7e14cdf43377b7d461f709a2c60f3e5dbb8ce803b2eb295b9bf"} Sep 10 12:56:59.293873 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:56:59.293848 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-5gf6w/progression-disabled-node-0-0-c2n2w" Sep 10 12:56:59.325258 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:56:59.325188 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-5gf6w/progression-disabled-node-0-0-c2n2w" podStartSLOduration=2.3251680710000002 podStartE2EDuration="2.325168071s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:56:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:56:59.324076245 +0000 UTC m=+678.356689025" watchObservedRunningTime="2026-09-10 12:56:59.325168071 +0000 UTC m=+678.357780845" Sep 10 12:57:00.301958 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:57:00.297271 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-5gf6w/progression-disabled-node-0-0-c2n2w" Sep 10 12:57:22.294573 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:57:22.294527 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-5gf6w/progression-disabled-node-0-0-c2n2w" podUID="fa18dbc2-b002-430d-a690-9866ee5d5911" containerName="node" probeResult="failure" output="Get \"http://10.133.0.25:28080/metrics\": dial tcp 10.133.0.25:28080: connect: connection refused" Sep 10 12:57:22.388817 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:57:22.388783 2577 generic.go:356] "Generic (PLEG): container finished" podID="fa18dbc2-b002-430d-a690-9866ee5d5911" containerID="523102a4ea698064931f1a43e56a67126c0e9f349a4ceb686a2dbce1fd675652" exitCode=0 Sep 10 12:57:22.388984 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:57:22.388826 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-5gf6w/progression-disabled-node-0-0-c2n2w" event={"ID":"fa18dbc2-b002-430d-a690-9866ee5d5911","Type":"ContainerDied","Data":"523102a4ea698064931f1a43e56a67126c0e9f349a4ceb686a2dbce1fd675652"} Sep 10 12:57:23.526869 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:57:23.526842 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-5gf6w/progression-disabled-node-0-0-c2n2w" Sep 10 12:57:23.634671 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:57:23.634630 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gsvzz\" (UniqueName: \"kubernetes.io/projected/fa18dbc2-b002-430d-a690-9866ee5d5911-kube-api-access-gsvzz\") pod \"fa18dbc2-b002-430d-a690-9866ee5d5911\" (UID: \"fa18dbc2-b002-430d-a690-9866ee5d5911\") " Sep 10 12:57:23.636810 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:57:23.636776 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa18dbc2-b002-430d-a690-9866ee5d5911-kube-api-access-gsvzz" (OuterVolumeSpecName: "kube-api-access-gsvzz") pod "fa18dbc2-b002-430d-a690-9866ee5d5911" (UID: "fa18dbc2-b002-430d-a690-9866ee5d5911"). InnerVolumeSpecName "kube-api-access-gsvzz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:57:23.735472 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:57:23.735387 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gsvzz\" (UniqueName: \"kubernetes.io/projected/fa18dbc2-b002-430d-a690-9866ee5d5911-kube-api-access-gsvzz\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" Sep 10 12:57:24.399138 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:57:24.399109 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-5gf6w/progression-disabled-node-0-0-c2n2w" Sep 10 12:57:24.399138 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:57:24.399118 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-5gf6w/progression-disabled-node-0-0-c2n2w" event={"ID":"fa18dbc2-b002-430d-a690-9866ee5d5911","Type":"ContainerDied","Data":"268b0f846b8de7e14cdf43377b7d461f709a2c60f3e5dbb8ce803b2eb295b9bf"} Sep 10 12:57:24.399390 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:57:24.399181 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="268b0f846b8de7e14cdf43377b7d461f709a2c60f3e5dbb8ce803b2eb295b9bf" Sep 10 12:57:32.888982 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:57:32.888941 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-5gf6w/progression-invalid-node-0-0-qcqmz"] Sep 10 12:57:32.889487 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:57:32.889268 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa18dbc2-b002-430d-a690-9866ee5d5911" containerName="node" Sep 10 12:57:32.889487 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:57:32.889279 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa18dbc2-b002-430d-a690-9866ee5d5911" containerName="node" Sep 10 12:57:32.889487 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:57:32.889352 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa18dbc2-b002-430d-a690-9866ee5d5911" containerName="node" Sep 10 12:57:32.891410 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:57:32.891392 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-5gf6w/progression-invalid-node-0-0-qcqmz" Sep 10 12:57:32.893792 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:57:32.893764 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-5gf6w\"/\"default-dockercfg-8tzn9\"" Sep 10 12:57:32.893915 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:57:32.893819 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-5gf6w\"/\"openshift-service-ca.crt\"" Sep 10 12:57:32.894516 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:57:32.894500 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-5gf6w\"/\"kube-root-ca.crt\"" Sep 10 12:57:32.906401 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:57:32.906375 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-5gf6w/progression-invalid-node-0-0-qcqmz"] Sep 10 12:57:33.010399 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:57:33.010355 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ntfc\" (UniqueName: \"kubernetes.io/projected/ce9d3b63-6635-4cfe-bb6b-7e5bf1eddd8d-kube-api-access-9ntfc\") pod \"progression-invalid-node-0-0-qcqmz\" (UID: \"ce9d3b63-6635-4cfe-bb6b-7e5bf1eddd8d\") " pod="rhai-e2e-progression-5gf6w/progression-invalid-node-0-0-qcqmz" Sep 10 12:57:33.111161 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:57:33.111113 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ntfc\" (UniqueName: \"kubernetes.io/projected/ce9d3b63-6635-4cfe-bb6b-7e5bf1eddd8d-kube-api-access-9ntfc\") pod \"progression-invalid-node-0-0-qcqmz\" (UID: \"ce9d3b63-6635-4cfe-bb6b-7e5bf1eddd8d\") " pod="rhai-e2e-progression-5gf6w/progression-invalid-node-0-0-qcqmz" Sep 10 12:57:33.120502 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:57:33.120476 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ntfc\" (UniqueName: \"kubernetes.io/projected/ce9d3b63-6635-4cfe-bb6b-7e5bf1eddd8d-kube-api-access-9ntfc\") pod \"progression-invalid-node-0-0-qcqmz\" (UID: \"ce9d3b63-6635-4cfe-bb6b-7e5bf1eddd8d\") " pod="rhai-e2e-progression-5gf6w/progression-invalid-node-0-0-qcqmz" Sep 10 12:57:33.200391 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:57:33.200294 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-5gf6w/progression-invalid-node-0-0-qcqmz" Sep 10 12:57:33.475347 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:57:33.475321 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-5gf6w/progression-invalid-node-0-0-qcqmz"] Sep 10 12:57:33.477486 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:57:33.477458 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce9d3b63_6635_4cfe_bb6b_7e5bf1eddd8d.slice/crio-23cc43f2c54ccb29f904de4bc6c7b26fb2adb1e7fa958195e3c4eb058f72fc62 WatchSource:0}: Error finding container 23cc43f2c54ccb29f904de4bc6c7b26fb2adb1e7fa958195e3c4eb058f72fc62: Status 404 returned error can't find the container with id 23cc43f2c54ccb29f904de4bc6c7b26fb2adb1e7fa958195e3c4eb058f72fc62 Sep 10 12:57:34.444969 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:57:34.444930 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-5gf6w/progression-invalid-node-0-0-qcqmz" event={"ID":"ce9d3b63-6635-4cfe-bb6b-7e5bf1eddd8d","Type":"ContainerStarted","Data":"ac99c52634ebb934bdb390d0f102c2def7dd34615620b3b553bebb7760634143"} Sep 10 12:57:34.445403 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:57:34.445011 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-5gf6w/progression-invalid-node-0-0-qcqmz" event={"ID":"ce9d3b63-6635-4cfe-bb6b-7e5bf1eddd8d","Type":"ContainerStarted","Data":"23cc43f2c54ccb29f904de4bc6c7b26fb2adb1e7fa958195e3c4eb058f72fc62"} Sep 10 12:57:34.445403 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:57:34.445057 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-5gf6w/progression-invalid-node-0-0-qcqmz" Sep 10 12:57:34.466566 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:57:34.466496 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-5gf6w/progression-invalid-node-0-0-qcqmz" podStartSLOduration=2.466473254 podStartE2EDuration="2.466473254s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:57:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:57:34.465083092 +0000 UTC m=+713.497695868" watchObservedRunningTime="2026-09-10 12:57:34.466473254 +0000 UTC m=+713.499086033" Sep 10 12:57:35.448638 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:57:35.448597 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-5gf6w/progression-invalid-node-0-0-qcqmz" Sep 10 12:57:56.693646 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:57:56.693598 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-5gf6w/progression-invalid-node-0-0-qcqmz" podUID="ce9d3b63-6635-4cfe-bb6b-7e5bf1eddd8d" containerName="node" probeResult="failure" output="Get \"http://10.133.0.26:28080/metrics\": read tcp 10.133.0.2:43512->10.133.0.26:28080: read: connection reset by peer" Sep 10 12:57:57.446304 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:57:57.446261 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-5gf6w/progression-invalid-node-0-0-qcqmz" podUID="ce9d3b63-6635-4cfe-bb6b-7e5bf1eddd8d" containerName="node" probeResult="failure" output="Get \"http://10.133.0.26:28080/metrics\": dial tcp 10.133.0.26:28080: connect: connection refused" Sep 10 12:57:57.446482 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:57:57.446425 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-5gf6w/progression-invalid-node-0-0-qcqmz" Sep 10 12:57:57.446892 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:57:57.446865 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-5gf6w/progression-invalid-node-0-0-qcqmz" podUID="ce9d3b63-6635-4cfe-bb6b-7e5bf1eddd8d" containerName="node" probeResult="failure" output="Get \"http://10.133.0.26:28080/metrics\": dial tcp 10.133.0.26:28080: connect: connection refused" Sep 10 12:57:57.549098 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:57:57.549065 2577 generic.go:356] "Generic (PLEG): container finished" podID="ce9d3b63-6635-4cfe-bb6b-7e5bf1eddd8d" containerID="ac99c52634ebb934bdb390d0f102c2def7dd34615620b3b553bebb7760634143" exitCode=0 Sep 10 12:57:57.549304 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:57:57.549153 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-5gf6w/progression-invalid-node-0-0-qcqmz" event={"ID":"ce9d3b63-6635-4cfe-bb6b-7e5bf1eddd8d","Type":"ContainerDied","Data":"ac99c52634ebb934bdb390d0f102c2def7dd34615620b3b553bebb7760634143"} Sep 10 12:57:58.686897 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:57:58.686869 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-5gf6w/progression-invalid-node-0-0-qcqmz" Sep 10 12:57:58.845226 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:57:58.845128 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9ntfc\" (UniqueName: \"kubernetes.io/projected/ce9d3b63-6635-4cfe-bb6b-7e5bf1eddd8d-kube-api-access-9ntfc\") pod \"ce9d3b63-6635-4cfe-bb6b-7e5bf1eddd8d\" (UID: \"ce9d3b63-6635-4cfe-bb6b-7e5bf1eddd8d\") " Sep 10 12:57:58.847288 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:57:58.847250 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce9d3b63-6635-4cfe-bb6b-7e5bf1eddd8d-kube-api-access-9ntfc" (OuterVolumeSpecName: "kube-api-access-9ntfc") pod "ce9d3b63-6635-4cfe-bb6b-7e5bf1eddd8d" (UID: "ce9d3b63-6635-4cfe-bb6b-7e5bf1eddd8d"). InnerVolumeSpecName "kube-api-access-9ntfc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:57:58.946235 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:57:58.946194 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9ntfc\" (UniqueName: \"kubernetes.io/projected/ce9d3b63-6635-4cfe-bb6b-7e5bf1eddd8d-kube-api-access-9ntfc\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" Sep 10 12:57:59.558712 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:57:59.558681 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-5gf6w/progression-invalid-node-0-0-qcqmz" Sep 10 12:57:59.558877 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:57:59.558724 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-5gf6w/progression-invalid-node-0-0-qcqmz" event={"ID":"ce9d3b63-6635-4cfe-bb6b-7e5bf1eddd8d","Type":"ContainerDied","Data":"23cc43f2c54ccb29f904de4bc6c7b26fb2adb1e7fa958195e3c4eb058f72fc62"} Sep 10 12:57:59.558877 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:57:59.558768 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="23cc43f2c54ccb29f904de4bc6c7b26fb2adb1e7fa958195e3c4eb058f72fc62" Sep 10 12:59:48.764335 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:59:48.764297 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-5gf6w/progression-no-metrics-node-0-0-9sjd4"] Sep 10 12:59:48.764828 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:59:48.764640 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce9d3b63-6635-4cfe-bb6b-7e5bf1eddd8d" containerName="node" Sep 10 12:59:48.764828 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:59:48.764652 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce9d3b63-6635-4cfe-bb6b-7e5bf1eddd8d" containerName="node" Sep 10 12:59:48.764828 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:59:48.764709 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce9d3b63-6635-4cfe-bb6b-7e5bf1eddd8d" containerName="node" Sep 10 12:59:48.766682 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:59:48.766661 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-5gf6w/progression-no-metrics-node-0-0-9sjd4" Sep 10 12:59:48.768958 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:59:48.768937 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-5gf6w\"/\"kube-root-ca.crt\"" Sep 10 12:59:48.769512 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:59:48.769493 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-5gf6w\"/\"default-dockercfg-8tzn9\"" Sep 10 12:59:48.769622 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:59:48.769492 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-5gf6w\"/\"openshift-service-ca.crt\"" Sep 10 12:59:48.783299 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:59:48.783272 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-5gf6w/progression-no-metrics-node-0-0-9sjd4"] Sep 10 12:59:48.866111 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:59:48.866074 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wt5c\" (UniqueName: \"kubernetes.io/projected/aba1469a-189e-4276-afcc-adb91c2e795d-kube-api-access-5wt5c\") pod \"progression-no-metrics-node-0-0-9sjd4\" (UID: \"aba1469a-189e-4276-afcc-adb91c2e795d\") " pod="rhai-e2e-progression-5gf6w/progression-no-metrics-node-0-0-9sjd4" Sep 10 12:59:48.966612 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:59:48.966572 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wt5c\" (UniqueName: \"kubernetes.io/projected/aba1469a-189e-4276-afcc-adb91c2e795d-kube-api-access-5wt5c\") pod \"progression-no-metrics-node-0-0-9sjd4\" (UID: \"aba1469a-189e-4276-afcc-adb91c2e795d\") " pod="rhai-e2e-progression-5gf6w/progression-no-metrics-node-0-0-9sjd4" Sep 10 12:59:48.975510 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:59:48.975489 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wt5c\" (UniqueName: \"kubernetes.io/projected/aba1469a-189e-4276-afcc-adb91c2e795d-kube-api-access-5wt5c\") pod \"progression-no-metrics-node-0-0-9sjd4\" (UID: \"aba1469a-189e-4276-afcc-adb91c2e795d\") " pod="rhai-e2e-progression-5gf6w/progression-no-metrics-node-0-0-9sjd4" Sep 10 12:59:49.075555 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:59:49.075528 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-5gf6w/progression-no-metrics-node-0-0-9sjd4" Sep 10 12:59:49.345664 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:59:49.345576 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-5gf6w/progression-no-metrics-node-0-0-9sjd4"] Sep 10 12:59:49.348327 ip-10-0-139-146 kubenswrapper[2577]: W0910 12:59:49.348299 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaba1469a_189e_4276_afcc_adb91c2e795d.slice/crio-a7f7f8c34f6bc9ea49bdfc9108cf0ca7a53ba3f867cfb8fbfe9c3be92e17addf WatchSource:0}: Error finding container a7f7f8c34f6bc9ea49bdfc9108cf0ca7a53ba3f867cfb8fbfe9c3be92e17addf: Status 404 returned error can't find the container with id a7f7f8c34f6bc9ea49bdfc9108cf0ca7a53ba3f867cfb8fbfe9c3be92e17addf Sep 10 12:59:50.080356 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:59:50.080319 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-5gf6w/progression-no-metrics-node-0-0-9sjd4" event={"ID":"aba1469a-189e-4276-afcc-adb91c2e795d","Type":"ContainerStarted","Data":"a4181ec6598887938c2b781978216795a8981fcf9fbefba0e9efe60d6d4ba24f"} Sep 10 12:59:50.080749 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:59:50.080374 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-5gf6w/progression-no-metrics-node-0-0-9sjd4" event={"ID":"aba1469a-189e-4276-afcc-adb91c2e795d","Type":"ContainerStarted","Data":"a7f7f8c34f6bc9ea49bdfc9108cf0ca7a53ba3f867cfb8fbfe9c3be92e17addf"} Sep 10 12:59:50.099697 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:59:50.099645 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-5gf6w/progression-no-metrics-node-0-0-9sjd4" podStartSLOduration=2.099627469 podStartE2EDuration="2.099627469s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:59:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:59:50.097699 +0000 UTC m=+849.130311776" watchObservedRunningTime="2026-09-10 12:59:50.099627469 +0000 UTC m=+849.132240283" Sep 10 12:59:55.105306 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:59:55.105271 2577 generic.go:356] "Generic (PLEG): container finished" podID="aba1469a-189e-4276-afcc-adb91c2e795d" containerID="a4181ec6598887938c2b781978216795a8981fcf9fbefba0e9efe60d6d4ba24f" exitCode=0 Sep 10 12:59:55.105691 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:59:55.105342 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-5gf6w/progression-no-metrics-node-0-0-9sjd4" event={"ID":"aba1469a-189e-4276-afcc-adb91c2e795d","Type":"ContainerDied","Data":"a4181ec6598887938c2b781978216795a8981fcf9fbefba0e9efe60d6d4ba24f"} Sep 10 12:59:56.241263 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:59:56.241237 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-5gf6w/progression-no-metrics-node-0-0-9sjd4" Sep 10 12:59:56.331474 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:59:56.331439 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wt5c\" (UniqueName: \"kubernetes.io/projected/aba1469a-189e-4276-afcc-adb91c2e795d-kube-api-access-5wt5c\") pod \"aba1469a-189e-4276-afcc-adb91c2e795d\" (UID: \"aba1469a-189e-4276-afcc-adb91c2e795d\") " Sep 10 12:59:56.333524 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:59:56.333495 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aba1469a-189e-4276-afcc-adb91c2e795d-kube-api-access-5wt5c" (OuterVolumeSpecName: "kube-api-access-5wt5c") pod "aba1469a-189e-4276-afcc-adb91c2e795d" (UID: "aba1469a-189e-4276-afcc-adb91c2e795d"). InnerVolumeSpecName "kube-api-access-5wt5c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:59:56.432301 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:59:56.432216 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5wt5c\" (UniqueName: \"kubernetes.io/projected/aba1469a-189e-4276-afcc-adb91c2e795d-kube-api-access-5wt5c\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" Sep 10 12:59:57.115782 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:59:57.115752 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-5gf6w/progression-no-metrics-node-0-0-9sjd4" Sep 10 12:59:57.115985 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:59:57.115786 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-5gf6w/progression-no-metrics-node-0-0-9sjd4" event={"ID":"aba1469a-189e-4276-afcc-adb91c2e795d","Type":"ContainerDied","Data":"a7f7f8c34f6bc9ea49bdfc9108cf0ca7a53ba3f867cfb8fbfe9c3be92e17addf"} Sep 10 12:59:57.115985 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:59:57.115823 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a7f7f8c34f6bc9ea49bdfc9108cf0ca7a53ba3f867cfb8fbfe9c3be92e17addf" Sep 10 12:59:59.547896 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:59:59.547862 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-z6xzz/must-gather-jsvvm"] Sep 10 12:59:59.548317 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:59:59.548201 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aba1469a-189e-4276-afcc-adb91c2e795d" containerName="node" Sep 10 12:59:59.548317 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:59:59.548212 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="aba1469a-189e-4276-afcc-adb91c2e795d" containerName="node" Sep 10 12:59:59.548317 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:59:59.548269 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="aba1469a-189e-4276-afcc-adb91c2e795d" containerName="node" Sep 10 12:59:59.550302 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:59:59.550279 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z6xzz/must-gather-jsvvm" Sep 10 12:59:59.552884 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:59:59.552864 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-z6xzz\"/\"kube-root-ca.crt\"" Sep 10 12:59:59.553463 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:59:59.553444 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-z6xzz\"/\"openshift-service-ca.crt\"" Sep 10 12:59:59.553561 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:59:59.553444 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-z6xzz\"/\"default-dockercfg-jqls5\"" Sep 10 12:59:59.561807 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:59:59.561773 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z6xzz/must-gather-jsvvm"] Sep 10 12:59:59.661024 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:59:59.660984 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrpkm\" (UniqueName: \"kubernetes.io/projected/0b215ac8-bc1a-4f0f-ba63-469ad252a4e1-kube-api-access-hrpkm\") pod \"must-gather-jsvvm\" (UID: \"0b215ac8-bc1a-4f0f-ba63-469ad252a4e1\") " pod="openshift-must-gather-z6xzz/must-gather-jsvvm" Sep 10 12:59:59.661280 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:59:59.661033 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0b215ac8-bc1a-4f0f-ba63-469ad252a4e1-must-gather-output\") pod \"must-gather-jsvvm\" (UID: \"0b215ac8-bc1a-4f0f-ba63-469ad252a4e1\") " pod="openshift-must-gather-z6xzz/must-gather-jsvvm" Sep 10 12:59:59.762481 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:59:59.762444 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrpkm\" (UniqueName: \"kubernetes.io/projected/0b215ac8-bc1a-4f0f-ba63-469ad252a4e1-kube-api-access-hrpkm\") pod \"must-gather-jsvvm\" (UID: \"0b215ac8-bc1a-4f0f-ba63-469ad252a4e1\") " pod="openshift-must-gather-z6xzz/must-gather-jsvvm" Sep 10 12:59:59.762660 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:59:59.762494 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0b215ac8-bc1a-4f0f-ba63-469ad252a4e1-must-gather-output\") pod \"must-gather-jsvvm\" (UID: \"0b215ac8-bc1a-4f0f-ba63-469ad252a4e1\") " pod="openshift-must-gather-z6xzz/must-gather-jsvvm" Sep 10 12:59:59.762834 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:59:59.762819 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0b215ac8-bc1a-4f0f-ba63-469ad252a4e1-must-gather-output\") pod \"must-gather-jsvvm\" (UID: \"0b215ac8-bc1a-4f0f-ba63-469ad252a4e1\") " pod="openshift-must-gather-z6xzz/must-gather-jsvvm" Sep 10 12:59:59.773718 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:59:59.773695 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrpkm\" (UniqueName: \"kubernetes.io/projected/0b215ac8-bc1a-4f0f-ba63-469ad252a4e1-kube-api-access-hrpkm\") pod \"must-gather-jsvvm\" (UID: \"0b215ac8-bc1a-4f0f-ba63-469ad252a4e1\") " pod="openshift-must-gather-z6xzz/must-gather-jsvvm" Sep 10 12:59:59.865976 ip-10-0-139-146 kubenswrapper[2577]: I0910 12:59:59.865885 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z6xzz/must-gather-jsvvm" Sep 10 13:00:00.139331 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:00:00.139306 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z6xzz/must-gather-jsvvm"] Sep 10 13:00:00.142004 ip-10-0-139-146 kubenswrapper[2577]: W0910 13:00:00.141971 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0b215ac8_bc1a_4f0f_ba63_469ad252a4e1.slice/crio-38d19642e5546355362b3ad55605304cd1a9740adaeed69deb027002546074dc WatchSource:0}: Error finding container 38d19642e5546355362b3ad55605304cd1a9740adaeed69deb027002546074dc: Status 404 returned error can't find the container with id 38d19642e5546355362b3ad55605304cd1a9740adaeed69deb027002546074dc Sep 10 13:00:00.143802 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:00:00.143784 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 13:00:01.139897 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:00:01.139853 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z6xzz/must-gather-jsvvm" event={"ID":"0b215ac8-bc1a-4f0f-ba63-469ad252a4e1","Type":"ContainerStarted","Data":"38d19642e5546355362b3ad55605304cd1a9740adaeed69deb027002546074dc"} Sep 10 13:00:03.812033 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:00:03.811991 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-5gf6w/progression-disabled-node-0-0-c2n2w"] Sep 10 13:00:03.815959 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:00:03.815931 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-5gf6w/progression-disabled-node-0-0-c2n2w"] Sep 10 13:00:03.820704 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:00:03.820676 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-5gf6w/progression-enabled-node-0-0-r55xl"] Sep 10 13:00:03.825900 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:00:03.825867 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-5gf6w/progression-enabled-node-0-0-r55xl"] Sep 10 13:00:03.830890 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:00:03.830864 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-5gf6w/progression-invalid-node-0-0-qcqmz"] Sep 10 13:00:03.838039 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:00:03.838011 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-5gf6w/progression-invalid-node-0-0-qcqmz"] Sep 10 13:00:03.855089 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:00:03.855058 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-5gf6w/progression-no-metrics-node-0-0-9sjd4"] Sep 10 13:00:03.858427 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:00:03.858400 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-5gf6w/progression-no-metrics-node-0-0-9sjd4"] Sep 10 13:00:05.497595 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:00:05.497560 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aba1469a-189e-4276-afcc-adb91c2e795d" path="/var/lib/kubelet/pods/aba1469a-189e-4276-afcc-adb91c2e795d/volumes" Sep 10 13:00:05.498083 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:00:05.498013 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4bf152f-42ab-4f41-864c-f3d418c729ac" path="/var/lib/kubelet/pods/c4bf152f-42ab-4f41-864c-f3d418c729ac/volumes" Sep 10 13:00:05.498395 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:00:05.498376 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce9d3b63-6635-4cfe-bb6b-7e5bf1eddd8d" path="/var/lib/kubelet/pods/ce9d3b63-6635-4cfe-bb6b-7e5bf1eddd8d/volumes" Sep 10 13:00:05.498715 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:00:05.498691 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa18dbc2-b002-430d-a690-9866ee5d5911" path="/var/lib/kubelet/pods/fa18dbc2-b002-430d-a690-9866ee5d5911/volumes" Sep 10 13:00:07.180959 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:00:07.180912 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z6xzz/must-gather-jsvvm" event={"ID":"0b215ac8-bc1a-4f0f-ba63-469ad252a4e1","Type":"ContainerStarted","Data":"0512216f925546f62a4819b6a179eb453878f00d2e5c0e7c961f9430158e1b62"} Sep 10 13:00:07.180959 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:00:07.180967 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z6xzz/must-gather-jsvvm" event={"ID":"0b215ac8-bc1a-4f0f-ba63-469ad252a4e1","Type":"ContainerStarted","Data":"6e64616310098dd3741c825835d34e993136487e3b5f59bad1e041f880cfb42d"} Sep 10 13:00:07.199739 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:00:07.199671 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-z6xzz/must-gather-jsvvm" podStartSLOduration=1.946851486 podStartE2EDuration="8.199652256s" totalImagesPullingTime="6.25280077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:59:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:00:07.199367001 +0000 UTC m=+866.231979779" watchObservedRunningTime="2026-09-10 13:00:07.199652256 +0000 UTC m=+866.232265034" Sep 10 13:00:41.435710 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:00:41.435631 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-dvf22_765454f6-c879-42b5-8e20-f19a691f6a34/console-operator/2.log" Sep 10 13:00:41.436556 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:00:41.436532 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-dvf22_765454f6-c879-42b5-8e20-f19a691f6a34/console-operator/2.log" Sep 10 13:00:56.425699 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:00:56.425663 2577 generic.go:356] "Generic (PLEG): container finished" podID="0b215ac8-bc1a-4f0f-ba63-469ad252a4e1" containerID="6e64616310098dd3741c825835d34e993136487e3b5f59bad1e041f880cfb42d" exitCode=0 Sep 10 13:00:56.426159 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:00:56.425737 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z6xzz/must-gather-jsvvm" event={"ID":"0b215ac8-bc1a-4f0f-ba63-469ad252a4e1","Type":"ContainerDied","Data":"6e64616310098dd3741c825835d34e993136487e3b5f59bad1e041f880cfb42d"} Sep 10 13:00:56.426159 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:00:56.426058 2577 scope.go:117] "RemoveContainer" containerID="6e64616310098dd3741c825835d34e993136487e3b5f59bad1e041f880cfb42d" Sep 10 13:00:57.269794 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:00:57.269758 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-z6xzz_must-gather-jsvvm_0b215ac8-bc1a-4f0f-ba63-469ad252a4e1/gather/0.log" Sep 10 13:01:01.690243 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:01.690203 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nxpwf_2b0dc0a6-6df7-464d-9890-3ee7814c618e/global-pull-secret-syncer/0.log" Sep 10 13:01:01.882620 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:01.882588 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9vttg_f6d266d9-2de4-4b51-9900-20e96cd6f6a7/konnectivity-agent/0.log" Sep 10 13:01:01.969445 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:01.969362 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-146.ec2.internal_28a60915b4725d613f028290262a63dc/haproxy/0.log" Sep 10 13:01:02.621242 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:02.621203 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-z6xzz/must-gather-jsvvm"] Sep 10 13:01:02.621420 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:02.621405 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-z6xzz/must-gather-jsvvm" podUID="0b215ac8-bc1a-4f0f-ba63-469ad252a4e1" containerName="copy" containerID="cri-o://0512216f925546f62a4819b6a179eb453878f00d2e5c0e7c961f9430158e1b62" gracePeriod=2 Sep 10 13:01:02.623625 ip-10-0-139-146 kubenswrapper[2577]: E0910 13:01:02.623593 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-jsvvm\" is forbidden: User \"system:node:ip-10-0-139-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-z6xzz\": no relationship found between node 'ip-10-0-139-146.ec2.internal' and this object" podUID="0b215ac8-bc1a-4f0f-ba63-469ad252a4e1" pod="openshift-must-gather-z6xzz/must-gather-jsvvm" Sep 10 13:01:02.625654 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:02.625085 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-z6xzz/must-gather-jsvvm"] Sep 10 13:01:02.862526 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:02.862502 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-z6xzz_must-gather-jsvvm_0b215ac8-bc1a-4f0f-ba63-469ad252a4e1/copy/0.log" Sep 10 13:01:02.865243 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:02.865223 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z6xzz/must-gather-jsvvm" Sep 10 13:01:02.867293 ip-10-0-139-146 kubenswrapper[2577]: E0910 13:01:02.867269 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-jsvvm\" is forbidden: User \"system:node:ip-10-0-139-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-z6xzz\": no relationship found between node 'ip-10-0-139-146.ec2.internal' and this object" podUID="0b215ac8-bc1a-4f0f-ba63-469ad252a4e1" pod="openshift-must-gather-z6xzz/must-gather-jsvvm" Sep 10 13:01:02.940648 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:02.940565 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hrpkm\" (UniqueName: \"kubernetes.io/projected/0b215ac8-bc1a-4f0f-ba63-469ad252a4e1-kube-api-access-hrpkm\") pod \"0b215ac8-bc1a-4f0f-ba63-469ad252a4e1\" (UID: \"0b215ac8-bc1a-4f0f-ba63-469ad252a4e1\") " Sep 10 13:01:02.940805 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:02.940670 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0b215ac8-bc1a-4f0f-ba63-469ad252a4e1-must-gather-output\") pod \"0b215ac8-bc1a-4f0f-ba63-469ad252a4e1\" (UID: \"0b215ac8-bc1a-4f0f-ba63-469ad252a4e1\") " Sep 10 13:01:02.941930 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:02.941907 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b215ac8-bc1a-4f0f-ba63-469ad252a4e1-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "0b215ac8-bc1a-4f0f-ba63-469ad252a4e1" (UID: "0b215ac8-bc1a-4f0f-ba63-469ad252a4e1"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 13:01:02.942826 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:02.942799 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b215ac8-bc1a-4f0f-ba63-469ad252a4e1-kube-api-access-hrpkm" (OuterVolumeSpecName: "kube-api-access-hrpkm") pod "0b215ac8-bc1a-4f0f-ba63-469ad252a4e1" (UID: "0b215ac8-bc1a-4f0f-ba63-469ad252a4e1"). InnerVolumeSpecName "kube-api-access-hrpkm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 13:01:03.042162 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:03.042105 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrpkm\" (UniqueName: \"kubernetes.io/projected/0b215ac8-bc1a-4f0f-ba63-469ad252a4e1-kube-api-access-hrpkm\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" Sep 10 13:01:03.042162 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:03.042136 2577 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0b215ac8-bc1a-4f0f-ba63-469ad252a4e1-must-gather-output\") on node \"ip-10-0-139-146.ec2.internal\" DevicePath \"\"" Sep 10 13:01:03.458622 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:03.458593 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-z6xzz_must-gather-jsvvm_0b215ac8-bc1a-4f0f-ba63-469ad252a4e1/copy/0.log" Sep 10 13:01:03.458983 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:03.458958 2577 generic.go:356] "Generic (PLEG): container finished" podID="0b215ac8-bc1a-4f0f-ba63-469ad252a4e1" containerID="0512216f925546f62a4819b6a179eb453878f00d2e5c0e7c961f9430158e1b62" exitCode=143 Sep 10 13:01:03.459069 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:03.459008 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z6xzz/must-gather-jsvvm" Sep 10 13:01:03.459069 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:03.459030 2577 scope.go:117] "RemoveContainer" containerID="0512216f925546f62a4819b6a179eb453878f00d2e5c0e7c961f9430158e1b62" Sep 10 13:01:03.461940 ip-10-0-139-146 kubenswrapper[2577]: E0910 13:01:03.461906 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-jsvvm\" is forbidden: User \"system:node:ip-10-0-139-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-z6xzz\": no relationship found between node 'ip-10-0-139-146.ec2.internal' and this object" podUID="0b215ac8-bc1a-4f0f-ba63-469ad252a4e1" pod="openshift-must-gather-z6xzz/must-gather-jsvvm" Sep 10 13:01:03.467302 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:03.467280 2577 scope.go:117] "RemoveContainer" containerID="6e64616310098dd3741c825835d34e993136487e3b5f59bad1e041f880cfb42d" Sep 10 13:01:03.469239 ip-10-0-139-146 kubenswrapper[2577]: E0910 13:01:03.469209 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-jsvvm\" is forbidden: User \"system:node:ip-10-0-139-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-z6xzz\": no relationship found between node 'ip-10-0-139-146.ec2.internal' and this object" podUID="0b215ac8-bc1a-4f0f-ba63-469ad252a4e1" pod="openshift-must-gather-z6xzz/must-gather-jsvvm" Sep 10 13:01:03.479652 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:03.479636 2577 scope.go:117] "RemoveContainer" containerID="0512216f925546f62a4819b6a179eb453878f00d2e5c0e7c961f9430158e1b62" Sep 10 13:01:03.479930 ip-10-0-139-146 kubenswrapper[2577]: E0910 13:01:03.479912 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0512216f925546f62a4819b6a179eb453878f00d2e5c0e7c961f9430158e1b62\": container with ID starting with 0512216f925546f62a4819b6a179eb453878f00d2e5c0e7c961f9430158e1b62 not found: ID does not exist" containerID="0512216f925546f62a4819b6a179eb453878f00d2e5c0e7c961f9430158e1b62" Sep 10 13:01:03.479988 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:03.479936 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0512216f925546f62a4819b6a179eb453878f00d2e5c0e7c961f9430158e1b62"} err="failed to get container status \"0512216f925546f62a4819b6a179eb453878f00d2e5c0e7c961f9430158e1b62\": rpc error: code = NotFound desc = could not find container \"0512216f925546f62a4819b6a179eb453878f00d2e5c0e7c961f9430158e1b62\": container with ID starting with 0512216f925546f62a4819b6a179eb453878f00d2e5c0e7c961f9430158e1b62 not found: ID does not exist" Sep 10 13:01:03.479988 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:03.479951 2577 scope.go:117] "RemoveContainer" containerID="6e64616310098dd3741c825835d34e993136487e3b5f59bad1e041f880cfb42d" Sep 10 13:01:03.480221 ip-10-0-139-146 kubenswrapper[2577]: E0910 13:01:03.480203 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e64616310098dd3741c825835d34e993136487e3b5f59bad1e041f880cfb42d\": container with ID starting with 6e64616310098dd3741c825835d34e993136487e3b5f59bad1e041f880cfb42d not found: ID does not exist" containerID="6e64616310098dd3741c825835d34e993136487e3b5f59bad1e041f880cfb42d" Sep 10 13:01:03.480270 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:03.480228 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e64616310098dd3741c825835d34e993136487e3b5f59bad1e041f880cfb42d"} err="failed to get container status \"6e64616310098dd3741c825835d34e993136487e3b5f59bad1e041f880cfb42d\": rpc error: code = NotFound desc = could not find container \"6e64616310098dd3741c825835d34e993136487e3b5f59bad1e041f880cfb42d\": container with ID starting with 6e64616310098dd3741c825835d34e993136487e3b5f59bad1e041f880cfb42d not found: ID does not exist" Sep 10 13:01:03.496231 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:03.496206 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b215ac8-bc1a-4f0f-ba63-469ad252a4e1" path="/var/lib/kubelet/pods/0b215ac8-bc1a-4f0f-ba63-469ad252a4e1/volumes" Sep 10 13:01:05.403217 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:05.403184 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_aaebd1a9-1e7d-4481-80bc-42065e2e38f3/alertmanager/0.log" Sep 10 13:01:05.467919 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:05.467885 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_aaebd1a9-1e7d-4481-80bc-42065e2e38f3/config-reloader/0.log" Sep 10 13:01:05.515740 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:05.515707 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_aaebd1a9-1e7d-4481-80bc-42065e2e38f3/kube-rbac-proxy-web/0.log" Sep 10 13:01:05.577325 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:05.577293 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_aaebd1a9-1e7d-4481-80bc-42065e2e38f3/kube-rbac-proxy/0.log" Sep 10 13:01:05.626094 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:05.626013 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_aaebd1a9-1e7d-4481-80bc-42065e2e38f3/kube-rbac-proxy-metric/0.log" Sep 10 13:01:05.660833 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:05.660797 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_aaebd1a9-1e7d-4481-80bc-42065e2e38f3/prom-label-proxy/0.log" Sep 10 13:01:05.688836 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:05.688803 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_aaebd1a9-1e7d-4481-80bc-42065e2e38f3/init-config-reloader/0.log" Sep 10 13:01:05.765446 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:05.765421 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-xzssw_f1c08bc4-6f77-4cff-980f-c92aa693df27/kube-state-metrics/0.log" Sep 10 13:01:05.796259 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:05.796222 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-xzssw_f1c08bc4-6f77-4cff-980f-c92aa693df27/kube-rbac-proxy-main/0.log" Sep 10 13:01:05.838547 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:05.838517 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-xzssw_f1c08bc4-6f77-4cff-980f-c92aa693df27/kube-rbac-proxy-self/0.log" Sep 10 13:01:05.937789 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:05.937761 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4tbxj_8f463359-0563-45ff-83ef-eb224c06d1d9/node-exporter/0.log" Sep 10 13:01:05.964101 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:05.964072 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4tbxj_8f463359-0563-45ff-83ef-eb224c06d1d9/kube-rbac-proxy/0.log" Sep 10 13:01:05.989248 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:05.989218 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4tbxj_8f463359-0563-45ff-83ef-eb224c06d1d9/init-textfile/0.log" Sep 10 13:01:06.314856 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:06.314828 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fe64b28e-fac3-4edc-befe-bb299bc643a9/prometheus/0.log" Sep 10 13:01:06.340781 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:06.340754 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fe64b28e-fac3-4edc-befe-bb299bc643a9/config-reloader/0.log" Sep 10 13:01:06.364974 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:06.364941 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fe64b28e-fac3-4edc-befe-bb299bc643a9/thanos-sidecar/0.log" Sep 10 13:01:06.399248 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:06.399217 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fe64b28e-fac3-4edc-befe-bb299bc643a9/kube-rbac-proxy-web/0.log" Sep 10 13:01:06.425832 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:06.425802 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fe64b28e-fac3-4edc-befe-bb299bc643a9/kube-rbac-proxy/0.log" Sep 10 13:01:06.450836 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:06.450808 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fe64b28e-fac3-4edc-befe-bb299bc643a9/kube-rbac-proxy-thanos/0.log" Sep 10 13:01:06.488459 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:06.488434 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fe64b28e-fac3-4edc-befe-bb299bc643a9/init-config-reloader/0.log" Sep 10 13:01:06.531292 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:06.531257 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-vqwkf_4bd832c4-0e62-410c-8bea-c063fc04006e/prometheus-operator/0.log" Sep 10 13:01:06.558242 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:06.558209 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-vqwkf_4bd832c4-0e62-410c-8bea-c063fc04006e/kube-rbac-proxy/0.log" Sep 10 13:01:06.588549 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:06.588466 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-tpxqw_3fd51cb2-2dc9-4317-a503-1926ff0d7bfe/prometheus-operator-admission-webhook/0.log" Sep 10 13:01:08.113189 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:08.113164 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-8j2jv_a2202efa-bdce-43d6-9472-d148b6f085fe/networking-console-plugin/0.log" Sep 10 13:01:08.600080 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:08.600051 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-dvf22_765454f6-c879-42b5-8e20-f19a691f6a34/console-operator/2.log" Sep 10 13:01:08.607628 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:08.607605 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-dvf22_765454f6-c879-42b5-8e20-f19a691f6a34/console-operator/3.log" Sep 10 13:01:09.316391 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:09.316358 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-whz7w/perf-node-gather-daemonset-nxz7x"] Sep 10 13:01:09.316764 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:09.316683 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b215ac8-bc1a-4f0f-ba63-469ad252a4e1" containerName="gather" Sep 10 13:01:09.316764 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:09.316693 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b215ac8-bc1a-4f0f-ba63-469ad252a4e1" containerName="gather" Sep 10 13:01:09.316764 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:09.316720 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b215ac8-bc1a-4f0f-ba63-469ad252a4e1" containerName="copy" Sep 10 13:01:09.316764 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:09.316726 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b215ac8-bc1a-4f0f-ba63-469ad252a4e1" containerName="copy" Sep 10 13:01:09.316893 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:09.316780 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b215ac8-bc1a-4f0f-ba63-469ad252a4e1" containerName="gather" Sep 10 13:01:09.316893 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:09.316788 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b215ac8-bc1a-4f0f-ba63-469ad252a4e1" containerName="copy" Sep 10 13:01:09.319796 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:09.319776 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-whz7w/perf-node-gather-daemonset-nxz7x" Sep 10 13:01:09.322092 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:09.322072 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-whz7w\"/\"default-dockercfg-snlm5\"" Sep 10 13:01:09.322297 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:09.322282 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-whz7w\"/\"openshift-service-ca.crt\"" Sep 10 13:01:09.322765 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:09.322751 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-whz7w\"/\"kube-root-ca.crt\"" Sep 10 13:01:09.330872 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:09.330852 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-whz7w/perf-node-gather-daemonset-nxz7x"] Sep 10 13:01:09.394281 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:09.394247 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cadc5765-6ace-4705-81ce-f2a6e9f89ed8-podres\") pod \"perf-node-gather-daemonset-nxz7x\" (UID: \"cadc5765-6ace-4705-81ce-f2a6e9f89ed8\") " pod="openshift-must-gather-whz7w/perf-node-gather-daemonset-nxz7x" Sep 10 13:01:09.394444 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:09.394298 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cadc5765-6ace-4705-81ce-f2a6e9f89ed8-sys\") pod \"perf-node-gather-daemonset-nxz7x\" (UID: \"cadc5765-6ace-4705-81ce-f2a6e9f89ed8\") " pod="openshift-must-gather-whz7w/perf-node-gather-daemonset-nxz7x" Sep 10 13:01:09.394444 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:09.394396 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cadc5765-6ace-4705-81ce-f2a6e9f89ed8-proc\") pod \"perf-node-gather-daemonset-nxz7x\" (UID: \"cadc5765-6ace-4705-81ce-f2a6e9f89ed8\") " pod="openshift-must-gather-whz7w/perf-node-gather-daemonset-nxz7x" Sep 10 13:01:09.394444 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:09.394420 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cadc5765-6ace-4705-81ce-f2a6e9f89ed8-lib-modules\") pod \"perf-node-gather-daemonset-nxz7x\" (UID: \"cadc5765-6ace-4705-81ce-f2a6e9f89ed8\") " pod="openshift-must-gather-whz7w/perf-node-gather-daemonset-nxz7x" Sep 10 13:01:09.394551 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:09.394495 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26mq9\" (UniqueName: \"kubernetes.io/projected/cadc5765-6ace-4705-81ce-f2a6e9f89ed8-kube-api-access-26mq9\") pod \"perf-node-gather-daemonset-nxz7x\" (UID: \"cadc5765-6ace-4705-81ce-f2a6e9f89ed8\") " pod="openshift-must-gather-whz7w/perf-node-gather-daemonset-nxz7x" Sep 10 13:01:09.494843 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:09.494812 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cadc5765-6ace-4705-81ce-f2a6e9f89ed8-proc\") pod \"perf-node-gather-daemonset-nxz7x\" (UID: \"cadc5765-6ace-4705-81ce-f2a6e9f89ed8\") " pod="openshift-must-gather-whz7w/perf-node-gather-daemonset-nxz7x" Sep 10 13:01:09.494843 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:09.494843 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cadc5765-6ace-4705-81ce-f2a6e9f89ed8-lib-modules\") pod \"perf-node-gather-daemonset-nxz7x\" (UID: \"cadc5765-6ace-4705-81ce-f2a6e9f89ed8\") " pod="openshift-must-gather-whz7w/perf-node-gather-daemonset-nxz7x" Sep 10 13:01:09.495090 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:09.494873 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26mq9\" (UniqueName: \"kubernetes.io/projected/cadc5765-6ace-4705-81ce-f2a6e9f89ed8-kube-api-access-26mq9\") pod \"perf-node-gather-daemonset-nxz7x\" (UID: \"cadc5765-6ace-4705-81ce-f2a6e9f89ed8\") " pod="openshift-must-gather-whz7w/perf-node-gather-daemonset-nxz7x" Sep 10 13:01:09.495090 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:09.494976 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cadc5765-6ace-4705-81ce-f2a6e9f89ed8-podres\") pod \"perf-node-gather-daemonset-nxz7x\" (UID: \"cadc5765-6ace-4705-81ce-f2a6e9f89ed8\") " pod="openshift-must-gather-whz7w/perf-node-gather-daemonset-nxz7x" Sep 10 13:01:09.495090 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:09.494981 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cadc5765-6ace-4705-81ce-f2a6e9f89ed8-proc\") pod \"perf-node-gather-daemonset-nxz7x\" (UID: \"cadc5765-6ace-4705-81ce-f2a6e9f89ed8\") " pod="openshift-must-gather-whz7w/perf-node-gather-daemonset-nxz7x" Sep 10 13:01:09.495090 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:09.495036 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cadc5765-6ace-4705-81ce-f2a6e9f89ed8-lib-modules\") pod \"perf-node-gather-daemonset-nxz7x\" (UID: \"cadc5765-6ace-4705-81ce-f2a6e9f89ed8\") " pod="openshift-must-gather-whz7w/perf-node-gather-daemonset-nxz7x" Sep 10 13:01:09.495284 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:09.495092 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cadc5765-6ace-4705-81ce-f2a6e9f89ed8-podres\") pod \"perf-node-gather-daemonset-nxz7x\" (UID: \"cadc5765-6ace-4705-81ce-f2a6e9f89ed8\") " pod="openshift-must-gather-whz7w/perf-node-gather-daemonset-nxz7x" Sep 10 13:01:09.495284 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:09.495105 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cadc5765-6ace-4705-81ce-f2a6e9f89ed8-sys\") pod \"perf-node-gather-daemonset-nxz7x\" (UID: \"cadc5765-6ace-4705-81ce-f2a6e9f89ed8\") " pod="openshift-must-gather-whz7w/perf-node-gather-daemonset-nxz7x" Sep 10 13:01:09.495284 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:09.495191 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cadc5765-6ace-4705-81ce-f2a6e9f89ed8-sys\") pod \"perf-node-gather-daemonset-nxz7x\" (UID: \"cadc5765-6ace-4705-81ce-f2a6e9f89ed8\") " pod="openshift-must-gather-whz7w/perf-node-gather-daemonset-nxz7x" Sep 10 13:01:09.504052 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:09.504023 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26mq9\" (UniqueName: \"kubernetes.io/projected/cadc5765-6ace-4705-81ce-f2a6e9f89ed8-kube-api-access-26mq9\") pod \"perf-node-gather-daemonset-nxz7x\" (UID: \"cadc5765-6ace-4705-81ce-f2a6e9f89ed8\") " pod="openshift-must-gather-whz7w/perf-node-gather-daemonset-nxz7x" Sep 10 13:01:09.578461 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:09.578385 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-n927p_274481a5-adbe-428d-9381-2a98b78f1f43/volume-data-source-validator/0.log" Sep 10 13:01:09.629373 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:09.629332 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-whz7w/perf-node-gather-daemonset-nxz7x" Sep 10 13:01:09.898012 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:09.897936 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-whz7w/perf-node-gather-daemonset-nxz7x"] Sep 10 13:01:09.901176 ip-10-0-139-146 kubenswrapper[2577]: W0910 13:01:09.901126 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcadc5765_6ace_4705_81ce_f2a6e9f89ed8.slice/crio-da00ebc44b3c6c795142a141d1f98de8f21035c4d9abe3d67497afd50358321b WatchSource:0}: Error finding container da00ebc44b3c6c795142a141d1f98de8f21035c4d9abe3d67497afd50358321b: Status 404 returned error can't find the container with id da00ebc44b3c6c795142a141d1f98de8f21035c4d9abe3d67497afd50358321b Sep 10 13:01:10.495528 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:10.495495 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-whz7w/perf-node-gather-daemonset-nxz7x" event={"ID":"cadc5765-6ace-4705-81ce-f2a6e9f89ed8","Type":"ContainerStarted","Data":"1eadda3bde00b5ce359ad289614916127754b59cad99e507e58d4631d9875a9c"} Sep 10 13:01:10.496006 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:10.495544 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-whz7w/perf-node-gather-daemonset-nxz7x" event={"ID":"cadc5765-6ace-4705-81ce-f2a6e9f89ed8","Type":"ContainerStarted","Data":"da00ebc44b3c6c795142a141d1f98de8f21035c4d9abe3d67497afd50358321b"} Sep 10 13:01:10.496006 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:10.495589 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-whz7w/perf-node-gather-daemonset-nxz7x" Sep 10 13:01:10.511523 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:10.511468 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-whz7w/perf-node-gather-daemonset-nxz7x" podStartSLOduration=1.511449919 podStartE2EDuration="1.511449919s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 13:01:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 13:01:10.511218659 +0000 UTC m=+929.543831432" watchObservedRunningTime="2026-09-10 13:01:10.511449919 +0000 UTC m=+929.544062699" Sep 10 13:01:10.518078 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:10.518050 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pl69q_8bbef592-ec3a-418e-b64f-a783b5205a24/dns/0.log" Sep 10 13:01:10.541106 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:10.541077 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pl69q_8bbef592-ec3a-418e-b64f-a783b5205a24/kube-rbac-proxy/0.log" Sep 10 13:01:10.618595 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:10.618562 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hnwpz_e73d37ca-36d4-43f1-a967-0022bc31cc28/dns-node-resolver/0.log" Sep 10 13:01:11.071989 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:11.071957 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8htgx_32029bf2-b2b1-4a78-ac29-1aa65ee60328/node-ca/0.log" Sep 10 13:01:12.233199 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:12.233165 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qlhzv_29dbffec-6ed7-4409-b5fa-c2a8de733e92/serve-healthcheck-canary/0.log" Sep 10 13:01:12.598613 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:12.598585 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-72gpf_dfd3fa37-09e7-46a1-b67e-57e760dbde61/kube-rbac-proxy/0.log" Sep 10 13:01:12.619937 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:12.619910 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-72gpf_dfd3fa37-09e7-46a1-b67e-57e760dbde61/exporter/0.log" Sep 10 13:01:12.642800 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:12.642769 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-72gpf_dfd3fa37-09e7-46a1-b67e-57e760dbde61/extractor/0.log" Sep 10 13:01:16.508920 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:16.508889 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-whz7w/perf-node-gather-daemonset-nxz7x" Sep 10 13:01:18.474537 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:18.474498 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-g6mq9_29ea1f07-01f3-4c53-b31f-fe44107e44de/kube-storage-version-migrator-operator/1.log" Sep 10 13:01:18.476073 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:18.476039 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-g6mq9_29ea1f07-01f3-4c53-b31f-fe44107e44de/kube-storage-version-migrator-operator/0.log" Sep 10 13:01:19.910758 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:19.910728 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fbs4n_969c2051-92b9-4d3e-85f4-3e6139609dcd/kube-multus-additional-cni-plugins/0.log" Sep 10 13:01:19.977284 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:19.977254 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fbs4n_969c2051-92b9-4d3e-85f4-3e6139609dcd/egress-router-binary-copy/0.log" Sep 10 13:01:20.017893 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:20.017863 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fbs4n_969c2051-92b9-4d3e-85f4-3e6139609dcd/cni-plugins/0.log" Sep 10 13:01:20.081868 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:20.081844 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fbs4n_969c2051-92b9-4d3e-85f4-3e6139609dcd/bond-cni-plugin/0.log" Sep 10 13:01:20.120486 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:20.120458 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fbs4n_969c2051-92b9-4d3e-85f4-3e6139609dcd/routeoverride-cni/0.log" Sep 10 13:01:20.162283 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:20.162193 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fbs4n_969c2051-92b9-4d3e-85f4-3e6139609dcd/whereabouts-cni-bincopy/0.log" Sep 10 13:01:20.211309 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:20.211277 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fbs4n_969c2051-92b9-4d3e-85f4-3e6139609dcd/whereabouts-cni/0.log" Sep 10 13:01:20.541669 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:20.541642 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-g8m8c_3a2efb90-0ec4-4480-b918-1b1cfc03b658/kube-multus/0.log" Sep 10 13:01:20.678404 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:20.678345 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-f9qs9_8c429ad1-3c1f-41a5-9759-671b36d5ee17/network-metrics-daemon/0.log" Sep 10 13:01:20.702393 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:20.702361 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-f9qs9_8c429ad1-3c1f-41a5-9759-671b36d5ee17/kube-rbac-proxy/0.log" Sep 10 13:01:21.782027 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:21.781997 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4sphq_1335b6c2-94c2-40c5-97a0-f588fac570e9/ovn-controller/0.log" Sep 10 13:01:21.802979 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:21.802941 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4sphq_1335b6c2-94c2-40c5-97a0-f588fac570e9/ovn-acl-logging/0.log" Sep 10 13:01:21.836398 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:21.836367 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4sphq_1335b6c2-94c2-40c5-97a0-f588fac570e9/kube-rbac-proxy-node/0.log" Sep 10 13:01:21.870965 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:21.870934 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4sphq_1335b6c2-94c2-40c5-97a0-f588fac570e9/kube-rbac-proxy-ovn-metrics/0.log" Sep 10 13:01:21.910175 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:21.910125 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4sphq_1335b6c2-94c2-40c5-97a0-f588fac570e9/northd/0.log" Sep 10 13:01:21.934816 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:21.934786 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4sphq_1335b6c2-94c2-40c5-97a0-f588fac570e9/nbdb/0.log" Sep 10 13:01:21.961239 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:21.961194 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4sphq_1335b6c2-94c2-40c5-97a0-f588fac570e9/sbdb/0.log" Sep 10 13:01:22.031426 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:22.031393 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4sphq_1335b6c2-94c2-40c5-97a0-f588fac570e9/ovnkube-controller/0.log" Sep 10 13:01:23.315015 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:23.314983 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-qt6gw_9629113a-f227-4d19-a2ce-b9e201dcefbd/network-check-target-container/0.log" Sep 10 13:01:24.318004 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:24.317978 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-rfpgn_a71dc7da-816c-4cae-af16-dbdd1c3805fe/iptables-alerter/0.log" Sep 10 13:01:24.978797 ip-10-0-139-146 kubenswrapper[2577]: I0910 13:01:24.978763 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-kdbsr_7cb323c0-b8cf-40fd-9931-78b8db058640/tuned/0.log"