Sep 07 03:55:58.620537 ip-10-0-143-125 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 07 03:55:58.620550 ip-10-0-143-125 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 07 03:55:58.620562 ip-10-0-143-125 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 07 03:55:58.620933 ip-10-0-143-125 systemd[1]: Failed to start Kubernetes Kubelet. Sep 07 03:56:08.852359 ip-10-0-143-125 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 07 03:56:08.852376 ip-10-0-143-125 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 17cae2fffe1f4ad09dd4a6d49abc69cb -- Sep 07 03:57:46.184256 ip-10-0-143-125 systemd[1]: Starting Kubernetes Kubelet... Sep 07 03:57:46.596406 ip-10-0-143-125 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 07 03:57:46.596406 ip-10-0-143-125 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 07 03:57:46.596406 ip-10-0-143-125 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 07 03:57:46.596406 ip-10-0-143-125 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 07 03:57:46.596406 ip-10-0-143-125 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 07 03:57:46.597404 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.597290 2566 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 07 03:57:46.601842 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.601451 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 03:57:46.601979 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.601967 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 03:57:46.601979 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.601977 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 03:57:46.601979 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.601980 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 03:57:46.602109 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.601983 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 03:57:46.602109 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.601987 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 03:57:46.602109 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.601989 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 03:57:46.602109 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.601992 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 03:57:46.602109 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.601995 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 03:57:46.602109 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.601998 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 03:57:46.602109 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602000 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 03:57:46.602109 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602003 2566 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 03:57:46.602109 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602006 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 03:57:46.602109 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602008 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 03:57:46.602109 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602011 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 03:57:46.602109 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602015 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 03:57:46.602109 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602018 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 03:57:46.602109 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602020 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 03:57:46.602109 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602023 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 03:57:46.602109 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602026 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 03:57:46.602109 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602028 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 03:57:46.602109 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602031 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 03:57:46.602109 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602033 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 03:57:46.602109 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602036 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 03:57:46.602605 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602039 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 03:57:46.602605 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602042 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 03:57:46.602605 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602045 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 03:57:46.602605 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602048 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 03:57:46.602605 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602051 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 03:57:46.602605 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602053 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 03:57:46.602605 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602056 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 03:57:46.602605 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602062 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 03:57:46.602605 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602065 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 03:57:46.602605 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602069 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 03:57:46.602605 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602072 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 03:57:46.602605 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602075 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 03:57:46.602605 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602078 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 03:57:46.602605 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602082 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 03:57:46.602605 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602084 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 03:57:46.602605 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602087 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 03:57:46.602605 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602091 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 03:57:46.602605 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602096 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 03:57:46.603063 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602100 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 03:57:46.603063 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602105 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 03:57:46.603063 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602108 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 03:57:46.603063 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602112 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 03:57:46.603063 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602114 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 03:57:46.603063 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602117 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 03:57:46.603063 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602121 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 03:57:46.603063 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602124 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 03:57:46.603063 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602127 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 03:57:46.603063 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602130 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 03:57:46.603063 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602133 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 03:57:46.603063 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602136 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 03:57:46.603063 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602138 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 03:57:46.603063 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602141 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 03:57:46.603063 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602144 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 03:57:46.603063 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602146 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 03:57:46.603063 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602149 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 03:57:46.603063 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602152 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 03:57:46.603063 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602154 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 03:57:46.603063 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602157 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 03:57:46.603553 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602159 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 03:57:46.603553 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602162 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 03:57:46.603553 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602165 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 03:57:46.603553 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602167 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 03:57:46.603553 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602170 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 03:57:46.603553 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602173 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 03:57:46.603553 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602176 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 03:57:46.603553 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602179 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 03:57:46.603553 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602182 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 03:57:46.603553 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602185 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 03:57:46.603553 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602187 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 03:57:46.603553 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602190 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 03:57:46.603553 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602192 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 03:57:46.603553 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602196 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 03:57:46.603553 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602200 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 03:57:46.603553 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602203 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 03:57:46.603553 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602207 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 03:57:46.603553 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602210 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 03:57:46.603553 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602212 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 03:57:46.604030 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602215 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 03:57:46.604030 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602219 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 03:57:46.604030 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602221 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 03:57:46.604030 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602224 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 03:57:46.604030 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602227 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 03:57:46.604030 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602230 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 03:57:46.604030 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602233 2566 feature_gate.go:328] unrecognized feature gate: Example Sep 07 03:57:46.604030 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602235 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 03:57:46.604030 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602238 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 03:57:46.604030 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602240 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 03:57:46.604030 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602243 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 03:57:46.604030 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602246 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 03:57:46.604030 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602248 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 03:57:46.604030 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602251 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 03:57:46.604030 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602253 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 03:57:46.604030 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602256 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 03:57:46.604030 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602259 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 03:57:46.604030 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.602261 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 03:57:46.604030 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603011 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 03:57:46.604030 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603023 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 03:57:46.604519 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603028 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 03:57:46.604519 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603032 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 03:57:46.604519 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603036 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 03:57:46.604519 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603040 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 03:57:46.604519 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603045 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 03:57:46.604519 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603049 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 03:57:46.604519 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603053 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 03:57:46.604519 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603056 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 03:57:46.604519 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603058 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 03:57:46.604519 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603061 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 03:57:46.604519 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603064 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 03:57:46.604519 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603067 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 03:57:46.604519 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603070 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 03:57:46.604519 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603072 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 03:57:46.604519 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603075 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 03:57:46.604519 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603079 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 03:57:46.604519 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603081 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 03:57:46.604519 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603084 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 03:57:46.604519 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603087 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 03:57:46.604519 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603090 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 03:57:46.605065 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603092 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 03:57:46.605065 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603095 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 03:57:46.605065 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603098 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 03:57:46.605065 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603100 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 03:57:46.605065 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603103 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 03:57:46.605065 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603106 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 03:57:46.605065 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603108 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 03:57:46.605065 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603111 2566 feature_gate.go:328] unrecognized feature gate: Example Sep 07 03:57:46.605065 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603114 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 03:57:46.605065 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603116 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 03:57:46.605065 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603119 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 03:57:46.605065 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603122 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 03:57:46.605065 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603125 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 03:57:46.605065 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603128 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 03:57:46.605065 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603131 2566 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 03:57:46.605065 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603133 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 03:57:46.605065 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603136 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 03:57:46.605065 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603138 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 03:57:46.605065 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603141 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 03:57:46.605065 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603143 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 03:57:46.605554 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603146 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 03:57:46.605554 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603149 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 03:57:46.605554 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603153 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 03:57:46.605554 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603158 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 03:57:46.605554 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603162 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 03:57:46.605554 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603165 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 03:57:46.605554 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603170 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 03:57:46.605554 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603176 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 03:57:46.605554 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603183 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 03:57:46.605554 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603186 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 03:57:46.605554 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603189 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 03:57:46.605554 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603191 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 03:57:46.605554 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603194 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 03:57:46.605554 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603197 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 03:57:46.605554 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603200 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 03:57:46.605554 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603202 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 03:57:46.605554 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603205 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 03:57:46.605554 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603208 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 03:57:46.605554 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603211 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 03:57:46.605554 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603213 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 03:57:46.606057 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603216 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 03:57:46.606057 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603218 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 03:57:46.606057 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603221 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 03:57:46.606057 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603224 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 03:57:46.606057 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603226 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 03:57:46.606057 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603230 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 03:57:46.606057 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603233 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 03:57:46.606057 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603235 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 03:57:46.606057 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603238 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 03:57:46.606057 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603240 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 03:57:46.606057 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603243 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 03:57:46.606057 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603246 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 03:57:46.606057 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603248 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 03:57:46.606057 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603251 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 03:57:46.606057 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603253 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 03:57:46.606057 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603255 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 03:57:46.606057 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603258 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 03:57:46.606057 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603260 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 03:57:46.606057 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603263 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 03:57:46.606512 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603266 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 03:57:46.606512 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603268 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 03:57:46.606512 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603271 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 03:57:46.606512 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603274 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 03:57:46.606512 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603277 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 03:57:46.606512 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603279 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 03:57:46.606512 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603282 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 03:57:46.606512 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603285 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 03:57:46.606512 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603287 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 03:57:46.606512 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603290 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 03:57:46.606512 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603294 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 03:57:46.606512 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603297 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 03:57:46.606512 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603300 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 03:57:46.606512 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603304 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 03:57:46.606512 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603307 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 03:57:46.606512 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603310 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 03:57:46.606512 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603312 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 03:57:46.606512 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603315 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 03:57:46.606512 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603687 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 03:57:46.606996 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603692 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 03:57:46.606996 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603695 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 03:57:46.606996 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603698 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 03:57:46.606996 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603702 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 03:57:46.606996 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603706 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 03:57:46.606996 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603709 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 03:57:46.606996 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603713 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 03:57:46.606996 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603716 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 03:57:46.606996 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603718 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 03:57:46.606996 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603721 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 03:57:46.606996 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603724 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 03:57:46.606996 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603726 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 03:57:46.606996 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603729 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 03:57:46.606996 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603732 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 03:57:46.606996 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603734 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 03:57:46.606996 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603738 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 03:57:46.606996 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603740 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 03:57:46.606996 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603743 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 03:57:46.606996 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603745 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 03:57:46.607448 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603749 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 03:57:46.607448 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603751 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 03:57:46.607448 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603755 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 03:57:46.607448 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603759 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 03:57:46.607448 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603762 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 03:57:46.607448 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603765 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 03:57:46.607448 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603767 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 03:57:46.607448 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603770 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 03:57:46.607448 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603773 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 03:57:46.607448 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603776 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 03:57:46.607448 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603778 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 03:57:46.607448 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603781 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 03:57:46.607448 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603783 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 03:57:46.607448 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603786 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 03:57:46.607448 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603789 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 03:57:46.607448 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603791 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 03:57:46.607448 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603794 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 03:57:46.607448 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603797 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 03:57:46.607448 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603799 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 03:57:46.607448 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603802 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 03:57:46.607962 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603804 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 03:57:46.607962 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603806 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 03:57:46.607962 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603809 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 03:57:46.607962 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603811 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 03:57:46.607962 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603814 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 03:57:46.607962 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603816 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 03:57:46.607962 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603819 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 03:57:46.607962 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603821 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 03:57:46.607962 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603824 2566 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 03:57:46.607962 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603829 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 03:57:46.607962 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603832 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 03:57:46.607962 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603835 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 03:57:46.607962 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603838 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 03:57:46.607962 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603841 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 03:57:46.607962 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603843 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 03:57:46.607962 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603846 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 03:57:46.607962 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603849 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 03:57:46.607962 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603851 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 03:57:46.607962 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603854 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 03:57:46.607962 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603857 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 03:57:46.608458 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603860 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 03:57:46.608458 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603862 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 03:57:46.608458 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603865 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 03:57:46.608458 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603868 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 03:57:46.608458 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603870 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 03:57:46.608458 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603873 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 03:57:46.608458 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603876 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 03:57:46.608458 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603878 2566 feature_gate.go:328] unrecognized feature gate: Example Sep 07 03:57:46.608458 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603881 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 03:57:46.608458 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603883 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 03:57:46.608458 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603886 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 03:57:46.608458 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603889 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 03:57:46.608458 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603905 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 03:57:46.608458 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603908 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 03:57:46.608458 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603911 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 03:57:46.608458 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603914 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 03:57:46.608458 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603917 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 03:57:46.608458 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603919 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 03:57:46.608458 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603922 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 03:57:46.608458 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603924 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 03:57:46.608964 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603927 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 03:57:46.608964 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603930 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 03:57:46.608964 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603933 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 03:57:46.608964 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603936 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 03:57:46.608964 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603939 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 03:57:46.608964 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603942 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 03:57:46.608964 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603945 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 03:57:46.608964 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603947 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 03:57:46.608964 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603950 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 03:57:46.608964 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603953 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 03:57:46.608964 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603956 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 03:57:46.608964 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603958 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 03:57:46.608964 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603961 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 03:57:46.608964 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603963 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 03:57:46.608964 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603966 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 03:57:46.608964 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603968 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 03:57:46.608964 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603971 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 03:57:46.608964 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603973 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 03:57:46.608964 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.603976 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 03:57:46.608964 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604047 2566 flags.go:64] FLAG: --address="0.0.0.0" Sep 07 03:57:46.609526 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604080 2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 07 03:57:46.609526 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604087 2566 flags.go:64] FLAG: --anonymous-auth="true" Sep 07 03:57:46.609526 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604091 2566 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 07 03:57:46.609526 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604095 2566 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 07 03:57:46.609526 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604098 2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 07 03:57:46.609526 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604102 2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 07 03:57:46.609526 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604107 2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 07 03:57:46.609526 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604110 2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 07 03:57:46.609526 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604113 2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 07 03:57:46.609526 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604116 2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 07 03:57:46.609526 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604119 2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 07 03:57:46.609526 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604122 2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 07 03:57:46.609526 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604125 2566 flags.go:64] FLAG: --cgroup-root="" Sep 07 03:57:46.609526 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604128 2566 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 07 03:57:46.609526 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604131 2566 flags.go:64] FLAG: --client-ca-file="" Sep 07 03:57:46.609526 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604135 2566 flags.go:64] FLAG: --cloud-provider="external" Sep 07 03:57:46.609526 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604140 2566 flags.go:64] FLAG: --cluster-dns="[]" Sep 07 03:57:46.609526 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604144 2566 flags.go:64] FLAG: --cluster-domain="" Sep 07 03:57:46.609526 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604147 2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 07 03:57:46.609526 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604150 2566 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 07 03:57:46.609526 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604153 2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 07 03:57:46.609526 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604157 2566 flags.go:64] FLAG: --container-log-max-files="5" Sep 07 03:57:46.609526 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604165 2566 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 07 03:57:46.609526 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604168 2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 07 03:57:46.610128 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604171 2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 07 03:57:46.610128 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604174 2566 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 07 03:57:46.610128 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604177 2566 flags.go:64] FLAG: --contention-profiling="false" Sep 07 03:57:46.610128 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604180 2566 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 07 03:57:46.610128 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604183 2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 07 03:57:46.610128 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604186 2566 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 07 03:57:46.610128 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604189 2566 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 07 03:57:46.610128 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604199 2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 07 03:57:46.610128 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604202 2566 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 07 03:57:46.610128 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604205 2566 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 07 03:57:46.610128 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604208 2566 flags.go:64] FLAG: --enable-load-reader="false" Sep 07 03:57:46.610128 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604211 2566 flags.go:64] FLAG: --enable-server="true" Sep 07 03:57:46.610128 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604213 2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 07 03:57:46.610128 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604218 2566 flags.go:64] FLAG: --event-burst="100" Sep 07 03:57:46.610128 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604221 2566 flags.go:64] FLAG: --event-qps="50" Sep 07 03:57:46.610128 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604224 2566 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 07 03:57:46.610128 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604227 2566 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 07 03:57:46.610128 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604230 2566 flags.go:64] FLAG: --eviction-hard="" Sep 07 03:57:46.610128 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604233 2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 07 03:57:46.610128 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604236 2566 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 07 03:57:46.610128 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604239 2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 07 03:57:46.610128 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604242 2566 flags.go:64] FLAG: --eviction-soft="" Sep 07 03:57:46.610128 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604245 2566 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 07 03:57:46.610128 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604247 2566 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 07 03:57:46.610128 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604252 2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 07 03:57:46.610822 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604255 2566 flags.go:64] FLAG: --experimental-mounter-path="" Sep 07 03:57:46.610822 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604258 2566 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 07 03:57:46.610822 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604260 2566 flags.go:64] FLAG: --fail-swap-on="true" Sep 07 03:57:46.610822 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604263 2566 flags.go:64] FLAG: --feature-gates="" Sep 07 03:57:46.610822 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604267 2566 flags.go:64] FLAG: --file-check-frequency="20s" Sep 07 03:57:46.610822 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604270 2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 07 03:57:46.610822 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604273 2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 07 03:57:46.610822 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604276 2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 07 03:57:46.610822 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604279 2566 flags.go:64] FLAG: --healthz-port="10248" Sep 07 03:57:46.610822 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604282 2566 flags.go:64] FLAG: --help="false" Sep 07 03:57:46.610822 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604285 2566 flags.go:64] FLAG: --hostname-override="ip-10-0-143-125.ec2.internal" Sep 07 03:57:46.610822 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604288 2566 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 07 03:57:46.610822 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604291 2566 flags.go:64] FLAG: --http-check-frequency="20s" Sep 07 03:57:46.610822 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604294 2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 07 03:57:46.610822 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604297 2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 07 03:57:46.610822 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604300 2566 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 07 03:57:46.610822 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604303 2566 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 07 03:57:46.610822 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604306 2566 flags.go:64] FLAG: --image-service-endpoint="" Sep 07 03:57:46.610822 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604308 2566 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 07 03:57:46.610822 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604311 2566 flags.go:64] FLAG: --kube-api-burst="100" Sep 07 03:57:46.610822 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604314 2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 07 03:57:46.610822 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604317 2566 flags.go:64] FLAG: --kube-api-qps="50" Sep 07 03:57:46.610822 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604320 2566 flags.go:64] FLAG: --kube-reserved="" Sep 07 03:57:46.610822 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604323 2566 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 07 03:57:46.611447 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604325 2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 07 03:57:46.611447 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604328 2566 flags.go:64] FLAG: --kubelet-cgroups="" Sep 07 03:57:46.611447 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604331 2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 07 03:57:46.611447 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604334 2566 flags.go:64] FLAG: --lock-file="" Sep 07 03:57:46.611447 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604337 2566 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 07 03:57:46.611447 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604339 2566 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 07 03:57:46.611447 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604342 2566 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 07 03:57:46.611447 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604349 2566 flags.go:64] FLAG: --log-json-split-stream="false" Sep 07 03:57:46.611447 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604352 2566 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 07 03:57:46.611447 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604355 2566 flags.go:64] FLAG: --log-text-split-stream="false" Sep 07 03:57:46.611447 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604358 2566 flags.go:64] FLAG: --logging-format="text" Sep 07 03:57:46.611447 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604360 2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 07 03:57:46.611447 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604364 2566 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 07 03:57:46.611447 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604366 2566 flags.go:64] FLAG: --manifest-url="" Sep 07 03:57:46.611447 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604371 2566 flags.go:64] FLAG: --manifest-url-header="" Sep 07 03:57:46.611447 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604375 2566 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 07 03:57:46.611447 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604377 2566 flags.go:64] FLAG: --max-open-files="1000000" Sep 07 03:57:46.611447 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604381 2566 flags.go:64] FLAG: --max-pods="110" Sep 07 03:57:46.611447 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604384 2566 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 07 03:57:46.611447 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604387 2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 07 03:57:46.611447 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604390 2566 flags.go:64] FLAG: --memory-manager-policy="None" Sep 07 03:57:46.611447 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604393 2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 07 03:57:46.611447 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604395 2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 07 03:57:46.611447 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604398 2566 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 07 03:57:46.611447 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604401 2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 07 03:57:46.612078 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604408 2566 flags.go:64] FLAG: --node-status-max-images="50" Sep 07 03:57:46.612078 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604411 2566 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 07 03:57:46.612078 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604414 2566 flags.go:64] FLAG: --oom-score-adj="-999" Sep 07 03:57:46.612078 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604417 2566 flags.go:64] FLAG: --pod-cidr="" Sep 07 03:57:46.612078 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604419 2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 07 03:57:46.612078 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604424 2566 flags.go:64] FLAG: --pod-manifest-path="" Sep 07 03:57:46.612078 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604427 2566 flags.go:64] FLAG: --pod-max-pids="-1" Sep 07 03:57:46.612078 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604430 2566 flags.go:64] FLAG: --pods-per-core="0" Sep 07 03:57:46.612078 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604433 2566 flags.go:64] FLAG: --port="10250" Sep 07 03:57:46.612078 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604436 2566 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 07 03:57:46.612078 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604439 2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-046032cd74ab26574" Sep 07 03:57:46.612078 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604442 2566 flags.go:64] FLAG: --qos-reserved="" Sep 07 03:57:46.612078 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604444 2566 flags.go:64] FLAG: --read-only-port="10255" Sep 07 03:57:46.612078 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604447 2566 flags.go:64] FLAG: --register-node="true" Sep 07 03:57:46.612078 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604450 2566 flags.go:64] FLAG: --register-with-taints="" Sep 07 03:57:46.612078 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604457 2566 flags.go:64] FLAG: --registry-burst="10" Sep 07 03:57:46.612078 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604460 2566 flags.go:64] FLAG: --registry-qps="5" Sep 07 03:57:46.612078 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604463 2566 flags.go:64] FLAG: --reserved-cpus="" Sep 07 03:57:46.612078 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604466 2566 flags.go:64] FLAG: --reserved-memory="" Sep 07 03:57:46.612078 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604470 2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 07 03:57:46.612078 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604473 2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 07 03:57:46.612078 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604477 2566 flags.go:64] FLAG: --rotate-certificates="false" Sep 07 03:57:46.612078 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604480 2566 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 07 03:57:46.612078 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604482 2566 flags.go:64] FLAG: --runonce="false" Sep 07 03:57:46.612078 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604485 2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 07 03:57:46.612693 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604488 2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 07 03:57:46.612693 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604491 2566 flags.go:64] FLAG: --seccomp-default="false" Sep 07 03:57:46.612693 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604494 2566 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 07 03:57:46.612693 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604497 2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 07 03:57:46.612693 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604499 2566 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 07 03:57:46.612693 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604502 2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 07 03:57:46.612693 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604505 2566 flags.go:64] FLAG: --storage-driver-password="root" Sep 07 03:57:46.612693 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604508 2566 flags.go:64] FLAG: --storage-driver-secure="false" Sep 07 03:57:46.612693 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604511 2566 flags.go:64] FLAG: --storage-driver-table="stats" Sep 07 03:57:46.612693 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604514 2566 flags.go:64] FLAG: --storage-driver-user="root" Sep 07 03:57:46.612693 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604517 2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 07 03:57:46.612693 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604520 2566 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 07 03:57:46.612693 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604523 2566 flags.go:64] FLAG: --system-cgroups="" Sep 07 03:57:46.612693 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604526 2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 07 03:57:46.612693 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604531 2566 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 07 03:57:46.612693 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604534 2566 flags.go:64] FLAG: --tls-cert-file="" Sep 07 03:57:46.612693 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604537 2566 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 07 03:57:46.612693 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604541 2566 flags.go:64] FLAG: --tls-min-version="" Sep 07 03:57:46.612693 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604543 2566 flags.go:64] FLAG: --tls-private-key-file="" Sep 07 03:57:46.612693 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604546 2566 flags.go:64] FLAG: --topology-manager-policy="none" Sep 07 03:57:46.612693 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604549 2566 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 07 03:57:46.612693 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604552 2566 flags.go:64] FLAG: --topology-manager-scope="container" Sep 07 03:57:46.612693 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604556 2566 flags.go:64] FLAG: --v="2" Sep 07 03:57:46.612693 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604560 2566 flags.go:64] FLAG: --version="false" Sep 07 03:57:46.612693 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604564 2566 flags.go:64] FLAG: --vmodule="" Sep 07 03:57:46.613350 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604568 2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 07 03:57:46.613350 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.604571 2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 07 03:57:46.613350 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604679 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 03:57:46.613350 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604685 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 03:57:46.613350 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604688 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 03:57:46.613350 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604691 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 03:57:46.613350 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604695 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 03:57:46.613350 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604699 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 03:57:46.613350 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604702 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 03:57:46.613350 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604705 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 03:57:46.613350 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604708 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 03:57:46.613350 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604711 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 03:57:46.613350 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604714 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 03:57:46.613350 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604717 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 03:57:46.613350 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604719 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 03:57:46.613350 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604722 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 03:57:46.613350 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604725 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 03:57:46.613350 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604728 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 03:57:46.613350 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604732 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 03:57:46.613815 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604735 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 03:57:46.613815 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604738 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 03:57:46.613815 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604741 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 03:57:46.613815 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604744 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 03:57:46.613815 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604746 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 03:57:46.613815 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604749 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 03:57:46.613815 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604751 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 03:57:46.613815 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604755 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 03:57:46.613815 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604757 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 03:57:46.613815 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604760 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 03:57:46.613815 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604763 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 03:57:46.613815 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604766 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 03:57:46.613815 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604769 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 03:57:46.613815 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604772 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 03:57:46.613815 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604774 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 03:57:46.613815 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604777 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 03:57:46.613815 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604781 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 03:57:46.613815 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604783 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 03:57:46.613815 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604786 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 03:57:46.613815 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604788 2566 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 03:57:46.614389 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604791 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 03:57:46.614389 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604793 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 03:57:46.614389 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604796 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 03:57:46.614389 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604798 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 03:57:46.614389 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604801 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 03:57:46.614389 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604803 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 03:57:46.614389 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604806 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 03:57:46.614389 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604808 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 03:57:46.614389 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604811 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 03:57:46.614389 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604814 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 03:57:46.614389 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604816 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 03:57:46.614389 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604819 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 03:57:46.614389 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604821 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 03:57:46.614389 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604824 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 03:57:46.614389 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604826 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 03:57:46.614389 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604828 2566 feature_gate.go:328] unrecognized feature gate: Example Sep 07 03:57:46.614389 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604831 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 03:57:46.614389 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604834 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 03:57:46.614389 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604836 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 03:57:46.614389 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604839 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 03:57:46.614890 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604841 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 03:57:46.614890 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604844 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 03:57:46.614890 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604847 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 03:57:46.614890 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604851 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 03:57:46.614890 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604854 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 03:57:46.614890 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604857 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 03:57:46.614890 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604868 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 03:57:46.614890 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604871 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 03:57:46.614890 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604875 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 03:57:46.614890 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604878 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 03:57:46.614890 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604881 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 03:57:46.614890 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604883 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 03:57:46.614890 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604886 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 03:57:46.614890 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604889 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 03:57:46.614890 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604904 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 03:57:46.614890 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604907 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 03:57:46.614890 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604910 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 03:57:46.614890 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604912 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 03:57:46.614890 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604915 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 03:57:46.615370 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604918 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 03:57:46.615370 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604920 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 03:57:46.615370 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604923 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 03:57:46.615370 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604925 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 03:57:46.615370 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604928 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 03:57:46.615370 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604931 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 03:57:46.615370 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604933 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 03:57:46.615370 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604936 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 03:57:46.615370 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604938 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 03:57:46.615370 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604941 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 03:57:46.615370 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604944 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 03:57:46.615370 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604946 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 03:57:46.615370 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604949 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 03:57:46.615370 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604952 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 03:57:46.615370 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604954 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 03:57:46.615370 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604958 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 03:57:46.615370 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604960 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 03:57:46.615370 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604963 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 03:57:46.615370 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604965 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 03:57:46.615370 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604968 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 03:57:46.615869 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604972 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 03:57:46.615869 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604975 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 03:57:46.615869 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.604978 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 03:57:46.615869 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.606192 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 07 03:57:46.615869 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.612864 2566 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 07 03:57:46.615869 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.612880 2566 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 07 03:57:46.615869 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.612913 2566 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 07 03:57:46.615869 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.612919 2566 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 07 03:57:46.615869 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.612991 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 03:57:46.615869 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.612997 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 03:57:46.615869 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613000 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 03:57:46.615869 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613003 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 03:57:46.615869 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613006 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 03:57:46.615869 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613009 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 03:57:46.615869 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613012 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 03:57:46.616262 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613015 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 03:57:46.616262 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613018 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 03:57:46.616262 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613021 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 03:57:46.616262 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613023 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 03:57:46.616262 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613027 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 03:57:46.616262 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613032 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 03:57:46.616262 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613035 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 03:57:46.616262 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613038 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 03:57:46.616262 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613041 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 03:57:46.616262 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613044 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 03:57:46.616262 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613047 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 03:57:46.616262 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613049 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 03:57:46.616262 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613052 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 03:57:46.616262 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613054 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 03:57:46.616262 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613057 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 03:57:46.616262 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613060 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 03:57:46.616262 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613062 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 03:57:46.616262 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613066 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 03:57:46.616262 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613068 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 03:57:46.616768 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613071 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 03:57:46.616768 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613074 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 03:57:46.616768 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613076 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 03:57:46.616768 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613080 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 03:57:46.616768 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613083 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 03:57:46.616768 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613085 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 03:57:46.616768 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613088 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 03:57:46.616768 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613091 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 03:57:46.616768 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613094 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 03:57:46.616768 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613096 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 03:57:46.616768 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613099 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 03:57:46.616768 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613102 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 03:57:46.616768 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613104 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 03:57:46.616768 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613107 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 03:57:46.616768 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613109 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 03:57:46.616768 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613112 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 03:57:46.616768 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613114 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 03:57:46.616768 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613117 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 03:57:46.616768 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613119 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 03:57:46.616768 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613122 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 03:57:46.617266 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613125 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 03:57:46.617266 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613127 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 03:57:46.617266 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613130 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 03:57:46.617266 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613133 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 03:57:46.617266 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613135 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 03:57:46.617266 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613138 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 03:57:46.617266 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613140 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 03:57:46.617266 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613144 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 03:57:46.617266 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613148 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 03:57:46.617266 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613150 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 03:57:46.617266 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613153 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 03:57:46.617266 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613157 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 03:57:46.617266 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613160 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 03:57:46.617266 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613162 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 03:57:46.617266 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613165 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 03:57:46.617266 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613169 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 03:57:46.617266 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613171 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 03:57:46.617266 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613174 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 03:57:46.617266 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613176 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 03:57:46.617729 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613179 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 03:57:46.617729 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613181 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 03:57:46.617729 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613184 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 03:57:46.617729 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613187 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 03:57:46.617729 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613189 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 03:57:46.617729 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613192 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 03:57:46.617729 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613194 2566 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 03:57:46.617729 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613197 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 03:57:46.617729 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613200 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 03:57:46.617729 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613203 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 03:57:46.617729 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613205 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 03:57:46.617729 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613208 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 03:57:46.617729 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613211 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 03:57:46.617729 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613213 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 03:57:46.617729 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613216 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 03:57:46.617729 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613219 2566 feature_gate.go:328] unrecognized feature gate: Example Sep 07 03:57:46.617729 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613221 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 03:57:46.617729 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613224 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 03:57:46.617729 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613226 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 03:57:46.617729 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613229 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 03:57:46.618296 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613232 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 03:57:46.618296 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613234 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 03:57:46.618296 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613237 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 03:57:46.618296 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613239 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 03:57:46.618296 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613242 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 03:57:46.618296 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613245 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 03:57:46.618296 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613249 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 03:57:46.618296 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613252 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 03:57:46.618296 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613256 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 03:57:46.618296 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613259 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 03:57:46.618296 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613261 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 03:57:46.618296 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613264 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 03:57:46.618296 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613267 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 03:57:46.618296 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613269 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 03:57:46.618655 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.613274 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 07 03:57:46.618655 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613396 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 03:57:46.618655 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613400 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 03:57:46.618655 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613404 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 03:57:46.618655 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613406 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 03:57:46.618655 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613409 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 03:57:46.618655 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613412 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 03:57:46.618655 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613415 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 03:57:46.618655 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613418 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 03:57:46.618655 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613420 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 03:57:46.618655 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613423 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 03:57:46.618655 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613426 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 03:57:46.618655 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613429 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 03:57:46.618655 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613432 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 03:57:46.618655 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613435 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 03:57:46.619050 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613437 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 03:57:46.619050 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613440 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 03:57:46.619050 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613442 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 03:57:46.619050 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613445 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 03:57:46.619050 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613447 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 03:57:46.619050 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613450 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 03:57:46.619050 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613452 2566 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 03:57:46.619050 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613455 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 03:57:46.619050 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613458 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 03:57:46.619050 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613461 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 03:57:46.619050 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613463 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 03:57:46.619050 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613466 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 03:57:46.619050 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613471 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 03:57:46.619050 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613474 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 03:57:46.619050 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613478 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 03:57:46.619050 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613481 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 03:57:46.619050 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613484 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 03:57:46.619050 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613486 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 03:57:46.619050 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613489 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 03:57:46.619050 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613492 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 03:57:46.619533 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613494 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 03:57:46.619533 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613497 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 03:57:46.619533 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613499 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 03:57:46.619533 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613502 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 03:57:46.619533 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613504 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 03:57:46.619533 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613507 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 03:57:46.619533 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613509 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 03:57:46.619533 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613512 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 03:57:46.619533 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613514 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 03:57:46.619533 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613516 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 03:57:46.619533 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613519 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 03:57:46.619533 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613521 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 03:57:46.619533 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613524 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 03:57:46.619533 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613526 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 03:57:46.619533 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613529 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 03:57:46.619533 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613532 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 03:57:46.619533 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613535 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 03:57:46.619533 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613537 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 03:57:46.619533 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613540 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 03:57:46.619533 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613542 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 03:57:46.620028 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613545 2566 feature_gate.go:328] unrecognized feature gate: Example Sep 07 03:57:46.620028 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613547 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 03:57:46.620028 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613550 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 03:57:46.620028 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613553 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 03:57:46.620028 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613556 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 03:57:46.620028 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613558 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 03:57:46.620028 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613561 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 03:57:46.620028 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613563 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 03:57:46.620028 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613566 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 03:57:46.620028 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613568 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 03:57:46.620028 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613571 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 03:57:46.620028 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613574 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 03:57:46.620028 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613576 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 03:57:46.620028 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613579 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 03:57:46.620028 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613581 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 03:57:46.620028 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613585 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 03:57:46.620028 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613589 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 03:57:46.620028 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613591 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 03:57:46.620028 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613594 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 03:57:46.620485 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613597 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 03:57:46.620485 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613599 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 03:57:46.620485 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613602 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 03:57:46.620485 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613604 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 03:57:46.620485 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613607 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 03:57:46.620485 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613609 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 03:57:46.620485 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613612 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 03:57:46.620485 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613615 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 03:57:46.620485 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613617 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 03:57:46.620485 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613620 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 03:57:46.620485 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613622 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 03:57:46.620485 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613625 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 03:57:46.620485 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613627 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 03:57:46.620485 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613629 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 03:57:46.620485 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613632 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 03:57:46.620485 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613634 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 03:57:46.620485 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613638 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 03:57:46.620485 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613641 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 03:57:46.620485 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613643 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 03:57:46.620485 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613646 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 03:57:46.621003 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613648 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 03:57:46.621003 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613652 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 03:57:46.621003 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613655 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 03:57:46.621003 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613658 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 03:57:46.621003 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613661 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 03:57:46.621003 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:46.613664 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 03:57:46.621003 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.613669 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 07 03:57:46.621003 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.613759 2566 server.go:962] "Client rotation is on, will bootstrap in background" Sep 07 03:57:46.621003 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.615706 2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 07 03:57:46.621003 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.616675 2566 server.go:1019] "Starting client certificate rotation" Sep 07 03:57:46.621003 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.616774 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 07 03:57:46.621003 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.616817 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 07 03:57:46.621003 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.618845 2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 07 03:57:46.621323 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.620005 2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 07 03:57:46.630434 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.630333 2566 log.go:25] "Validated CRI v1 runtime API" Sep 07 03:57:46.633120 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.633103 2566 log.go:25] "Validated CRI v1 image API" Sep 07 03:57:46.633890 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.633871 2566 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 07 03:57:46.639273 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.639254 2566 fs.go:135] Filesystem UUIDs: map[1ba7f4d3-ba7c-4ff7-a411-3a6145d9463b:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d9207cf4-56d0-44d8-8972-9c7efc11b62b:/dev/nvme0n1p3] Sep 07 03:57:46.639325 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.639275 2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 07 03:57:46.645673 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.645562 2566 manager.go:216] Machine: {Timestamp:2026-09-07 03:57:46.644004635 +0000 UTC m=+0.341113956 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3108890 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26aa2dd4c459c32977bf2167911a43 SystemUUID:ec26aa2d-d4c4-59c3-2977-bf2167911a43 BootID:17cae2ff-fe1f-4ad0-9dd4-a6d49abc69cb Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2c:ad:e5:cd:a9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2c:ad:e5:cd:a9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6e:ed:d6:d5:9a:0a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 07 03:57:46.645673 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.645666 2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 07 03:57:46.645801 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.645769 2566 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 07 03:57:46.648222 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.648206 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 07 03:57:46.648714 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.648692 2566 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 07 03:57:46.648854 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.648717 2566 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-125.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 07 03:57:46.649359 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.649349 2566 topology_manager.go:138] "Creating topology manager with none policy" Sep 07 03:57:46.649398 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.649362 2566 container_manager_linux.go:309] "Creating device plugin manager" Sep 07 03:57:46.649398 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.649370 2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 07 03:57:46.650015 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.650004 2566 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 07 03:57:46.650732 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.650722 2566 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 07 03:57:46.654385 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.654374 2566 state_mem.go:36] "Initialized new in-memory state store" Sep 07 03:57:46.654506 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.654496 2566 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 07 03:57:46.654547 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.654526 2566 kubelet.go:486] "Attempting to sync node with API server" Sep 07 03:57:46.654547 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.654535 2566 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 07 03:57:46.654634 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.654550 2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 07 03:57:46.654634 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.654560 2566 kubelet.go:398] "Adding apiserver pod source" Sep 07 03:57:46.654634 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.654576 2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 07 03:57:46.654963 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.654952 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 07 03:57:46.654996 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.654969 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 07 03:57:46.656921 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.656887 2566 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 07 03:57:46.659212 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.659198 2566 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 07 03:57:46.659274 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.659228 2566 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 07 03:57:46.660260 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.660248 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 07 03:57:46.660319 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.660267 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 07 03:57:46.660319 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.660276 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 07 03:57:46.660319 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.660283 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 07 03:57:46.660319 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.660295 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 07 03:57:46.660319 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.660303 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 07 03:57:46.660463 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.660322 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 07 03:57:46.660463 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.660329 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 07 03:57:46.660463 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.660340 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 07 03:57:46.660463 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.660348 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 07 03:57:46.660463 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.660360 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 07 03:57:46.660463 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.660370 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 07 03:57:46.660463 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.660399 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 07 03:57:46.660463 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.660406 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 07 03:57:46.662425 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.662403 2566 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-125.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 07 03:57:46.662513 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:46.662442 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 07 03:57:46.664154 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:46.663676 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-125.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 07 03:57:46.665818 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.665803 2566 server.go:1268] "Started kubelet" Sep 07 03:57:46.665920 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.665860 2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 07 03:57:46.666491 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.666425 2566 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 07 03:57:46.666583 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.666518 2566 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 07 03:57:46.666779 ip-10-0-143-125 systemd[1]: Started Kubernetes Kubelet. Sep 07 03:57:46.667602 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.667583 2566 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 07 03:57:46.667812 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.667798 2566 server.go:310] "Adding debug handlers to kubelet server" Sep 07 03:57:46.671103 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:46.671082 2566 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 07 03:57:46.671391 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.671375 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6h8zz" Sep 07 03:57:46.672000 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:46.670269 2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-125.ec2.internal.18d2edccfb5c9c69 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-125.ec2.internal,UID:ip-10-0-143-125.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-125.ec2.internal,},FirstTimestamp:2026-09-07 03:57:46.665770089 +0000 UTC m=+0.362879412,LastTimestamp:2026-09-07 03:57:46.665770089 +0000 UTC m=+0.362879412,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-125.ec2.internal,}" Sep 07 03:57:46.672463 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.672449 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 07 03:57:46.672797 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.672779 2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 07 03:57:46.672920 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:46.672875 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-125.ec2.internal\" not found" Sep 07 03:57:46.673332 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.673272 2566 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 07 03:57:46.673332 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.673282 2566 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 07 03:57:46.673332 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.673295 2566 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 07 03:57:46.673523 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.673403 2566 reconstruct.go:97] "Volume reconstruction finished" Sep 07 03:57:46.673523 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.673410 2566 reconciler.go:29] "Reconciler: start to sync state" Sep 07 03:57:46.673799 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.673787 2566 factory.go:153] Registering CRI-O factory Sep 07 03:57:46.673847 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.673821 2566 factory.go:223] Registration of the crio container factory successfully Sep 07 03:57:46.673908 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.673861 2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 07 03:57:46.673908 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.673869 2566 factory.go:55] Registering systemd factory Sep 07 03:57:46.673908 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.673874 2566 factory.go:223] Registration of the systemd container factory successfully Sep 07 03:57:46.673908 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.673886 2566 factory.go:103] Registering Raw factory Sep 07 03:57:46.673908 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.673912 2566 manager.go:1196] Started watching for new ooms in manager Sep 07 03:57:46.674263 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.674253 2566 manager.go:349] Starting recovery of all containers Sep 07 03:57:46.675367 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:46.675342 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 07 03:57:46.675465 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:46.675444 2566 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-125.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 07 03:57:46.678224 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.678203 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6h8zz" Sep 07 03:57:46.686193 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.686170 2566 manager.go:354] Recovery completed Sep 07 03:57:46.692485 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.692471 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 03:57:46.694357 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.694341 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-125.ec2.internal" event="NodeHasSufficientMemory" Sep 07 03:57:46.694449 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.694369 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-125.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 03:57:46.694449 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.694380 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-125.ec2.internal" event="NodeHasSufficientPID" Sep 07 03:57:46.695691 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.695623 2566 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 07 03:57:46.695691 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.695635 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 03:57:46.695691 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.695637 2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 07 03:57:46.695691 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.695680 2566 state_mem.go:36] "Initialized new in-memory state store" Sep 07 03:57:46.696394 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.696380 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-125.ec2.internal" event="NodeHasSufficientMemory" Sep 07 03:57:46.696460 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.696407 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-125.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 03:57:46.696460 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.696421 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-125.ec2.internal" event="NodeHasSufficientPID" Sep 07 03:57:46.697824 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.697812 2566 policy_none.go:49] "None policy: Start" Sep 07 03:57:46.697875 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.697831 2566 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 07 03:57:46.697875 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.697845 2566 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 07 03:57:46.700003 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.699959 2566 policy_none.go:47] "Start" Sep 07 03:57:46.726611 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.726595 2566 manager.go:337] "Starting Device Plugin manager" Sep 07 03:57:46.745324 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:46.726637 2566 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 07 03:57:46.745324 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.726647 2566 server.go:87] "Starting device plugin registration server" Sep 07 03:57:46.745324 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.726971 2566 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 07 03:57:46.745324 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.726984 2566 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 07 03:57:46.745324 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.727082 2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 07 03:57:46.745324 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.727157 2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 07 03:57:46.745324 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.727163 2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 07 03:57:46.745324 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:46.727632 2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 07 03:57:46.745324 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:46.727676 2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-125.ec2.internal\" not found" Sep 07 03:57:46.803489 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.803449 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 07 03:57:46.804678 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.804654 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 07 03:57:46.804784 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.804704 2566 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 07 03:57:46.804784 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.804727 2566 kubelet.go:2448] "Starting kubelet main sync loop" Sep 07 03:57:46.804784 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:46.804775 2566 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 07 03:57:46.806983 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.806957 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 03:57:46.827999 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.827977 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 03:57:46.828906 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.828878 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-125.ec2.internal" event="NodeHasSufficientMemory" Sep 07 03:57:46.828975 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.828918 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-125.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 03:57:46.828975 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.828929 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-125.ec2.internal" event="NodeHasSufficientPID" Sep 07 03:57:46.828975 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.828952 2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-125.ec2.internal" Sep 07 03:57:46.836741 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.836718 2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-125.ec2.internal" Sep 07 03:57:46.836741 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:46.836742 2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-125.ec2.internal\": node \"ip-10-0-143-125.ec2.internal\" not found" Sep 07 03:57:46.849935 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:46.849843 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-125.ec2.internal\" not found" Sep 07 03:57:46.905770 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.905743 2566 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-125.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-125.ec2.internal"] Sep 07 03:57:46.905870 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.905809 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 03:57:46.906785 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.906769 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-125.ec2.internal" event="NodeHasSufficientMemory" Sep 07 03:57:46.906850 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.906803 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-125.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 03:57:46.906850 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.906817 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-125.ec2.internal" event="NodeHasSufficientPID" Sep 07 03:57:46.909162 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.909150 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 03:57:46.909274 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.909260 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-125.ec2.internal" Sep 07 03:57:46.909334 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.909288 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 03:57:46.909877 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.909859 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-125.ec2.internal" event="NodeHasSufficientMemory" Sep 07 03:57:46.909971 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.909887 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-125.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 03:57:46.909971 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.909914 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-125.ec2.internal" event="NodeHasSufficientPID" Sep 07 03:57:46.909971 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.909863 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-125.ec2.internal" event="NodeHasSufficientMemory" Sep 07 03:57:46.910109 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.909974 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-125.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 03:57:46.910109 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.909992 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-125.ec2.internal" event="NodeHasSufficientPID" Sep 07 03:57:46.912199 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.912184 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-125.ec2.internal" Sep 07 03:57:46.912284 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.912211 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 03:57:46.912846 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.912833 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-125.ec2.internal" event="NodeHasSufficientMemory" Sep 07 03:57:46.912939 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.912860 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-125.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 03:57:46.912939 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.912873 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-125.ec2.internal" event="NodeHasSufficientPID" Sep 07 03:57:46.935423 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:46.935400 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-125.ec2.internal\" not found" node="ip-10-0-143-125.ec2.internal" Sep 07 03:57:46.939773 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:46.939758 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-125.ec2.internal\" not found" node="ip-10-0-143-125.ec2.internal" Sep 07 03:57:46.950698 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:46.950684 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-125.ec2.internal\" not found" Sep 07 03:57:46.975211 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.975190 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ba5931dfbb1cb6ce0bae7ffbbefa796b-config\") pod \"kube-apiserver-proxy-ip-10-0-143-125.ec2.internal\" (UID: \"ba5931dfbb1cb6ce0bae7ffbbefa796b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-125.ec2.internal" Sep 07 03:57:46.975282 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.975213 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f60cefb4c31f4cfc617414d028d68a25-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-125.ec2.internal\" (UID: \"f60cefb4c31f4cfc617414d028d68a25\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-125.ec2.internal" Sep 07 03:57:46.975282 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:46.975232 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f60cefb4c31f4cfc617414d028d68a25-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-125.ec2.internal\" (UID: \"f60cefb4c31f4cfc617414d028d68a25\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-125.ec2.internal" Sep 07 03:57:47.051352 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:47.051324 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-125.ec2.internal\" not found" Sep 07 03:57:47.075680 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:47.075648 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f60cefb4c31f4cfc617414d028d68a25-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-125.ec2.internal\" (UID: \"f60cefb4c31f4cfc617414d028d68a25\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-125.ec2.internal" Sep 07 03:57:47.075765 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:47.075687 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f60cefb4c31f4cfc617414d028d68a25-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-125.ec2.internal\" (UID: \"f60cefb4c31f4cfc617414d028d68a25\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-125.ec2.internal" Sep 07 03:57:47.075765 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:47.075705 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ba5931dfbb1cb6ce0bae7ffbbefa796b-config\") pod \"kube-apiserver-proxy-ip-10-0-143-125.ec2.internal\" (UID: \"ba5931dfbb1cb6ce0bae7ffbbefa796b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-125.ec2.internal" Sep 07 03:57:47.075765 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:47.075739 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ba5931dfbb1cb6ce0bae7ffbbefa796b-config\") pod \"kube-apiserver-proxy-ip-10-0-143-125.ec2.internal\" (UID: \"ba5931dfbb1cb6ce0bae7ffbbefa796b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-125.ec2.internal" Sep 07 03:57:47.075765 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:47.075744 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f60cefb4c31f4cfc617414d028d68a25-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-125.ec2.internal\" (UID: \"f60cefb4c31f4cfc617414d028d68a25\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-125.ec2.internal" Sep 07 03:57:47.075885 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:47.075751 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f60cefb4c31f4cfc617414d028d68a25-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-125.ec2.internal\" (UID: \"f60cefb4c31f4cfc617414d028d68a25\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-125.ec2.internal" Sep 07 03:57:47.152004 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:47.151937 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-125.ec2.internal\" not found" Sep 07 03:57:47.237652 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:47.237614 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-125.ec2.internal" Sep 07 03:57:47.242318 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:47.242297 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-125.ec2.internal" Sep 07 03:57:47.252768 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:47.252750 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-125.ec2.internal\" not found" Sep 07 03:57:47.353316 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:47.353271 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-125.ec2.internal\" not found" Sep 07 03:57:47.453805 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:47.453750 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-125.ec2.internal\" not found" Sep 07 03:57:48.831120 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:48.831086 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-125.ec2.internal\" not found" Sep 07 03:57:48.893568 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:48.893540 2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 07 03:57:48.893982 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:48.893716 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 07 03:57:48.931869 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:48.931836 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-125.ec2.internal\" not found" Sep 07 03:57:48.959952 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:48.959902 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-06 03:52:47 +0000 UTC" deadline="2028-04-22 22:18:49.981573971 +0000 UTC" Sep 07 03:57:48.959952 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:48.959948 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14250h21m1.021629697s" Sep 07 03:57:49.024459 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.024390 2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 03:57:49.032951 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:49.032927 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-125.ec2.internal\" not found" Sep 07 03:57:49.093432 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:49.093265 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf60cefb4c31f4cfc617414d028d68a25.slice/crio-f6e0bdf3afbeee546e53bcd2994cb7cc04b7d8a3b66f4a2e8e7d4af6f3aa8bd3 WatchSource:0}: Error finding container f6e0bdf3afbeee546e53bcd2994cb7cc04b7d8a3b66f4a2e8e7d4af6f3aa8bd3: Status 404 returned error can't find the container with id f6e0bdf3afbeee546e53bcd2994cb7cc04b7d8a3b66f4a2e8e7d4af6f3aa8bd3 Sep 07 03:57:49.093705 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:49.093688 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba5931dfbb1cb6ce0bae7ffbbefa796b.slice/crio-f9ca4a742129093bf368ee717548ef4d7548b24374753529112e932907624d4c WatchSource:0}: Error finding container f9ca4a742129093bf368ee717548ef4d7548b24374753529112e932907624d4c: Status 404 returned error can't find the container with id f9ca4a742129093bf368ee717548ef4d7548b24374753529112e932907624d4c Sep 07 03:57:49.100910 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.100889 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 07 03:57:49.133693 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:49.133663 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-125.ec2.internal\" not found" Sep 07 03:57:49.234154 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:49.234114 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-125.ec2.internal\" not found" Sep 07 03:57:49.334716 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:49.334625 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-125.ec2.internal\" not found" Sep 07 03:57:49.373915 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.373890 2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 03:57:49.381782 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.381759 2566 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 03:57:49.450212 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.450182 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-125.ec2.internal" Sep 07 03:57:49.461027 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.461008 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 07 03:57:49.462058 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.462038 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-125.ec2.internal" Sep 07 03:57:49.469126 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.469107 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 07 03:57:49.905396 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.905366 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 03:57:49.931999 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.931968 2566 apiserver.go:52] "Watching apiserver" Sep 07 03:57:49.937887 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.937864 2566 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 07 03:57:49.939143 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.939119 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-zz74s","kube-system/kube-apiserver-proxy-ip-10-0-143-125.ec2.internal","openshift-dns/node-resolver-j2xph","openshift-multus/multus-2fxtz","openshift-network-diagnostics/network-check-target-79dgl","openshift-network-operator/iptables-alerter-6bjt9","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnwmn","openshift-cluster-node-tuning-operator/tuned-6rxjb","openshift-image-registry/node-ca-hkdpb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-125.ec2.internal","openshift-multus/multus-additional-cni-plugins-sg6pk","openshift-multus/network-metrics-daemon-bshbg","openshift-ovn-kubernetes/ovnkube-node-f6xmb","kube-system/global-pull-secret-syncer-7gs6n"] Sep 07 03:57:49.941547 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.941504 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnwmn" Sep 07 03:57:49.943494 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.943474 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 07 03:57:49.943599 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.943575 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 07 03:57:49.943680 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.943599 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-l5hz8\"" Sep 07 03:57:49.943680 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.943651 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 07 03:57:49.943981 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.943962 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:49.946042 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.946022 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 07 03:57:49.946138 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.946066 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 07 03:57:49.946497 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.946449 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 07 03:57:49.947199 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.946769 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j2xph" Sep 07 03:57:49.947199 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.946974 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 07 03:57:49.947359 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.947246 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 07 03:57:49.947601 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.947455 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 07 03:57:49.947601 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.947507 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9ppct\"" Sep 07 03:57:49.948930 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.948559 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 07 03:57:49.948930 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.948784 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-t7wm7\"" Sep 07 03:57:49.948930 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.948863 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 07 03:57:49.949340 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.949321 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2fxtz" Sep 07 03:57:49.950190 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.950173 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 07 03:57:49.951221 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.950884 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 07 03:57:49.951221 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.951120 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 07 03:57:49.951221 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.951122 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 07 03:57:49.951737 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.951483 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ctk5z\"" Sep 07 03:57:49.951737 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.951678 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 07 03:57:49.953817 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.953282 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-79dgl" Sep 07 03:57:49.953817 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:49.953375 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-79dgl" podUID="31a21753-1b6d-4d23-a382-b2d0794b9837" Sep 07 03:57:49.956258 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.956238 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6bjt9" Sep 07 03:57:49.957842 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.957821 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 07 03:57:49.958062 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.958038 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 07 03:57:49.958251 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.958233 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 07 03:57:49.958332 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.958290 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5hwcm\"" Sep 07 03:57:49.958676 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.958656 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hkdpb" Sep 07 03:57:49.960147 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.960123 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f6840b8-fcfe-4c33-8275-80fd1864e452-host-slash\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:49.960235 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.960168 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d84c7c95-f426-47f3-82ce-19f90665ec16-device-dir\") pod \"aws-ebs-csi-driver-node-jnwmn\" (UID: \"d84c7c95-f426-47f3-82ce-19f90665ec16\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnwmn" Sep 07 03:57:49.960235 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.960195 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d84c7c95-f426-47f3-82ce-19f90665ec16-etc-selinux\") pod \"aws-ebs-csi-driver-node-jnwmn\" (UID: \"d84c7c95-f426-47f3-82ce-19f90665ec16\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnwmn" Sep 07 03:57:49.960235 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.960222 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7f6840b8-fcfe-4c33-8275-80fd1864e452-run-systemd\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:49.960358 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.960245 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f6840b8-fcfe-4c33-8275-80fd1864e452-run-openvswitch\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:49.960358 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.960265 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7f6840b8-fcfe-4c33-8275-80fd1864e452-node-log\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:49.960358 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.960288 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d84c7c95-f426-47f3-82ce-19f90665ec16-sys-fs\") pod \"aws-ebs-csi-driver-node-jnwmn\" (UID: \"d84c7c95-f426-47f3-82ce-19f90665ec16\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnwmn" Sep 07 03:57:49.960358 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.960311 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7f6840b8-fcfe-4c33-8275-80fd1864e452-host-cni-bin\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:49.960358 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.960333 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7f6840b8-fcfe-4c33-8275-80fd1864e452-ovn-node-metrics-cert\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:49.960358 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.960355 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cfn4\" (UniqueName: \"kubernetes.io/projected/7f6840b8-fcfe-4c33-8275-80fd1864e452-kube-api-access-4cfn4\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:49.960564 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.960376 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d5c78be9-7199-4898-8b64-335079a42ce2-hosts-file\") pod \"node-resolver-j2xph\" (UID: \"d5c78be9-7199-4898-8b64-335079a42ce2\") " pod="openshift-dns/node-resolver-j2xph" Sep 07 03:57:49.960564 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.960398 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjn7k\" (UniqueName: \"kubernetes.io/projected/d5c78be9-7199-4898-8b64-335079a42ce2-kube-api-access-kjn7k\") pod \"node-resolver-j2xph\" (UID: \"d5c78be9-7199-4898-8b64-335079a42ce2\") " pod="openshift-dns/node-resolver-j2xph" Sep 07 03:57:49.960564 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.960423 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/550f6b92-213b-4ca0-9324-1fdf41107530-system-cni-dir\") pod \"multus-2fxtz\" (UID: \"550f6b92-213b-4ca0-9324-1fdf41107530\") " pod="openshift-multus/multus-2fxtz" Sep 07 03:57:49.960564 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.960480 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/550f6b92-213b-4ca0-9324-1fdf41107530-hostroot\") pod \"multus-2fxtz\" (UID: \"550f6b92-213b-4ca0-9324-1fdf41107530\") " pod="openshift-multus/multus-2fxtz" Sep 07 03:57:49.960564 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.960506 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d84c7c95-f426-47f3-82ce-19f90665ec16-registration-dir\") pod \"aws-ebs-csi-driver-node-jnwmn\" (UID: \"d84c7c95-f426-47f3-82ce-19f90665ec16\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnwmn" Sep 07 03:57:49.960564 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.960530 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f6840b8-fcfe-4c33-8275-80fd1864e452-host-kubelet\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:49.960564 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.960555 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7f6840b8-fcfe-4c33-8275-80fd1864e452-host-cni-netd\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:49.960886 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.960583 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f6840b8-fcfe-4c33-8275-80fd1864e452-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:49.960886 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.960611 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/550f6b92-213b-4ca0-9324-1fdf41107530-host-run-k8s-cni-cncf-io\") pod \"multus-2fxtz\" (UID: \"550f6b92-213b-4ca0-9324-1fdf41107530\") " pod="openshift-multus/multus-2fxtz" Sep 07 03:57:49.960886 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.960670 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/550f6b92-213b-4ca0-9324-1fdf41107530-etc-kubernetes\") pod \"multus-2fxtz\" (UID: \"550f6b92-213b-4ca0-9324-1fdf41107530\") " pod="openshift-multus/multus-2fxtz" Sep 07 03:57:49.960886 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.960696 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cr7h\" (UniqueName: \"kubernetes.io/projected/31a21753-1b6d-4d23-a382-b2d0794b9837-kube-api-access-4cr7h\") pod \"network-check-target-79dgl\" (UID: \"31a21753-1b6d-4d23-a382-b2d0794b9837\") " pod="openshift-network-diagnostics/network-check-target-79dgl" Sep 07 03:57:49.960886 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.960722 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d84c7c95-f426-47f3-82ce-19f90665ec16-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jnwmn\" (UID: \"d84c7c95-f426-47f3-82ce-19f90665ec16\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnwmn" Sep 07 03:57:49.960886 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.960746 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/550f6b92-213b-4ca0-9324-1fdf41107530-host-var-lib-cni-bin\") pod \"multus-2fxtz\" (UID: \"550f6b92-213b-4ca0-9324-1fdf41107530\") " pod="openshift-multus/multus-2fxtz" Sep 07 03:57:49.960886 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.960768 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/550f6b92-213b-4ca0-9324-1fdf41107530-multus-daemon-config\") pod \"multus-2fxtz\" (UID: \"550f6b92-213b-4ca0-9324-1fdf41107530\") " pod="openshift-multus/multus-2fxtz" Sep 07 03:57:49.960886 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.960790 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/550f6b92-213b-4ca0-9324-1fdf41107530-host-run-multus-certs\") pod \"multus-2fxtz\" (UID: \"550f6b92-213b-4ca0-9324-1fdf41107530\") " pod="openshift-multus/multus-2fxtz" Sep 07 03:57:49.960886 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.960828 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7f6840b8-fcfe-4c33-8275-80fd1864e452-systemd-units\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:49.960886 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.960856 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f6840b8-fcfe-4c33-8275-80fd1864e452-var-lib-openvswitch\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:49.961356 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.960952 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f6840b8-fcfe-4c33-8275-80fd1864e452-etc-openvswitch\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:49.961356 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.960985 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7f6840b8-fcfe-4c33-8275-80fd1864e452-ovnkube-script-lib\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:49.961356 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.961013 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/550f6b92-213b-4ca0-9324-1fdf41107530-cnibin\") pod \"multus-2fxtz\" (UID: \"550f6b92-213b-4ca0-9324-1fdf41107530\") " pod="openshift-multus/multus-2fxtz" Sep 07 03:57:49.961356 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.961046 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/550f6b92-213b-4ca0-9324-1fdf41107530-multus-conf-dir\") pod \"multus-2fxtz\" (UID: \"550f6b92-213b-4ca0-9324-1fdf41107530\") " pod="openshift-multus/multus-2fxtz" Sep 07 03:57:49.961356 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.961074 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s58rr\" (UniqueName: \"kubernetes.io/projected/550f6b92-213b-4ca0-9324-1fdf41107530-kube-api-access-s58rr\") pod \"multus-2fxtz\" (UID: \"550f6b92-213b-4ca0-9324-1fdf41107530\") " pod="openshift-multus/multus-2fxtz" Sep 07 03:57:49.961356 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.961103 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7f6840b8-fcfe-4c33-8275-80fd1864e452-run-ovn\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:49.961356 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.961151 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7f6840b8-fcfe-4c33-8275-80fd1864e452-ovnkube-config\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:49.961356 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.961179 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5c78be9-7199-4898-8b64-335079a42ce2-tmp-dir\") pod \"node-resolver-j2xph\" (UID: \"d5c78be9-7199-4898-8b64-335079a42ce2\") " pod="openshift-dns/node-resolver-j2xph" Sep 07 03:57:49.961356 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.961203 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 07 03:57:49.961356 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.961251 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/550f6b92-213b-4ca0-9324-1fdf41107530-multus-socket-dir-parent\") pod \"multus-2fxtz\" (UID: \"550f6b92-213b-4ca0-9324-1fdf41107530\") " pod="openshift-multus/multus-2fxtz" Sep 07 03:57:49.961356 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.961256 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-b2cd4\"" Sep 07 03:57:49.961356 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.961282 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/550f6b92-213b-4ca0-9324-1fdf41107530-host-var-lib-cni-multus\") pod \"multus-2fxtz\" (UID: \"550f6b92-213b-4ca0-9324-1fdf41107530\") " pod="openshift-multus/multus-2fxtz" Sep 07 03:57:49.961356 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.961310 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgw6z\" (UniqueName: \"kubernetes.io/projected/d84c7c95-f426-47f3-82ce-19f90665ec16-kube-api-access-pgw6z\") pod \"aws-ebs-csi-driver-node-jnwmn\" (UID: \"d84c7c95-f426-47f3-82ce-19f90665ec16\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnwmn" Sep 07 03:57:49.961356 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.961334 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7f6840b8-fcfe-4c33-8275-80fd1864e452-log-socket\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:49.961356 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.961346 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 07 03:57:49.962038 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.961377 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f6840b8-fcfe-4c33-8275-80fd1864e452-host-run-ovn-kubernetes\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:49.962038 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.961411 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7f6840b8-fcfe-4c33-8275-80fd1864e452-env-overrides\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:49.962038 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.961440 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/550f6b92-213b-4ca0-9324-1fdf41107530-multus-cni-dir\") pod \"multus-2fxtz\" (UID: \"550f6b92-213b-4ca0-9324-1fdf41107530\") " pod="openshift-multus/multus-2fxtz" Sep 07 03:57:49.962038 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.961469 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 07 03:57:49.962038 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.961477 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/550f6b92-213b-4ca0-9324-1fdf41107530-host-run-netns\") pod \"multus-2fxtz\" (UID: \"550f6b92-213b-4ca0-9324-1fdf41107530\") " pod="openshift-multus/multus-2fxtz" Sep 07 03:57:49.962038 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.961516 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zz74s" Sep 07 03:57:49.962038 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.961528 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/550f6b92-213b-4ca0-9324-1fdf41107530-host-var-lib-kubelet\") pod \"multus-2fxtz\" (UID: \"550f6b92-213b-4ca0-9324-1fdf41107530\") " pod="openshift-multus/multus-2fxtz" Sep 07 03:57:49.962038 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.961575 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d84c7c95-f426-47f3-82ce-19f90665ec16-socket-dir\") pod \"aws-ebs-csi-driver-node-jnwmn\" (UID: \"d84c7c95-f426-47f3-82ce-19f90665ec16\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnwmn" Sep 07 03:57:49.962038 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.961617 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7f6840b8-fcfe-4c33-8275-80fd1864e452-host-run-netns\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:49.962038 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.961670 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/550f6b92-213b-4ca0-9324-1fdf41107530-cni-binary-copy\") pod \"multus-2fxtz\" (UID: \"550f6b92-213b-4ca0-9324-1fdf41107530\") " pod="openshift-multus/multus-2fxtz" Sep 07 03:57:49.962489 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.962469 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 07 03:57:49.963722 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.963704 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 07 03:57:49.963908 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.963892 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 07 03:57:49.964060 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.964041 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qh246\"" Sep 07 03:57:49.964598 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.964409 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7gs6n" Sep 07 03:57:49.964598 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:49.964564 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7gs6n" podUID="27f19200-987c-44ac-b2bd-695e3989a859" Sep 07 03:57:49.966822 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.966803 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6rxjb" Sep 07 03:57:49.968564 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.968542 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 07 03:57:49.968914 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.968899 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jf8qv\"" Sep 07 03:57:49.969173 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.969010 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 07 03:57:49.969794 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.969661 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sg6pk" Sep 07 03:57:49.971272 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.971253 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 07 03:57:49.971387 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.971371 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 07 03:57:49.971856 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.971766 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-r92bp\"" Sep 07 03:57:49.972514 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.972497 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bshbg" Sep 07 03:57:49.972607 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:49.972565 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bshbg" podUID="2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9" Sep 07 03:57:49.982728 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.982705 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wvx9b" Sep 07 03:57:49.991382 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:49.990963 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wvx9b" Sep 07 03:57:50.051136 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.051110 2566 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 07 03:57:50.062108 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.062084 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d84c7c95-f426-47f3-82ce-19f90665ec16-socket-dir\") pod \"aws-ebs-csi-driver-node-jnwmn\" (UID: \"d84c7c95-f426-47f3-82ce-19f90665ec16\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnwmn" Sep 07 03:57:50.062238 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.062115 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7f6840b8-fcfe-4c33-8275-80fd1864e452-host-run-netns\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:50.062238 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.062137 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/550f6b92-213b-4ca0-9324-1fdf41107530-cni-binary-copy\") pod \"multus-2fxtz\" (UID: \"550f6b92-213b-4ca0-9324-1fdf41107530\") " pod="openshift-multus/multus-2fxtz" Sep 07 03:57:50.062238 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.062164 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a3e06efa-aad9-4b2e-8f04-27f5765a2b90-agent-certs\") pod \"konnectivity-agent-zz74s\" (UID: \"a3e06efa-aad9-4b2e-8f04-27f5765a2b90\") " pod="kube-system/konnectivity-agent-zz74s" Sep 07 03:57:50.062238 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.062188 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1cf367ba-8995-4c9e-a64d-2b1b3577d648-system-cni-dir\") pod \"multus-additional-cni-plugins-sg6pk\" (UID: \"1cf367ba-8995-4c9e-a64d-2b1b3577d648\") " pod="openshift-multus/multus-additional-cni-plugins-sg6pk" Sep 07 03:57:50.062238 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.062212 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hf9n\" (UniqueName: \"kubernetes.io/projected/9acda50f-310f-4846-a461-5d45a198cd54-kube-api-access-5hf9n\") pod \"node-ca-hkdpb\" (UID: \"9acda50f-310f-4846-a461-5d45a198cd54\") " pod="openshift-image-registry/node-ca-hkdpb" Sep 07 03:57:50.062238 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.062235 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7f6840b8-fcfe-4c33-8275-80fd1864e452-host-run-netns\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:50.062545 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.062240 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d84c7c95-f426-47f3-82ce-19f90665ec16-device-dir\") pod \"aws-ebs-csi-driver-node-jnwmn\" (UID: \"d84c7c95-f426-47f3-82ce-19f90665ec16\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnwmn" Sep 07 03:57:50.062545 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.062265 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d84c7c95-f426-47f3-82ce-19f90665ec16-socket-dir\") pod \"aws-ebs-csi-driver-node-jnwmn\" (UID: \"d84c7c95-f426-47f3-82ce-19f90665ec16\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnwmn" Sep 07 03:57:50.062545 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.062282 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d84c7c95-f426-47f3-82ce-19f90665ec16-etc-selinux\") pod \"aws-ebs-csi-driver-node-jnwmn\" (UID: \"d84c7c95-f426-47f3-82ce-19f90665ec16\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnwmn" Sep 07 03:57:50.062545 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.062289 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d84c7c95-f426-47f3-82ce-19f90665ec16-device-dir\") pod \"aws-ebs-csi-driver-node-jnwmn\" (UID: \"d84c7c95-f426-47f3-82ce-19f90665ec16\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnwmn" Sep 07 03:57:50.062545 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.062317 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7f6840b8-fcfe-4c33-8275-80fd1864e452-node-log\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:50.062545 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.062337 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d5c78be9-7199-4898-8b64-335079a42ce2-hosts-file\") pod \"node-resolver-j2xph\" (UID: \"d5c78be9-7199-4898-8b64-335079a42ce2\") " pod="openshift-dns/node-resolver-j2xph" Sep 07 03:57:50.062545 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.062356 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/550f6b92-213b-4ca0-9324-1fdf41107530-hostroot\") pod \"multus-2fxtz\" (UID: \"550f6b92-213b-4ca0-9324-1fdf41107530\") " pod="openshift-multus/multus-2fxtz" Sep 07 03:57:50.062545 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.062386 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7f6840b8-fcfe-4c33-8275-80fd1864e452-node-log\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:50.062545 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.062399 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/550f6b92-213b-4ca0-9324-1fdf41107530-hostroot\") pod \"multus-2fxtz\" (UID: \"550f6b92-213b-4ca0-9324-1fdf41107530\") " pod="openshift-multus/multus-2fxtz" Sep 07 03:57:50.062545 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.062388 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d84c7c95-f426-47f3-82ce-19f90665ec16-etc-selinux\") pod \"aws-ebs-csi-driver-node-jnwmn\" (UID: \"d84c7c95-f426-47f3-82ce-19f90665ec16\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnwmn" Sep 07 03:57:50.062545 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.062413 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d5c78be9-7199-4898-8b64-335079a42ce2-hosts-file\") pod \"node-resolver-j2xph\" (UID: \"d5c78be9-7199-4898-8b64-335079a42ce2\") " pod="openshift-dns/node-resolver-j2xph" Sep 07 03:57:50.062545 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.062445 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1cf367ba-8995-4c9e-a64d-2b1b3577d648-cni-binary-copy\") pod \"multus-additional-cni-plugins-sg6pk\" (UID: \"1cf367ba-8995-4c9e-a64d-2b1b3577d648\") " pod="openshift-multus/multus-additional-cni-plugins-sg6pk" Sep 07 03:57:50.062545 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.062477 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d84c7c95-f426-47f3-82ce-19f90665ec16-sys-fs\") pod \"aws-ebs-csi-driver-node-jnwmn\" (UID: \"d84c7c95-f426-47f3-82ce-19f90665ec16\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnwmn" Sep 07 03:57:50.062545 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.062499 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cfn4\" (UniqueName: \"kubernetes.io/projected/7f6840b8-fcfe-4c33-8275-80fd1864e452-kube-api-access-4cfn4\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:50.062545 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.062523 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/550f6b92-213b-4ca0-9324-1fdf41107530-etc-kubernetes\") pod \"multus-2fxtz\" (UID: \"550f6b92-213b-4ca0-9324-1fdf41107530\") " pod="openshift-multus/multus-2fxtz" Sep 07 03:57:50.063234 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.062557 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d84c7c95-f426-47f3-82ce-19f90665ec16-sys-fs\") pod \"aws-ebs-csi-driver-node-jnwmn\" (UID: \"d84c7c95-f426-47f3-82ce-19f90665ec16\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnwmn" Sep 07 03:57:50.063234 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.062574 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fjfw\" (UniqueName: \"kubernetes.io/projected/c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789-kube-api-access-4fjfw\") pod \"tuned-6rxjb\" (UID: \"c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789\") " pod="openshift-cluster-node-tuning-operator/tuned-6rxjb" Sep 07 03:57:50.063234 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.062589 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/550f6b92-213b-4ca0-9324-1fdf41107530-etc-kubernetes\") pod \"multus-2fxtz\" (UID: \"550f6b92-213b-4ca0-9324-1fdf41107530\") " pod="openshift-multus/multus-2fxtz" Sep 07 03:57:50.063234 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.062593 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1cf367ba-8995-4c9e-a64d-2b1b3577d648-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sg6pk\" (UID: \"1cf367ba-8995-4c9e-a64d-2b1b3577d648\") " pod="openshift-multus/multus-additional-cni-plugins-sg6pk" Sep 07 03:57:50.063234 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.062621 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d84c7c95-f426-47f3-82ce-19f90665ec16-registration-dir\") pod \"aws-ebs-csi-driver-node-jnwmn\" (UID: \"d84c7c95-f426-47f3-82ce-19f90665ec16\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnwmn" Sep 07 03:57:50.063234 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.062664 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zkt6\" (UniqueName: \"kubernetes.io/projected/2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9-kube-api-access-9zkt6\") pod \"network-metrics-daemon-bshbg\" (UID: \"2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9\") " pod="openshift-multus/network-metrics-daemon-bshbg" Sep 07 03:57:50.063234 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.062687 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a3e06efa-aad9-4b2e-8f04-27f5765a2b90-konnectivity-ca\") pod \"konnectivity-agent-zz74s\" (UID: \"a3e06efa-aad9-4b2e-8f04-27f5765a2b90\") " pod="kube-system/konnectivity-agent-zz74s" Sep 07 03:57:50.063234 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.062693 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d84c7c95-f426-47f3-82ce-19f90665ec16-registration-dir\") pod \"aws-ebs-csi-driver-node-jnwmn\" (UID: \"d84c7c95-f426-47f3-82ce-19f90665ec16\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnwmn" Sep 07 03:57:50.063234 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.062711 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789-etc-sysconfig\") pod \"tuned-6rxjb\" (UID: \"c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789\") " pod="openshift-cluster-node-tuning-operator/tuned-6rxjb" Sep 07 03:57:50.063234 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.062734 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789-etc-kubernetes\") pod \"tuned-6rxjb\" (UID: \"c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789\") " pod="openshift-cluster-node-tuning-operator/tuned-6rxjb" Sep 07 03:57:50.063234 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.062750 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789-tmp\") pod \"tuned-6rxjb\" (UID: \"c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789\") " pod="openshift-cluster-node-tuning-operator/tuned-6rxjb" Sep 07 03:57:50.063234 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.062765 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1cf367ba-8995-4c9e-a64d-2b1b3577d648-cnibin\") pod \"multus-additional-cni-plugins-sg6pk\" (UID: \"1cf367ba-8995-4c9e-a64d-2b1b3577d648\") " pod="openshift-multus/multus-additional-cni-plugins-sg6pk" Sep 07 03:57:50.063234 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.062771 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/550f6b92-213b-4ca0-9324-1fdf41107530-cni-binary-copy\") pod \"multus-2fxtz\" (UID: \"550f6b92-213b-4ca0-9324-1fdf41107530\") " pod="openshift-multus/multus-2fxtz" Sep 07 03:57:50.063234 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.062779 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/04a78909-1aec-4203-b049-eb51194a1632-host-slash\") pod \"iptables-alerter-6bjt9\" (UID: \"04a78909-1aec-4203-b049-eb51194a1632\") " pod="openshift-network-operator/iptables-alerter-6bjt9" Sep 07 03:57:50.063234 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.062860 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9acda50f-310f-4846-a461-5d45a198cd54-host\") pod \"node-ca-hkdpb\" (UID: \"9acda50f-310f-4846-a461-5d45a198cd54\") " pod="openshift-image-registry/node-ca-hkdpb" Sep 07 03:57:50.063234 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.062889 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7f6840b8-fcfe-4c33-8275-80fd1864e452-systemd-units\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:50.063234 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.062912 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f6840b8-fcfe-4c33-8275-80fd1864e452-etc-openvswitch\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:50.063869 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.062956 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f6840b8-fcfe-4c33-8275-80fd1864e452-etc-openvswitch\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:50.063869 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.062960 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7f6840b8-fcfe-4c33-8275-80fd1864e452-systemd-units\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:50.063869 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.063001 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/550f6b92-213b-4ca0-9324-1fdf41107530-multus-conf-dir\") pod \"multus-2fxtz\" (UID: \"550f6b92-213b-4ca0-9324-1fdf41107530\") " pod="openshift-multus/multus-2fxtz" Sep 07 03:57:50.063869 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.063027 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s58rr\" (UniqueName: \"kubernetes.io/projected/550f6b92-213b-4ca0-9324-1fdf41107530-kube-api-access-s58rr\") pod \"multus-2fxtz\" (UID: \"550f6b92-213b-4ca0-9324-1fdf41107530\") " pod="openshift-multus/multus-2fxtz" Sep 07 03:57:50.063869 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.063055 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2pg2\" (UniqueName: \"kubernetes.io/projected/04a78909-1aec-4203-b049-eb51194a1632-kube-api-access-w2pg2\") pod \"iptables-alerter-6bjt9\" (UID: \"04a78909-1aec-4203-b049-eb51194a1632\") " pod="openshift-network-operator/iptables-alerter-6bjt9" Sep 07 03:57:50.063869 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.063079 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/550f6b92-213b-4ca0-9324-1fdf41107530-multus-conf-dir\") pod \"multus-2fxtz\" (UID: \"550f6b92-213b-4ca0-9324-1fdf41107530\") " pod="openshift-multus/multus-2fxtz" Sep 07 03:57:50.063869 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.063082 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9acda50f-310f-4846-a461-5d45a198cd54-serviceca\") pod \"node-ca-hkdpb\" (UID: \"9acda50f-310f-4846-a461-5d45a198cd54\") " pod="openshift-image-registry/node-ca-hkdpb" Sep 07 03:57:50.063869 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.063123 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9-metrics-certs\") pod \"network-metrics-daemon-bshbg\" (UID: \"2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9\") " pod="openshift-multus/network-metrics-daemon-bshbg" Sep 07 03:57:50.063869 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.063144 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789-host\") pod \"tuned-6rxjb\" (UID: \"c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789\") " pod="openshift-cluster-node-tuning-operator/tuned-6rxjb" Sep 07 03:57:50.063869 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.063176 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7f6840b8-fcfe-4c33-8275-80fd1864e452-ovnkube-config\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:50.063869 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.063235 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/550f6b92-213b-4ca0-9324-1fdf41107530-host-var-lib-cni-multus\") pod \"multus-2fxtz\" (UID: \"550f6b92-213b-4ca0-9324-1fdf41107530\") " pod="openshift-multus/multus-2fxtz" Sep 07 03:57:50.063869 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.063261 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789-etc-sysctl-conf\") pod \"tuned-6rxjb\" (UID: \"c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789\") " pod="openshift-cluster-node-tuning-operator/tuned-6rxjb" Sep 07 03:57:50.063869 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.063285 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1cf367ba-8995-4c9e-a64d-2b1b3577d648-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sg6pk\" (UID: \"1cf367ba-8995-4c9e-a64d-2b1b3577d648\") " pod="openshift-multus/multus-additional-cni-plugins-sg6pk" Sep 07 03:57:50.063869 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.063318 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgw6z\" (UniqueName: \"kubernetes.io/projected/d84c7c95-f426-47f3-82ce-19f90665ec16-kube-api-access-pgw6z\") pod \"aws-ebs-csi-driver-node-jnwmn\" (UID: \"d84c7c95-f426-47f3-82ce-19f90665ec16\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnwmn" Sep 07 03:57:50.063869 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.063347 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7f6840b8-fcfe-4c33-8275-80fd1864e452-log-socket\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:50.063869 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.063351 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/550f6b92-213b-4ca0-9324-1fdf41107530-host-var-lib-cni-multus\") pod \"multus-2fxtz\" (UID: \"550f6b92-213b-4ca0-9324-1fdf41107530\") " pod="openshift-multus/multus-2fxtz" Sep 07 03:57:50.063869 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.063369 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f6840b8-fcfe-4c33-8275-80fd1864e452-host-run-ovn-kubernetes\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:50.064401 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.063393 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7f6840b8-fcfe-4c33-8275-80fd1864e452-env-overrides\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:50.064401 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.063395 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7f6840b8-fcfe-4c33-8275-80fd1864e452-log-socket\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:50.064401 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.063417 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/550f6b92-213b-4ca0-9324-1fdf41107530-multus-cni-dir\") pod \"multus-2fxtz\" (UID: \"550f6b92-213b-4ca0-9324-1fdf41107530\") " pod="openshift-multus/multus-2fxtz" Sep 07 03:57:50.064401 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.063431 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f6840b8-fcfe-4c33-8275-80fd1864e452-host-run-ovn-kubernetes\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:50.064401 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.063442 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/550f6b92-213b-4ca0-9324-1fdf41107530-host-run-netns\") pod \"multus-2fxtz\" (UID: \"550f6b92-213b-4ca0-9324-1fdf41107530\") " pod="openshift-multus/multus-2fxtz" Sep 07 03:57:50.064401 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.063508 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/550f6b92-213b-4ca0-9324-1fdf41107530-host-run-netns\") pod \"multus-2fxtz\" (UID: \"550f6b92-213b-4ca0-9324-1fdf41107530\") " pod="openshift-multus/multus-2fxtz" Sep 07 03:57:50.064401 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.063539 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/550f6b92-213b-4ca0-9324-1fdf41107530-host-var-lib-kubelet\") pod \"multus-2fxtz\" (UID: \"550f6b92-213b-4ca0-9324-1fdf41107530\") " pod="openshift-multus/multus-2fxtz" Sep 07 03:57:50.064401 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.063564 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/27f19200-987c-44ac-b2bd-695e3989a859-kubelet-config\") pod \"global-pull-secret-syncer-7gs6n\" (UID: \"27f19200-987c-44ac-b2bd-695e3989a859\") " pod="kube-system/global-pull-secret-syncer-7gs6n" Sep 07 03:57:50.064401 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.063578 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/550f6b92-213b-4ca0-9324-1fdf41107530-host-var-lib-kubelet\") pod \"multus-2fxtz\" (UID: \"550f6b92-213b-4ca0-9324-1fdf41107530\") " pod="openshift-multus/multus-2fxtz" Sep 07 03:57:50.064401 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.063594 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/550f6b92-213b-4ca0-9324-1fdf41107530-multus-cni-dir\") pod \"multus-2fxtz\" (UID: \"550f6b92-213b-4ca0-9324-1fdf41107530\") " pod="openshift-multus/multus-2fxtz" Sep 07 03:57:50.064401 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.063589 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789-var-lib-kubelet\") pod \"tuned-6rxjb\" (UID: \"c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789\") " pod="openshift-cluster-node-tuning-operator/tuned-6rxjb" Sep 07 03:57:50.064401 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.063669 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/550f6b92-213b-4ca0-9324-1fdf41107530-multus-daemon-config\") pod \"multus-2fxtz\" (UID: \"550f6b92-213b-4ca0-9324-1fdf41107530\") " pod="openshift-multus/multus-2fxtz" Sep 07 03:57:50.064401 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.063715 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7f6840b8-fcfe-4c33-8275-80fd1864e452-ovnkube-config\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:50.064401 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.063756 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f6840b8-fcfe-4c33-8275-80fd1864e452-host-slash\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:50.064401 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.063781 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7f6840b8-fcfe-4c33-8275-80fd1864e452-run-systemd\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:50.064401 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.063813 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7f6840b8-fcfe-4c33-8275-80fd1864e452-env-overrides\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:50.064401 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.063823 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f6840b8-fcfe-4c33-8275-80fd1864e452-run-openvswitch\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:50.064401 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.063824 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f6840b8-fcfe-4c33-8275-80fd1864e452-host-slash\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:50.065157 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.063854 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7f6840b8-fcfe-4c33-8275-80fd1864e452-host-cni-bin\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:50.065157 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.063852 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7f6840b8-fcfe-4c33-8275-80fd1864e452-run-systemd\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:50.065157 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.063896 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f6840b8-fcfe-4c33-8275-80fd1864e452-run-openvswitch\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:50.065157 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.063919 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7f6840b8-fcfe-4c33-8275-80fd1864e452-ovn-node-metrics-cert\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:50.065157 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.063944 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7f6840b8-fcfe-4c33-8275-80fd1864e452-host-cni-bin\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:50.065157 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.063984 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjn7k\" (UniqueName: \"kubernetes.io/projected/d5c78be9-7199-4898-8b64-335079a42ce2-kube-api-access-kjn7k\") pod \"node-resolver-j2xph\" (UID: \"d5c78be9-7199-4898-8b64-335079a42ce2\") " pod="openshift-dns/node-resolver-j2xph" Sep 07 03:57:50.065157 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.064083 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/550f6b92-213b-4ca0-9324-1fdf41107530-system-cni-dir\") pod \"multus-2fxtz\" (UID: \"550f6b92-213b-4ca0-9324-1fdf41107530\") " pod="openshift-multus/multus-2fxtz" Sep 07 03:57:50.065157 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.064096 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/550f6b92-213b-4ca0-9324-1fdf41107530-multus-daemon-config\") pod \"multus-2fxtz\" (UID: \"550f6b92-213b-4ca0-9324-1fdf41107530\") " pod="openshift-multus/multus-2fxtz" Sep 07 03:57:50.065157 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.064137 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789-etc-sysctl-d\") pod \"tuned-6rxjb\" (UID: \"c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789\") " pod="openshift-cluster-node-tuning-operator/tuned-6rxjb" Sep 07 03:57:50.065157 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.064172 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789-etc-systemd\") pod \"tuned-6rxjb\" (UID: \"c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789\") " pod="openshift-cluster-node-tuning-operator/tuned-6rxjb" Sep 07 03:57:50.065157 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.064187 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/550f6b92-213b-4ca0-9324-1fdf41107530-system-cni-dir\") pod \"multus-2fxtz\" (UID: \"550f6b92-213b-4ca0-9324-1fdf41107530\") " pod="openshift-multus/multus-2fxtz" Sep 07 03:57:50.065157 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.064199 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789-sys\") pod \"tuned-6rxjb\" (UID: \"c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789\") " pod="openshift-cluster-node-tuning-operator/tuned-6rxjb" Sep 07 03:57:50.065157 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.064225 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789-lib-modules\") pod \"tuned-6rxjb\" (UID: \"c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789\") " pod="openshift-cluster-node-tuning-operator/tuned-6rxjb" Sep 07 03:57:50.065157 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.064250 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j9dq\" (UniqueName: \"kubernetes.io/projected/1cf367ba-8995-4c9e-a64d-2b1b3577d648-kube-api-access-7j9dq\") pod \"multus-additional-cni-plugins-sg6pk\" (UID: \"1cf367ba-8995-4c9e-a64d-2b1b3577d648\") " pod="openshift-multus/multus-additional-cni-plugins-sg6pk" Sep 07 03:57:50.065157 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.064293 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f6840b8-fcfe-4c33-8275-80fd1864e452-host-kubelet\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:50.065157 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.064323 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7f6840b8-fcfe-4c33-8275-80fd1864e452-host-cni-netd\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:50.065157 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.064355 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f6840b8-fcfe-4c33-8275-80fd1864e452-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:50.065812 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.064365 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7f6840b8-fcfe-4c33-8275-80fd1864e452-host-cni-netd\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:50.065812 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.064367 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f6840b8-fcfe-4c33-8275-80fd1864e452-host-kubelet\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:50.065812 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.064380 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/550f6b92-213b-4ca0-9324-1fdf41107530-host-run-k8s-cni-cncf-io\") pod \"multus-2fxtz\" (UID: \"550f6b92-213b-4ca0-9324-1fdf41107530\") " pod="openshift-multus/multus-2fxtz" Sep 07 03:57:50.065812 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.064397 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cr7h\" (UniqueName: \"kubernetes.io/projected/31a21753-1b6d-4d23-a382-b2d0794b9837-kube-api-access-4cr7h\") pod \"network-check-target-79dgl\" (UID: \"31a21753-1b6d-4d23-a382-b2d0794b9837\") " pod="openshift-network-diagnostics/network-check-target-79dgl" Sep 07 03:57:50.065812 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.064402 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f6840b8-fcfe-4c33-8275-80fd1864e452-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:50.065812 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.064412 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789-etc-modprobe-d\") pod \"tuned-6rxjb\" (UID: \"c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789\") " pod="openshift-cluster-node-tuning-operator/tuned-6rxjb" Sep 07 03:57:50.065812 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.064436 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789-run\") pod \"tuned-6rxjb\" (UID: \"c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789\") " pod="openshift-cluster-node-tuning-operator/tuned-6rxjb" Sep 07 03:57:50.065812 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.064458 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/550f6b92-213b-4ca0-9324-1fdf41107530-host-run-k8s-cni-cncf-io\") pod \"multus-2fxtz\" (UID: \"550f6b92-213b-4ca0-9324-1fdf41107530\") " pod="openshift-multus/multus-2fxtz" Sep 07 03:57:50.065812 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.064462 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d84c7c95-f426-47f3-82ce-19f90665ec16-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jnwmn\" (UID: \"d84c7c95-f426-47f3-82ce-19f90665ec16\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnwmn" Sep 07 03:57:50.065812 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.064490 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/550f6b92-213b-4ca0-9324-1fdf41107530-host-var-lib-cni-bin\") pod \"multus-2fxtz\" (UID: \"550f6b92-213b-4ca0-9324-1fdf41107530\") " pod="openshift-multus/multus-2fxtz" Sep 07 03:57:50.065812 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.064505 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d84c7c95-f426-47f3-82ce-19f90665ec16-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jnwmn\" (UID: \"d84c7c95-f426-47f3-82ce-19f90665ec16\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnwmn" Sep 07 03:57:50.065812 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.064513 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/550f6b92-213b-4ca0-9324-1fdf41107530-host-run-multus-certs\") pod \"multus-2fxtz\" (UID: \"550f6b92-213b-4ca0-9324-1fdf41107530\") " pod="openshift-multus/multus-2fxtz" Sep 07 03:57:50.065812 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.064538 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/04a78909-1aec-4203-b049-eb51194a1632-iptables-alerter-script\") pod \"iptables-alerter-6bjt9\" (UID: \"04a78909-1aec-4203-b049-eb51194a1632\") " pod="openshift-network-operator/iptables-alerter-6bjt9" Sep 07 03:57:50.065812 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.064549 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/550f6b92-213b-4ca0-9324-1fdf41107530-host-var-lib-cni-bin\") pod \"multus-2fxtz\" (UID: \"550f6b92-213b-4ca0-9324-1fdf41107530\") " pod="openshift-multus/multus-2fxtz" Sep 07 03:57:50.065812 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.064558 2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 07 03:57:50.065812 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.064585 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/550f6b92-213b-4ca0-9324-1fdf41107530-host-run-multus-certs\") pod \"multus-2fxtz\" (UID: \"550f6b92-213b-4ca0-9324-1fdf41107530\") " pod="openshift-multus/multus-2fxtz" Sep 07 03:57:50.065812 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.064591 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27f19200-987c-44ac-b2bd-695e3989a859-original-pull-secret\") pod \"global-pull-secret-syncer-7gs6n\" (UID: \"27f19200-987c-44ac-b2bd-695e3989a859\") " pod="kube-system/global-pull-secret-syncer-7gs6n" Sep 07 03:57:50.066502 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.064616 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f6840b8-fcfe-4c33-8275-80fd1864e452-var-lib-openvswitch\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:50.066502 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.064662 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7f6840b8-fcfe-4c33-8275-80fd1864e452-ovnkube-script-lib\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:50.066502 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.064681 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f6840b8-fcfe-4c33-8275-80fd1864e452-var-lib-openvswitch\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:50.066502 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.064684 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/550f6b92-213b-4ca0-9324-1fdf41107530-cnibin\") pod \"multus-2fxtz\" (UID: \"550f6b92-213b-4ca0-9324-1fdf41107530\") " pod="openshift-multus/multus-2fxtz" Sep 07 03:57:50.066502 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.064724 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/550f6b92-213b-4ca0-9324-1fdf41107530-cnibin\") pod \"multus-2fxtz\" (UID: \"550f6b92-213b-4ca0-9324-1fdf41107530\") " pod="openshift-multus/multus-2fxtz" Sep 07 03:57:50.066502 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.064722 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1cf367ba-8995-4c9e-a64d-2b1b3577d648-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sg6pk\" (UID: \"1cf367ba-8995-4c9e-a64d-2b1b3577d648\") " pod="openshift-multus/multus-additional-cni-plugins-sg6pk" Sep 07 03:57:50.066502 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.064765 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7f6840b8-fcfe-4c33-8275-80fd1864e452-run-ovn\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:50.066502 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.064789 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5c78be9-7199-4898-8b64-335079a42ce2-tmp-dir\") pod \"node-resolver-j2xph\" (UID: \"d5c78be9-7199-4898-8b64-335079a42ce2\") " pod="openshift-dns/node-resolver-j2xph" Sep 07 03:57:50.066502 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.064813 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/550f6b92-213b-4ca0-9324-1fdf41107530-multus-socket-dir-parent\") pod \"multus-2fxtz\" (UID: \"550f6b92-213b-4ca0-9324-1fdf41107530\") " pod="openshift-multus/multus-2fxtz" Sep 07 03:57:50.066502 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.064836 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7f6840b8-fcfe-4c33-8275-80fd1864e452-run-ovn\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:50.066502 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.064837 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789-etc-tuned\") pod \"tuned-6rxjb\" (UID: \"c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789\") " pod="openshift-cluster-node-tuning-operator/tuned-6rxjb" Sep 07 03:57:50.066502 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.064867 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/27f19200-987c-44ac-b2bd-695e3989a859-dbus\") pod \"global-pull-secret-syncer-7gs6n\" (UID: \"27f19200-987c-44ac-b2bd-695e3989a859\") " pod="kube-system/global-pull-secret-syncer-7gs6n" Sep 07 03:57:50.066502 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.064952 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/550f6b92-213b-4ca0-9324-1fdf41107530-multus-socket-dir-parent\") pod \"multus-2fxtz\" (UID: \"550f6b92-213b-4ca0-9324-1fdf41107530\") " pod="openshift-multus/multus-2fxtz" Sep 07 03:57:50.066502 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.065132 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5c78be9-7199-4898-8b64-335079a42ce2-tmp-dir\") pod \"node-resolver-j2xph\" (UID: \"d5c78be9-7199-4898-8b64-335079a42ce2\") " pod="openshift-dns/node-resolver-j2xph" Sep 07 03:57:50.066502 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.065160 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7f6840b8-fcfe-4c33-8275-80fd1864e452-ovnkube-script-lib\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:50.068609 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.068593 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7f6840b8-fcfe-4c33-8275-80fd1864e452-ovn-node-metrics-cert\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:50.071000 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:50.070979 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 03:57:50.071086 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:50.071006 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 03:57:50.071086 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:50.071019 2566 projected.go:196] Error preparing data for projected volume kube-api-access-4cr7h for pod openshift-network-diagnostics/network-check-target-79dgl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 03:57:50.071193 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:50.071090 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31a21753-1b6d-4d23-a382-b2d0794b9837-kube-api-access-4cr7h podName:31a21753-1b6d-4d23-a382-b2d0794b9837 nodeName:}" failed. No retries permitted until 2026-09-07 03:57:50.571070496 +0000 UTC m=+2.991445211 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4cr7h" (UniqueName: "kubernetes.io/projected/31a21753-1b6d-4d23-a382-b2d0794b9837-kube-api-access-4cr7h") pod "network-check-target-79dgl" (UID: "31a21753-1b6d-4d23-a382-b2d0794b9837") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 03:57:50.073196 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.073173 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s58rr\" (UniqueName: \"kubernetes.io/projected/550f6b92-213b-4ca0-9324-1fdf41107530-kube-api-access-s58rr\") pod \"multus-2fxtz\" (UID: \"550f6b92-213b-4ca0-9324-1fdf41107530\") " pod="openshift-multus/multus-2fxtz" Sep 07 03:57:50.073597 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.073567 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cfn4\" (UniqueName: \"kubernetes.io/projected/7f6840b8-fcfe-4c33-8275-80fd1864e452-kube-api-access-4cfn4\") pod \"ovnkube-node-f6xmb\" (UID: \"7f6840b8-fcfe-4c33-8275-80fd1864e452\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:50.073861 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.073838 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgw6z\" (UniqueName: \"kubernetes.io/projected/d84c7c95-f426-47f3-82ce-19f90665ec16-kube-api-access-pgw6z\") pod \"aws-ebs-csi-driver-node-jnwmn\" (UID: \"d84c7c95-f426-47f3-82ce-19f90665ec16\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnwmn" Sep 07 03:57:50.074065 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.074044 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjn7k\" (UniqueName: \"kubernetes.io/projected/d5c78be9-7199-4898-8b64-335079a42ce2-kube-api-access-kjn7k\") pod \"node-resolver-j2xph\" (UID: \"d5c78be9-7199-4898-8b64-335079a42ce2\") " pod="openshift-dns/node-resolver-j2xph" Sep 07 03:57:50.085907 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.085862 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-125.ec2.internal" event={"ID":"ba5931dfbb1cb6ce0bae7ffbbefa796b","Type":"ContainerStarted","Data":"f9ca4a742129093bf368ee717548ef4d7548b24374753529112e932907624d4c"} Sep 07 03:57:50.087053 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.087029 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-125.ec2.internal" event={"ID":"f60cefb4c31f4cfc617414d028d68a25","Type":"ContainerStarted","Data":"f6e0bdf3afbeee546e53bcd2994cb7cc04b7d8a3b66f4a2e8e7d4af6f3aa8bd3"} Sep 07 03:57:50.165482 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.165408 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1cf367ba-8995-4c9e-a64d-2b1b3577d648-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sg6pk\" (UID: \"1cf367ba-8995-4c9e-a64d-2b1b3577d648\") " pod="openshift-multus/multus-additional-cni-plugins-sg6pk" Sep 07 03:57:50.165482 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.165440 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789-etc-tuned\") pod \"tuned-6rxjb\" (UID: \"c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789\") " pod="openshift-cluster-node-tuning-operator/tuned-6rxjb" Sep 07 03:57:50.165482 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.165462 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/27f19200-987c-44ac-b2bd-695e3989a859-dbus\") pod \"global-pull-secret-syncer-7gs6n\" (UID: \"27f19200-987c-44ac-b2bd-695e3989a859\") " pod="kube-system/global-pull-secret-syncer-7gs6n" Sep 07 03:57:50.165750 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.165488 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a3e06efa-aad9-4b2e-8f04-27f5765a2b90-agent-certs\") pod \"konnectivity-agent-zz74s\" (UID: \"a3e06efa-aad9-4b2e-8f04-27f5765a2b90\") " pod="kube-system/konnectivity-agent-zz74s" Sep 07 03:57:50.165750 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.165695 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/27f19200-987c-44ac-b2bd-695e3989a859-dbus\") pod \"global-pull-secret-syncer-7gs6n\" (UID: \"27f19200-987c-44ac-b2bd-695e3989a859\") " pod="kube-system/global-pull-secret-syncer-7gs6n" Sep 07 03:57:50.165750 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.165744 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1cf367ba-8995-4c9e-a64d-2b1b3577d648-system-cni-dir\") pod \"multus-additional-cni-plugins-sg6pk\" (UID: \"1cf367ba-8995-4c9e-a64d-2b1b3577d648\") " pod="openshift-multus/multus-additional-cni-plugins-sg6pk" Sep 07 03:57:50.165951 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.165774 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hf9n\" (UniqueName: \"kubernetes.io/projected/9acda50f-310f-4846-a461-5d45a198cd54-kube-api-access-5hf9n\") pod \"node-ca-hkdpb\" (UID: \"9acda50f-310f-4846-a461-5d45a198cd54\") " pod="openshift-image-registry/node-ca-hkdpb" Sep 07 03:57:50.165951 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.165805 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1cf367ba-8995-4c9e-a64d-2b1b3577d648-cni-binary-copy\") pod \"multus-additional-cni-plugins-sg6pk\" (UID: \"1cf367ba-8995-4c9e-a64d-2b1b3577d648\") " pod="openshift-multus/multus-additional-cni-plugins-sg6pk" Sep 07 03:57:50.165951 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.165836 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fjfw\" (UniqueName: \"kubernetes.io/projected/c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789-kube-api-access-4fjfw\") pod \"tuned-6rxjb\" (UID: \"c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789\") " pod="openshift-cluster-node-tuning-operator/tuned-6rxjb" Sep 07 03:57:50.166365 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.166147 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1cf367ba-8995-4c9e-a64d-2b1b3577d648-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sg6pk\" (UID: \"1cf367ba-8995-4c9e-a64d-2b1b3577d648\") " pod="openshift-multus/multus-additional-cni-plugins-sg6pk" Sep 07 03:57:50.166365 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.166189 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zkt6\" (UniqueName: \"kubernetes.io/projected/2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9-kube-api-access-9zkt6\") pod \"network-metrics-daemon-bshbg\" (UID: \"2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9\") " pod="openshift-multus/network-metrics-daemon-bshbg" Sep 07 03:57:50.166365 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.166216 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a3e06efa-aad9-4b2e-8f04-27f5765a2b90-konnectivity-ca\") pod \"konnectivity-agent-zz74s\" (UID: \"a3e06efa-aad9-4b2e-8f04-27f5765a2b90\") " pod="kube-system/konnectivity-agent-zz74s" Sep 07 03:57:50.166365 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.166243 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789-etc-sysconfig\") pod \"tuned-6rxjb\" (UID: \"c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789\") " pod="openshift-cluster-node-tuning-operator/tuned-6rxjb" Sep 07 03:57:50.166365 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.166265 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789-etc-kubernetes\") pod \"tuned-6rxjb\" (UID: \"c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789\") " pod="openshift-cluster-node-tuning-operator/tuned-6rxjb" Sep 07 03:57:50.166365 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.166287 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789-tmp\") pod \"tuned-6rxjb\" (UID: \"c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789\") " pod="openshift-cluster-node-tuning-operator/tuned-6rxjb" Sep 07 03:57:50.166365 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.166310 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1cf367ba-8995-4c9e-a64d-2b1b3577d648-cnibin\") pod \"multus-additional-cni-plugins-sg6pk\" (UID: \"1cf367ba-8995-4c9e-a64d-2b1b3577d648\") " pod="openshift-multus/multus-additional-cni-plugins-sg6pk" Sep 07 03:57:50.168481 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.167008 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1cf367ba-8995-4c9e-a64d-2b1b3577d648-system-cni-dir\") pod \"multus-additional-cni-plugins-sg6pk\" (UID: \"1cf367ba-8995-4c9e-a64d-2b1b3577d648\") " pod="openshift-multus/multus-additional-cni-plugins-sg6pk" Sep 07 03:57:50.168481 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.166344 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1cf367ba-8995-4c9e-a64d-2b1b3577d648-cni-binary-copy\") pod \"multus-additional-cni-plugins-sg6pk\" (UID: \"1cf367ba-8995-4c9e-a64d-2b1b3577d648\") " pod="openshift-multus/multus-additional-cni-plugins-sg6pk" Sep 07 03:57:50.168481 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.167213 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/04a78909-1aec-4203-b049-eb51194a1632-host-slash\") pod \"iptables-alerter-6bjt9\" (UID: \"04a78909-1aec-4203-b049-eb51194a1632\") " pod="openshift-network-operator/iptables-alerter-6bjt9" Sep 07 03:57:50.168481 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.166151 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1cf367ba-8995-4c9e-a64d-2b1b3577d648-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sg6pk\" (UID: \"1cf367ba-8995-4c9e-a64d-2b1b3577d648\") " pod="openshift-multus/multus-additional-cni-plugins-sg6pk" Sep 07 03:57:50.168481 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.166350 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/04a78909-1aec-4203-b049-eb51194a1632-host-slash\") pod \"iptables-alerter-6bjt9\" (UID: \"04a78909-1aec-4203-b049-eb51194a1632\") " pod="openshift-network-operator/iptables-alerter-6bjt9" Sep 07 03:57:50.168481 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.167330 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9acda50f-310f-4846-a461-5d45a198cd54-host\") pod \"node-ca-hkdpb\" (UID: \"9acda50f-310f-4846-a461-5d45a198cd54\") " pod="openshift-image-registry/node-ca-hkdpb" Sep 07 03:57:50.168481 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.167342 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1cf367ba-8995-4c9e-a64d-2b1b3577d648-cnibin\") pod \"multus-additional-cni-plugins-sg6pk\" (UID: \"1cf367ba-8995-4c9e-a64d-2b1b3577d648\") " pod="openshift-multus/multus-additional-cni-plugins-sg6pk" Sep 07 03:57:50.168481 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.167371 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2pg2\" (UniqueName: \"kubernetes.io/projected/04a78909-1aec-4203-b049-eb51194a1632-kube-api-access-w2pg2\") pod \"iptables-alerter-6bjt9\" (UID: \"04a78909-1aec-4203-b049-eb51194a1632\") " pod="openshift-network-operator/iptables-alerter-6bjt9" Sep 07 03:57:50.168481 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.167402 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9acda50f-310f-4846-a461-5d45a198cd54-serviceca\") pod \"node-ca-hkdpb\" (UID: \"9acda50f-310f-4846-a461-5d45a198cd54\") " pod="openshift-image-registry/node-ca-hkdpb" Sep 07 03:57:50.168481 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.167460 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789-etc-kubernetes\") pod \"tuned-6rxjb\" (UID: \"c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789\") " pod="openshift-cluster-node-tuning-operator/tuned-6rxjb" Sep 07 03:57:50.168481 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.167474 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9acda50f-310f-4846-a461-5d45a198cd54-host\") pod \"node-ca-hkdpb\" (UID: \"9acda50f-310f-4846-a461-5d45a198cd54\") " pod="openshift-image-registry/node-ca-hkdpb" Sep 07 03:57:50.168481 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.167462 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9-metrics-certs\") pod \"network-metrics-daemon-bshbg\" (UID: \"2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9\") " pod="openshift-multus/network-metrics-daemon-bshbg" Sep 07 03:57:50.168481 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.167531 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789-host\") pod \"tuned-6rxjb\" (UID: \"c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789\") " pod="openshift-cluster-node-tuning-operator/tuned-6rxjb" Sep 07 03:57:50.168481 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.167578 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789-etc-sysctl-conf\") pod \"tuned-6rxjb\" (UID: \"c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789\") " pod="openshift-cluster-node-tuning-operator/tuned-6rxjb" Sep 07 03:57:50.168481 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.167738 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789-etc-sysctl-conf\") pod \"tuned-6rxjb\" (UID: \"c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789\") " pod="openshift-cluster-node-tuning-operator/tuned-6rxjb" Sep 07 03:57:50.168481 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.167797 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789-etc-sysconfig\") pod \"tuned-6rxjb\" (UID: \"c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789\") " pod="openshift-cluster-node-tuning-operator/tuned-6rxjb" Sep 07 03:57:50.168481 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.167944 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9acda50f-310f-4846-a461-5d45a198cd54-serviceca\") pod \"node-ca-hkdpb\" (UID: \"9acda50f-310f-4846-a461-5d45a198cd54\") " pod="openshift-image-registry/node-ca-hkdpb" Sep 07 03:57:50.168481 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.168164 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789-host\") pod \"tuned-6rxjb\" (UID: \"c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789\") " pod="openshift-cluster-node-tuning-operator/tuned-6rxjb" Sep 07 03:57:50.169353 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.168309 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1cf367ba-8995-4c9e-a64d-2b1b3577d648-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sg6pk\" (UID: \"1cf367ba-8995-4c9e-a64d-2b1b3577d648\") " pod="openshift-multus/multus-additional-cni-plugins-sg6pk" Sep 07 03:57:50.169353 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.168442 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a3e06efa-aad9-4b2e-8f04-27f5765a2b90-konnectivity-ca\") pod \"konnectivity-agent-zz74s\" (UID: \"a3e06efa-aad9-4b2e-8f04-27f5765a2b90\") " pod="kube-system/konnectivity-agent-zz74s" Sep 07 03:57:50.169353 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.168456 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a3e06efa-aad9-4b2e-8f04-27f5765a2b90-agent-certs\") pod \"konnectivity-agent-zz74s\" (UID: \"a3e06efa-aad9-4b2e-8f04-27f5765a2b90\") " pod="kube-system/konnectivity-agent-zz74s" Sep 07 03:57:50.169353 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.168692 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/27f19200-987c-44ac-b2bd-695e3989a859-kubelet-config\") pod \"global-pull-secret-syncer-7gs6n\" (UID: \"27f19200-987c-44ac-b2bd-695e3989a859\") " pod="kube-system/global-pull-secret-syncer-7gs6n" Sep 07 03:57:50.169353 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.168727 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789-var-lib-kubelet\") pod \"tuned-6rxjb\" (UID: \"c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789\") " pod="openshift-cluster-node-tuning-operator/tuned-6rxjb" Sep 07 03:57:50.169353 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.168771 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789-etc-sysctl-d\") pod \"tuned-6rxjb\" (UID: \"c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789\") " pod="openshift-cluster-node-tuning-operator/tuned-6rxjb" Sep 07 03:57:50.169353 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.168801 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789-etc-systemd\") pod \"tuned-6rxjb\" (UID: \"c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789\") " pod="openshift-cluster-node-tuning-operator/tuned-6rxjb" Sep 07 03:57:50.169353 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.168820 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/27f19200-987c-44ac-b2bd-695e3989a859-kubelet-config\") pod \"global-pull-secret-syncer-7gs6n\" (UID: \"27f19200-987c-44ac-b2bd-695e3989a859\") " pod="kube-system/global-pull-secret-syncer-7gs6n" Sep 07 03:57:50.169353 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.168831 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789-sys\") pod \"tuned-6rxjb\" (UID: \"c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789\") " pod="openshift-cluster-node-tuning-operator/tuned-6rxjb" Sep 07 03:57:50.169353 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.168872 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789-lib-modules\") pod \"tuned-6rxjb\" (UID: \"c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789\") " pod="openshift-cluster-node-tuning-operator/tuned-6rxjb" Sep 07 03:57:50.169353 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.168888 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789-sys\") pod \"tuned-6rxjb\" (UID: \"c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789\") " pod="openshift-cluster-node-tuning-operator/tuned-6rxjb" Sep 07 03:57:50.169353 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.168895 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1cf367ba-8995-4c9e-a64d-2b1b3577d648-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sg6pk\" (UID: \"1cf367ba-8995-4c9e-a64d-2b1b3577d648\") " pod="openshift-multus/multus-additional-cni-plugins-sg6pk" Sep 07 03:57:50.169353 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.168902 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j9dq\" (UniqueName: \"kubernetes.io/projected/1cf367ba-8995-4c9e-a64d-2b1b3577d648-kube-api-access-7j9dq\") pod \"multus-additional-cni-plugins-sg6pk\" (UID: \"1cf367ba-8995-4c9e-a64d-2b1b3577d648\") " pod="openshift-multus/multus-additional-cni-plugins-sg6pk" Sep 07 03:57:50.169353 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.168962 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789-var-lib-kubelet\") pod \"tuned-6rxjb\" (UID: \"c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789\") " pod="openshift-cluster-node-tuning-operator/tuned-6rxjb" Sep 07 03:57:50.169353 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.168972 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789-etc-modprobe-d\") pod \"tuned-6rxjb\" (UID: \"c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789\") " pod="openshift-cluster-node-tuning-operator/tuned-6rxjb" Sep 07 03:57:50.169353 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.168956 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789-etc-systemd\") pod \"tuned-6rxjb\" (UID: \"c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789\") " pod="openshift-cluster-node-tuning-operator/tuned-6rxjb" Sep 07 03:57:50.169353 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.169000 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789-run\") pod \"tuned-6rxjb\" (UID: \"c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789\") " pod="openshift-cluster-node-tuning-operator/tuned-6rxjb" Sep 07 03:57:50.170094 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.169035 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/04a78909-1aec-4203-b049-eb51194a1632-iptables-alerter-script\") pod \"iptables-alerter-6bjt9\" (UID: \"04a78909-1aec-4203-b049-eb51194a1632\") " pod="openshift-network-operator/iptables-alerter-6bjt9" Sep 07 03:57:50.170094 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.169063 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27f19200-987c-44ac-b2bd-695e3989a859-original-pull-secret\") pod \"global-pull-secret-syncer-7gs6n\" (UID: \"27f19200-987c-44ac-b2bd-695e3989a859\") " pod="kube-system/global-pull-secret-syncer-7gs6n" Sep 07 03:57:50.170094 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.169080 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789-etc-modprobe-d\") pod \"tuned-6rxjb\" (UID: \"c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789\") " pod="openshift-cluster-node-tuning-operator/tuned-6rxjb" Sep 07 03:57:50.170094 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.169092 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789-etc-sysctl-d\") pod \"tuned-6rxjb\" (UID: \"c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789\") " pod="openshift-cluster-node-tuning-operator/tuned-6rxjb" Sep 07 03:57:50.170094 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.169171 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789-lib-modules\") pod \"tuned-6rxjb\" (UID: \"c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789\") " pod="openshift-cluster-node-tuning-operator/tuned-6rxjb" Sep 07 03:57:50.170094 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.169297 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1cf367ba-8995-4c9e-a64d-2b1b3577d648-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sg6pk\" (UID: \"1cf367ba-8995-4c9e-a64d-2b1b3577d648\") " pod="openshift-multus/multus-additional-cni-plugins-sg6pk" Sep 07 03:57:50.170094 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:50.169426 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 03:57:50.170094 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:50.169470 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 03:57:50.170094 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:50.169514 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9-metrics-certs podName:2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9 nodeName:}" failed. No retries permitted until 2026-09-07 03:57:50.669488571 +0000 UTC m=+3.089863276 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9-metrics-certs") pod "network-metrics-daemon-bshbg" (UID: "2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 03:57:50.170094 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:50.169537 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27f19200-987c-44ac-b2bd-695e3989a859-original-pull-secret podName:27f19200-987c-44ac-b2bd-695e3989a859 nodeName:}" failed. No retries permitted until 2026-09-07 03:57:50.669522427 +0000 UTC m=+3.089897141 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27f19200-987c-44ac-b2bd-695e3989a859-original-pull-secret") pod "global-pull-secret-syncer-7gs6n" (UID: "27f19200-987c-44ac-b2bd-695e3989a859") : object "kube-system"/"original-pull-secret" not registered Sep 07 03:57:50.170094 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.169560 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/04a78909-1aec-4203-b049-eb51194a1632-iptables-alerter-script\") pod \"iptables-alerter-6bjt9\" (UID: \"04a78909-1aec-4203-b049-eb51194a1632\") " pod="openshift-network-operator/iptables-alerter-6bjt9" Sep 07 03:57:50.170094 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.169579 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789-run\") pod \"tuned-6rxjb\" (UID: \"c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789\") " pod="openshift-cluster-node-tuning-operator/tuned-6rxjb" Sep 07 03:57:50.172177 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.172117 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789-etc-tuned\") pod \"tuned-6rxjb\" (UID: \"c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789\") " pod="openshift-cluster-node-tuning-operator/tuned-6rxjb" Sep 07 03:57:50.174085 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.174063 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hf9n\" (UniqueName: \"kubernetes.io/projected/9acda50f-310f-4846-a461-5d45a198cd54-kube-api-access-5hf9n\") pod \"node-ca-hkdpb\" (UID: \"9acda50f-310f-4846-a461-5d45a198cd54\") " pod="openshift-image-registry/node-ca-hkdpb" Sep 07 03:57:50.174178 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.174098 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fjfw\" (UniqueName: \"kubernetes.io/projected/c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789-kube-api-access-4fjfw\") pod \"tuned-6rxjb\" (UID: \"c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789\") " pod="openshift-cluster-node-tuning-operator/tuned-6rxjb" Sep 07 03:57:50.174492 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.174468 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789-tmp\") pod \"tuned-6rxjb\" (UID: \"c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789\") " pod="openshift-cluster-node-tuning-operator/tuned-6rxjb" Sep 07 03:57:50.175849 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.175830 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zkt6\" (UniqueName: \"kubernetes.io/projected/2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9-kube-api-access-9zkt6\") pod \"network-metrics-daemon-bshbg\" (UID: \"2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9\") " pod="openshift-multus/network-metrics-daemon-bshbg" Sep 07 03:57:50.176120 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.176099 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2pg2\" (UniqueName: \"kubernetes.io/projected/04a78909-1aec-4203-b049-eb51194a1632-kube-api-access-w2pg2\") pod \"iptables-alerter-6bjt9\" (UID: \"04a78909-1aec-4203-b049-eb51194a1632\") " pod="openshift-network-operator/iptables-alerter-6bjt9" Sep 07 03:57:50.177018 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.177000 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j9dq\" (UniqueName: \"kubernetes.io/projected/1cf367ba-8995-4c9e-a64d-2b1b3577d648-kube-api-access-7j9dq\") pod \"multus-additional-cni-plugins-sg6pk\" (UID: \"1cf367ba-8995-4c9e-a64d-2b1b3577d648\") " pod="openshift-multus/multus-additional-cni-plugins-sg6pk" Sep 07 03:57:50.256357 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.256328 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnwmn" Sep 07 03:57:50.264246 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.264228 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:57:50.273851 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.273830 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j2xph" Sep 07 03:57:50.278994 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.278977 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2fxtz" Sep 07 03:57:50.287417 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.287398 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6bjt9" Sep 07 03:57:50.293998 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.293976 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hkdpb" Sep 07 03:57:50.301684 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.301667 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zz74s" Sep 07 03:57:50.309268 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.309249 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6rxjb" Sep 07 03:57:50.315735 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.315717 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sg6pk" Sep 07 03:57:50.572236 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.572156 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cr7h\" (UniqueName: \"kubernetes.io/projected/31a21753-1b6d-4d23-a382-b2d0794b9837-kube-api-access-4cr7h\") pod \"network-check-target-79dgl\" (UID: \"31a21753-1b6d-4d23-a382-b2d0794b9837\") " pod="openshift-network-diagnostics/network-check-target-79dgl" Sep 07 03:57:50.572394 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:50.572313 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 03:57:50.572394 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:50.572336 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 03:57:50.572394 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:50.572348 2566 projected.go:196] Error preparing data for projected volume kube-api-access-4cr7h for pod openshift-network-diagnostics/network-check-target-79dgl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 03:57:50.572521 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:50.572408 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31a21753-1b6d-4d23-a382-b2d0794b9837-kube-api-access-4cr7h podName:31a21753-1b6d-4d23-a382-b2d0794b9837 nodeName:}" failed. No retries permitted until 2026-09-07 03:57:51.572394015 +0000 UTC m=+3.992768721 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4cr7h" (UniqueName: "kubernetes.io/projected/31a21753-1b6d-4d23-a382-b2d0794b9837-kube-api-access-4cr7h") pod "network-check-target-79dgl" (UID: "31a21753-1b6d-4d23-a382-b2d0794b9837") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 03:57:50.672624 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.672592 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27f19200-987c-44ac-b2bd-695e3989a859-original-pull-secret\") pod \"global-pull-secret-syncer-7gs6n\" (UID: \"27f19200-987c-44ac-b2bd-695e3989a859\") " pod="kube-system/global-pull-secret-syncer-7gs6n" Sep 07 03:57:50.672792 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.672660 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9-metrics-certs\") pod \"network-metrics-daemon-bshbg\" (UID: \"2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9\") " pod="openshift-multus/network-metrics-daemon-bshbg" Sep 07 03:57:50.672792 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:50.672756 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 03:57:50.672792 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:50.672765 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 03:57:50.672907 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:50.672812 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9-metrics-certs podName:2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9 nodeName:}" failed. No retries permitted until 2026-09-07 03:57:51.672797224 +0000 UTC m=+4.093171927 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9-metrics-certs") pod "network-metrics-daemon-bshbg" (UID: "2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 03:57:50.672907 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:50.672847 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27f19200-987c-44ac-b2bd-695e3989a859-original-pull-secret podName:27f19200-987c-44ac-b2bd-695e3989a859 nodeName:}" failed. No retries permitted until 2026-09-07 03:57:51.672828658 +0000 UTC m=+4.093203377 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27f19200-987c-44ac-b2bd-695e3989a859-original-pull-secret") pod "global-pull-secret-syncer-7gs6n" (UID: "27f19200-987c-44ac-b2bd-695e3989a859") : object "kube-system"/"original-pull-secret" not registered Sep 07 03:57:50.927100 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:50.927073 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc83ccf30_d7f7_425a_b6b9_d8e7d2a2b789.slice/crio-04a137f86de5f3909723bc397671c12778a2fef64b3d616ac4d4092e9384f22c WatchSource:0}: Error finding container 04a137f86de5f3909723bc397671c12778a2fef64b3d616ac4d4092e9384f22c: Status 404 returned error can't find the container with id 04a137f86de5f3909723bc397671c12778a2fef64b3d616ac4d4092e9384f22c Sep 07 03:57:50.928464 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:50.928432 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9acda50f_310f_4846_a461_5d45a198cd54.slice/crio-3ce93bcf9dcc18304d9e6c55fc83feb742f1b8345f104395793b3a4eff049259 WatchSource:0}: Error finding container 3ce93bcf9dcc18304d9e6c55fc83feb742f1b8345f104395793b3a4eff049259: Status 404 returned error can't find the container with id 3ce93bcf9dcc18304d9e6c55fc83feb742f1b8345f104395793b3a4eff049259 Sep 07 03:57:50.929092 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:50.929072 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd84c7c95_f426_47f3_82ce_19f90665ec16.slice/crio-037a42a4c63c62d88af086ffa10b2cef72bce7d8346b6ec9fa72351bc5f74c7a WatchSource:0}: Error finding container 037a42a4c63c62d88af086ffa10b2cef72bce7d8346b6ec9fa72351bc5f74c7a: Status 404 returned error can't find the container with id 037a42a4c63c62d88af086ffa10b2cef72bce7d8346b6ec9fa72351bc5f74c7a Sep 07 03:57:50.932312 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:50.932289 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cf367ba_8995_4c9e_a64d_2b1b3577d648.slice/crio-946c135ffd5f4f5c71cd1d2161ffdc7f3cdb4f97d7de17a7a43ca226cd3e2f3c WatchSource:0}: Error finding container 946c135ffd5f4f5c71cd1d2161ffdc7f3cdb4f97d7de17a7a43ca226cd3e2f3c: Status 404 returned error can't find the container with id 946c135ffd5f4f5c71cd1d2161ffdc7f3cdb4f97d7de17a7a43ca226cd3e2f3c Sep 07 03:57:50.933602 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:50.933581 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f6840b8_fcfe_4c33_8275_80fd1864e452.slice/crio-2d437398023c2859df162bd3afe870575cb1ac75988ade2e24135ea7b31b73cb WatchSource:0}: Error finding container 2d437398023c2859df162bd3afe870575cb1ac75988ade2e24135ea7b31b73cb: Status 404 returned error can't find the container with id 2d437398023c2859df162bd3afe870575cb1ac75988ade2e24135ea7b31b73cb Sep 07 03:57:50.954165 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:50.954138 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04a78909_1aec_4203_b049_eb51194a1632.slice/crio-bccb4ac7a1b9507fedd43556d668f88b5b2af46582c74884fdce6adfdd4f24ad WatchSource:0}: Error finding container bccb4ac7a1b9507fedd43556d668f88b5b2af46582c74884fdce6adfdd4f24ad: Status 404 returned error can't find the container with id bccb4ac7a1b9507fedd43556d668f88b5b2af46582c74884fdce6adfdd4f24ad Sep 07 03:57:50.954822 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:50.954800 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod550f6b92_213b_4ca0_9324_1fdf41107530.slice/crio-683cbb17d380660fe627dc3cfeaaa81e787e9ca9920592503b9b44731a672996 WatchSource:0}: Error finding container 683cbb17d380660fe627dc3cfeaaa81e787e9ca9920592503b9b44731a672996: Status 404 returned error can't find the container with id 683cbb17d380660fe627dc3cfeaaa81e787e9ca9920592503b9b44731a672996 Sep 07 03:57:50.955675 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:50.955657 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5c78be9_7199_4898_8b64_335079a42ce2.slice/crio-6fcc2fb3d701aed36f9992c3c6756805fe4abc268b2bc303233c73176c1b1c61 WatchSource:0}: Error finding container 6fcc2fb3d701aed36f9992c3c6756805fe4abc268b2bc303233c73176c1b1c61: Status 404 returned error can't find the container with id 6fcc2fb3d701aed36f9992c3c6756805fe4abc268b2bc303233c73176c1b1c61 Sep 07 03:57:50.957345 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:57:50.957325 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3e06efa_aad9_4b2e_8f04_27f5765a2b90.slice/crio-2f85c5892c37c9dd954efecbe341c83bfa5ecd453849ba2f687d10641231350b WatchSource:0}: Error finding container 2f85c5892c37c9dd954efecbe341c83bfa5ecd453849ba2f687d10641231350b: Status 404 returned error can't find the container with id 2f85c5892c37c9dd954efecbe341c83bfa5ecd453849ba2f687d10641231350b Sep 07 03:57:50.994020 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.993954 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 03:52:49 +0000 UTC" deadline="2028-02-06 12:16:23.551597724 +0000 UTC" Sep 07 03:57:50.994127 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:50.994021 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12416h18m32.557581021s" Sep 07 03:57:51.082691 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:51.082660 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bshbg" Sep 07 03:57:51.082833 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:51.082663 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7gs6n" Sep 07 03:57:51.082833 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:51.082812 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bshbg" podUID="2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9" Sep 07 03:57:51.082948 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:51.082928 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7gs6n" podUID="27f19200-987c-44ac-b2bd-695e3989a859" Sep 07 03:57:51.091834 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:51.091812 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zz74s" event={"ID":"a3e06efa-aad9-4b2e-8f04-27f5765a2b90","Type":"ContainerStarted","Data":"2f85c5892c37c9dd954efecbe341c83bfa5ecd453849ba2f687d10641231350b"} Sep 07 03:57:51.093197 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:51.093147 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2fxtz" event={"ID":"550f6b92-213b-4ca0-9324-1fdf41107530","Type":"ContainerStarted","Data":"683cbb17d380660fe627dc3cfeaaa81e787e9ca9920592503b9b44731a672996"} Sep 07 03:57:51.094286 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:51.094262 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sg6pk" event={"ID":"1cf367ba-8995-4c9e-a64d-2b1b3577d648","Type":"ContainerStarted","Data":"946c135ffd5f4f5c71cd1d2161ffdc7f3cdb4f97d7de17a7a43ca226cd3e2f3c"} Sep 07 03:57:51.095428 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:51.095410 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6rxjb" event={"ID":"c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789","Type":"ContainerStarted","Data":"04a137f86de5f3909723bc397671c12778a2fef64b3d616ac4d4092e9384f22c"} Sep 07 03:57:51.097403 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:51.097378 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-125.ec2.internal" event={"ID":"ba5931dfbb1cb6ce0bae7ffbbefa796b","Type":"ContainerStarted","Data":"4fe8d1b696816f2f274b652b30a23f782eb1906f28081ed413f6b94c936ce88a"} Sep 07 03:57:51.098680 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:51.098657 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j2xph" event={"ID":"d5c78be9-7199-4898-8b64-335079a42ce2","Type":"ContainerStarted","Data":"6fcc2fb3d701aed36f9992c3c6756805fe4abc268b2bc303233c73176c1b1c61"} Sep 07 03:57:51.099876 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:51.099842 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6bjt9" event={"ID":"04a78909-1aec-4203-b049-eb51194a1632","Type":"ContainerStarted","Data":"bccb4ac7a1b9507fedd43556d668f88b5b2af46582c74884fdce6adfdd4f24ad"} Sep 07 03:57:51.101036 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:51.100990 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" event={"ID":"7f6840b8-fcfe-4c33-8275-80fd1864e452","Type":"ContainerStarted","Data":"2d437398023c2859df162bd3afe870575cb1ac75988ade2e24135ea7b31b73cb"} Sep 07 03:57:51.102032 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:51.102010 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnwmn" event={"ID":"d84c7c95-f426-47f3-82ce-19f90665ec16","Type":"ContainerStarted","Data":"037a42a4c63c62d88af086ffa10b2cef72bce7d8346b6ec9fa72351bc5f74c7a"} Sep 07 03:57:51.103015 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:51.102996 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hkdpb" event={"ID":"9acda50f-310f-4846-a461-5d45a198cd54","Type":"ContainerStarted","Data":"3ce93bcf9dcc18304d9e6c55fc83feb742f1b8345f104395793b3a4eff049259"} Sep 07 03:57:51.579169 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:51.579083 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cr7h\" (UniqueName: \"kubernetes.io/projected/31a21753-1b6d-4d23-a382-b2d0794b9837-kube-api-access-4cr7h\") pod \"network-check-target-79dgl\" (UID: \"31a21753-1b6d-4d23-a382-b2d0794b9837\") " pod="openshift-network-diagnostics/network-check-target-79dgl" Sep 07 03:57:51.579350 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:51.579312 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 03:57:51.579350 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:51.579335 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 03:57:51.579350 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:51.579348 2566 projected.go:196] Error preparing data for projected volume kube-api-access-4cr7h for pod openshift-network-diagnostics/network-check-target-79dgl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 03:57:51.579505 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:51.579409 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31a21753-1b6d-4d23-a382-b2d0794b9837-kube-api-access-4cr7h podName:31a21753-1b6d-4d23-a382-b2d0794b9837 nodeName:}" failed. No retries permitted until 2026-09-07 03:57:53.579389043 +0000 UTC m=+5.999763749 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4cr7h" (UniqueName: "kubernetes.io/projected/31a21753-1b6d-4d23-a382-b2d0794b9837-kube-api-access-4cr7h") pod "network-check-target-79dgl" (UID: "31a21753-1b6d-4d23-a382-b2d0794b9837") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 03:57:51.681247 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:51.680499 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9-metrics-certs\") pod \"network-metrics-daemon-bshbg\" (UID: \"2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9\") " pod="openshift-multus/network-metrics-daemon-bshbg" Sep 07 03:57:51.681247 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:51.680574 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27f19200-987c-44ac-b2bd-695e3989a859-original-pull-secret\") pod \"global-pull-secret-syncer-7gs6n\" (UID: \"27f19200-987c-44ac-b2bd-695e3989a859\") " pod="kube-system/global-pull-secret-syncer-7gs6n" Sep 07 03:57:51.681247 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:51.680721 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 03:57:51.681247 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:51.680781 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27f19200-987c-44ac-b2bd-695e3989a859-original-pull-secret podName:27f19200-987c-44ac-b2bd-695e3989a859 nodeName:}" failed. No retries permitted until 2026-09-07 03:57:53.680764 +0000 UTC m=+6.101138705 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27f19200-987c-44ac-b2bd-695e3989a859-original-pull-secret") pod "global-pull-secret-syncer-7gs6n" (UID: "27f19200-987c-44ac-b2bd-695e3989a859") : object "kube-system"/"original-pull-secret" not registered Sep 07 03:57:51.681247 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:51.681165 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 03:57:51.681247 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:51.681212 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9-metrics-certs podName:2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9 nodeName:}" failed. No retries permitted until 2026-09-07 03:57:53.681197024 +0000 UTC m=+6.101571729 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9-metrics-certs") pod "network-metrics-daemon-bshbg" (UID: "2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 03:57:51.999701 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:51.994112 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 03:52:49 +0000 UTC" deadline="2028-06-02 09:41:34.176436084 +0000 UTC" Sep 07 03:57:51.999701 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:51.994155 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15221h43m42.182285872s" Sep 07 03:57:52.085524 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:52.084511 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-79dgl" Sep 07 03:57:52.085524 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:52.084651 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-79dgl" podUID="31a21753-1b6d-4d23-a382-b2d0794b9837" Sep 07 03:57:52.113544 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:52.113509 2566 generic.go:356] "Generic (PLEG): container finished" podID="f60cefb4c31f4cfc617414d028d68a25" containerID="dcd091af290fe81d58dc26586054a4c0c3d70a9d79afa0e767ddb56e8183ad74" exitCode=0 Sep 07 03:57:52.114089 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:52.114063 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-125.ec2.internal" event={"ID":"f60cefb4c31f4cfc617414d028d68a25","Type":"ContainerDied","Data":"dcd091af290fe81d58dc26586054a4c0c3d70a9d79afa0e767ddb56e8183ad74"} Sep 07 03:57:52.128141 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:52.128095 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-125.ec2.internal" podStartSLOduration=3.128075372 podStartE2EDuration="3.128075372s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 03:57:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:57:51.108894743 +0000 UTC m=+3.529269465" watchObservedRunningTime="2026-09-07 03:57:52.128075372 +0000 UTC m=+4.548450097" Sep 07 03:57:53.082305 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:53.082063 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7gs6n" Sep 07 03:57:53.082305 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:53.082302 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bshbg" Sep 07 03:57:53.082829 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:53.082408 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7gs6n" podUID="27f19200-987c-44ac-b2bd-695e3989a859" Sep 07 03:57:53.082829 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:53.082815 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bshbg" podUID="2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9" Sep 07 03:57:53.132513 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:53.132478 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-125.ec2.internal" event={"ID":"f60cefb4c31f4cfc617414d028d68a25","Type":"ContainerStarted","Data":"ae56a65206cff0d65d7f66429c6b0d71b09f3fa4922829153b63f87055284a7a"} Sep 07 03:57:53.599916 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:53.599878 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cr7h\" (UniqueName: \"kubernetes.io/projected/31a21753-1b6d-4d23-a382-b2d0794b9837-kube-api-access-4cr7h\") pod \"network-check-target-79dgl\" (UID: \"31a21753-1b6d-4d23-a382-b2d0794b9837\") " pod="openshift-network-diagnostics/network-check-target-79dgl" Sep 07 03:57:53.600110 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:53.600091 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 03:57:53.600178 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:53.600115 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 03:57:53.600178 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:53.600128 2566 projected.go:196] Error preparing data for projected volume kube-api-access-4cr7h for pod openshift-network-diagnostics/network-check-target-79dgl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 03:57:53.600273 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:53.600186 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31a21753-1b6d-4d23-a382-b2d0794b9837-kube-api-access-4cr7h podName:31a21753-1b6d-4d23-a382-b2d0794b9837 nodeName:}" failed. No retries permitted until 2026-09-07 03:57:57.600168643 +0000 UTC m=+10.020543363 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4cr7h" (UniqueName: "kubernetes.io/projected/31a21753-1b6d-4d23-a382-b2d0794b9837-kube-api-access-4cr7h") pod "network-check-target-79dgl" (UID: "31a21753-1b6d-4d23-a382-b2d0794b9837") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 03:57:53.700641 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:53.700589 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9-metrics-certs\") pod \"network-metrics-daemon-bshbg\" (UID: \"2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9\") " pod="openshift-multus/network-metrics-daemon-bshbg" Sep 07 03:57:53.700829 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:53.700692 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27f19200-987c-44ac-b2bd-695e3989a859-original-pull-secret\") pod \"global-pull-secret-syncer-7gs6n\" (UID: \"27f19200-987c-44ac-b2bd-695e3989a859\") " pod="kube-system/global-pull-secret-syncer-7gs6n" Sep 07 03:57:53.700829 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:53.700819 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 03:57:53.700935 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:53.700881 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27f19200-987c-44ac-b2bd-695e3989a859-original-pull-secret podName:27f19200-987c-44ac-b2bd-695e3989a859 nodeName:}" failed. No retries permitted until 2026-09-07 03:57:57.700862326 +0000 UTC m=+10.121237055 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27f19200-987c-44ac-b2bd-695e3989a859-original-pull-secret") pod "global-pull-secret-syncer-7gs6n" (UID: "27f19200-987c-44ac-b2bd-695e3989a859") : object "kube-system"/"original-pull-secret" not registered Sep 07 03:57:53.701283 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:53.701259 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 03:57:53.701377 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:53.701321 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9-metrics-certs podName:2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9 nodeName:}" failed. No retries permitted until 2026-09-07 03:57:57.701305283 +0000 UTC m=+10.121680025 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9-metrics-certs") pod "network-metrics-daemon-bshbg" (UID: "2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 03:57:54.083877 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:54.083799 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-79dgl" Sep 07 03:57:54.084303 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:54.083929 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-79dgl" podUID="31a21753-1b6d-4d23-a382-b2d0794b9837" Sep 07 03:57:55.082112 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:55.082080 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7gs6n" Sep 07 03:57:55.082299 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:55.082214 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7gs6n" podUID="27f19200-987c-44ac-b2bd-695e3989a859" Sep 07 03:57:55.082299 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:55.082256 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bshbg" Sep 07 03:57:55.082415 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:55.082361 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bshbg" podUID="2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9" Sep 07 03:57:56.083654 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:56.082715 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-79dgl" Sep 07 03:57:56.083654 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:56.082853 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-79dgl" podUID="31a21753-1b6d-4d23-a382-b2d0794b9837" Sep 07 03:57:57.082073 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:57.082010 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bshbg" Sep 07 03:57:57.082184 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:57.082160 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bshbg" podUID="2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9" Sep 07 03:57:57.082244 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:57.082225 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7gs6n" Sep 07 03:57:57.082333 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:57.082317 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7gs6n" podUID="27f19200-987c-44ac-b2bd-695e3989a859" Sep 07 03:57:57.644755 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:57.644716 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cr7h\" (UniqueName: \"kubernetes.io/projected/31a21753-1b6d-4d23-a382-b2d0794b9837-kube-api-access-4cr7h\") pod \"network-check-target-79dgl\" (UID: \"31a21753-1b6d-4d23-a382-b2d0794b9837\") " pod="openshift-network-diagnostics/network-check-target-79dgl" Sep 07 03:57:57.645217 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:57.644891 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 03:57:57.645217 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:57.644911 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 03:57:57.645217 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:57.644923 2566 projected.go:196] Error preparing data for projected volume kube-api-access-4cr7h for pod openshift-network-diagnostics/network-check-target-79dgl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 03:57:57.645217 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:57.644990 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31a21753-1b6d-4d23-a382-b2d0794b9837-kube-api-access-4cr7h podName:31a21753-1b6d-4d23-a382-b2d0794b9837 nodeName:}" failed. No retries permitted until 2026-09-07 03:58:05.64496857 +0000 UTC m=+18.065343291 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4cr7h" (UniqueName: "kubernetes.io/projected/31a21753-1b6d-4d23-a382-b2d0794b9837-kube-api-access-4cr7h") pod "network-check-target-79dgl" (UID: "31a21753-1b6d-4d23-a382-b2d0794b9837") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 03:57:57.746141 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:57.746100 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9-metrics-certs\") pod \"network-metrics-daemon-bshbg\" (UID: \"2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9\") " pod="openshift-multus/network-metrics-daemon-bshbg" Sep 07 03:57:57.746380 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:57.746192 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27f19200-987c-44ac-b2bd-695e3989a859-original-pull-secret\") pod \"global-pull-secret-syncer-7gs6n\" (UID: \"27f19200-987c-44ac-b2bd-695e3989a859\") " pod="kube-system/global-pull-secret-syncer-7gs6n" Sep 07 03:57:57.746380 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:57.746273 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 03:57:57.746380 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:57.746304 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 03:57:57.746380 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:57.746351 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9-metrics-certs podName:2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9 nodeName:}" failed. No retries permitted until 2026-09-07 03:58:05.746330601 +0000 UTC m=+18.166705324 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9-metrics-certs") pod "network-metrics-daemon-bshbg" (UID: "2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 03:57:57.746380 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:57.746369 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27f19200-987c-44ac-b2bd-695e3989a859-original-pull-secret podName:27f19200-987c-44ac-b2bd-695e3989a859 nodeName:}" failed. No retries permitted until 2026-09-07 03:58:05.746360827 +0000 UTC m=+18.166735532 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27f19200-987c-44ac-b2bd-695e3989a859-original-pull-secret") pod "global-pull-secret-syncer-7gs6n" (UID: "27f19200-987c-44ac-b2bd-695e3989a859") : object "kube-system"/"original-pull-secret" not registered Sep 07 03:57:58.082838 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:58.082756 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-79dgl" Sep 07 03:57:58.083002 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:58.082871 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-79dgl" podUID="31a21753-1b6d-4d23-a382-b2d0794b9837" Sep 07 03:57:59.082743 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:59.082712 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7gs6n" Sep 07 03:57:59.083080 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:59.082843 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7gs6n" podUID="27f19200-987c-44ac-b2bd-695e3989a859" Sep 07 03:57:59.083080 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:57:59.082965 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bshbg" Sep 07 03:57:59.083159 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:57:59.083079 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bshbg" podUID="2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9" Sep 07 03:58:00.082581 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:00.082549 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-79dgl" Sep 07 03:58:00.082775 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:00.082690 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-79dgl" podUID="31a21753-1b6d-4d23-a382-b2d0794b9837" Sep 07 03:58:01.081916 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:01.081880 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7gs6n" Sep 07 03:58:01.082096 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:01.081880 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bshbg" Sep 07 03:58:01.082096 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:01.081976 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7gs6n" podUID="27f19200-987c-44ac-b2bd-695e3989a859" Sep 07 03:58:01.082096 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:01.082084 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bshbg" podUID="2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9" Sep 07 03:58:02.081895 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:02.081864 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-79dgl" Sep 07 03:58:02.082302 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:02.081961 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-79dgl" podUID="31a21753-1b6d-4d23-a382-b2d0794b9837" Sep 07 03:58:03.081848 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:03.081808 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7gs6n" Sep 07 03:58:03.082018 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:03.081942 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7gs6n" podUID="27f19200-987c-44ac-b2bd-695e3989a859" Sep 07 03:58:03.082018 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:03.082003 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bshbg" Sep 07 03:58:03.082433 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:03.082139 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bshbg" podUID="2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9" Sep 07 03:58:04.082402 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:04.082369 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-79dgl" Sep 07 03:58:04.082838 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:04.082490 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-79dgl" podUID="31a21753-1b6d-4d23-a382-b2d0794b9837" Sep 07 03:58:05.081877 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:05.081837 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7gs6n" Sep 07 03:58:05.082122 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:05.081851 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bshbg" Sep 07 03:58:05.082122 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:05.081988 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7gs6n" podUID="27f19200-987c-44ac-b2bd-695e3989a859" Sep 07 03:58:05.082122 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:05.082059 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bshbg" podUID="2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9" Sep 07 03:58:05.703272 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:05.703226 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cr7h\" (UniqueName: \"kubernetes.io/projected/31a21753-1b6d-4d23-a382-b2d0794b9837-kube-api-access-4cr7h\") pod \"network-check-target-79dgl\" (UID: \"31a21753-1b6d-4d23-a382-b2d0794b9837\") " pod="openshift-network-diagnostics/network-check-target-79dgl" Sep 07 03:58:05.703660 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:05.703422 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 03:58:05.703660 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:05.703446 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 03:58:05.703660 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:05.703460 2566 projected.go:196] Error preparing data for projected volume kube-api-access-4cr7h for pod openshift-network-diagnostics/network-check-target-79dgl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 03:58:05.703660 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:05.703521 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31a21753-1b6d-4d23-a382-b2d0794b9837-kube-api-access-4cr7h podName:31a21753-1b6d-4d23-a382-b2d0794b9837 nodeName:}" failed. No retries permitted until 2026-09-07 03:58:21.703508199 +0000 UTC m=+34.123882900 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4cr7h" (UniqueName: "kubernetes.io/projected/31a21753-1b6d-4d23-a382-b2d0794b9837-kube-api-access-4cr7h") pod "network-check-target-79dgl" (UID: "31a21753-1b6d-4d23-a382-b2d0794b9837") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 03:58:05.804368 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:05.804331 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9-metrics-certs\") pod \"network-metrics-daemon-bshbg\" (UID: \"2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9\") " pod="openshift-multus/network-metrics-daemon-bshbg" Sep 07 03:58:05.804543 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:05.804397 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27f19200-987c-44ac-b2bd-695e3989a859-original-pull-secret\") pod \"global-pull-secret-syncer-7gs6n\" (UID: \"27f19200-987c-44ac-b2bd-695e3989a859\") " pod="kube-system/global-pull-secret-syncer-7gs6n" Sep 07 03:58:05.804543 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:05.804488 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 03:58:05.804543 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:05.804514 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 03:58:05.804677 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:05.804573 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9-metrics-certs podName:2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9 nodeName:}" failed. No retries permitted until 2026-09-07 03:58:21.804554666 +0000 UTC m=+34.224929373 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9-metrics-certs") pod "network-metrics-daemon-bshbg" (UID: "2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 03:58:05.804677 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:05.804592 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27f19200-987c-44ac-b2bd-695e3989a859-original-pull-secret podName:27f19200-987c-44ac-b2bd-695e3989a859 nodeName:}" failed. No retries permitted until 2026-09-07 03:58:21.80458386 +0000 UTC m=+34.224958565 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27f19200-987c-44ac-b2bd-695e3989a859-original-pull-secret") pod "global-pull-secret-syncer-7gs6n" (UID: "27f19200-987c-44ac-b2bd-695e3989a859") : object "kube-system"/"original-pull-secret" not registered Sep 07 03:58:06.082830 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:06.082758 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-79dgl" Sep 07 03:58:06.082978 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:06.082875 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-79dgl" podUID="31a21753-1b6d-4d23-a382-b2d0794b9837" Sep 07 03:58:07.082563 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:07.082534 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bshbg" Sep 07 03:58:07.082991 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:07.082537 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7gs6n" Sep 07 03:58:07.082991 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:07.082683 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bshbg" podUID="2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9" Sep 07 03:58:07.082991 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:07.082745 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7gs6n" podUID="27f19200-987c-44ac-b2bd-695e3989a859" Sep 07 03:58:08.083368 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:08.083336 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-79dgl" Sep 07 03:58:08.083830 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:08.083448 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-79dgl" podUID="31a21753-1b6d-4d23-a382-b2d0794b9837" Sep 07 03:58:09.082534 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:09.082360 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bshbg" Sep 07 03:58:09.082667 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:09.082381 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7gs6n" Sep 07 03:58:09.082713 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:09.082660 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bshbg" podUID="2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9" Sep 07 03:58:09.082713 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:09.082701 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7gs6n" podUID="27f19200-987c-44ac-b2bd-695e3989a859" Sep 07 03:58:09.164846 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:09.164815 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j2xph" event={"ID":"d5c78be9-7199-4898-8b64-335079a42ce2","Type":"ContainerStarted","Data":"1c8f617d5333593bb07cc745c290e976888ef0ff4f972063b5468fca41456d11"} Sep 07 03:58:09.167816 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:09.167562 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" event={"ID":"7f6840b8-fcfe-4c33-8275-80fd1864e452","Type":"ContainerStarted","Data":"efb241d386a5724c4ed8b30d816468061b5bd6772c25a304f079b18b7e897e4d"} Sep 07 03:58:09.167940 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:09.167875 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" event={"ID":"7f6840b8-fcfe-4c33-8275-80fd1864e452","Type":"ContainerStarted","Data":"aaf8ba1507aefd6d3a482c47ad76db58d50b07546092eb233ed5fe62f55225ab"} Sep 07 03:58:09.167940 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:09.167917 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" event={"ID":"7f6840b8-fcfe-4c33-8275-80fd1864e452","Type":"ContainerStarted","Data":"b7925894920ca13639d1842e47caa10667771b1e91c81c5a92215a552819a365"} Sep 07 03:58:09.168019 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:09.167946 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" event={"ID":"7f6840b8-fcfe-4c33-8275-80fd1864e452","Type":"ContainerStarted","Data":"a061f84c9cb3b62498cc20d14b298ec961c9ce36a52eabceebe2e1279ce5298d"} Sep 07 03:58:09.168019 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:09.167986 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" event={"ID":"7f6840b8-fcfe-4c33-8275-80fd1864e452","Type":"ContainerStarted","Data":"ab128bf3e6d75b29172c2a57f54a40b59eda22180301416edb863b314ea0c2fa"} Sep 07 03:58:09.169074 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:09.169056 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnwmn" event={"ID":"d84c7c95-f426-47f3-82ce-19f90665ec16","Type":"ContainerStarted","Data":"7c590fbd36ab691e548525cf13c62c6feb037e1d781c79471ca9050e0986d353"} Sep 07 03:58:09.170405 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:09.170388 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hkdpb" event={"ID":"9acda50f-310f-4846-a461-5d45a198cd54","Type":"ContainerStarted","Data":"777342d9b6b618cc737ec6aa25080972bc40c6caec3da745dbcd49f3bc247b35"} Sep 07 03:58:09.171673 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:09.171654 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zz74s" event={"ID":"a3e06efa-aad9-4b2e-8f04-27f5765a2b90","Type":"ContainerStarted","Data":"a671e45b947f6ea33f22d731a43f1108484acedc50d543ff5bd7ed9d66735e79"} Sep 07 03:58:09.173008 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:09.172991 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2fxtz" event={"ID":"550f6b92-213b-4ca0-9324-1fdf41107530","Type":"ContainerStarted","Data":"2b46dfba7825e298808a0973d74293d56e27f2fefcd941eb73ec23af8f929db4"} Sep 07 03:58:09.174381 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:09.174359 2566 generic.go:356] "Generic (PLEG): container finished" podID="1cf367ba-8995-4c9e-a64d-2b1b3577d648" containerID="b63d67a748b8c0165bdcd2b4efed0cb99349dbee91e54bbb7df44cb7506fef37" exitCode=0 Sep 07 03:58:09.174479 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:09.174437 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sg6pk" event={"ID":"1cf367ba-8995-4c9e-a64d-2b1b3577d648","Type":"ContainerDied","Data":"b63d67a748b8c0165bdcd2b4efed0cb99349dbee91e54bbb7df44cb7506fef37"} Sep 07 03:58:09.175782 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:09.175737 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6rxjb" event={"ID":"c83ccf30-d7f7-425a-b6b9-d8e7d2a2b789","Type":"ContainerStarted","Data":"8f1bc878fb7ea98d9ea8205009409410659ce48f6b9cc4f3c2e8980c9d6c1a1d"} Sep 07 03:58:09.178995 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:09.178956 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-125.ec2.internal" podStartSLOduration=20.178945325 podStartE2EDuration="20.178945325s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 03:57:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:57:53.15060221 +0000 UTC m=+5.570976935" watchObservedRunningTime="2026-09-07 03:58:09.178945325 +0000 UTC m=+21.599320047" Sep 07 03:58:09.195658 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:09.194767 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-j2xph" podStartSLOduration=3.5624815549999997 podStartE2EDuration="21.194747596s" totalImagesPullingTime="17.632266041s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 03:57:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:58:09.178716941 +0000 UTC m=+21.599091667" watchObservedRunningTime="2026-09-07 03:58:09.194747596 +0000 UTC m=+21.615122319" Sep 07 03:58:09.195658 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:09.194906 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2fxtz" podStartSLOduration=3.4655505 podStartE2EDuration="21.194896769s" totalImagesPullingTime="17.729346269s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 03:57:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:58:09.193896185 +0000 UTC m=+21.614270909" watchObservedRunningTime="2026-09-07 03:58:09.194896769 +0000 UTC m=+21.615271493" Sep 07 03:58:09.213005 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:09.212963 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hkdpb" podStartSLOduration=3.569730435 podStartE2EDuration="21.212948946s" totalImagesPullingTime="17.643218511s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 03:57:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:58:09.212695067 +0000 UTC m=+21.633069790" watchObservedRunningTime="2026-09-07 03:58:09.212948946 +0000 UTC m=+21.633323715" Sep 07 03:58:09.225956 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:09.225874 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zz74s" podStartSLOduration=11.026905983 podStartE2EDuration="21.225864454s" totalImagesPullingTime="10.198958471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 03:57:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:58:09.225518123 +0000 UTC m=+21.645892848" watchObservedRunningTime="2026-09-07 03:58:09.225864454 +0000 UTC m=+21.646239176" Sep 07 03:58:09.240252 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:09.240209 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6rxjb" podStartSLOduration=3.577084277 podStartE2EDuration="21.240197038s" totalImagesPullingTime="17.663112761s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 03:57:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:58:09.239934241 +0000 UTC m=+21.660308964" watchObservedRunningTime="2026-09-07 03:58:09.240197038 +0000 UTC m=+21.660571761" Sep 07 03:58:10.082526 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:10.082497 2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 07 03:58:10.082688 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:10.082526 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-79dgl" Sep 07 03:58:10.082688 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:10.082642 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-79dgl" podUID="31a21753-1b6d-4d23-a382-b2d0794b9837" Sep 07 03:58:10.179939 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:10.179888 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6bjt9" event={"ID":"04a78909-1aec-4203-b049-eb51194a1632","Type":"ContainerStarted","Data":"5e39ad0d3d6c83b7b9cec7d874e5c160581afbd19b3dbd8fd1bee725415beab8"} Sep 07 03:58:10.183774 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:10.183741 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" event={"ID":"7f6840b8-fcfe-4c33-8275-80fd1864e452","Type":"ContainerStarted","Data":"b974cf70d85be3ee3c895632e0ad620051a8a86e5b84de39cbe7b246529143f3"} Sep 07 03:58:10.185868 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:10.185802 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnwmn" event={"ID":"d84c7c95-f426-47f3-82ce-19f90665ec16","Type":"ContainerStarted","Data":"b4007de65fac4c1933b0df0b0ed96e7b67cfba6cbf870aa886293672975a5a15"} Sep 07 03:58:11.016287 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:11.016175 2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-07T03:58:10.08252105Z","UUID":"07ec5922-2b84-44ee-bfb6-f9f39f7d5180","Handler":null,"Name":"","Endpoint":""} Sep 07 03:58:11.017874 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:11.017852 2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 07 03:58:11.017874 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:11.017881 2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 07 03:58:11.082317 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:11.082286 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7gs6n" Sep 07 03:58:11.082550 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:11.082528 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7gs6n" podUID="27f19200-987c-44ac-b2bd-695e3989a859" Sep 07 03:58:11.082622 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:11.082578 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bshbg" Sep 07 03:58:11.082736 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:11.082717 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bshbg" podUID="2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9" Sep 07 03:58:11.191235 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:11.191143 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnwmn" event={"ID":"d84c7c95-f426-47f3-82ce-19f90665ec16","Type":"ContainerStarted","Data":"4499faef3d2ed571767632805c3d3ce581c6d8dd569f6b20daca4075ffade45f"} Sep 07 03:58:11.209602 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:11.209561 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6bjt9" podStartSLOduration=5.591560584 podStartE2EDuration="23.209547231s" totalImagesPullingTime="17.617986647s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 03:57:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:58:10.194153647 +0000 UTC m=+22.614528371" watchObservedRunningTime="2026-09-07 03:58:11.209547231 +0000 UTC m=+23.629921954" Sep 07 03:58:11.209774 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:11.209644 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnwmn" podStartSLOduration=3.640246595 podStartE2EDuration="23.209625045s" totalImagesPullingTime="19.56937845s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 03:57:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:58:11.209343817 +0000 UTC m=+23.629718540" watchObservedRunningTime="2026-09-07 03:58:11.209625045 +0000 UTC m=+23.629999768" Sep 07 03:58:12.082349 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:12.082307 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-79dgl" Sep 07 03:58:12.082608 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:12.082427 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-79dgl" podUID="31a21753-1b6d-4d23-a382-b2d0794b9837" Sep 07 03:58:12.197482 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:12.197443 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" event={"ID":"7f6840b8-fcfe-4c33-8275-80fd1864e452","Type":"ContainerStarted","Data":"f59a3e32127d377b2d076d8955ec84778126239fd188d7a3959dc1941b29ed23"} Sep 07 03:58:13.082204 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:13.082171 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7gs6n" Sep 07 03:58:13.082361 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:13.082290 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7gs6n" podUID="27f19200-987c-44ac-b2bd-695e3989a859" Sep 07 03:58:13.082361 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:13.082343 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bshbg" Sep 07 03:58:13.082498 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:13.082476 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bshbg" podUID="2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9" Sep 07 03:58:13.256830 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:13.256795 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zz74s" Sep 07 03:58:13.257661 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:13.257619 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zz74s" Sep 07 03:58:14.081775 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:14.081583 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-79dgl" Sep 07 03:58:14.081940 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:14.081854 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-79dgl" podUID="31a21753-1b6d-4d23-a382-b2d0794b9837" Sep 07 03:58:14.205173 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:14.205092 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" event={"ID":"7f6840b8-fcfe-4c33-8275-80fd1864e452","Type":"ContainerStarted","Data":"854f0cf240aed86a266a08dfc2bf9613b2c729d5afb53cd77952d962e8adaa30"} Sep 07 03:58:14.205397 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:14.205376 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:58:14.205482 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:14.205447 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:58:14.207866 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:14.207838 2566 generic.go:356] "Generic (PLEG): container finished" podID="1cf367ba-8995-4c9e-a64d-2b1b3577d648" containerID="7ca33f0a7301479ef431b964d8e5f99190bf56d3a0f4ef21c7ebfe358c37f7fd" exitCode=0 Sep 07 03:58:14.207994 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:14.207915 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sg6pk" event={"ID":"1cf367ba-8995-4c9e-a64d-2b1b3577d648","Type":"ContainerDied","Data":"7ca33f0a7301479ef431b964d8e5f99190bf56d3a0f4ef21c7ebfe358c37f7fd"} Sep 07 03:58:14.208150 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:14.208130 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zz74s" Sep 07 03:58:14.214044 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:14.213986 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zz74s" Sep 07 03:58:14.221968 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:14.221948 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:58:14.222137 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:14.222123 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:58:14.233597 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:14.233558 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" podStartSLOduration=8.573480011000001 podStartE2EDuration="26.233547367s" totalImagesPullingTime="17.660067356s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 03:57:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:58:14.233165816 +0000 UTC m=+26.653540534" watchObservedRunningTime="2026-09-07 03:58:14.233547367 +0000 UTC m=+26.653922090" Sep 07 03:58:15.082227 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:15.082194 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7gs6n" Sep 07 03:58:15.082227 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:15.082228 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bshbg" Sep 07 03:58:15.082904 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:15.082341 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7gs6n" podUID="27f19200-987c-44ac-b2bd-695e3989a859" Sep 07 03:58:15.082904 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:15.082444 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bshbg" podUID="2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9" Sep 07 03:58:15.213138 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:15.212940 2566 generic.go:356] "Generic (PLEG): container finished" podID="1cf367ba-8995-4c9e-a64d-2b1b3577d648" containerID="bd7f5a801ae78a477e9f9c2f3e98145611e63af123b813d09ee287547ed6185d" exitCode=0 Sep 07 03:58:15.213138 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:15.213027 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sg6pk" event={"ID":"1cf367ba-8995-4c9e-a64d-2b1b3577d648","Type":"ContainerDied","Data":"bd7f5a801ae78a477e9f9c2f3e98145611e63af123b813d09ee287547ed6185d"} Sep 07 03:58:15.213138 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:15.213101 2566 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 07 03:58:15.486251 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:15.486117 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-79dgl"] Sep 07 03:58:15.486455 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:15.486271 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-79dgl" Sep 07 03:58:15.486455 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:15.486374 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-79dgl" podUID="31a21753-1b6d-4d23-a382-b2d0794b9837" Sep 07 03:58:15.486890 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:15.486863 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7gs6n"] Sep 07 03:58:15.487001 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:15.486948 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7gs6n" Sep 07 03:58:15.487052 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:15.487023 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7gs6n" podUID="27f19200-987c-44ac-b2bd-695e3989a859" Sep 07 03:58:15.497826 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:15.497280 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bshbg"] Sep 07 03:58:15.500451 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:15.500434 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bshbg" Sep 07 03:58:15.500537 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:15.500523 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bshbg" podUID="2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9" Sep 07 03:58:16.010523 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:16.010499 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:58:16.218241 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:16.218150 2566 generic.go:356] "Generic (PLEG): container finished" podID="1cf367ba-8995-4c9e-a64d-2b1b3577d648" containerID="9edd5b65be1b0201bfe086143a57df35d6de2a2358928c8cc4802731bfd0cf40" exitCode=0 Sep 07 03:58:16.218692 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:16.218235 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sg6pk" event={"ID":"1cf367ba-8995-4c9e-a64d-2b1b3577d648","Type":"ContainerDied","Data":"9edd5b65be1b0201bfe086143a57df35d6de2a2358928c8cc4802731bfd0cf40"} Sep 07 03:58:17.082000 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:17.081956 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bshbg" Sep 07 03:58:17.082198 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:17.082091 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-79dgl" Sep 07 03:58:17.082198 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:17.082104 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bshbg" podUID="2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9" Sep 07 03:58:17.082198 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:17.082131 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7gs6n" Sep 07 03:58:17.082316 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:17.082237 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-79dgl" podUID="31a21753-1b6d-4d23-a382-b2d0794b9837" Sep 07 03:58:17.082372 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:17.082327 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7gs6n" podUID="27f19200-987c-44ac-b2bd-695e3989a859" Sep 07 03:58:19.081912 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:19.081874 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bshbg" Sep 07 03:58:19.082302 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:19.081874 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7gs6n" Sep 07 03:58:19.082302 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:19.081995 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-79dgl" Sep 07 03:58:19.082302 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:19.082001 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bshbg" podUID="2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9" Sep 07 03:58:19.082302 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:19.082073 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7gs6n" podUID="27f19200-987c-44ac-b2bd-695e3989a859" Sep 07 03:58:19.082302 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:19.082160 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-79dgl" podUID="31a21753-1b6d-4d23-a382-b2d0794b9837" Sep 07 03:58:21.082238 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:21.082047 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7gs6n" Sep 07 03:58:21.082692 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:21.082092 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-79dgl" Sep 07 03:58:21.082692 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:21.082317 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7gs6n" podUID="27f19200-987c-44ac-b2bd-695e3989a859" Sep 07 03:58:21.082692 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:21.082103 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bshbg" Sep 07 03:58:21.082692 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:21.082384 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-79dgl" podUID="31a21753-1b6d-4d23-a382-b2d0794b9837" Sep 07 03:58:21.082692 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:21.082473 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bshbg" podUID="2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9" Sep 07 03:58:21.233123 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:21.233094 2566 generic.go:356] "Generic (PLEG): container finished" podID="1cf367ba-8995-4c9e-a64d-2b1b3577d648" containerID="802162031a666f9a30bcee1c8286c585bf8cfa75e05b747eea67a5d38a9b3d6a" exitCode=0 Sep 07 03:58:21.233274 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:21.233150 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sg6pk" event={"ID":"1cf367ba-8995-4c9e-a64d-2b1b3577d648","Type":"ContainerDied","Data":"802162031a666f9a30bcee1c8286c585bf8cfa75e05b747eea67a5d38a9b3d6a"} Sep 07 03:58:21.379503 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:21.379481 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-125.ec2.internal" event="NodeReady" Sep 07 03:58:21.379667 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:21.379654 2566 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 07 03:58:21.424349 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:21.424326 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-s7vls"] Sep 07 03:58:21.442259 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:21.442232 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s7vls" Sep 07 03:58:21.442369 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:21.442221 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9fkxh"] Sep 07 03:58:21.444883 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:21.444863 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 07 03:58:21.445449 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:21.445435 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 07 03:58:21.445449 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:21.445441 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tk9sb\"" Sep 07 03:58:21.458302 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:21.458278 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9fkxh" Sep 07 03:58:21.458302 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:21.458281 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9fkxh"] Sep 07 03:58:21.458488 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:21.458325 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s7vls"] Sep 07 03:58:21.460967 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:21.460953 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 07 03:58:21.461825 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:21.461812 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 07 03:58:21.461949 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:21.461934 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rbnhc\"" Sep 07 03:58:21.464320 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:21.464304 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 07 03:58:21.517870 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:21.517845 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97c0529d-571d-4f5a-9cf6-594835d9d3f5-metrics-tls\") pod \"dns-default-s7vls\" (UID: \"97c0529d-571d-4f5a-9cf6-594835d9d3f5\") " pod="openshift-dns/dns-default-s7vls" Sep 07 03:58:21.517996 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:21.517897 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97c0529d-571d-4f5a-9cf6-594835d9d3f5-tmp-dir\") pod \"dns-default-s7vls\" (UID: \"97c0529d-571d-4f5a-9cf6-594835d9d3f5\") " pod="openshift-dns/dns-default-s7vls" Sep 07 03:58:21.517996 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:21.517914 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/97c0529d-571d-4f5a-9cf6-594835d9d3f5-config-volume\") pod \"dns-default-s7vls\" (UID: \"97c0529d-571d-4f5a-9cf6-594835d9d3f5\") " pod="openshift-dns/dns-default-s7vls" Sep 07 03:58:21.517996 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:21.517960 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhfmr\" (UniqueName: \"kubernetes.io/projected/97c0529d-571d-4f5a-9cf6-594835d9d3f5-kube-api-access-nhfmr\") pod \"dns-default-s7vls\" (UID: \"97c0529d-571d-4f5a-9cf6-594835d9d3f5\") " pod="openshift-dns/dns-default-s7vls" Sep 07 03:58:21.618774 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:21.618696 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97c0529d-571d-4f5a-9cf6-594835d9d3f5-tmp-dir\") pod \"dns-default-s7vls\" (UID: \"97c0529d-571d-4f5a-9cf6-594835d9d3f5\") " pod="openshift-dns/dns-default-s7vls" Sep 07 03:58:21.618774 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:21.618733 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/97c0529d-571d-4f5a-9cf6-594835d9d3f5-config-volume\") pod \"dns-default-s7vls\" (UID: \"97c0529d-571d-4f5a-9cf6-594835d9d3f5\") " pod="openshift-dns/dns-default-s7vls" Sep 07 03:58:21.618774 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:21.618752 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhfmr\" (UniqueName: \"kubernetes.io/projected/97c0529d-571d-4f5a-9cf6-594835d9d3f5-kube-api-access-nhfmr\") pod \"dns-default-s7vls\" (UID: \"97c0529d-571d-4f5a-9cf6-594835d9d3f5\") " pod="openshift-dns/dns-default-s7vls" Sep 07 03:58:21.618960 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:21.618799 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97c0529d-571d-4f5a-9cf6-594835d9d3f5-metrics-tls\") pod \"dns-default-s7vls\" (UID: \"97c0529d-571d-4f5a-9cf6-594835d9d3f5\") " pod="openshift-dns/dns-default-s7vls" Sep 07 03:58:21.618960 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:21.618820 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/981e0f5c-3f82-4c3f-9623-d3282f75a9af-cert\") pod \"ingress-canary-9fkxh\" (UID: \"981e0f5c-3f82-4c3f-9623-d3282f75a9af\") " pod="openshift-ingress-canary/ingress-canary-9fkxh" Sep 07 03:58:21.618960 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:21.618886 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sbpm\" (UniqueName: \"kubernetes.io/projected/981e0f5c-3f82-4c3f-9623-d3282f75a9af-kube-api-access-6sbpm\") pod \"ingress-canary-9fkxh\" (UID: \"981e0f5c-3f82-4c3f-9623-d3282f75a9af\") " pod="openshift-ingress-canary/ingress-canary-9fkxh" Sep 07 03:58:21.619092 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:21.619033 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 03:58:21.619141 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:21.619082 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97c0529d-571d-4f5a-9cf6-594835d9d3f5-tmp-dir\") pod \"dns-default-s7vls\" (UID: \"97c0529d-571d-4f5a-9cf6-594835d9d3f5\") " pod="openshift-dns/dns-default-s7vls" Sep 07 03:58:21.619141 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:21.619128 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97c0529d-571d-4f5a-9cf6-594835d9d3f5-metrics-tls podName:97c0529d-571d-4f5a-9cf6-594835d9d3f5 nodeName:}" failed. No retries permitted until 2026-09-07 03:58:22.119106258 +0000 UTC m=+34.539480978 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97c0529d-571d-4f5a-9cf6-594835d9d3f5-metrics-tls") pod "dns-default-s7vls" (UID: "97c0529d-571d-4f5a-9cf6-594835d9d3f5") : secret "dns-default-metrics-tls" not found Sep 07 03:58:21.619297 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:21.619279 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/97c0529d-571d-4f5a-9cf6-594835d9d3f5-config-volume\") pod \"dns-default-s7vls\" (UID: \"97c0529d-571d-4f5a-9cf6-594835d9d3f5\") " pod="openshift-dns/dns-default-s7vls" Sep 07 03:58:21.630170 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:21.630142 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhfmr\" (UniqueName: \"kubernetes.io/projected/97c0529d-571d-4f5a-9cf6-594835d9d3f5-kube-api-access-nhfmr\") pod \"dns-default-s7vls\" (UID: \"97c0529d-571d-4f5a-9cf6-594835d9d3f5\") " pod="openshift-dns/dns-default-s7vls" Sep 07 03:58:21.720187 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:21.720159 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/981e0f5c-3f82-4c3f-9623-d3282f75a9af-cert\") pod \"ingress-canary-9fkxh\" (UID: \"981e0f5c-3f82-4c3f-9623-d3282f75a9af\") " pod="openshift-ingress-canary/ingress-canary-9fkxh" Sep 07 03:58:21.720340 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:21.720197 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sbpm\" (UniqueName: \"kubernetes.io/projected/981e0f5c-3f82-4c3f-9623-d3282f75a9af-kube-api-access-6sbpm\") pod \"ingress-canary-9fkxh\" (UID: \"981e0f5c-3f82-4c3f-9623-d3282f75a9af\") " pod="openshift-ingress-canary/ingress-canary-9fkxh" Sep 07 03:58:21.720340 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:21.720216 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cr7h\" (UniqueName: \"kubernetes.io/projected/31a21753-1b6d-4d23-a382-b2d0794b9837-kube-api-access-4cr7h\") pod \"network-check-target-79dgl\" (UID: \"31a21753-1b6d-4d23-a382-b2d0794b9837\") " pod="openshift-network-diagnostics/network-check-target-79dgl" Sep 07 03:58:21.720447 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:21.720418 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 03:58:21.720447 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:21.720442 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 03:58:21.720549 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:21.720451 2566 projected.go:196] Error preparing data for projected volume kube-api-access-4cr7h for pod openshift-network-diagnostics/network-check-target-79dgl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 03:58:21.720549 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:21.720500 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31a21753-1b6d-4d23-a382-b2d0794b9837-kube-api-access-4cr7h podName:31a21753-1b6d-4d23-a382-b2d0794b9837 nodeName:}" failed. No retries permitted until 2026-09-07 03:58:53.720486795 +0000 UTC m=+66.140861509 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4cr7h" (UniqueName: "kubernetes.io/projected/31a21753-1b6d-4d23-a382-b2d0794b9837-kube-api-access-4cr7h") pod "network-check-target-79dgl" (UID: "31a21753-1b6d-4d23-a382-b2d0794b9837") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 03:58:21.722546 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:21.722523 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/981e0f5c-3f82-4c3f-9623-d3282f75a9af-cert\") pod \"ingress-canary-9fkxh\" (UID: \"981e0f5c-3f82-4c3f-9623-d3282f75a9af\") " pod="openshift-ingress-canary/ingress-canary-9fkxh" Sep 07 03:58:21.727585 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:21.727561 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sbpm\" (UniqueName: \"kubernetes.io/projected/981e0f5c-3f82-4c3f-9623-d3282f75a9af-kube-api-access-6sbpm\") pod \"ingress-canary-9fkxh\" (UID: \"981e0f5c-3f82-4c3f-9623-d3282f75a9af\") " pod="openshift-ingress-canary/ingress-canary-9fkxh" Sep 07 03:58:21.778219 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:21.778192 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9fkxh" Sep 07 03:58:21.821585 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:21.821553 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27f19200-987c-44ac-b2bd-695e3989a859-original-pull-secret\") pod \"global-pull-secret-syncer-7gs6n\" (UID: \"27f19200-987c-44ac-b2bd-695e3989a859\") " pod="kube-system/global-pull-secret-syncer-7gs6n" Sep 07 03:58:21.821698 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:21.821606 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9-metrics-certs\") pod \"network-metrics-daemon-bshbg\" (UID: \"2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9\") " pod="openshift-multus/network-metrics-daemon-bshbg" Sep 07 03:58:21.821745 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:21.821724 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 03:58:21.821745 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:21.821733 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 03:58:21.821812 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:21.821779 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9-metrics-certs podName:2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9 nodeName:}" failed. No retries permitted until 2026-09-07 03:58:53.821766143 +0000 UTC m=+66.242140844 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9-metrics-certs") pod "network-metrics-daemon-bshbg" (UID: "2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 03:58:21.821812 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:21.821794 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27f19200-987c-44ac-b2bd-695e3989a859-original-pull-secret podName:27f19200-987c-44ac-b2bd-695e3989a859 nodeName:}" failed. No retries permitted until 2026-09-07 03:58:53.82178774 +0000 UTC m=+66.242162441 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27f19200-987c-44ac-b2bd-695e3989a859-original-pull-secret") pod "global-pull-secret-syncer-7gs6n" (UID: "27f19200-987c-44ac-b2bd-695e3989a859") : object "kube-system"/"original-pull-secret" not registered Sep 07 03:58:22.096046 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:22.096015 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9fkxh"] Sep 07 03:58:22.099584 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:58:22.099561 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod981e0f5c_3f82_4c3f_9623_d3282f75a9af.slice/crio-370d90901f9ac626a090ef49c78786978cef1469398cfd12ae3c803032e9f054 WatchSource:0}: Error finding container 370d90901f9ac626a090ef49c78786978cef1469398cfd12ae3c803032e9f054: Status 404 returned error can't find the container with id 370d90901f9ac626a090ef49c78786978cef1469398cfd12ae3c803032e9f054 Sep 07 03:58:22.124119 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:22.124100 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97c0529d-571d-4f5a-9cf6-594835d9d3f5-metrics-tls\") pod \"dns-default-s7vls\" (UID: \"97c0529d-571d-4f5a-9cf6-594835d9d3f5\") " pod="openshift-dns/dns-default-s7vls" Sep 07 03:58:22.124221 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:22.124208 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 03:58:22.124270 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:22.124261 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97c0529d-571d-4f5a-9cf6-594835d9d3f5-metrics-tls podName:97c0529d-571d-4f5a-9cf6-594835d9d3f5 nodeName:}" failed. No retries permitted until 2026-09-07 03:58:23.124247234 +0000 UTC m=+35.544621935 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97c0529d-571d-4f5a-9cf6-594835d9d3f5-metrics-tls") pod "dns-default-s7vls" (UID: "97c0529d-571d-4f5a-9cf6-594835d9d3f5") : secret "dns-default-metrics-tls" not found Sep 07 03:58:22.236798 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:22.236714 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9fkxh" event={"ID":"981e0f5c-3f82-4c3f-9623-d3282f75a9af","Type":"ContainerStarted","Data":"370d90901f9ac626a090ef49c78786978cef1469398cfd12ae3c803032e9f054"} Sep 07 03:58:22.239722 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:22.239699 2566 generic.go:356] "Generic (PLEG): container finished" podID="1cf367ba-8995-4c9e-a64d-2b1b3577d648" containerID="e08b33154c72da2c1dbcc24a324b6245132a38fced1e2e0d1a5f16b11ed36633" exitCode=0 Sep 07 03:58:22.239834 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:22.239731 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sg6pk" event={"ID":"1cf367ba-8995-4c9e-a64d-2b1b3577d648","Type":"ContainerDied","Data":"e08b33154c72da2c1dbcc24a324b6245132a38fced1e2e0d1a5f16b11ed36633"} Sep 07 03:58:23.082793 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:23.082756 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7gs6n" Sep 07 03:58:23.082993 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:23.082756 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-79dgl" Sep 07 03:58:23.082993 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:23.082880 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bshbg" Sep 07 03:58:23.085297 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:23.085275 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 07 03:58:23.086019 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:23.085994 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 07 03:58:23.086132 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:23.086113 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lrlx9\"" Sep 07 03:58:23.086198 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:23.086188 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 07 03:58:23.086259 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:23.086187 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 07 03:58:23.086259 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:23.086204 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rbtcj\"" Sep 07 03:58:23.132177 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:23.132152 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97c0529d-571d-4f5a-9cf6-594835d9d3f5-metrics-tls\") pod \"dns-default-s7vls\" (UID: \"97c0529d-571d-4f5a-9cf6-594835d9d3f5\") " pod="openshift-dns/dns-default-s7vls" Sep 07 03:58:23.132554 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:23.132331 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 03:58:23.132554 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:23.132417 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97c0529d-571d-4f5a-9cf6-594835d9d3f5-metrics-tls podName:97c0529d-571d-4f5a-9cf6-594835d9d3f5 nodeName:}" failed. No retries permitted until 2026-09-07 03:58:25.13239493 +0000 UTC m=+37.552769654 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97c0529d-571d-4f5a-9cf6-594835d9d3f5-metrics-tls") pod "dns-default-s7vls" (UID: "97c0529d-571d-4f5a-9cf6-594835d9d3f5") : secret "dns-default-metrics-tls" not found Sep 07 03:58:23.246069 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:23.246031 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sg6pk" event={"ID":"1cf367ba-8995-4c9e-a64d-2b1b3577d648","Type":"ContainerStarted","Data":"da94b9956b70d3d732f907ab98e9255991c0096232bcd2919bc48594d337c4c5"} Sep 07 03:58:23.266830 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:23.266779 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-sg6pk" podStartSLOduration=7.410570303 podStartE2EDuration="35.266758271s" totalImagesPullingTime="27.856187968s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 03:57:48 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:58:23.265377206 +0000 UTC m=+35.685751931" watchObservedRunningTime="2026-09-07 03:58:23.266758271 +0000 UTC m=+35.687132995" Sep 07 03:58:25.149669 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:25.149617 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97c0529d-571d-4f5a-9cf6-594835d9d3f5-metrics-tls\") pod \"dns-default-s7vls\" (UID: \"97c0529d-571d-4f5a-9cf6-594835d9d3f5\") " pod="openshift-dns/dns-default-s7vls" Sep 07 03:58:25.149994 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:25.149776 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 03:58:25.149994 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:25.149852 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97c0529d-571d-4f5a-9cf6-594835d9d3f5-metrics-tls podName:97c0529d-571d-4f5a-9cf6-594835d9d3f5 nodeName:}" failed. No retries permitted until 2026-09-07 03:58:29.149825527 +0000 UTC m=+41.570200233 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97c0529d-571d-4f5a-9cf6-594835d9d3f5-metrics-tls") pod "dns-default-s7vls" (UID: "97c0529d-571d-4f5a-9cf6-594835d9d3f5") : secret "dns-default-metrics-tls" not found Sep 07 03:58:25.251825 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:25.251795 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9fkxh" event={"ID":"981e0f5c-3f82-4c3f-9623-d3282f75a9af","Type":"ContainerStarted","Data":"94595d435e305e3a4df389d1601bae32b9fe43fce08c32aecf59e7c2311d8055"} Sep 07 03:58:25.268086 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:25.268042 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9fkxh" podStartSLOduration=1.749712044 podStartE2EDuration="4.26802444s" totalImagesPullingTime="2.518312396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 03:58:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:58:25.267676854 +0000 UTC m=+37.688051578" watchObservedRunningTime="2026-09-07 03:58:25.26802444 +0000 UTC m=+37.688399162" Sep 07 03:58:29.179844 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:29.179803 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97c0529d-571d-4f5a-9cf6-594835d9d3f5-metrics-tls\") pod \"dns-default-s7vls\" (UID: \"97c0529d-571d-4f5a-9cf6-594835d9d3f5\") " pod="openshift-dns/dns-default-s7vls" Sep 07 03:58:29.180209 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:29.179956 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 03:58:29.180209 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:29.180022 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97c0529d-571d-4f5a-9cf6-594835d9d3f5-metrics-tls podName:97c0529d-571d-4f5a-9cf6-594835d9d3f5 nodeName:}" failed. No retries permitted until 2026-09-07 03:58:37.180006148 +0000 UTC m=+49.600380865 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97c0529d-571d-4f5a-9cf6-594835d9d3f5-metrics-tls") pod "dns-default-s7vls" (UID: "97c0529d-571d-4f5a-9cf6-594835d9d3f5") : secret "dns-default-metrics-tls" not found Sep 07 03:58:37.233226 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:37.233179 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97c0529d-571d-4f5a-9cf6-594835d9d3f5-metrics-tls\") pod \"dns-default-s7vls\" (UID: \"97c0529d-571d-4f5a-9cf6-594835d9d3f5\") " pod="openshift-dns/dns-default-s7vls" Sep 07 03:58:37.233671 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:37.233329 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 03:58:37.233671 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:37.233400 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97c0529d-571d-4f5a-9cf6-594835d9d3f5-metrics-tls podName:97c0529d-571d-4f5a-9cf6-594835d9d3f5 nodeName:}" failed. No retries permitted until 2026-09-07 03:58:53.233383455 +0000 UTC m=+65.653758180 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97c0529d-571d-4f5a-9cf6-594835d9d3f5-metrics-tls") pod "dns-default-s7vls" (UID: "97c0529d-571d-4f5a-9cf6-594835d9d3f5") : secret "dns-default-metrics-tls" not found Sep 07 03:58:47.230380 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:47.230348 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f6xmb" Sep 07 03:58:53.235794 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:53.235732 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97c0529d-571d-4f5a-9cf6-594835d9d3f5-metrics-tls\") pod \"dns-default-s7vls\" (UID: \"97c0529d-571d-4f5a-9cf6-594835d9d3f5\") " pod="openshift-dns/dns-default-s7vls" Sep 07 03:58:53.236263 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:53.235867 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 03:58:53.236263 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:53.235922 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97c0529d-571d-4f5a-9cf6-594835d9d3f5-metrics-tls podName:97c0529d-571d-4f5a-9cf6-594835d9d3f5 nodeName:}" failed. No retries permitted until 2026-09-07 03:59:25.235908846 +0000 UTC m=+97.656283547 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97c0529d-571d-4f5a-9cf6-594835d9d3f5-metrics-tls") pod "dns-default-s7vls" (UID: "97c0529d-571d-4f5a-9cf6-594835d9d3f5") : secret "dns-default-metrics-tls" not found Sep 07 03:58:53.738979 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:53.738938 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cr7h\" (UniqueName: \"kubernetes.io/projected/31a21753-1b6d-4d23-a382-b2d0794b9837-kube-api-access-4cr7h\") pod \"network-check-target-79dgl\" (UID: \"31a21753-1b6d-4d23-a382-b2d0794b9837\") " pod="openshift-network-diagnostics/network-check-target-79dgl" Sep 07 03:58:53.741077 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:53.741061 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 07 03:58:53.751101 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:53.751082 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 07 03:58:53.764212 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:53.764180 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cr7h\" (UniqueName: \"kubernetes.io/projected/31a21753-1b6d-4d23-a382-b2d0794b9837-kube-api-access-4cr7h\") pod \"network-check-target-79dgl\" (UID: \"31a21753-1b6d-4d23-a382-b2d0794b9837\") " pod="openshift-network-diagnostics/network-check-target-79dgl" Sep 07 03:58:53.840211 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:53.840174 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9-metrics-certs\") pod \"network-metrics-daemon-bshbg\" (UID: \"2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9\") " pod="openshift-multus/network-metrics-daemon-bshbg" Sep 07 03:58:53.840363 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:53.840233 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27f19200-987c-44ac-b2bd-695e3989a859-original-pull-secret\") pod \"global-pull-secret-syncer-7gs6n\" (UID: \"27f19200-987c-44ac-b2bd-695e3989a859\") " pod="kube-system/global-pull-secret-syncer-7gs6n" Sep 07 03:58:53.842817 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:53.842797 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 07 03:58:53.842868 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:53.842828 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 07 03:58:53.850693 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:53.850610 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 07 03:58:53.850693 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:58:53.850692 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9-metrics-certs podName:2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9 nodeName:}" failed. No retries permitted until 2026-09-07 03:59:57.850674801 +0000 UTC m=+130.271049503 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9-metrics-certs") pod "network-metrics-daemon-bshbg" (UID: "2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9") : secret "metrics-daemon-secret" not found Sep 07 03:58:53.852779 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:53.852753 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27f19200-987c-44ac-b2bd-695e3989a859-original-pull-secret\") pod \"global-pull-secret-syncer-7gs6n\" (UID: \"27f19200-987c-44ac-b2bd-695e3989a859\") " pod="kube-system/global-pull-secret-syncer-7gs6n" Sep 07 03:58:53.994341 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:53.994269 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7gs6n" Sep 07 03:58:54.003006 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:54.002987 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lrlx9\"" Sep 07 03:58:54.011824 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:54.011806 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-79dgl" Sep 07 03:58:54.262081 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:54.262011 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7gs6n"] Sep 07 03:58:54.265186 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:58:54.265165 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27f19200_987c_44ac_b2bd_695e3989a859.slice/crio-19b9d1f20e95417ffb9a466c4506abe20a2484a5af54d4b4d3f8233e991f7893 WatchSource:0}: Error finding container 19b9d1f20e95417ffb9a466c4506abe20a2484a5af54d4b4d3f8233e991f7893: Status 404 returned error can't find the container with id 19b9d1f20e95417ffb9a466c4506abe20a2484a5af54d4b4d3f8233e991f7893 Sep 07 03:58:54.283167 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:54.283145 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-79dgl"] Sep 07 03:58:54.285661 ip-10-0-143-125 kubenswrapper[2566]: W0907 03:58:54.285618 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31a21753_1b6d_4d23_a382_b2d0794b9837.slice/crio-d98fbb1a2188a4c5c7f8d6079c7f6b7038a6b2e349a0321de6f0084a93310985 WatchSource:0}: Error finding container d98fbb1a2188a4c5c7f8d6079c7f6b7038a6b2e349a0321de6f0084a93310985: Status 404 returned error can't find the container with id d98fbb1a2188a4c5c7f8d6079c7f6b7038a6b2e349a0321de6f0084a93310985 Sep 07 03:58:54.320080 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:54.320052 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-79dgl" event={"ID":"31a21753-1b6d-4d23-a382-b2d0794b9837","Type":"ContainerStarted","Data":"d98fbb1a2188a4c5c7f8d6079c7f6b7038a6b2e349a0321de6f0084a93310985"} Sep 07 03:58:54.321190 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:54.321168 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7gs6n" event={"ID":"27f19200-987c-44ac-b2bd-695e3989a859","Type":"ContainerStarted","Data":"19b9d1f20e95417ffb9a466c4506abe20a2484a5af54d4b4d3f8233e991f7893"} Sep 07 03:58:59.336867 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:59.336829 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-79dgl" event={"ID":"31a21753-1b6d-4d23-a382-b2d0794b9837","Type":"ContainerStarted","Data":"2d006d26175843fb20a236546eaf1c2b44f179dbbcede9f35e1373e43bbf9ed8"} Sep 07 03:58:59.337294 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:59.336958 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-79dgl" Sep 07 03:58:59.338333 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:59.338313 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7gs6n" event={"ID":"27f19200-987c-44ac-b2bd-695e3989a859","Type":"ContainerStarted","Data":"b334a9f6e6a88087bf4acc423e7009cb765e01c7bb682065609ffeb4aa9f6818"} Sep 07 03:58:59.352338 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:59.352290 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-79dgl" podStartSLOduration=66.981090898 podStartE2EDuration="1m11.352274647s" totalImagesPullingTime="4.371183749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 03:57:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:58:59.351373976 +0000 UTC m=+71.771748703" watchObservedRunningTime="2026-09-07 03:58:59.352274647 +0000 UTC m=+71.772649369" Sep 07 03:58:59.363809 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:58:59.363759 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7gs6n" podStartSLOduration=66.96732125 podStartE2EDuration="1m11.363742079s" totalImagesPullingTime="4.396420829s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 03:57:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:58:59.363273459 +0000 UTC m=+71.783648182" watchObservedRunningTime="2026-09-07 03:58:59.363742079 +0000 UTC m=+71.784116802" Sep 07 03:59:25.250453 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:59:25.250418 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97c0529d-571d-4f5a-9cf6-594835d9d3f5-metrics-tls\") pod \"dns-default-s7vls\" (UID: \"97c0529d-571d-4f5a-9cf6-594835d9d3f5\") " pod="openshift-dns/dns-default-s7vls" Sep 07 03:59:25.250875 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:59:25.250538 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 03:59:25.250875 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:59:25.250592 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97c0529d-571d-4f5a-9cf6-594835d9d3f5-metrics-tls podName:97c0529d-571d-4f5a-9cf6-594835d9d3f5 nodeName:}" failed. No retries permitted until 2026-09-07 04:00:29.250577773 +0000 UTC m=+161.670952487 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97c0529d-571d-4f5a-9cf6-594835d9d3f5-metrics-tls") pod "dns-default-s7vls" (UID: "97c0529d-571d-4f5a-9cf6-594835d9d3f5") : secret "dns-default-metrics-tls" not found Sep 07 03:59:30.343999 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:59:30.343968 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-79dgl" Sep 07 03:59:57.862215 ip-10-0-143-125 kubenswrapper[2566]: I0907 03:59:57.862175 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9-metrics-certs\") pod \"network-metrics-daemon-bshbg\" (UID: \"2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9\") " pod="openshift-multus/network-metrics-daemon-bshbg" Sep 07 03:59:57.862702 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:59:57.862306 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 07 03:59:57.862702 ip-10-0-143-125 kubenswrapper[2566]: E0907 03:59:57.862395 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9-metrics-certs podName:2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9 nodeName:}" failed. No retries permitted until 2026-09-07 04:01:59.862370027 +0000 UTC m=+252.282744746 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9-metrics-certs") pod "network-metrics-daemon-bshbg" (UID: "2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9") : secret "metrics-daemon-secret" not found Sep 07 04:00:24.473789 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:00:24.473729 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-s7vls" podUID="97c0529d-571d-4f5a-9cf6-594835d9d3f5" Sep 07 04:00:24.532577 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:00:24.532550 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s7vls" Sep 07 04:00:26.106511 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:00:26.106471 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-bshbg" podUID="2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9" Sep 07 04:00:29.267596 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:00:29.267542 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97c0529d-571d-4f5a-9cf6-594835d9d3f5-metrics-tls\") pod \"dns-default-s7vls\" (UID: \"97c0529d-571d-4f5a-9cf6-594835d9d3f5\") " pod="openshift-dns/dns-default-s7vls" Sep 07 04:00:29.268026 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:00:29.267677 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 04:00:29.268026 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:00:29.267741 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97c0529d-571d-4f5a-9cf6-594835d9d3f5-metrics-tls podName:97c0529d-571d-4f5a-9cf6-594835d9d3f5 nodeName:}" failed. No retries permitted until 2026-09-07 04:02:31.267726084 +0000 UTC m=+283.688100798 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97c0529d-571d-4f5a-9cf6-594835d9d3f5-metrics-tls") pod "dns-default-s7vls" (UID: "97c0529d-571d-4f5a-9cf6-594835d9d3f5") : secret "dns-default-metrics-tls" not found Sep 07 04:00:37.082447 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:00:37.082408 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bshbg" Sep 07 04:01:53.871614 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:53.871575 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85b454874b-bgrfr"] Sep 07 04:01:53.873409 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:53.873387 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pphq7"] Sep 07 04:01:53.873546 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:53.873501 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-bgrfr" Sep 07 04:01:53.874905 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:53.874886 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5c47978b8-5xwws"] Sep 07 04:01:53.875016 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:53.874991 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pphq7" Sep 07 04:01:53.875733 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:53.875713 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Sep 07 04:01:53.875836 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:53.875746 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Sep 07 04:01:53.875836 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:53.875722 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-6pb7t\"" Sep 07 04:01:53.876279 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:53.876263 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c47978b8-5xwws" Sep 07 04:01:53.877195 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:53.877179 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Sep 07 04:01:53.877285 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:53.877273 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 07 04:01:53.877378 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:53.877283 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Sep 07 04:01:53.877435 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:53.877283 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 07 04:01:53.877798 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:53.877777 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-wct2s\"" Sep 07 04:01:53.877798 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:53.877778 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 07 04:01:53.878134 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:53.878120 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 07 04:01:53.878242 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:53.878227 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dlnc5\"" Sep 07 04:01:53.878361 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:53.878347 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 07 04:01:53.879180 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:53.879160 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 07 04:01:53.885605 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:53.885582 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 07 04:01:53.886829 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:53.886811 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Sep 07 04:01:53.891210 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:53.891130 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-bgrfr"] Sep 07 04:01:53.891849 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:53.891830 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pphq7"] Sep 07 04:01:53.893898 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:53.893881 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c47978b8-5xwws"] Sep 07 04:01:53.928164 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:53.928131 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bad8bde3-660e-4e61-b849-89dae63bed94-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-pphq7\" (UID: \"bad8bde3-660e-4e61-b849-89dae63bed94\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pphq7" Sep 07 04:01:53.928304 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:53.928166 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgn6g\" (UniqueName: \"kubernetes.io/projected/bad8bde3-660e-4e61-b849-89dae63bed94-kube-api-access-fgn6g\") pod \"cluster-samples-operator-7cdcfcf76c-pphq7\" (UID: \"bad8bde3-660e-4e61-b849-89dae63bed94\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pphq7" Sep 07 04:01:53.928304 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:53.928193 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-registry-certificates\") pod \"image-registry-5c47978b8-5xwws\" (UID: \"07312acd-cd4b-4853-8db1-a5b6f6ae1a00\") " pod="openshift-image-registry/image-registry-5c47978b8-5xwws" Sep 07 04:01:53.928304 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:53.928211 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-trusted-ca\") pod \"image-registry-5c47978b8-5xwws\" (UID: \"07312acd-cd4b-4853-8db1-a5b6f6ae1a00\") " pod="openshift-image-registry/image-registry-5c47978b8-5xwws" Sep 07 04:01:53.928304 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:53.928230 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-bound-sa-token\") pod \"image-registry-5c47978b8-5xwws\" (UID: \"07312acd-cd4b-4853-8db1-a5b6f6ae1a00\") " pod="openshift-image-registry/image-registry-5c47978b8-5xwws" Sep 07 04:01:53.928304 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:53.928268 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-installation-pull-secrets\") pod \"image-registry-5c47978b8-5xwws\" (UID: \"07312acd-cd4b-4853-8db1-a5b6f6ae1a00\") " pod="openshift-image-registry/image-registry-5c47978b8-5xwws" Sep 07 04:01:53.928304 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:53.928293 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-registry-tls\") pod \"image-registry-5c47978b8-5xwws\" (UID: \"07312acd-cd4b-4853-8db1-a5b6f6ae1a00\") " pod="openshift-image-registry/image-registry-5c47978b8-5xwws" Sep 07 04:01:53.928607 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:53.928310 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a-trusted-ca\") pod \"console-operator-85b454874b-bgrfr\" (UID: \"9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a\") " pod="openshift-console-operator/console-operator-85b454874b-bgrfr" Sep 07 04:01:53.928607 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:53.928362 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbjfc\" (UniqueName: \"kubernetes.io/projected/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-kube-api-access-rbjfc\") pod \"image-registry-5c47978b8-5xwws\" (UID: \"07312acd-cd4b-4853-8db1-a5b6f6ae1a00\") " pod="openshift-image-registry/image-registry-5c47978b8-5xwws" Sep 07 04:01:53.928607 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:53.928394 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcpkh\" (UniqueName: \"kubernetes.io/projected/9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a-kube-api-access-tcpkh\") pod \"console-operator-85b454874b-bgrfr\" (UID: \"9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a\") " pod="openshift-console-operator/console-operator-85b454874b-bgrfr" Sep 07 04:01:53.928607 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:53.928431 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-ca-trust-extracted\") pod \"image-registry-5c47978b8-5xwws\" (UID: \"07312acd-cd4b-4853-8db1-a5b6f6ae1a00\") " pod="openshift-image-registry/image-registry-5c47978b8-5xwws" Sep 07 04:01:53.928607 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:53.928458 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a-config\") pod \"console-operator-85b454874b-bgrfr\" (UID: \"9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a\") " pod="openshift-console-operator/console-operator-85b454874b-bgrfr" Sep 07 04:01:53.928607 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:53.928528 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-image-registry-private-configuration\") pod \"image-registry-5c47978b8-5xwws\" (UID: \"07312acd-cd4b-4853-8db1-a5b6f6ae1a00\") " pod="openshift-image-registry/image-registry-5c47978b8-5xwws" Sep 07 04:01:53.928607 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:53.928553 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a-serving-cert\") pod \"console-operator-85b454874b-bgrfr\" (UID: \"9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a\") " pod="openshift-console-operator/console-operator-85b454874b-bgrfr" Sep 07 04:01:53.967524 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:53.967494 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-mjqjt"] Sep 07 04:01:53.969295 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:53.969278 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-mjqjt" Sep 07 04:01:53.971435 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:53.971407 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Sep 07 04:01:53.971435 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:53.971411 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Sep 07 04:01:53.971591 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:53.971411 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Sep 07 04:01:53.971591 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:53.971413 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-clhgc\"" Sep 07 04:01:53.972972 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:53.972957 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Sep 07 04:01:53.982772 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:53.982752 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-mjqjt"] Sep 07 04:01:54.028985 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:54.028951 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-image-registry-private-configuration\") pod \"image-registry-5c47978b8-5xwws\" (UID: \"07312acd-cd4b-4853-8db1-a5b6f6ae1a00\") " pod="openshift-image-registry/image-registry-5c47978b8-5xwws" Sep 07 04:01:54.028985 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:54.028985 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a-serving-cert\") pod \"console-operator-85b454874b-bgrfr\" (UID: \"9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a\") " pod="openshift-console-operator/console-operator-85b454874b-bgrfr" Sep 07 04:01:54.029213 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:54.029017 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/599835cb-1ae6-41a2-a0a8-fabb6f329fbe-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-mjqjt\" (UID: \"599835cb-1ae6-41a2-a0a8-fabb6f329fbe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-mjqjt" Sep 07 04:01:54.029213 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:54.029050 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bad8bde3-660e-4e61-b849-89dae63bed94-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-pphq7\" (UID: \"bad8bde3-660e-4e61-b849-89dae63bed94\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pphq7" Sep 07 04:01:54.029213 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:54.029079 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgn6g\" (UniqueName: \"kubernetes.io/projected/bad8bde3-660e-4e61-b849-89dae63bed94-kube-api-access-fgn6g\") pod \"cluster-samples-operator-7cdcfcf76c-pphq7\" (UID: \"bad8bde3-660e-4e61-b849-89dae63bed94\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pphq7" Sep 07 04:01:54.029213 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:54.029103 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-registry-certificates\") pod \"image-registry-5c47978b8-5xwws\" (UID: \"07312acd-cd4b-4853-8db1-a5b6f6ae1a00\") " pod="openshift-image-registry/image-registry-5c47978b8-5xwws" Sep 07 04:01:54.029213 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:54.029124 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-trusted-ca\") pod \"image-registry-5c47978b8-5xwws\" (UID: \"07312acd-cd4b-4853-8db1-a5b6f6ae1a00\") " pod="openshift-image-registry/image-registry-5c47978b8-5xwws" Sep 07 04:01:54.029213 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:01:54.029183 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 07 04:01:54.029552 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:54.029221 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7fwq\" (UniqueName: \"kubernetes.io/projected/599835cb-1ae6-41a2-a0a8-fabb6f329fbe-kube-api-access-h7fwq\") pod \"kube-storage-version-migrator-operator-8d7dd4675-mjqjt\" (UID: \"599835cb-1ae6-41a2-a0a8-fabb6f329fbe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-mjqjt" Sep 07 04:01:54.029552 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:01:54.029288 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bad8bde3-660e-4e61-b849-89dae63bed94-samples-operator-tls podName:bad8bde3-660e-4e61-b849-89dae63bed94 nodeName:}" failed. No retries permitted until 2026-09-07 04:01:54.529267611 +0000 UTC m=+246.949642322 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bad8bde3-660e-4e61-b849-89dae63bed94-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-pphq7" (UID: "bad8bde3-660e-4e61-b849-89dae63bed94") : secret "samples-operator-tls" not found Sep 07 04:01:54.029552 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:54.029311 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-bound-sa-token\") pod \"image-registry-5c47978b8-5xwws\" (UID: \"07312acd-cd4b-4853-8db1-a5b6f6ae1a00\") " pod="openshift-image-registry/image-registry-5c47978b8-5xwws" Sep 07 04:01:54.029552 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:54.029342 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-installation-pull-secrets\") pod \"image-registry-5c47978b8-5xwws\" (UID: \"07312acd-cd4b-4853-8db1-a5b6f6ae1a00\") " pod="openshift-image-registry/image-registry-5c47978b8-5xwws" Sep 07 04:01:54.029552 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:54.029369 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/599835cb-1ae6-41a2-a0a8-fabb6f329fbe-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-mjqjt\" (UID: \"599835cb-1ae6-41a2-a0a8-fabb6f329fbe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-mjqjt" Sep 07 04:01:54.029552 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:54.029395 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-registry-tls\") pod \"image-registry-5c47978b8-5xwws\" (UID: \"07312acd-cd4b-4853-8db1-a5b6f6ae1a00\") " pod="openshift-image-registry/image-registry-5c47978b8-5xwws" Sep 07 04:01:54.029552 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:54.029423 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a-trusted-ca\") pod \"console-operator-85b454874b-bgrfr\" (UID: \"9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a\") " pod="openshift-console-operator/console-operator-85b454874b-bgrfr" Sep 07 04:01:54.029552 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:54.029458 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbjfc\" (UniqueName: \"kubernetes.io/projected/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-kube-api-access-rbjfc\") pod \"image-registry-5c47978b8-5xwws\" (UID: \"07312acd-cd4b-4853-8db1-a5b6f6ae1a00\") " pod="openshift-image-registry/image-registry-5c47978b8-5xwws" Sep 07 04:01:54.029552 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:54.029483 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcpkh\" (UniqueName: \"kubernetes.io/projected/9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a-kube-api-access-tcpkh\") pod \"console-operator-85b454874b-bgrfr\" (UID: \"9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a\") " pod="openshift-console-operator/console-operator-85b454874b-bgrfr" Sep 07 04:01:54.029552 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:54.029519 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-ca-trust-extracted\") pod \"image-registry-5c47978b8-5xwws\" (UID: \"07312acd-cd4b-4853-8db1-a5b6f6ae1a00\") " pod="openshift-image-registry/image-registry-5c47978b8-5xwws" Sep 07 04:01:54.029552 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:54.029544 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a-config\") pod \"console-operator-85b454874b-bgrfr\" (UID: \"9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a\") " pod="openshift-console-operator/console-operator-85b454874b-bgrfr" Sep 07 04:01:54.030144 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:01:54.030011 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 04:01:54.030144 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:01:54.030027 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c47978b8-5xwws: secret "image-registry-tls" not found Sep 07 04:01:54.030144 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:54.030128 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-ca-trust-extracted\") pod \"image-registry-5c47978b8-5xwws\" (UID: \"07312acd-cd4b-4853-8db1-a5b6f6ae1a00\") " pod="openshift-image-registry/image-registry-5c47978b8-5xwws" Sep 07 04:01:54.030144 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:01:54.030146 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-registry-tls podName:07312acd-cd4b-4853-8db1-a5b6f6ae1a00 nodeName:}" failed. No retries permitted until 2026-09-07 04:01:54.530127902 +0000 UTC m=+246.950502617 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-registry-tls") pod "image-registry-5c47978b8-5xwws" (UID: "07312acd-cd4b-4853-8db1-a5b6f6ae1a00") : secret "image-registry-tls" not found Sep 07 04:01:54.030412 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:54.030391 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-trusted-ca\") pod \"image-registry-5c47978b8-5xwws\" (UID: \"07312acd-cd4b-4853-8db1-a5b6f6ae1a00\") " pod="openshift-image-registry/image-registry-5c47978b8-5xwws" Sep 07 04:01:54.030662 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:54.030646 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-registry-certificates\") pod \"image-registry-5c47978b8-5xwws\" (UID: \"07312acd-cd4b-4853-8db1-a5b6f6ae1a00\") " pod="openshift-image-registry/image-registry-5c47978b8-5xwws" Sep 07 04:01:54.030725 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:54.030660 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a-config\") pod \"console-operator-85b454874b-bgrfr\" (UID: \"9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a\") " pod="openshift-console-operator/console-operator-85b454874b-bgrfr" Sep 07 04:01:54.030725 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:54.030704 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a-trusted-ca\") pod \"console-operator-85b454874b-bgrfr\" (UID: \"9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a\") " pod="openshift-console-operator/console-operator-85b454874b-bgrfr" Sep 07 04:01:54.031755 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:54.031730 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a-serving-cert\") pod \"console-operator-85b454874b-bgrfr\" (UID: \"9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a\") " pod="openshift-console-operator/console-operator-85b454874b-bgrfr" Sep 07 04:01:54.031849 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:54.031793 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-image-registry-private-configuration\") pod \"image-registry-5c47978b8-5xwws\" (UID: \"07312acd-cd4b-4853-8db1-a5b6f6ae1a00\") " pod="openshift-image-registry/image-registry-5c47978b8-5xwws" Sep 07 04:01:54.031946 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:54.031929 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-installation-pull-secrets\") pod \"image-registry-5c47978b8-5xwws\" (UID: \"07312acd-cd4b-4853-8db1-a5b6f6ae1a00\") " pod="openshift-image-registry/image-registry-5c47978b8-5xwws" Sep 07 04:01:54.054056 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:54.054028 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgn6g\" (UniqueName: \"kubernetes.io/projected/bad8bde3-660e-4e61-b849-89dae63bed94-kube-api-access-fgn6g\") pod \"cluster-samples-operator-7cdcfcf76c-pphq7\" (UID: \"bad8bde3-660e-4e61-b849-89dae63bed94\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pphq7" Sep 07 04:01:54.054167 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:54.054084 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbjfc\" (UniqueName: \"kubernetes.io/projected/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-kube-api-access-rbjfc\") pod \"image-registry-5c47978b8-5xwws\" (UID: \"07312acd-cd4b-4853-8db1-a5b6f6ae1a00\") " pod="openshift-image-registry/image-registry-5c47978b8-5xwws" Sep 07 04:01:54.054255 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:54.054233 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcpkh\" (UniqueName: \"kubernetes.io/projected/9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a-kube-api-access-tcpkh\") pod \"console-operator-85b454874b-bgrfr\" (UID: \"9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a\") " pod="openshift-console-operator/console-operator-85b454874b-bgrfr" Sep 07 04:01:54.055154 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:54.055131 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-bound-sa-token\") pod \"image-registry-5c47978b8-5xwws\" (UID: \"07312acd-cd4b-4853-8db1-a5b6f6ae1a00\") " pod="openshift-image-registry/image-registry-5c47978b8-5xwws" Sep 07 04:01:54.130335 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:54.130257 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7fwq\" (UniqueName: \"kubernetes.io/projected/599835cb-1ae6-41a2-a0a8-fabb6f329fbe-kube-api-access-h7fwq\") pod \"kube-storage-version-migrator-operator-8d7dd4675-mjqjt\" (UID: \"599835cb-1ae6-41a2-a0a8-fabb6f329fbe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-mjqjt" Sep 07 04:01:54.130335 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:54.130299 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/599835cb-1ae6-41a2-a0a8-fabb6f329fbe-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-mjqjt\" (UID: \"599835cb-1ae6-41a2-a0a8-fabb6f329fbe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-mjqjt" Sep 07 04:01:54.130503 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:54.130360 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/599835cb-1ae6-41a2-a0a8-fabb6f329fbe-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-mjqjt\" (UID: \"599835cb-1ae6-41a2-a0a8-fabb6f329fbe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-mjqjt" Sep 07 04:01:54.130935 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:54.130916 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/599835cb-1ae6-41a2-a0a8-fabb6f329fbe-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-mjqjt\" (UID: \"599835cb-1ae6-41a2-a0a8-fabb6f329fbe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-mjqjt" Sep 07 04:01:54.132594 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:54.132573 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/599835cb-1ae6-41a2-a0a8-fabb6f329fbe-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-mjqjt\" (UID: \"599835cb-1ae6-41a2-a0a8-fabb6f329fbe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-mjqjt" Sep 07 04:01:54.137364 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:54.137343 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7fwq\" (UniqueName: \"kubernetes.io/projected/599835cb-1ae6-41a2-a0a8-fabb6f329fbe-kube-api-access-h7fwq\") pod \"kube-storage-version-migrator-operator-8d7dd4675-mjqjt\" (UID: \"599835cb-1ae6-41a2-a0a8-fabb6f329fbe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-mjqjt" Sep 07 04:01:54.187596 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:54.187563 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-bgrfr" Sep 07 04:01:54.277947 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:54.277917 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-mjqjt" Sep 07 04:01:54.452123 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:54.452052 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-bgrfr"] Sep 07 04:01:54.454760 ip-10-0-143-125 kubenswrapper[2566]: W0907 04:01:54.454734 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e50e1de_b302_4b6a_8cf1_88d1d1e1bb2a.slice/crio-a4c7003018160e89b5f82abdb292a3756dbdc514e430d786fef12834e91c9328 WatchSource:0}: Error finding container a4c7003018160e89b5f82abdb292a3756dbdc514e430d786fef12834e91c9328: Status 404 returned error can't find the container with id a4c7003018160e89b5f82abdb292a3756dbdc514e430d786fef12834e91c9328 Sep 07 04:01:54.533454 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:54.533426 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bad8bde3-660e-4e61-b849-89dae63bed94-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-pphq7\" (UID: \"bad8bde3-660e-4e61-b849-89dae63bed94\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pphq7" Sep 07 04:01:54.533605 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:54.533469 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-registry-tls\") pod \"image-registry-5c47978b8-5xwws\" (UID: \"07312acd-cd4b-4853-8db1-a5b6f6ae1a00\") " pod="openshift-image-registry/image-registry-5c47978b8-5xwws" Sep 07 04:01:54.533605 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:01:54.533568 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 04:01:54.533605 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:01:54.533571 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 07 04:01:54.533747 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:01:54.533578 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c47978b8-5xwws: secret "image-registry-tls" not found Sep 07 04:01:54.533747 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:01:54.533654 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bad8bde3-660e-4e61-b849-89dae63bed94-samples-operator-tls podName:bad8bde3-660e-4e61-b849-89dae63bed94 nodeName:}" failed. No retries permitted until 2026-09-07 04:01:55.533620445 +0000 UTC m=+247.953995164 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bad8bde3-660e-4e61-b849-89dae63bed94-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-pphq7" (UID: "bad8bde3-660e-4e61-b849-89dae63bed94") : secret "samples-operator-tls" not found Sep 07 04:01:54.533747 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:01:54.533672 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-registry-tls podName:07312acd-cd4b-4853-8db1-a5b6f6ae1a00 nodeName:}" failed. No retries permitted until 2026-09-07 04:01:55.533663746 +0000 UTC m=+247.954038446 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-registry-tls") pod "image-registry-5c47978b8-5xwws" (UID: "07312acd-cd4b-4853-8db1-a5b6f6ae1a00") : secret "image-registry-tls" not found Sep 07 04:01:54.539851 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:54.539827 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-mjqjt"] Sep 07 04:01:54.542801 ip-10-0-143-125 kubenswrapper[2566]: W0907 04:01:54.542778 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod599835cb_1ae6_41a2_a0a8_fabb6f329fbe.slice/crio-59fa9e039d448f1a32ae82af8feaba685be29d6c169acd6d05be5316d58bfacd WatchSource:0}: Error finding container 59fa9e039d448f1a32ae82af8feaba685be29d6c169acd6d05be5316d58bfacd: Status 404 returned error can't find the container with id 59fa9e039d448f1a32ae82af8feaba685be29d6c169acd6d05be5316d58bfacd Sep 07 04:01:54.742061 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:54.741962 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-mjqjt" event={"ID":"599835cb-1ae6-41a2-a0a8-fabb6f329fbe","Type":"ContainerStarted","Data":"59fa9e039d448f1a32ae82af8feaba685be29d6c169acd6d05be5316d58bfacd"} Sep 07 04:01:54.742910 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:54.742888 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-bgrfr" event={"ID":"9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a","Type":"ContainerStarted","Data":"a4c7003018160e89b5f82abdb292a3756dbdc514e430d786fef12834e91c9328"} Sep 07 04:01:55.543743 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:55.543705 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bad8bde3-660e-4e61-b849-89dae63bed94-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-pphq7\" (UID: \"bad8bde3-660e-4e61-b849-89dae63bed94\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pphq7" Sep 07 04:01:55.544490 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:55.543768 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-registry-tls\") pod \"image-registry-5c47978b8-5xwws\" (UID: \"07312acd-cd4b-4853-8db1-a5b6f6ae1a00\") " pod="openshift-image-registry/image-registry-5c47978b8-5xwws" Sep 07 04:01:55.544490 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:01:55.543886 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 04:01:55.544490 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:01:55.543889 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 07 04:01:55.544490 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:01:55.543973 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bad8bde3-660e-4e61-b849-89dae63bed94-samples-operator-tls podName:bad8bde3-660e-4e61-b849-89dae63bed94 nodeName:}" failed. No retries permitted until 2026-09-07 04:01:57.543952332 +0000 UTC m=+249.964327047 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bad8bde3-660e-4e61-b849-89dae63bed94-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-pphq7" (UID: "bad8bde3-660e-4e61-b849-89dae63bed94") : secret "samples-operator-tls" not found Sep 07 04:01:55.544490 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:01:55.543901 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c47978b8-5xwws: secret "image-registry-tls" not found Sep 07 04:01:55.544490 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:01:55.544032 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-registry-tls podName:07312acd-cd4b-4853-8db1-a5b6f6ae1a00 nodeName:}" failed. No retries permitted until 2026-09-07 04:01:57.5440173 +0000 UTC m=+249.964392015 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-registry-tls") pod "image-registry-5c47978b8-5xwws" (UID: "07312acd-cd4b-4853-8db1-a5b6f6ae1a00") : secret "image-registry-tls" not found Sep 07 04:01:57.562208 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:57.562157 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bad8bde3-660e-4e61-b849-89dae63bed94-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-pphq7\" (UID: \"bad8bde3-660e-4e61-b849-89dae63bed94\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pphq7" Sep 07 04:01:57.562623 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:57.562226 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-registry-tls\") pod \"image-registry-5c47978b8-5xwws\" (UID: \"07312acd-cd4b-4853-8db1-a5b6f6ae1a00\") " pod="openshift-image-registry/image-registry-5c47978b8-5xwws" Sep 07 04:01:57.562623 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:01:57.562315 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 07 04:01:57.562623 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:01:57.562376 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bad8bde3-660e-4e61-b849-89dae63bed94-samples-operator-tls podName:bad8bde3-660e-4e61-b849-89dae63bed94 nodeName:}" failed. No retries permitted until 2026-09-07 04:02:01.562360955 +0000 UTC m=+253.982735669 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bad8bde3-660e-4e61-b849-89dae63bed94-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-pphq7" (UID: "bad8bde3-660e-4e61-b849-89dae63bed94") : secret "samples-operator-tls" not found Sep 07 04:01:57.562623 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:01:57.562323 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 04:01:57.562623 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:01:57.562410 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c47978b8-5xwws: secret "image-registry-tls" not found Sep 07 04:01:57.562623 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:01:57.562448 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-registry-tls podName:07312acd-cd4b-4853-8db1-a5b6f6ae1a00 nodeName:}" failed. No retries permitted until 2026-09-07 04:02:01.562437975 +0000 UTC m=+253.982812679 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-registry-tls") pod "image-registry-5c47978b8-5xwws" (UID: "07312acd-cd4b-4853-8db1-a5b6f6ae1a00") : secret "image-registry-tls" not found Sep 07 04:01:57.755624 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:57.755590 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-mjqjt" event={"ID":"599835cb-1ae6-41a2-a0a8-fabb6f329fbe","Type":"ContainerStarted","Data":"e775bb80fa411595f0a1fe00b572f2152ea34ff98228650e9ab3a954a0ceec1b"} Sep 07 04:01:57.757215 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:57.757194 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-bgrfr_9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a/console-operator/0.log" Sep 07 04:01:57.757326 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:57.757227 2566 generic.go:356] "Generic (PLEG): container finished" podID="9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a" containerID="505a59901159d142f29de6552b422394b6acc922b9ed59ef7178baddd055b0b8" exitCode=255 Sep 07 04:01:57.757326 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:57.757256 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-bgrfr" event={"ID":"9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a","Type":"ContainerDied","Data":"505a59901159d142f29de6552b422394b6acc922b9ed59ef7178baddd055b0b8"} Sep 07 04:01:57.757468 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:57.757453 2566 scope.go:117] "RemoveContainer" containerID="505a59901159d142f29de6552b422394b6acc922b9ed59ef7178baddd055b0b8" Sep 07 04:01:57.770189 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:57.770145 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-mjqjt" podStartSLOduration=2.620483788 podStartE2EDuration="4.770129798s" totalImagesPullingTime="2.14964601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:01:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:01:57.76933143 +0000 UTC m=+250.189706154" watchObservedRunningTime="2026-09-07 04:01:57.770129798 +0000 UTC m=+250.190504520" Sep 07 04:01:58.597694 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:58.597660 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-g9wd9"] Sep 07 04:01:58.599674 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:58.599659 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-g9wd9" Sep 07 04:01:58.602867 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:58.602844 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9ddtk\"" Sep 07 04:01:58.602989 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:58.602874 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 07 04:01:58.603653 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:58.603617 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 07 04:01:58.603748 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:58.603659 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 07 04:01:58.603748 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:58.603668 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 07 04:01:58.613407 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:58.613380 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-g9wd9"] Sep 07 04:01:58.671267 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:58.671230 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e03bf6a3-d565-4c87-bf65-cd285eb1ec64-crio-socket\") pod \"insights-runtime-extractor-g9wd9\" (UID: \"e03bf6a3-d565-4c87-bf65-cd285eb1ec64\") " pod="openshift-insights/insights-runtime-extractor-g9wd9" Sep 07 04:01:58.671267 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:58.671272 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e03bf6a3-d565-4c87-bf65-cd285eb1ec64-data-volume\") pod \"insights-runtime-extractor-g9wd9\" (UID: \"e03bf6a3-d565-4c87-bf65-cd285eb1ec64\") " pod="openshift-insights/insights-runtime-extractor-g9wd9" Sep 07 04:01:58.671510 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:58.671295 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e03bf6a3-d565-4c87-bf65-cd285eb1ec64-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g9wd9\" (UID: \"e03bf6a3-d565-4c87-bf65-cd285eb1ec64\") " pod="openshift-insights/insights-runtime-extractor-g9wd9" Sep 07 04:01:58.671510 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:58.671379 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5g7w\" (UniqueName: \"kubernetes.io/projected/e03bf6a3-d565-4c87-bf65-cd285eb1ec64-kube-api-access-v5g7w\") pod \"insights-runtime-extractor-g9wd9\" (UID: \"e03bf6a3-d565-4c87-bf65-cd285eb1ec64\") " pod="openshift-insights/insights-runtime-extractor-g9wd9" Sep 07 04:01:58.671510 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:58.671445 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e03bf6a3-d565-4c87-bf65-cd285eb1ec64-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g9wd9\" (UID: \"e03bf6a3-d565-4c87-bf65-cd285eb1ec64\") " pod="openshift-insights/insights-runtime-extractor-g9wd9" Sep 07 04:01:58.761933 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:58.761903 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-bgrfr_9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a/console-operator/1.log" Sep 07 04:01:58.762324 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:58.762308 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-bgrfr_9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a/console-operator/0.log" Sep 07 04:01:58.762383 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:58.762342 2566 generic.go:356] "Generic (PLEG): container finished" podID="9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a" containerID="a316ee7f536f87e7c5f9d12194a37519b4d8f39253d80e59ff5a250ac780ea87" exitCode=255 Sep 07 04:01:58.762440 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:58.762416 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-bgrfr" event={"ID":"9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a","Type":"ContainerDied","Data":"a316ee7f536f87e7c5f9d12194a37519b4d8f39253d80e59ff5a250ac780ea87"} Sep 07 04:01:58.762489 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:58.762456 2566 scope.go:117] "RemoveContainer" containerID="505a59901159d142f29de6552b422394b6acc922b9ed59ef7178baddd055b0b8" Sep 07 04:01:58.762681 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:58.762661 2566 scope.go:117] "RemoveContainer" containerID="a316ee7f536f87e7c5f9d12194a37519b4d8f39253d80e59ff5a250ac780ea87" Sep 07 04:01:58.762867 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:01:58.762846 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-bgrfr_openshift-console-operator(9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a)\"" pod="openshift-console-operator/console-operator-85b454874b-bgrfr" podUID="9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a" Sep 07 04:01:58.772754 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:58.772736 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e03bf6a3-d565-4c87-bf65-cd285eb1ec64-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g9wd9\" (UID: \"e03bf6a3-d565-4c87-bf65-cd285eb1ec64\") " pod="openshift-insights/insights-runtime-extractor-g9wd9" Sep 07 04:01:58.772849 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:58.772813 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e03bf6a3-d565-4c87-bf65-cd285eb1ec64-crio-socket\") pod \"insights-runtime-extractor-g9wd9\" (UID: \"e03bf6a3-d565-4c87-bf65-cd285eb1ec64\") " pod="openshift-insights/insights-runtime-extractor-g9wd9" Sep 07 04:01:58.772918 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:58.772855 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e03bf6a3-d565-4c87-bf65-cd285eb1ec64-data-volume\") pod \"insights-runtime-extractor-g9wd9\" (UID: \"e03bf6a3-d565-4c87-bf65-cd285eb1ec64\") " pod="openshift-insights/insights-runtime-extractor-g9wd9" Sep 07 04:01:58.772918 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:58.772886 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e03bf6a3-d565-4c87-bf65-cd285eb1ec64-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g9wd9\" (UID: \"e03bf6a3-d565-4c87-bf65-cd285eb1ec64\") " pod="openshift-insights/insights-runtime-extractor-g9wd9" Sep 07 04:01:58.773018 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:58.772914 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5g7w\" (UniqueName: \"kubernetes.io/projected/e03bf6a3-d565-4c87-bf65-cd285eb1ec64-kube-api-access-v5g7w\") pod \"insights-runtime-extractor-g9wd9\" (UID: \"e03bf6a3-d565-4c87-bf65-cd285eb1ec64\") " pod="openshift-insights/insights-runtime-extractor-g9wd9" Sep 07 04:01:58.773018 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:58.772936 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e03bf6a3-d565-4c87-bf65-cd285eb1ec64-crio-socket\") pod \"insights-runtime-extractor-g9wd9\" (UID: \"e03bf6a3-d565-4c87-bf65-cd285eb1ec64\") " pod="openshift-insights/insights-runtime-extractor-g9wd9" Sep 07 04:01:58.773018 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:01:58.772886 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 04:01:58.773018 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:01:58.772995 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 04:01:58.773172 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:01:58.773029 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e03bf6a3-d565-4c87-bf65-cd285eb1ec64-insights-runtime-extractor-tls podName:e03bf6a3-d565-4c87-bf65-cd285eb1ec64 nodeName:}" failed. No retries permitted until 2026-09-07 04:01:59.273006916 +0000 UTC m=+251.693381635 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e03bf6a3-d565-4c87-bf65-cd285eb1ec64-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g9wd9" (UID: "e03bf6a3-d565-4c87-bf65-cd285eb1ec64") : secret "insights-runtime-extractor-tls" not found Sep 07 04:01:58.773172 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:01:58.773052 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e03bf6a3-d565-4c87-bf65-cd285eb1ec64-kube-rbac-proxy-cm podName:e03bf6a3-d565-4c87-bf65-cd285eb1ec64 nodeName:}" failed. No retries permitted until 2026-09-07 04:01:59.273040908 +0000 UTC m=+251.693415611 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e03bf6a3-d565-4c87-bf65-cd285eb1ec64-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g9wd9" (UID: "e03bf6a3-d565-4c87-bf65-cd285eb1ec64") : configmap "kube-rbac-proxy" not found Sep 07 04:01:58.773172 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:58.773140 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e03bf6a3-d565-4c87-bf65-cd285eb1ec64-data-volume\") pod \"insights-runtime-extractor-g9wd9\" (UID: \"e03bf6a3-d565-4c87-bf65-cd285eb1ec64\") " pod="openshift-insights/insights-runtime-extractor-g9wd9" Sep 07 04:01:58.781331 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:58.781308 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5g7w\" (UniqueName: \"kubernetes.io/projected/e03bf6a3-d565-4c87-bf65-cd285eb1ec64-kube-api-access-v5g7w\") pod \"insights-runtime-extractor-g9wd9\" (UID: \"e03bf6a3-d565-4c87-bf65-cd285eb1ec64\") " pod="openshift-insights/insights-runtime-extractor-g9wd9" Sep 07 04:01:59.275900 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:59.275855 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e03bf6a3-d565-4c87-bf65-cd285eb1ec64-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g9wd9\" (UID: \"e03bf6a3-d565-4c87-bf65-cd285eb1ec64\") " pod="openshift-insights/insights-runtime-extractor-g9wd9" Sep 07 04:01:59.276158 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:59.275920 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e03bf6a3-d565-4c87-bf65-cd285eb1ec64-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g9wd9\" (UID: \"e03bf6a3-d565-4c87-bf65-cd285eb1ec64\") " pod="openshift-insights/insights-runtime-extractor-g9wd9" Sep 07 04:01:59.276158 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:01:59.276000 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 04:01:59.276158 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:01:59.276071 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e03bf6a3-d565-4c87-bf65-cd285eb1ec64-kube-rbac-proxy-cm podName:e03bf6a3-d565-4c87-bf65-cd285eb1ec64 nodeName:}" failed. No retries permitted until 2026-09-07 04:02:00.276054629 +0000 UTC m=+252.696429353 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e03bf6a3-d565-4c87-bf65-cd285eb1ec64-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g9wd9" (UID: "e03bf6a3-d565-4c87-bf65-cd285eb1ec64") : configmap "kube-rbac-proxy" not found Sep 07 04:01:59.276158 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:01:59.276011 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 04:01:59.276158 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:01:59.276137 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e03bf6a3-d565-4c87-bf65-cd285eb1ec64-insights-runtime-extractor-tls podName:e03bf6a3-d565-4c87-bf65-cd285eb1ec64 nodeName:}" failed. No retries permitted until 2026-09-07 04:02:00.27612479 +0000 UTC m=+252.696499491 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e03bf6a3-d565-4c87-bf65-cd285eb1ec64-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g9wd9" (UID: "e03bf6a3-d565-4c87-bf65-cd285eb1ec64") : secret "insights-runtime-extractor-tls" not found Sep 07 04:01:59.766402 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:59.766370 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-bgrfr_9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a/console-operator/1.log" Sep 07 04:01:59.766790 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:59.766713 2566 scope.go:117] "RemoveContainer" containerID="a316ee7f536f87e7c5f9d12194a37519b4d8f39253d80e59ff5a250ac780ea87" Sep 07 04:01:59.766913 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:01:59.766891 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-bgrfr_openshift-console-operator(9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a)\"" pod="openshift-console-operator/console-operator-85b454874b-bgrfr" podUID="9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a" Sep 07 04:01:59.882161 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:01:59.882100 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9-metrics-certs\") pod \"network-metrics-daemon-bshbg\" (UID: \"2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9\") " pod="openshift-multus/network-metrics-daemon-bshbg" Sep 07 04:01:59.882386 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:01:59.882213 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 07 04:01:59.882386 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:01:59.882261 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9-metrics-certs podName:2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9 nodeName:}" failed. No retries permitted until 2026-09-07 04:04:01.88224805 +0000 UTC m=+374.302622750 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9-metrics-certs") pod "network-metrics-daemon-bshbg" (UID: "2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9") : secret "metrics-daemon-secret" not found Sep 07 04:02:00.284790 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:00.284745 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e03bf6a3-d565-4c87-bf65-cd285eb1ec64-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g9wd9\" (UID: \"e03bf6a3-d565-4c87-bf65-cd285eb1ec64\") " pod="openshift-insights/insights-runtime-extractor-g9wd9" Sep 07 04:02:00.284997 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:00.284819 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e03bf6a3-d565-4c87-bf65-cd285eb1ec64-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g9wd9\" (UID: \"e03bf6a3-d565-4c87-bf65-cd285eb1ec64\") " pod="openshift-insights/insights-runtime-extractor-g9wd9" Sep 07 04:02:00.284997 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:02:00.284871 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 04:02:00.284997 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:02:00.284942 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 04:02:00.284997 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:02:00.284949 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e03bf6a3-d565-4c87-bf65-cd285eb1ec64-kube-rbac-proxy-cm podName:e03bf6a3-d565-4c87-bf65-cd285eb1ec64 nodeName:}" failed. No retries permitted until 2026-09-07 04:02:02.284932753 +0000 UTC m=+254.705307478 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e03bf6a3-d565-4c87-bf65-cd285eb1ec64-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g9wd9" (UID: "e03bf6a3-d565-4c87-bf65-cd285eb1ec64") : configmap "kube-rbac-proxy" not found Sep 07 04:02:00.284997 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:02:00.284992 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e03bf6a3-d565-4c87-bf65-cd285eb1ec64-insights-runtime-extractor-tls podName:e03bf6a3-d565-4c87-bf65-cd285eb1ec64 nodeName:}" failed. No retries permitted until 2026-09-07 04:02:02.284977021 +0000 UTC m=+254.705351722 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e03bf6a3-d565-4c87-bf65-cd285eb1ec64-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g9wd9" (UID: "e03bf6a3-d565-4c87-bf65-cd285eb1ec64") : secret "insights-runtime-extractor-tls" not found Sep 07 04:02:00.309617 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:00.309589 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-gk9ww"] Sep 07 04:02:00.313448 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:00.313432 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-gk9ww" Sep 07 04:02:00.315687 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:00.315662 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Sep 07 04:02:00.315785 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:00.315668 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Sep 07 04:02:00.315785 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:00.315720 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Sep 07 04:02:00.316392 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:00.316376 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-zw9tz\"" Sep 07 04:02:00.316454 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:00.316408 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Sep 07 04:02:00.319668 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:00.319624 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-gk9ww"] Sep 07 04:02:00.385406 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:00.385370 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e656208b-07a9-45dd-b5ae-c1595c2cd33d-signing-key\") pod \"service-ca-75d99c484-gk9ww\" (UID: \"e656208b-07a9-45dd-b5ae-c1595c2cd33d\") " pod="openshift-service-ca/service-ca-75d99c484-gk9ww" Sep 07 04:02:00.385406 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:00.385409 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e656208b-07a9-45dd-b5ae-c1595c2cd33d-signing-cabundle\") pod \"service-ca-75d99c484-gk9ww\" (UID: \"e656208b-07a9-45dd-b5ae-c1595c2cd33d\") " pod="openshift-service-ca/service-ca-75d99c484-gk9ww" Sep 07 04:02:00.385571 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:00.385534 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmtmq\" (UniqueName: \"kubernetes.io/projected/e656208b-07a9-45dd-b5ae-c1595c2cd33d-kube-api-access-zmtmq\") pod \"service-ca-75d99c484-gk9ww\" (UID: \"e656208b-07a9-45dd-b5ae-c1595c2cd33d\") " pod="openshift-service-ca/service-ca-75d99c484-gk9ww" Sep 07 04:02:00.486181 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:00.486148 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmtmq\" (UniqueName: \"kubernetes.io/projected/e656208b-07a9-45dd-b5ae-c1595c2cd33d-kube-api-access-zmtmq\") pod \"service-ca-75d99c484-gk9ww\" (UID: \"e656208b-07a9-45dd-b5ae-c1595c2cd33d\") " pod="openshift-service-ca/service-ca-75d99c484-gk9ww" Sep 07 04:02:00.486277 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:00.486233 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e656208b-07a9-45dd-b5ae-c1595c2cd33d-signing-key\") pod \"service-ca-75d99c484-gk9ww\" (UID: \"e656208b-07a9-45dd-b5ae-c1595c2cd33d\") " pod="openshift-service-ca/service-ca-75d99c484-gk9ww" Sep 07 04:02:00.486277 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:00.486261 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e656208b-07a9-45dd-b5ae-c1595c2cd33d-signing-cabundle\") pod \"service-ca-75d99c484-gk9ww\" (UID: \"e656208b-07a9-45dd-b5ae-c1595c2cd33d\") " pod="openshift-service-ca/service-ca-75d99c484-gk9ww" Sep 07 04:02:00.486985 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:00.486963 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e656208b-07a9-45dd-b5ae-c1595c2cd33d-signing-cabundle\") pod \"service-ca-75d99c484-gk9ww\" (UID: \"e656208b-07a9-45dd-b5ae-c1595c2cd33d\") " pod="openshift-service-ca/service-ca-75d99c484-gk9ww" Sep 07 04:02:00.488751 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:00.488723 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e656208b-07a9-45dd-b5ae-c1595c2cd33d-signing-key\") pod \"service-ca-75d99c484-gk9ww\" (UID: \"e656208b-07a9-45dd-b5ae-c1595c2cd33d\") " pod="openshift-service-ca/service-ca-75d99c484-gk9ww" Sep 07 04:02:00.493705 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:00.493682 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmtmq\" (UniqueName: \"kubernetes.io/projected/e656208b-07a9-45dd-b5ae-c1595c2cd33d-kube-api-access-zmtmq\") pod \"service-ca-75d99c484-gk9ww\" (UID: \"e656208b-07a9-45dd-b5ae-c1595c2cd33d\") " pod="openshift-service-ca/service-ca-75d99c484-gk9ww" Sep 07 04:02:00.569271 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:00.569211 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j2xph_d5c78be9-7199-4898-8b64-335079a42ce2/dns-node-resolver/0.log" Sep 07 04:02:00.623529 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:00.623497 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-gk9ww" Sep 07 04:02:00.890907 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:00.890876 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-gk9ww"] Sep 07 04:02:00.894280 ip-10-0-143-125 kubenswrapper[2566]: W0907 04:02:00.894257 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode656208b_07a9_45dd_b5ae_c1595c2cd33d.slice/crio-235ea7e04b609f85ffc2cd8a8df7dd420e2bab36c21d28323c7649be599787bf WatchSource:0}: Error finding container 235ea7e04b609f85ffc2cd8a8df7dd420e2bab36c21d28323c7649be599787bf: Status 404 returned error can't find the container with id 235ea7e04b609f85ffc2cd8a8df7dd420e2bab36c21d28323c7649be599787bf Sep 07 04:02:01.595378 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:01.595338 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bad8bde3-660e-4e61-b849-89dae63bed94-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-pphq7\" (UID: \"bad8bde3-660e-4e61-b849-89dae63bed94\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pphq7" Sep 07 04:02:01.595586 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:01.595466 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-registry-tls\") pod \"image-registry-5c47978b8-5xwws\" (UID: \"07312acd-cd4b-4853-8db1-a5b6f6ae1a00\") " pod="openshift-image-registry/image-registry-5c47978b8-5xwws" Sep 07 04:02:01.595586 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:02:01.595501 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 07 04:02:01.595723 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:02:01.595598 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bad8bde3-660e-4e61-b849-89dae63bed94-samples-operator-tls podName:bad8bde3-660e-4e61-b849-89dae63bed94 nodeName:}" failed. No retries permitted until 2026-09-07 04:02:09.595577702 +0000 UTC m=+262.015952418 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bad8bde3-660e-4e61-b849-89dae63bed94-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-pphq7" (UID: "bad8bde3-660e-4e61-b849-89dae63bed94") : secret "samples-operator-tls" not found Sep 07 04:02:01.595723 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:02:01.595643 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 04:02:01.595723 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:02:01.595662 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c47978b8-5xwws: secret "image-registry-tls" not found Sep 07 04:02:01.595893 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:02:01.595740 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-registry-tls podName:07312acd-cd4b-4853-8db1-a5b6f6ae1a00 nodeName:}" failed. No retries permitted until 2026-09-07 04:02:09.595722254 +0000 UTC m=+262.016096971 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-registry-tls") pod "image-registry-5c47978b8-5xwws" (UID: "07312acd-cd4b-4853-8db1-a5b6f6ae1a00") : secret "image-registry-tls" not found Sep 07 04:02:01.769923 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:01.769867 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hkdpb_9acda50f-310f-4846-a461-5d45a198cd54/node-ca/0.log" Sep 07 04:02:01.773013 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:01.772982 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-gk9ww" event={"ID":"e656208b-07a9-45dd-b5ae-c1595c2cd33d","Type":"ContainerStarted","Data":"235ea7e04b609f85ffc2cd8a8df7dd420e2bab36c21d28323c7649be599787bf"} Sep 07 04:02:02.170815 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:02.170779 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9fkxh_981e0f5c-3f82-4c3f-9623-d3282f75a9af/serve-healthcheck-canary/0.log" Sep 07 04:02:02.301321 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:02.301285 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e03bf6a3-d565-4c87-bf65-cd285eb1ec64-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g9wd9\" (UID: \"e03bf6a3-d565-4c87-bf65-cd285eb1ec64\") " pod="openshift-insights/insights-runtime-extractor-g9wd9" Sep 07 04:02:02.301473 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:02.301333 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e03bf6a3-d565-4c87-bf65-cd285eb1ec64-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g9wd9\" (UID: \"e03bf6a3-d565-4c87-bf65-cd285eb1ec64\") " pod="openshift-insights/insights-runtime-extractor-g9wd9" Sep 07 04:02:02.301473 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:02:02.301401 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 04:02:02.301473 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:02:02.301439 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 04:02:02.301582 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:02:02.301483 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e03bf6a3-d565-4c87-bf65-cd285eb1ec64-kube-rbac-proxy-cm podName:e03bf6a3-d565-4c87-bf65-cd285eb1ec64 nodeName:}" failed. No retries permitted until 2026-09-07 04:02:06.301466393 +0000 UTC m=+258.721841097 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e03bf6a3-d565-4c87-bf65-cd285eb1ec64-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g9wd9" (UID: "e03bf6a3-d565-4c87-bf65-cd285eb1ec64") : configmap "kube-rbac-proxy" not found Sep 07 04:02:02.301582 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:02:02.301499 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e03bf6a3-d565-4c87-bf65-cd285eb1ec64-insights-runtime-extractor-tls podName:e03bf6a3-d565-4c87-bf65-cd285eb1ec64 nodeName:}" failed. No retries permitted until 2026-09-07 04:02:06.301492872 +0000 UTC m=+258.721867573 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e03bf6a3-d565-4c87-bf65-cd285eb1ec64-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g9wd9" (UID: "e03bf6a3-d565-4c87-bf65-cd285eb1ec64") : secret "insights-runtime-extractor-tls" not found Sep 07 04:02:03.780730 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:03.780691 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-gk9ww" event={"ID":"e656208b-07a9-45dd-b5ae-c1595c2cd33d","Type":"ContainerStarted","Data":"79a58e556dd8f46bcdbf93b0a5d2ad2b72dbd167a1ab4c61655442b9334f4031"} Sep 07 04:02:03.796188 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:03.796140 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-gk9ww" podStartSLOduration=1.747354031 podStartE2EDuration="3.796126191s" totalImagesPullingTime="2.04877216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:02:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:02:03.795744906 +0000 UTC m=+256.216119630" watchObservedRunningTime="2026-09-07 04:02:03.796126191 +0000 UTC m=+256.216500913" Sep 07 04:02:04.188343 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:04.188306 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-bgrfr" Sep 07 04:02:04.188505 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:04.188370 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-bgrfr" Sep 07 04:02:04.188739 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:04.188725 2566 scope.go:117] "RemoveContainer" containerID="a316ee7f536f87e7c5f9d12194a37519b4d8f39253d80e59ff5a250ac780ea87" Sep 07 04:02:04.188888 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:02:04.188872 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-bgrfr_openshift-console-operator(9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a)\"" pod="openshift-console-operator/console-operator-85b454874b-bgrfr" podUID="9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a" Sep 07 04:02:06.335952 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:06.335909 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e03bf6a3-d565-4c87-bf65-cd285eb1ec64-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g9wd9\" (UID: \"e03bf6a3-d565-4c87-bf65-cd285eb1ec64\") " pod="openshift-insights/insights-runtime-extractor-g9wd9" Sep 07 04:02:06.336340 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:06.335962 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e03bf6a3-d565-4c87-bf65-cd285eb1ec64-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g9wd9\" (UID: \"e03bf6a3-d565-4c87-bf65-cd285eb1ec64\") " pod="openshift-insights/insights-runtime-extractor-g9wd9" Sep 07 04:02:06.336340 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:02:06.336045 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 04:02:06.336340 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:02:06.336067 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 04:02:06.336340 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:02:06.336118 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e03bf6a3-d565-4c87-bf65-cd285eb1ec64-kube-rbac-proxy-cm podName:e03bf6a3-d565-4c87-bf65-cd285eb1ec64 nodeName:}" failed. No retries permitted until 2026-09-07 04:02:14.336098832 +0000 UTC m=+266.756473547 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e03bf6a3-d565-4c87-bf65-cd285eb1ec64-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g9wd9" (UID: "e03bf6a3-d565-4c87-bf65-cd285eb1ec64") : configmap "kube-rbac-proxy" not found Sep 07 04:02:06.336340 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:02:06.336137 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e03bf6a3-d565-4c87-bf65-cd285eb1ec64-insights-runtime-extractor-tls podName:e03bf6a3-d565-4c87-bf65-cd285eb1ec64 nodeName:}" failed. No retries permitted until 2026-09-07 04:02:14.336128424 +0000 UTC m=+266.756503126 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e03bf6a3-d565-4c87-bf65-cd285eb1ec64-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g9wd9" (UID: "e03bf6a3-d565-4c87-bf65-cd285eb1ec64") : secret "insights-runtime-extractor-tls" not found Sep 07 04:02:09.660169 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:09.660125 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bad8bde3-660e-4e61-b849-89dae63bed94-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-pphq7\" (UID: \"bad8bde3-660e-4e61-b849-89dae63bed94\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pphq7" Sep 07 04:02:09.660592 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:09.660343 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-registry-tls\") pod \"image-registry-5c47978b8-5xwws\" (UID: \"07312acd-cd4b-4853-8db1-a5b6f6ae1a00\") " pod="openshift-image-registry/image-registry-5c47978b8-5xwws" Sep 07 04:02:09.662500 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:09.662477 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bad8bde3-660e-4e61-b849-89dae63bed94-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-pphq7\" (UID: \"bad8bde3-660e-4e61-b849-89dae63bed94\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pphq7" Sep 07 04:02:09.662833 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:09.662810 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-registry-tls\") pod \"image-registry-5c47978b8-5xwws\" (UID: \"07312acd-cd4b-4853-8db1-a5b6f6ae1a00\") " pod="openshift-image-registry/image-registry-5c47978b8-5xwws" Sep 07 04:02:09.794089 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:09.794051 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pphq7" Sep 07 04:02:09.799903 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:09.799874 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c47978b8-5xwws" Sep 07 04:02:10.073217 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:10.073098 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pphq7"] Sep 07 04:02:10.088116 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:10.088087 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c47978b8-5xwws"] Sep 07 04:02:10.093843 ip-10-0-143-125 kubenswrapper[2566]: W0907 04:02:10.093819 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07312acd_cd4b_4853_8db1_a5b6f6ae1a00.slice/crio-8842c3128b7f39bc581f3929d0f63880000bf50de1cab9c0c52978e3e5ac57c8 WatchSource:0}: Error finding container 8842c3128b7f39bc581f3929d0f63880000bf50de1cab9c0c52978e3e5ac57c8: Status 404 returned error can't find the container with id 8842c3128b7f39bc581f3929d0f63880000bf50de1cab9c0c52978e3e5ac57c8 Sep 07 04:02:10.804790 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:10.804751 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pphq7" event={"ID":"bad8bde3-660e-4e61-b849-89dae63bed94","Type":"ContainerStarted","Data":"14314ddba454e742103ef04819188de5293ce764ea767dfdc22e8a3622a22cb0"} Sep 07 04:02:10.805985 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:10.805962 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c47978b8-5xwws" event={"ID":"07312acd-cd4b-4853-8db1-a5b6f6ae1a00","Type":"ContainerStarted","Data":"e50df72696fedec965a6654d2d7b6303656a5276d428543cf70445e490f3c85d"} Sep 07 04:02:10.806096 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:10.806004 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c47978b8-5xwws" event={"ID":"07312acd-cd4b-4853-8db1-a5b6f6ae1a00","Type":"ContainerStarted","Data":"8842c3128b7f39bc581f3929d0f63880000bf50de1cab9c0c52978e3e5ac57c8"} Sep 07 04:02:10.806135 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:10.806098 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5c47978b8-5xwws" Sep 07 04:02:10.824703 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:10.824664 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5c47978b8-5xwws" podStartSLOduration=17.824649914 podStartE2EDuration="17.824649914s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:01:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:02:10.824216105 +0000 UTC m=+263.244590829" watchObservedRunningTime="2026-09-07 04:02:10.824649914 +0000 UTC m=+263.245024627" Sep 07 04:02:12.814765 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:12.814731 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pphq7" event={"ID":"bad8bde3-660e-4e61-b849-89dae63bed94","Type":"ContainerStarted","Data":"3d8f175835c747c43dac8b1de569c1cb282ba7c1e57202ee642cdd01b1de82d9"} Sep 07 04:02:12.815240 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:12.814786 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pphq7" event={"ID":"bad8bde3-660e-4e61-b849-89dae63bed94","Type":"ContainerStarted","Data":"fbfe9baddd760d2a63836f853a8eadf205256507110a6461cde2110ffd929037"} Sep 07 04:02:12.829386 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:12.829341 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pphq7" podStartSLOduration=17.711284663 podStartE2EDuration="19.82932812s" totalImagesPullingTime="2.118043457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:01:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:02:12.828645237 +0000 UTC m=+265.249019952" watchObservedRunningTime="2026-09-07 04:02:12.82932812 +0000 UTC m=+265.249702866" Sep 07 04:02:14.400561 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:14.400526 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e03bf6a3-d565-4c87-bf65-cd285eb1ec64-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g9wd9\" (UID: \"e03bf6a3-d565-4c87-bf65-cd285eb1ec64\") " pod="openshift-insights/insights-runtime-extractor-g9wd9" Sep 07 04:02:14.400946 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:14.400575 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e03bf6a3-d565-4c87-bf65-cd285eb1ec64-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g9wd9\" (UID: \"e03bf6a3-d565-4c87-bf65-cd285eb1ec64\") " pod="openshift-insights/insights-runtime-extractor-g9wd9" Sep 07 04:02:14.400946 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:02:14.400707 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 04:02:14.400946 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:02:14.400761 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e03bf6a3-d565-4c87-bf65-cd285eb1ec64-insights-runtime-extractor-tls podName:e03bf6a3-d565-4c87-bf65-cd285eb1ec64 nodeName:}" failed. No retries permitted until 2026-09-07 04:02:30.400746479 +0000 UTC m=+282.821121180 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e03bf6a3-d565-4c87-bf65-cd285eb1ec64-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g9wd9" (UID: "e03bf6a3-d565-4c87-bf65-cd285eb1ec64") : secret "insights-runtime-extractor-tls" not found Sep 07 04:02:14.401046 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:14.401027 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e03bf6a3-d565-4c87-bf65-cd285eb1ec64-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g9wd9\" (UID: \"e03bf6a3-d565-4c87-bf65-cd285eb1ec64\") " pod="openshift-insights/insights-runtime-extractor-g9wd9" Sep 07 04:02:17.082046 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:17.082015 2566 scope.go:117] "RemoveContainer" containerID="a316ee7f536f87e7c5f9d12194a37519b4d8f39253d80e59ff5a250ac780ea87" Sep 07 04:02:17.830756 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:17.830726 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-bgrfr_9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a/console-operator/2.log" Sep 07 04:02:17.831123 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:17.831105 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-bgrfr_9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a/console-operator/1.log" Sep 07 04:02:17.831245 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:17.831142 2566 generic.go:356] "Generic (PLEG): container finished" podID="9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a" containerID="36283f0fae413e7dc38da1a269cbc5fbfa066a86f60327a0d30b84169fd84c17" exitCode=255 Sep 07 04:02:17.831245 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:17.831178 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-bgrfr" event={"ID":"9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a","Type":"ContainerDied","Data":"36283f0fae413e7dc38da1a269cbc5fbfa066a86f60327a0d30b84169fd84c17"} Sep 07 04:02:17.831349 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:17.831267 2566 scope.go:117] "RemoveContainer" containerID="a316ee7f536f87e7c5f9d12194a37519b4d8f39253d80e59ff5a250ac780ea87" Sep 07 04:02:17.831604 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:17.831587 2566 scope.go:117] "RemoveContainer" containerID="36283f0fae413e7dc38da1a269cbc5fbfa066a86f60327a0d30b84169fd84c17" Sep 07 04:02:17.831808 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:02:17.831785 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-bgrfr_openshift-console-operator(9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a)\"" pod="openshift-console-operator/console-operator-85b454874b-bgrfr" podUID="9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a" Sep 07 04:02:18.835200 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:18.835162 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-bgrfr_9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a/console-operator/2.log" Sep 07 04:02:19.098621 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:19.098582 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5c47978b8-5xwws"] Sep 07 04:02:19.128864 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:19.128836 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5476d9d776-sdfhj"] Sep 07 04:02:19.131369 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:19.131346 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5476d9d776-sdfhj" Sep 07 04:02:19.143796 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:19.143767 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5476d9d776-sdfhj"] Sep 07 04:02:19.234707 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:19.234670 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a274089c-eeaf-42eb-af23-c0afbdf9470d-bound-sa-token\") pod \"image-registry-5476d9d776-sdfhj\" (UID: \"a274089c-eeaf-42eb-af23-c0afbdf9470d\") " pod="openshift-image-registry/image-registry-5476d9d776-sdfhj" Sep 07 04:02:19.234707 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:19.234707 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a274089c-eeaf-42eb-af23-c0afbdf9470d-ca-trust-extracted\") pod \"image-registry-5476d9d776-sdfhj\" (UID: \"a274089c-eeaf-42eb-af23-c0afbdf9470d\") " pod="openshift-image-registry/image-registry-5476d9d776-sdfhj" Sep 07 04:02:19.234951 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:19.234743 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a274089c-eeaf-42eb-af23-c0afbdf9470d-installation-pull-secrets\") pod \"image-registry-5476d9d776-sdfhj\" (UID: \"a274089c-eeaf-42eb-af23-c0afbdf9470d\") " pod="openshift-image-registry/image-registry-5476d9d776-sdfhj" Sep 07 04:02:19.234951 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:19.234760 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kglbh\" (UniqueName: \"kubernetes.io/projected/a274089c-eeaf-42eb-af23-c0afbdf9470d-kube-api-access-kglbh\") pod \"image-registry-5476d9d776-sdfhj\" (UID: \"a274089c-eeaf-42eb-af23-c0afbdf9470d\") " pod="openshift-image-registry/image-registry-5476d9d776-sdfhj" Sep 07 04:02:19.234951 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:19.234838 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a274089c-eeaf-42eb-af23-c0afbdf9470d-registry-certificates\") pod \"image-registry-5476d9d776-sdfhj\" (UID: \"a274089c-eeaf-42eb-af23-c0afbdf9470d\") " pod="openshift-image-registry/image-registry-5476d9d776-sdfhj" Sep 07 04:02:19.234951 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:19.234858 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a274089c-eeaf-42eb-af23-c0afbdf9470d-registry-tls\") pod \"image-registry-5476d9d776-sdfhj\" (UID: \"a274089c-eeaf-42eb-af23-c0afbdf9470d\") " pod="openshift-image-registry/image-registry-5476d9d776-sdfhj" Sep 07 04:02:19.234951 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:19.234906 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a274089c-eeaf-42eb-af23-c0afbdf9470d-image-registry-private-configuration\") pod \"image-registry-5476d9d776-sdfhj\" (UID: \"a274089c-eeaf-42eb-af23-c0afbdf9470d\") " pod="openshift-image-registry/image-registry-5476d9d776-sdfhj" Sep 07 04:02:19.234951 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:19.234927 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a274089c-eeaf-42eb-af23-c0afbdf9470d-trusted-ca\") pod \"image-registry-5476d9d776-sdfhj\" (UID: \"a274089c-eeaf-42eb-af23-c0afbdf9470d\") " pod="openshift-image-registry/image-registry-5476d9d776-sdfhj" Sep 07 04:02:19.335838 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:19.335800 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a274089c-eeaf-42eb-af23-c0afbdf9470d-image-registry-private-configuration\") pod \"image-registry-5476d9d776-sdfhj\" (UID: \"a274089c-eeaf-42eb-af23-c0afbdf9470d\") " pod="openshift-image-registry/image-registry-5476d9d776-sdfhj" Sep 07 04:02:19.335838 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:19.335841 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a274089c-eeaf-42eb-af23-c0afbdf9470d-trusted-ca\") pod \"image-registry-5476d9d776-sdfhj\" (UID: \"a274089c-eeaf-42eb-af23-c0afbdf9470d\") " pod="openshift-image-registry/image-registry-5476d9d776-sdfhj" Sep 07 04:02:19.336076 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:19.335899 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a274089c-eeaf-42eb-af23-c0afbdf9470d-bound-sa-token\") pod \"image-registry-5476d9d776-sdfhj\" (UID: \"a274089c-eeaf-42eb-af23-c0afbdf9470d\") " pod="openshift-image-registry/image-registry-5476d9d776-sdfhj" Sep 07 04:02:19.336076 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:19.335933 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a274089c-eeaf-42eb-af23-c0afbdf9470d-ca-trust-extracted\") pod \"image-registry-5476d9d776-sdfhj\" (UID: \"a274089c-eeaf-42eb-af23-c0afbdf9470d\") " pod="openshift-image-registry/image-registry-5476d9d776-sdfhj" Sep 07 04:02:19.336076 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:19.335973 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a274089c-eeaf-42eb-af23-c0afbdf9470d-installation-pull-secrets\") pod \"image-registry-5476d9d776-sdfhj\" (UID: \"a274089c-eeaf-42eb-af23-c0afbdf9470d\") " pod="openshift-image-registry/image-registry-5476d9d776-sdfhj" Sep 07 04:02:19.336076 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:19.335998 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kglbh\" (UniqueName: \"kubernetes.io/projected/a274089c-eeaf-42eb-af23-c0afbdf9470d-kube-api-access-kglbh\") pod \"image-registry-5476d9d776-sdfhj\" (UID: \"a274089c-eeaf-42eb-af23-c0afbdf9470d\") " pod="openshift-image-registry/image-registry-5476d9d776-sdfhj" Sep 07 04:02:19.336262 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:19.336111 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a274089c-eeaf-42eb-af23-c0afbdf9470d-registry-certificates\") pod \"image-registry-5476d9d776-sdfhj\" (UID: \"a274089c-eeaf-42eb-af23-c0afbdf9470d\") " pod="openshift-image-registry/image-registry-5476d9d776-sdfhj" Sep 07 04:02:19.336262 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:19.336163 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a274089c-eeaf-42eb-af23-c0afbdf9470d-registry-tls\") pod \"image-registry-5476d9d776-sdfhj\" (UID: \"a274089c-eeaf-42eb-af23-c0afbdf9470d\") " pod="openshift-image-registry/image-registry-5476d9d776-sdfhj" Sep 07 04:02:19.336414 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:19.336392 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a274089c-eeaf-42eb-af23-c0afbdf9470d-ca-trust-extracted\") pod \"image-registry-5476d9d776-sdfhj\" (UID: \"a274089c-eeaf-42eb-af23-c0afbdf9470d\") " pod="openshift-image-registry/image-registry-5476d9d776-sdfhj" Sep 07 04:02:19.336991 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:19.336961 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a274089c-eeaf-42eb-af23-c0afbdf9470d-registry-certificates\") pod \"image-registry-5476d9d776-sdfhj\" (UID: \"a274089c-eeaf-42eb-af23-c0afbdf9470d\") " pod="openshift-image-registry/image-registry-5476d9d776-sdfhj" Sep 07 04:02:19.337110 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:19.337091 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a274089c-eeaf-42eb-af23-c0afbdf9470d-trusted-ca\") pod \"image-registry-5476d9d776-sdfhj\" (UID: \"a274089c-eeaf-42eb-af23-c0afbdf9470d\") " pod="openshift-image-registry/image-registry-5476d9d776-sdfhj" Sep 07 04:02:19.338380 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:19.338354 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a274089c-eeaf-42eb-af23-c0afbdf9470d-image-registry-private-configuration\") pod \"image-registry-5476d9d776-sdfhj\" (UID: \"a274089c-eeaf-42eb-af23-c0afbdf9470d\") " pod="openshift-image-registry/image-registry-5476d9d776-sdfhj" Sep 07 04:02:19.338479 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:19.338441 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a274089c-eeaf-42eb-af23-c0afbdf9470d-registry-tls\") pod \"image-registry-5476d9d776-sdfhj\" (UID: \"a274089c-eeaf-42eb-af23-c0afbdf9470d\") " pod="openshift-image-registry/image-registry-5476d9d776-sdfhj" Sep 07 04:02:19.338562 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:19.338539 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a274089c-eeaf-42eb-af23-c0afbdf9470d-installation-pull-secrets\") pod \"image-registry-5476d9d776-sdfhj\" (UID: \"a274089c-eeaf-42eb-af23-c0afbdf9470d\") " pod="openshift-image-registry/image-registry-5476d9d776-sdfhj" Sep 07 04:02:19.345590 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:19.345569 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a274089c-eeaf-42eb-af23-c0afbdf9470d-bound-sa-token\") pod \"image-registry-5476d9d776-sdfhj\" (UID: \"a274089c-eeaf-42eb-af23-c0afbdf9470d\") " pod="openshift-image-registry/image-registry-5476d9d776-sdfhj" Sep 07 04:02:19.345710 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:19.345597 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kglbh\" (UniqueName: \"kubernetes.io/projected/a274089c-eeaf-42eb-af23-c0afbdf9470d-kube-api-access-kglbh\") pod \"image-registry-5476d9d776-sdfhj\" (UID: \"a274089c-eeaf-42eb-af23-c0afbdf9470d\") " pod="openshift-image-registry/image-registry-5476d9d776-sdfhj" Sep 07 04:02:19.440105 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:19.440015 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5476d9d776-sdfhj" Sep 07 04:02:19.711085 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:19.711008 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5476d9d776-sdfhj"] Sep 07 04:02:19.713819 ip-10-0-143-125 kubenswrapper[2566]: W0907 04:02:19.713791 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda274089c_eeaf_42eb_af23_c0afbdf9470d.slice/crio-57f6adb1f58c7360b5862b988e6b46d4064c5d1520033d7e8b14448c1db23bf0 WatchSource:0}: Error finding container 57f6adb1f58c7360b5862b988e6b46d4064c5d1520033d7e8b14448c1db23bf0: Status 404 returned error can't find the container with id 57f6adb1f58c7360b5862b988e6b46d4064c5d1520033d7e8b14448c1db23bf0 Sep 07 04:02:19.840330 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:19.840294 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5476d9d776-sdfhj" event={"ID":"a274089c-eeaf-42eb-af23-c0afbdf9470d","Type":"ContainerStarted","Data":"603d57e779df1c3824a408bc837606fe1cccb822b8a9834c4b9055fcf22e07d9"} Sep 07 04:02:19.840709 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:19.840350 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5476d9d776-sdfhj" event={"ID":"a274089c-eeaf-42eb-af23-c0afbdf9470d","Type":"ContainerStarted","Data":"57f6adb1f58c7360b5862b988e6b46d4064c5d1520033d7e8b14448c1db23bf0"} Sep 07 04:02:19.840709 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:19.840414 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5476d9d776-sdfhj" Sep 07 04:02:19.857478 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:19.857426 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5476d9d776-sdfhj" podStartSLOduration=0.857409409 podStartE2EDuration="857.409409ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:02:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:02:19.856560663 +0000 UTC m=+272.276935381" watchObservedRunningTime="2026-09-07 04:02:19.857409409 +0000 UTC m=+272.277784132" Sep 07 04:02:24.188303 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:24.188261 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-bgrfr" Sep 07 04:02:24.188901 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:24.188324 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-bgrfr" Sep 07 04:02:24.188901 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:24.188721 2566 scope.go:117] "RemoveContainer" containerID="36283f0fae413e7dc38da1a269cbc5fbfa066a86f60327a0d30b84169fd84c17" Sep 07 04:02:24.189018 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:02:24.188920 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-bgrfr_openshift-console-operator(9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a)\"" pod="openshift-console-operator/console-operator-85b454874b-bgrfr" podUID="9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a" Sep 07 04:02:27.533384 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:02:27.533340 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-s7vls" podUID="97c0529d-571d-4f5a-9cf6-594835d9d3f5" Sep 07 04:02:27.867080 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:27.867051 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s7vls" Sep 07 04:02:28.463147 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:28.463109 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-czrvx"] Sep 07 04:02:28.466138 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:28.466118 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-czrvx" Sep 07 04:02:28.468404 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:28.468383 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 07 04:02:28.468522 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:28.468438 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-b2r7p\"" Sep 07 04:02:28.474208 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:28.474183 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-czrvx"] Sep 07 04:02:28.605286 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:28.605250 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/befd6ca1-abd6-4055-8780-cd501061ab47-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-czrvx\" (UID: \"befd6ca1-abd6-4055-8780-cd501061ab47\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-czrvx" Sep 07 04:02:28.705542 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:28.705508 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/befd6ca1-abd6-4055-8780-cd501061ab47-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-czrvx\" (UID: \"befd6ca1-abd6-4055-8780-cd501061ab47\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-czrvx" Sep 07 04:02:28.706096 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:02:28.706076 2566 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Sep 07 04:02:28.706153 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:02:28.706143 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/befd6ca1-abd6-4055-8780-cd501061ab47-tls-certificates podName:befd6ca1-abd6-4055-8780-cd501061ab47 nodeName:}" failed. No retries permitted until 2026-09-07 04:02:29.206126087 +0000 UTC m=+281.626500789 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/befd6ca1-abd6-4055-8780-cd501061ab47-tls-certificates") pod "prometheus-operator-admission-webhook-78f599db79-czrvx" (UID: "befd6ca1-abd6-4055-8780-cd501061ab47") : secret "prometheus-operator-admission-webhook-tls" not found Sep 07 04:02:29.104209 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:29.104171 2566 patch_prober.go:28] interesting pod/image-registry-5c47978b8-5xwws container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 07 04:02:29.104372 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:29.104227 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5c47978b8-5xwws" podUID="07312acd-cd4b-4853-8db1-a5b6f6ae1a00" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 07 04:02:29.208945 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:29.208907 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/befd6ca1-abd6-4055-8780-cd501061ab47-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-czrvx\" (UID: \"befd6ca1-abd6-4055-8780-cd501061ab47\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-czrvx" Sep 07 04:02:29.211377 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:29.211336 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/befd6ca1-abd6-4055-8780-cd501061ab47-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-czrvx\" (UID: \"befd6ca1-abd6-4055-8780-cd501061ab47\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-czrvx" Sep 07 04:02:29.376319 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:29.376222 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-czrvx" Sep 07 04:02:29.642477 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:29.642428 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-czrvx"] Sep 07 04:02:29.645045 ip-10-0-143-125 kubenswrapper[2566]: W0907 04:02:29.645016 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbefd6ca1_abd6_4055_8780_cd501061ab47.slice/crio-b8bd42a21ea5d56c408c231130ed036c1ea463adff7377910beaae9310cb0636 WatchSource:0}: Error finding container b8bd42a21ea5d56c408c231130ed036c1ea463adff7377910beaae9310cb0636: Status 404 returned error can't find the container with id b8bd42a21ea5d56c408c231130ed036c1ea463adff7377910beaae9310cb0636 Sep 07 04:02:29.873564 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:29.873525 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-czrvx" event={"ID":"befd6ca1-abd6-4055-8780-cd501061ab47","Type":"ContainerStarted","Data":"b8bd42a21ea5d56c408c231130ed036c1ea463adff7377910beaae9310cb0636"} Sep 07 04:02:30.419353 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:30.419318 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e03bf6a3-d565-4c87-bf65-cd285eb1ec64-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g9wd9\" (UID: \"e03bf6a3-d565-4c87-bf65-cd285eb1ec64\") " pod="openshift-insights/insights-runtime-extractor-g9wd9" Sep 07 04:02:30.422190 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:30.422164 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e03bf6a3-d565-4c87-bf65-cd285eb1ec64-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g9wd9\" (UID: \"e03bf6a3-d565-4c87-bf65-cd285eb1ec64\") " pod="openshift-insights/insights-runtime-extractor-g9wd9" Sep 07 04:02:30.708450 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:30.708371 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-g9wd9" Sep 07 04:02:30.877982 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:30.877955 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-czrvx" event={"ID":"befd6ca1-abd6-4055-8780-cd501061ab47","Type":"ContainerStarted","Data":"d0a0c5306e3174634e18796b4e4d8a75b2501f36bab41145c50d56ec928c4c62"} Sep 07 04:02:30.878184 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:30.878161 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-czrvx" Sep 07 04:02:30.882425 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:30.882405 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-czrvx" Sep 07 04:02:30.892064 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:30.892022 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-czrvx" podStartSLOduration=1.757930526 podStartE2EDuration="2.892008944s" totalImagesPullingTime="1.134078418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:02:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:02:30.891009261 +0000 UTC m=+283.311383984" watchObservedRunningTime="2026-09-07 04:02:30.892008944 +0000 UTC m=+283.312383667" Sep 07 04:02:31.021867 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:31.021786 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-g9wd9"] Sep 07 04:02:31.024489 ip-10-0-143-125 kubenswrapper[2566]: W0907 04:02:31.024462 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode03bf6a3_d565_4c87_bf65_cd285eb1ec64.slice/crio-d12f8fa4c2f57f1f4313f5369ef08c8526083e5ff5e2d82c92f0edc11d2053be WatchSource:0}: Error finding container d12f8fa4c2f57f1f4313f5369ef08c8526083e5ff5e2d82c92f0edc11d2053be: Status 404 returned error can't find the container with id d12f8fa4c2f57f1f4313f5369ef08c8526083e5ff5e2d82c92f0edc11d2053be Sep 07 04:02:31.326363 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:31.326247 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97c0529d-571d-4f5a-9cf6-594835d9d3f5-metrics-tls\") pod \"dns-default-s7vls\" (UID: \"97c0529d-571d-4f5a-9cf6-594835d9d3f5\") " pod="openshift-dns/dns-default-s7vls" Sep 07 04:02:31.328512 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:31.328495 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97c0529d-571d-4f5a-9cf6-594835d9d3f5-metrics-tls\") pod \"dns-default-s7vls\" (UID: \"97c0529d-571d-4f5a-9cf6-594835d9d3f5\") " pod="openshift-dns/dns-default-s7vls" Sep 07 04:02:31.470183 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:31.470151 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tk9sb\"" Sep 07 04:02:31.478853 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:31.478828 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s7vls" Sep 07 04:02:31.512790 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:31.512759 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-66dzc"] Sep 07 04:02:31.515882 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:31.515857 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-66dzc" Sep 07 04:02:31.518242 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:31.518216 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 07 04:02:31.518840 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:31.518822 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 07 04:02:31.519129 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:31.519088 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 07 04:02:31.519129 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:31.519105 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-tftxk\"" Sep 07 04:02:31.519129 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:31.519095 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 07 04:02:31.519340 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:31.519095 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 07 04:02:31.524405 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:31.524281 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-66dzc"] Sep 07 04:02:31.527302 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:31.527271 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d775m\" (UniqueName: \"kubernetes.io/projected/9806780c-648f-438c-8ad0-2ccae8e6e102-kube-api-access-d775m\") pod \"prometheus-operator-6f4946db56-66dzc\" (UID: \"9806780c-648f-438c-8ad0-2ccae8e6e102\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-66dzc" Sep 07 04:02:31.527781 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:31.527457 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9806780c-648f-438c-8ad0-2ccae8e6e102-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-66dzc\" (UID: \"9806780c-648f-438c-8ad0-2ccae8e6e102\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-66dzc" Sep 07 04:02:31.527781 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:31.527497 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9806780c-648f-438c-8ad0-2ccae8e6e102-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-66dzc\" (UID: \"9806780c-648f-438c-8ad0-2ccae8e6e102\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-66dzc" Sep 07 04:02:31.527781 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:31.527695 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9806780c-648f-438c-8ad0-2ccae8e6e102-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-66dzc\" (UID: \"9806780c-648f-438c-8ad0-2ccae8e6e102\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-66dzc" Sep 07 04:02:31.628889 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:31.628855 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9806780c-648f-438c-8ad0-2ccae8e6e102-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-66dzc\" (UID: \"9806780c-648f-438c-8ad0-2ccae8e6e102\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-66dzc" Sep 07 04:02:31.628889 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:31.628895 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9806780c-648f-438c-8ad0-2ccae8e6e102-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-66dzc\" (UID: \"9806780c-648f-438c-8ad0-2ccae8e6e102\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-66dzc" Sep 07 04:02:31.629157 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:31.628924 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9806780c-648f-438c-8ad0-2ccae8e6e102-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-66dzc\" (UID: \"9806780c-648f-438c-8ad0-2ccae8e6e102\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-66dzc" Sep 07 04:02:31.629157 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:31.628944 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d775m\" (UniqueName: \"kubernetes.io/projected/9806780c-648f-438c-8ad0-2ccae8e6e102-kube-api-access-d775m\") pod \"prometheus-operator-6f4946db56-66dzc\" (UID: \"9806780c-648f-438c-8ad0-2ccae8e6e102\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-66dzc" Sep 07 04:02:31.629157 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:02:31.629021 2566 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Sep 07 04:02:31.629157 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:02:31.629112 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9806780c-648f-438c-8ad0-2ccae8e6e102-prometheus-operator-tls podName:9806780c-648f-438c-8ad0-2ccae8e6e102 nodeName:}" failed. No retries permitted until 2026-09-07 04:02:32.129091018 +0000 UTC m=+284.549465733 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/9806780c-648f-438c-8ad0-2ccae8e6e102-prometheus-operator-tls") pod "prometheus-operator-6f4946db56-66dzc" (UID: "9806780c-648f-438c-8ad0-2ccae8e6e102") : secret "prometheus-operator-tls" not found Sep 07 04:02:31.629720 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:31.629700 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9806780c-648f-438c-8ad0-2ccae8e6e102-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-66dzc\" (UID: \"9806780c-648f-438c-8ad0-2ccae8e6e102\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-66dzc" Sep 07 04:02:31.631308 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:31.631277 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9806780c-648f-438c-8ad0-2ccae8e6e102-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-66dzc\" (UID: \"9806780c-648f-438c-8ad0-2ccae8e6e102\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-66dzc" Sep 07 04:02:31.637429 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:31.637410 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d775m\" (UniqueName: \"kubernetes.io/projected/9806780c-648f-438c-8ad0-2ccae8e6e102-kube-api-access-d775m\") pod \"prometheus-operator-6f4946db56-66dzc\" (UID: \"9806780c-648f-438c-8ad0-2ccae8e6e102\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-66dzc" Sep 07 04:02:31.749335 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:31.749270 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s7vls"] Sep 07 04:02:31.753013 ip-10-0-143-125 kubenswrapper[2566]: W0907 04:02:31.752972 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97c0529d_571d_4f5a_9cf6_594835d9d3f5.slice/crio-a4ebd5ba49506ac2c2eee95ec2d76b2b670794ca82319aa9548919d8016686da WatchSource:0}: Error finding container a4ebd5ba49506ac2c2eee95ec2d76b2b670794ca82319aa9548919d8016686da: Status 404 returned error can't find the container with id a4ebd5ba49506ac2c2eee95ec2d76b2b670794ca82319aa9548919d8016686da Sep 07 04:02:31.881851 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:31.881764 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s7vls" event={"ID":"97c0529d-571d-4f5a-9cf6-594835d9d3f5","Type":"ContainerStarted","Data":"a4ebd5ba49506ac2c2eee95ec2d76b2b670794ca82319aa9548919d8016686da"} Sep 07 04:02:31.883091 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:31.883067 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g9wd9" event={"ID":"e03bf6a3-d565-4c87-bf65-cd285eb1ec64","Type":"ContainerStarted","Data":"22dc5e1e836e088fa70ccbe6685b6187ecff42d82244bc17c9d05edc4852a88a"} Sep 07 04:02:31.883192 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:31.883124 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g9wd9" event={"ID":"e03bf6a3-d565-4c87-bf65-cd285eb1ec64","Type":"ContainerStarted","Data":"d12f8fa4c2f57f1f4313f5369ef08c8526083e5ff5e2d82c92f0edc11d2053be"} Sep 07 04:02:32.133266 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:32.133173 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9806780c-648f-438c-8ad0-2ccae8e6e102-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-66dzc\" (UID: \"9806780c-648f-438c-8ad0-2ccae8e6e102\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-66dzc" Sep 07 04:02:32.135617 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:32.135587 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9806780c-648f-438c-8ad0-2ccae8e6e102-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-66dzc\" (UID: \"9806780c-648f-438c-8ad0-2ccae8e6e102\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-66dzc" Sep 07 04:02:32.427388 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:32.427301 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-66dzc" Sep 07 04:02:32.707220 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:32.707092 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-66dzc"] Sep 07 04:02:32.711717 ip-10-0-143-125 kubenswrapper[2566]: W0907 04:02:32.711671 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9806780c_648f_438c_8ad0_2ccae8e6e102.slice/crio-a90bf8e3c820314e4ffd44a9e962c1d2f8dbb250c6a3b37bc265f52a060aaa9b WatchSource:0}: Error finding container a90bf8e3c820314e4ffd44a9e962c1d2f8dbb250c6a3b37bc265f52a060aaa9b: Status 404 returned error can't find the container with id a90bf8e3c820314e4ffd44a9e962c1d2f8dbb250c6a3b37bc265f52a060aaa9b Sep 07 04:02:32.889825 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:32.889788 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g9wd9" event={"ID":"e03bf6a3-d565-4c87-bf65-cd285eb1ec64","Type":"ContainerStarted","Data":"1b64db4a79caddd95984ec076622bbb9c9820949bc9a2797256a0d58dd9f5db7"} Sep 07 04:02:32.891561 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:32.891501 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-66dzc" event={"ID":"9806780c-648f-438c-8ad0-2ccae8e6e102","Type":"ContainerStarted","Data":"a90bf8e3c820314e4ffd44a9e962c1d2f8dbb250c6a3b37bc265f52a060aaa9b"} Sep 07 04:02:33.899935 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:33.899894 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s7vls" event={"ID":"97c0529d-571d-4f5a-9cf6-594835d9d3f5","Type":"ContainerStarted","Data":"252774a3120daa8f29e03e5039378a4371b5bf3bb42e4d7e7b0cd26c979119fd"} Sep 07 04:02:33.902976 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:33.902942 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g9wd9" event={"ID":"e03bf6a3-d565-4c87-bf65-cd285eb1ec64","Type":"ContainerStarted","Data":"16a64ccdc1e24ee50d248a00acdec6abd541eec5320ead0a03c8b8003d173d2f"} Sep 07 04:02:33.919151 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:33.919096 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-g9wd9" podStartSLOduration=33.291177952 podStartE2EDuration="35.919074461s" totalImagesPullingTime="2.627896509s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 04:01:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:02:33.918607271 +0000 UTC m=+286.338981994" watchObservedRunningTime="2026-09-07 04:02:33.919074461 +0000 UTC m=+286.339449185" Sep 07 04:02:34.907644 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:34.907597 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s7vls" event={"ID":"97c0529d-571d-4f5a-9cf6-594835d9d3f5","Type":"ContainerStarted","Data":"fea811802857af2f435d707ff2f3b1183ff48fab27ecb5c0c7607b4ea87ff033"} Sep 07 04:02:34.908176 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:34.907694 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-s7vls" Sep 07 04:02:34.909431 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:34.909405 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-66dzc" event={"ID":"9806780c-648f-438c-8ad0-2ccae8e6e102","Type":"ContainerStarted","Data":"d8f39dae25c0d9191745289dc2c4fe95603b2c2f7257e8b6c5d9be776b7e78c8"} Sep 07 04:02:34.909529 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:34.909447 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-66dzc" event={"ID":"9806780c-648f-438c-8ad0-2ccae8e6e102","Type":"ContainerStarted","Data":"ef4f6bf44f3c3e0890ebe8caa411fdacea496f1070796c3c67ee8f67f963cd45"} Sep 07 04:02:34.925694 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:34.925657 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-s7vls" podStartSLOduration=251.909046032 podStartE2EDuration="4m13.925643319s" totalImagesPullingTime="2.016597287s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 03:58:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:02:34.924549662 +0000 UTC m=+287.344924386" watchObservedRunningTime="2026-09-07 04:02:34.925643319 +0000 UTC m=+287.346018036" Sep 07 04:02:34.940704 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:34.940659 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-66dzc" podStartSLOduration=2.148471137 podStartE2EDuration="3.94062145s" totalImagesPullingTime="1.792150313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:02:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:02:34.939925646 +0000 UTC m=+287.360300370" watchObservedRunningTime="2026-09-07 04:02:34.94062145 +0000 UTC m=+287.360996174" Sep 07 04:02:36.082388 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:36.082359 2566 scope.go:117] "RemoveContainer" containerID="36283f0fae413e7dc38da1a269cbc5fbfa066a86f60327a0d30b84169fd84c17" Sep 07 04:02:36.082792 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:02:36.082507 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-bgrfr_openshift-console-operator(9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a)\"" pod="openshift-console-operator/console-operator-85b454874b-bgrfr" podUID="9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a" Sep 07 04:02:36.864432 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:36.864388 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5thz7"] Sep 07 04:02:36.868175 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:36.868146 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-cvb9h"] Sep 07 04:02:36.868319 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:36.868277 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5thz7" Sep 07 04:02:36.870199 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:36.870174 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 07 04:02:36.870316 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:36.870287 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 07 04:02:36.870749 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:36.870730 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 07 04:02:36.870984 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:36.870970 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qfk5d\"" Sep 07 04:02:36.872495 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:36.872478 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvb9h" Sep 07 04:02:36.874543 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:36.874514 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 07 04:02:36.874835 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:36.874816 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 07 04:02:36.875298 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:36.875190 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 07 04:02:36.875436 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:36.875419 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-csnf7\"" Sep 07 04:02:36.886451 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:36.886431 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-cvb9h"] Sep 07 04:02:36.973896 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:36.973863 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvs4p\" (UniqueName: \"kubernetes.io/projected/4a0a60a5-6b56-4870-b069-3369c7089818-kube-api-access-pvs4p\") pod \"node-exporter-5thz7\" (UID: \"4a0a60a5-6b56-4870-b069-3369c7089818\") " pod="openshift-monitoring/node-exporter-5thz7" Sep 07 04:02:36.973896 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:36.973899 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32f77276-955b-42de-a74d-8a1d6d3db9a2-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-cvb9h\" (UID: \"32f77276-955b-42de-a74d-8a1d6d3db9a2\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvb9h" Sep 07 04:02:36.974114 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:36.973932 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4a0a60a5-6b56-4870-b069-3369c7089818-node-exporter-wtmp\") pod \"node-exporter-5thz7\" (UID: \"4a0a60a5-6b56-4870-b069-3369c7089818\") " pod="openshift-monitoring/node-exporter-5thz7" Sep 07 04:02:36.974114 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:36.973975 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a0a60a5-6b56-4870-b069-3369c7089818-metrics-client-ca\") pod \"node-exporter-5thz7\" (UID: \"4a0a60a5-6b56-4870-b069-3369c7089818\") " pod="openshift-monitoring/node-exporter-5thz7" Sep 07 04:02:36.974114 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:36.974008 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4a0a60a5-6b56-4870-b069-3369c7089818-node-exporter-accelerators-collector-config\") pod \"node-exporter-5thz7\" (UID: \"4a0a60a5-6b56-4870-b069-3369c7089818\") " pod="openshift-monitoring/node-exporter-5thz7" Sep 07 04:02:36.974114 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:36.974031 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a0a60a5-6b56-4870-b069-3369c7089818-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5thz7\" (UID: \"4a0a60a5-6b56-4870-b069-3369c7089818\") " pod="openshift-monitoring/node-exporter-5thz7" Sep 07 04:02:36.974114 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:36.974055 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/32f77276-955b-42de-a74d-8a1d6d3db9a2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-cvb9h\" (UID: \"32f77276-955b-42de-a74d-8a1d6d3db9a2\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvb9h" Sep 07 04:02:36.974114 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:36.974091 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/32f77276-955b-42de-a74d-8a1d6d3db9a2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-cvb9h\" (UID: \"32f77276-955b-42de-a74d-8a1d6d3db9a2\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvb9h" Sep 07 04:02:36.974114 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:36.974106 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48dr5\" (UniqueName: \"kubernetes.io/projected/32f77276-955b-42de-a74d-8a1d6d3db9a2-kube-api-access-48dr5\") pod \"kube-state-metrics-74cb57df7-cvb9h\" (UID: \"32f77276-955b-42de-a74d-8a1d6d3db9a2\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvb9h" Sep 07 04:02:36.974420 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:36.974128 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4a0a60a5-6b56-4870-b069-3369c7089818-root\") pod \"node-exporter-5thz7\" (UID: \"4a0a60a5-6b56-4870-b069-3369c7089818\") " pod="openshift-monitoring/node-exporter-5thz7" Sep 07 04:02:36.974420 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:36.974144 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4a0a60a5-6b56-4870-b069-3369c7089818-node-exporter-tls\") pod \"node-exporter-5thz7\" (UID: \"4a0a60a5-6b56-4870-b069-3369c7089818\") " pod="openshift-monitoring/node-exporter-5thz7" Sep 07 04:02:36.974420 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:36.974169 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4a0a60a5-6b56-4870-b069-3369c7089818-node-exporter-textfile\") pod \"node-exporter-5thz7\" (UID: \"4a0a60a5-6b56-4870-b069-3369c7089818\") " pod="openshift-monitoring/node-exporter-5thz7" Sep 07 04:02:36.974420 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:36.974190 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/32f77276-955b-42de-a74d-8a1d6d3db9a2-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-cvb9h\" (UID: \"32f77276-955b-42de-a74d-8a1d6d3db9a2\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvb9h" Sep 07 04:02:36.974420 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:36.974237 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a0a60a5-6b56-4870-b069-3369c7089818-sys\") pod \"node-exporter-5thz7\" (UID: \"4a0a60a5-6b56-4870-b069-3369c7089818\") " pod="openshift-monitoring/node-exporter-5thz7" Sep 07 04:02:36.974420 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:36.974322 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/32f77276-955b-42de-a74d-8a1d6d3db9a2-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-cvb9h\" (UID: \"32f77276-955b-42de-a74d-8a1d6d3db9a2\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvb9h" Sep 07 04:02:37.074873 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:37.074836 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32f77276-955b-42de-a74d-8a1d6d3db9a2-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-cvb9h\" (UID: \"32f77276-955b-42de-a74d-8a1d6d3db9a2\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvb9h" Sep 07 04:02:37.075054 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:37.074891 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4a0a60a5-6b56-4870-b069-3369c7089818-node-exporter-wtmp\") pod \"node-exporter-5thz7\" (UID: \"4a0a60a5-6b56-4870-b069-3369c7089818\") " pod="openshift-monitoring/node-exporter-5thz7" Sep 07 04:02:37.075054 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:37.074921 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a0a60a5-6b56-4870-b069-3369c7089818-metrics-client-ca\") pod \"node-exporter-5thz7\" (UID: \"4a0a60a5-6b56-4870-b069-3369c7089818\") " pod="openshift-monitoring/node-exporter-5thz7" Sep 07 04:02:37.075054 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:37.074946 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4a0a60a5-6b56-4870-b069-3369c7089818-node-exporter-accelerators-collector-config\") pod \"node-exporter-5thz7\" (UID: \"4a0a60a5-6b56-4870-b069-3369c7089818\") " pod="openshift-monitoring/node-exporter-5thz7" Sep 07 04:02:37.075054 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:37.074973 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a0a60a5-6b56-4870-b069-3369c7089818-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5thz7\" (UID: \"4a0a60a5-6b56-4870-b069-3369c7089818\") " pod="openshift-monitoring/node-exporter-5thz7" Sep 07 04:02:37.075054 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:37.074996 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/32f77276-955b-42de-a74d-8a1d6d3db9a2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-cvb9h\" (UID: \"32f77276-955b-42de-a74d-8a1d6d3db9a2\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvb9h" Sep 07 04:02:37.075054 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:37.075035 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/32f77276-955b-42de-a74d-8a1d6d3db9a2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-cvb9h\" (UID: \"32f77276-955b-42de-a74d-8a1d6d3db9a2\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvb9h" Sep 07 04:02:37.075339 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:37.075058 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48dr5\" (UniqueName: \"kubernetes.io/projected/32f77276-955b-42de-a74d-8a1d6d3db9a2-kube-api-access-48dr5\") pod \"kube-state-metrics-74cb57df7-cvb9h\" (UID: \"32f77276-955b-42de-a74d-8a1d6d3db9a2\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvb9h" Sep 07 04:02:37.075339 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:37.075077 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4a0a60a5-6b56-4870-b069-3369c7089818-node-exporter-wtmp\") pod \"node-exporter-5thz7\" (UID: \"4a0a60a5-6b56-4870-b069-3369c7089818\") " pod="openshift-monitoring/node-exporter-5thz7" Sep 07 04:02:37.075339 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:37.075084 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4a0a60a5-6b56-4870-b069-3369c7089818-root\") pod \"node-exporter-5thz7\" (UID: \"4a0a60a5-6b56-4870-b069-3369c7089818\") " pod="openshift-monitoring/node-exporter-5thz7" Sep 07 04:02:37.075339 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:37.075131 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4a0a60a5-6b56-4870-b069-3369c7089818-root\") pod \"node-exporter-5thz7\" (UID: \"4a0a60a5-6b56-4870-b069-3369c7089818\") " pod="openshift-monitoring/node-exporter-5thz7" Sep 07 04:02:37.075339 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:37.075138 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4a0a60a5-6b56-4870-b069-3369c7089818-node-exporter-tls\") pod \"node-exporter-5thz7\" (UID: \"4a0a60a5-6b56-4870-b069-3369c7089818\") " pod="openshift-monitoring/node-exporter-5thz7" Sep 07 04:02:37.075339 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:37.075181 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4a0a60a5-6b56-4870-b069-3369c7089818-node-exporter-textfile\") pod \"node-exporter-5thz7\" (UID: \"4a0a60a5-6b56-4870-b069-3369c7089818\") " pod="openshift-monitoring/node-exporter-5thz7" Sep 07 04:02:37.075339 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:37.075215 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/32f77276-955b-42de-a74d-8a1d6d3db9a2-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-cvb9h\" (UID: \"32f77276-955b-42de-a74d-8a1d6d3db9a2\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvb9h" Sep 07 04:02:37.075339 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:37.075245 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a0a60a5-6b56-4870-b069-3369c7089818-sys\") pod \"node-exporter-5thz7\" (UID: \"4a0a60a5-6b56-4870-b069-3369c7089818\") " pod="openshift-monitoring/node-exporter-5thz7" Sep 07 04:02:37.075339 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:37.075285 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/32f77276-955b-42de-a74d-8a1d6d3db9a2-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-cvb9h\" (UID: \"32f77276-955b-42de-a74d-8a1d6d3db9a2\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvb9h" Sep 07 04:02:37.075339 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:37.075313 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvs4p\" (UniqueName: \"kubernetes.io/projected/4a0a60a5-6b56-4870-b069-3369c7089818-kube-api-access-pvs4p\") pod \"node-exporter-5thz7\" (UID: \"4a0a60a5-6b56-4870-b069-3369c7089818\") " pod="openshift-monitoring/node-exporter-5thz7" Sep 07 04:02:37.075853 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:37.075578 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4a0a60a5-6b56-4870-b069-3369c7089818-node-exporter-accelerators-collector-config\") pod \"node-exporter-5thz7\" (UID: \"4a0a60a5-6b56-4870-b069-3369c7089818\") " pod="openshift-monitoring/node-exporter-5thz7" Sep 07 04:02:37.075853 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:37.075659 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a0a60a5-6b56-4870-b069-3369c7089818-sys\") pod \"node-exporter-5thz7\" (UID: \"4a0a60a5-6b56-4870-b069-3369c7089818\") " pod="openshift-monitoring/node-exporter-5thz7" Sep 07 04:02:37.075853 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:37.075691 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a0a60a5-6b56-4870-b069-3369c7089818-metrics-client-ca\") pod \"node-exporter-5thz7\" (UID: \"4a0a60a5-6b56-4870-b069-3369c7089818\") " pod="openshift-monitoring/node-exporter-5thz7" Sep 07 04:02:37.075853 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:37.075758 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32f77276-955b-42de-a74d-8a1d6d3db9a2-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-cvb9h\" (UID: \"32f77276-955b-42de-a74d-8a1d6d3db9a2\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvb9h" Sep 07 04:02:37.075853 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:37.075792 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/32f77276-955b-42de-a74d-8a1d6d3db9a2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-cvb9h\" (UID: \"32f77276-955b-42de-a74d-8a1d6d3db9a2\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvb9h" Sep 07 04:02:37.076096 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:37.075939 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/32f77276-955b-42de-a74d-8a1d6d3db9a2-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-cvb9h\" (UID: \"32f77276-955b-42de-a74d-8a1d6d3db9a2\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvb9h" Sep 07 04:02:37.076096 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:37.076007 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4a0a60a5-6b56-4870-b069-3369c7089818-node-exporter-textfile\") pod \"node-exporter-5thz7\" (UID: \"4a0a60a5-6b56-4870-b069-3369c7089818\") " pod="openshift-monitoring/node-exporter-5thz7" Sep 07 04:02:37.077789 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:37.077769 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/32f77276-955b-42de-a74d-8a1d6d3db9a2-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-cvb9h\" (UID: \"32f77276-955b-42de-a74d-8a1d6d3db9a2\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvb9h" Sep 07 04:02:37.077888 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:37.077774 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a0a60a5-6b56-4870-b069-3369c7089818-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5thz7\" (UID: \"4a0a60a5-6b56-4870-b069-3369c7089818\") " pod="openshift-monitoring/node-exporter-5thz7" Sep 07 04:02:37.077934 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:37.077922 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4a0a60a5-6b56-4870-b069-3369c7089818-node-exporter-tls\") pod \"node-exporter-5thz7\" (UID: \"4a0a60a5-6b56-4870-b069-3369c7089818\") " pod="openshift-monitoring/node-exporter-5thz7" Sep 07 04:02:37.077969 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:37.077946 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/32f77276-955b-42de-a74d-8a1d6d3db9a2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-cvb9h\" (UID: \"32f77276-955b-42de-a74d-8a1d6d3db9a2\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvb9h" Sep 07 04:02:37.084377 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:37.084347 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvs4p\" (UniqueName: \"kubernetes.io/projected/4a0a60a5-6b56-4870-b069-3369c7089818-kube-api-access-pvs4p\") pod \"node-exporter-5thz7\" (UID: \"4a0a60a5-6b56-4870-b069-3369c7089818\") " pod="openshift-monitoring/node-exporter-5thz7" Sep 07 04:02:37.085198 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:37.085174 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48dr5\" (UniqueName: \"kubernetes.io/projected/32f77276-955b-42de-a74d-8a1d6d3db9a2-kube-api-access-48dr5\") pod \"kube-state-metrics-74cb57df7-cvb9h\" (UID: \"32f77276-955b-42de-a74d-8a1d6d3db9a2\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvb9h" Sep 07 04:02:37.181199 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:37.181108 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5thz7" Sep 07 04:02:37.187365 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:37.187344 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvb9h" Sep 07 04:02:37.195057 ip-10-0-143-125 kubenswrapper[2566]: W0907 04:02:37.195017 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a0a60a5_6b56_4870_b069_3369c7089818.slice/crio-cd0eaedb87e6fa7f681041d44713734652564f7915ca71cd5a9183ebcb8889e6 WatchSource:0}: Error finding container cd0eaedb87e6fa7f681041d44713734652564f7915ca71cd5a9183ebcb8889e6: Status 404 returned error can't find the container with id cd0eaedb87e6fa7f681041d44713734652564f7915ca71cd5a9183ebcb8889e6 Sep 07 04:02:37.456515 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:37.456489 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-cvb9h"] Sep 07 04:02:37.458831 ip-10-0-143-125 kubenswrapper[2566]: W0907 04:02:37.458803 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32f77276_955b_42de_a74d_8a1d6d3db9a2.slice/crio-684f6528919acb99daa2348a6cf9ab0c99e0c529ff0ba0fadfc9c41974a782ff WatchSource:0}: Error finding container 684f6528919acb99daa2348a6cf9ab0c99e0c529ff0ba0fadfc9c41974a782ff: Status 404 returned error can't find the container with id 684f6528919acb99daa2348a6cf9ab0c99e0c529ff0ba0fadfc9c41974a782ff Sep 07 04:02:37.925088 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:37.925046 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvb9h" event={"ID":"32f77276-955b-42de-a74d-8a1d6d3db9a2","Type":"ContainerStarted","Data":"684f6528919acb99daa2348a6cf9ab0c99e0c529ff0ba0fadfc9c41974a782ff"} Sep 07 04:02:37.926410 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:37.926384 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5thz7" event={"ID":"4a0a60a5-6b56-4870-b069-3369c7089818","Type":"ContainerStarted","Data":"cd0eaedb87e6fa7f681041d44713734652564f7915ca71cd5a9183ebcb8889e6"} Sep 07 04:02:38.932806 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:38.932722 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvb9h" event={"ID":"32f77276-955b-42de-a74d-8a1d6d3db9a2","Type":"ContainerStarted","Data":"f780b22cfe357547e80458a48bbb63e306ec854bbf20f724863fd17a288ca014"} Sep 07 04:02:38.932806 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:38.932789 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvb9h" event={"ID":"32f77276-955b-42de-a74d-8a1d6d3db9a2","Type":"ContainerStarted","Data":"84b577dff5ff349b4df65f802fba59e842919f527cf8d601ee6bef825cfba264"} Sep 07 04:02:38.933256 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:38.932810 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvb9h" event={"ID":"32f77276-955b-42de-a74d-8a1d6d3db9a2","Type":"ContainerStarted","Data":"de3d21a0c42560bd7623e052854e0e8d9b5a8d35207565d11ffe91458dfc8614"} Sep 07 04:02:38.934327 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:38.934302 2566 generic.go:356] "Generic (PLEG): container finished" podID="4a0a60a5-6b56-4870-b069-3369c7089818" containerID="1e56685efcf780a222a8ad58faea23ed62814e553cfa0216ad0e599dbbda3847" exitCode=0 Sep 07 04:02:38.934436 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:38.934368 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5thz7" event={"ID":"4a0a60a5-6b56-4870-b069-3369c7089818","Type":"ContainerDied","Data":"1e56685efcf780a222a8ad58faea23ed62814e553cfa0216ad0e599dbbda3847"} Sep 07 04:02:38.952272 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:38.952229 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-cvb9h" podStartSLOduration=1.7709520109999999 podStartE2EDuration="2.952213906s" totalImagesPullingTime="1.181261895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:02:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:02:38.950853626 +0000 UTC m=+291.371228361" watchObservedRunningTime="2026-09-07 04:02:38.952213906 +0000 UTC m=+291.372588660" Sep 07 04:02:39.104306 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:39.104260 2566 patch_prober.go:28] interesting pod/image-registry-5c47978b8-5xwws container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 07 04:02:39.104479 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:39.104310 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5c47978b8-5xwws" podUID="07312acd-cd4b-4853-8db1-a5b6f6ae1a00" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 07 04:02:39.444464 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:39.444425 2566 patch_prober.go:28] interesting pod/image-registry-5476d9d776-sdfhj container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 07 04:02:39.444654 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:39.444488 2566 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5476d9d776-sdfhj" podUID="a274089c-eeaf-42eb-af23-c0afbdf9470d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 07 04:02:39.940539 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:39.940495 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5thz7" event={"ID":"4a0a60a5-6b56-4870-b069-3369c7089818","Type":"ContainerStarted","Data":"2031acefcfb1a9792e998a9efdba5cbf6dda1d4b5fd4419f5f38abd3baa141e8"} Sep 07 04:02:39.940977 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:39.940562 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5thz7" event={"ID":"4a0a60a5-6b56-4870-b069-3369c7089818","Type":"ContainerStarted","Data":"66aff655a854e22e2a48651b2e2e98b0361c304ccddba31cf9988f01f490c274"} Sep 07 04:02:39.960271 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:39.960226 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5thz7" podStartSLOduration=2.920747366 podStartE2EDuration="3.960211298s" totalImagesPullingTime="972.151232ms" totalInitContainerRuntime="67.3127ms" isStatefulPod=true podCreationTimestamp="2026-09-07 04:02:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:02:39.959500843 +0000 UTC m=+292.379875567" watchObservedRunningTime="2026-09-07 04:02:39.960211298 +0000 UTC m=+292.380586021" Sep 07 04:02:40.087653 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:02:40.083897 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-bshbg" podUID="2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9" Sep 07 04:02:40.847368 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:40.847332 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5476d9d776-sdfhj" Sep 07 04:02:41.632376 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:41.632341 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-hx4sz"] Sep 07 04:02:41.635464 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:41.635445 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-hx4sz" Sep 07 04:02:41.637293 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:41.637272 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 07 04:02:41.637410 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:41.637345 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-jg72b\"" Sep 07 04:02:41.644044 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:41.644022 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-hx4sz"] Sep 07 04:02:41.709854 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:41.709815 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f330bb9a-18cb-4403-b2f3-4cd61c8de0bb-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-hx4sz\" (UID: \"f330bb9a-18cb-4403-b2f3-4cd61c8de0bb\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-hx4sz" Sep 07 04:02:41.710025 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:41.709887 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnmzx\" (UniqueName: \"kubernetes.io/projected/f330bb9a-18cb-4403-b2f3-4cd61c8de0bb-kube-api-access-tnmzx\") pod \"monitoring-plugin-85bbbbbf4-hx4sz\" (UID: \"f330bb9a-18cb-4403-b2f3-4cd61c8de0bb\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-hx4sz" Sep 07 04:02:41.811187 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:41.811146 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f330bb9a-18cb-4403-b2f3-4cd61c8de0bb-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-hx4sz\" (UID: \"f330bb9a-18cb-4403-b2f3-4cd61c8de0bb\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-hx4sz" Sep 07 04:02:41.811404 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:41.811226 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnmzx\" (UniqueName: \"kubernetes.io/projected/f330bb9a-18cb-4403-b2f3-4cd61c8de0bb-kube-api-access-tnmzx\") pod \"monitoring-plugin-85bbbbbf4-hx4sz\" (UID: \"f330bb9a-18cb-4403-b2f3-4cd61c8de0bb\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-hx4sz" Sep 07 04:02:41.811404 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:02:41.811324 2566 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Sep 07 04:02:41.811528 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:02:41.811416 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f330bb9a-18cb-4403-b2f3-4cd61c8de0bb-monitoring-plugin-cert podName:f330bb9a-18cb-4403-b2f3-4cd61c8de0bb nodeName:}" failed. No retries permitted until 2026-09-07 04:02:42.311392095 +0000 UTC m=+294.731766813 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/f330bb9a-18cb-4403-b2f3-4cd61c8de0bb-monitoring-plugin-cert") pod "monitoring-plugin-85bbbbbf4-hx4sz" (UID: "f330bb9a-18cb-4403-b2f3-4cd61c8de0bb") : secret "monitoring-plugin-cert" not found Sep 07 04:02:41.821581 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:41.821555 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnmzx\" (UniqueName: \"kubernetes.io/projected/f330bb9a-18cb-4403-b2f3-4cd61c8de0bb-kube-api-access-tnmzx\") pod \"monitoring-plugin-85bbbbbf4-hx4sz\" (UID: \"f330bb9a-18cb-4403-b2f3-4cd61c8de0bb\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-hx4sz" Sep 07 04:02:42.316741 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:42.316699 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f330bb9a-18cb-4403-b2f3-4cd61c8de0bb-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-hx4sz\" (UID: \"f330bb9a-18cb-4403-b2f3-4cd61c8de0bb\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-hx4sz" Sep 07 04:02:42.319100 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:42.319070 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f330bb9a-18cb-4403-b2f3-4cd61c8de0bb-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-hx4sz\" (UID: \"f330bb9a-18cb-4403-b2f3-4cd61c8de0bb\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-hx4sz" Sep 07 04:02:42.546904 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:42.546867 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-hx4sz" Sep 07 04:02:42.828480 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:42.828355 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-hx4sz"] Sep 07 04:02:42.833106 ip-10-0-143-125 kubenswrapper[2566]: W0907 04:02:42.833070 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf330bb9a_18cb_4403_b2f3_4cd61c8de0bb.slice/crio-4bb88877a5aeac3ed6e7afa4f7bb0a971110847c6eb6908117d39a2a53b4929f WatchSource:0}: Error finding container 4bb88877a5aeac3ed6e7afa4f7bb0a971110847c6eb6908117d39a2a53b4929f: Status 404 returned error can't find the container with id 4bb88877a5aeac3ed6e7afa4f7bb0a971110847c6eb6908117d39a2a53b4929f Sep 07 04:02:42.954156 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:42.954119 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-hx4sz" event={"ID":"f330bb9a-18cb-4403-b2f3-4cd61c8de0bb","Type":"ContainerStarted","Data":"4bb88877a5aeac3ed6e7afa4f7bb0a971110847c6eb6908117d39a2a53b4929f"} Sep 07 04:02:43.011541 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.011498 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 04:02:43.032044 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.031983 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 04:02:43.032233 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.032143 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.035444 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.035194 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2dk60ii37d3q5\"" Sep 07 04:02:43.035444 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.035208 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 07 04:02:43.035444 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.035200 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 07 04:02:43.035444 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.035238 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 07 04:02:43.035444 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.035424 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 07 04:02:43.035877 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.035472 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 07 04:02:43.035877 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.035540 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 07 04:02:43.035877 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.035555 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 07 04:02:43.035877 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.035602 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-m686k\"" Sep 07 04:02:43.035877 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.035599 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 07 04:02:43.035877 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.035686 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 07 04:02:43.036236 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.036158 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 07 04:02:43.036303 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.036237 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 07 04:02:43.036303 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.036265 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 07 04:02:43.036436 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.036415 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 07 04:02:43.036705 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.036687 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 07 04:02:43.038498 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.038306 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 07 04:02:43.122879 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.122846 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.122879 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.122889 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.123134 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.122916 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.123134 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.122989 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.123134 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.123054 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-config\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.123134 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.123084 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.123134 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.123102 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.123134 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.123116 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.123369 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.123136 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.123369 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.123212 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-config-out\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.123369 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.123243 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.123369 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.123263 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.123369 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.123322 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.123369 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.123339 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.123369 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.123355 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.123688 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.123386 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.123688 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.123451 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.123688 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.123482 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.123688 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.123502 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-web-config\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.123688 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.123518 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgbbg\" (UniqueName: \"kubernetes.io/projected/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-kube-api-access-pgbbg\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.224492 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.224451 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.224710 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.224506 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.224710 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.224531 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.224710 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.224556 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-web-config\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.224710 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.224579 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgbbg\" (UniqueName: \"kubernetes.io/projected/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-kube-api-access-pgbbg\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.224710 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.224622 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.224957 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.224740 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.224957 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.224781 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.225058 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.224835 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.225247 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.225223 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-config\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.225318 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.225274 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.225318 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.225306 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.225433 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.225336 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.225433 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.225366 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.225529 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.225459 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-config-out\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.225606 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.225490 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.226077 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.226045 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.229208 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.228421 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.229208 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.228973 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-web-config\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.230049 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.229556 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.230049 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.230035 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.230367 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.230344 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.232486 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.232456 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.232842 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.232816 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-config-out\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.233537 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.233513 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.234958 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.234501 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.234958 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.234900 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.235119 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.235074 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.235176 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.225649 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.235236 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.235221 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.235291 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.235245 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.235291 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.235282 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.235401 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.235313 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.236727 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.236069 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.236866 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.236739 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgbbg\" (UniqueName: \"kubernetes.io/projected/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-kube-api-access-pgbbg\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.237223 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.237186 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.237362 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.237344 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.239319 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.239270 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.239319 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.239274 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.239544 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.239456 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-config\") pod \"prometheus-k8s-0\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.344658 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.344586 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:02:43.636148 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.636111 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 04:02:43.638677 ip-10-0-143-125 kubenswrapper[2566]: W0907 04:02:43.638619 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f99c6f7_eb4a_437c_b6b3_f188c8ce5436.slice/crio-c82262f12410568b67ba01e1e8d1681e2626075c3eb46137cdc2df8abe41d4e1 WatchSource:0}: Error finding container c82262f12410568b67ba01e1e8d1681e2626075c3eb46137cdc2df8abe41d4e1: Status 404 returned error can't find the container with id c82262f12410568b67ba01e1e8d1681e2626075c3eb46137cdc2df8abe41d4e1 Sep 07 04:02:43.960465 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:43.960424 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436","Type":"ContainerStarted","Data":"c82262f12410568b67ba01e1e8d1681e2626075c3eb46137cdc2df8abe41d4e1"} Sep 07 04:02:44.118605 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:44.118556 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5c47978b8-5xwws" podUID="07312acd-cd4b-4853-8db1-a5b6f6ae1a00" containerName="registry" containerID="cri-o://e50df72696fedec965a6654d2d7b6303656a5276d428543cf70445e490f3c85d" gracePeriod=30 Sep 07 04:02:44.602268 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:44.602246 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c47978b8-5xwws" Sep 07 04:02:44.647586 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:44.647558 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-registry-tls\") pod \"07312acd-cd4b-4853-8db1-a5b6f6ae1a00\" (UID: \"07312acd-cd4b-4853-8db1-a5b6f6ae1a00\") " Sep 07 04:02:44.647717 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:44.647603 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-trusted-ca\") pod \"07312acd-cd4b-4853-8db1-a5b6f6ae1a00\" (UID: \"07312acd-cd4b-4853-8db1-a5b6f6ae1a00\") " Sep 07 04:02:44.647717 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:44.647640 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rbjfc\" (UniqueName: \"kubernetes.io/projected/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-kube-api-access-rbjfc\") pod \"07312acd-cd4b-4853-8db1-a5b6f6ae1a00\" (UID: \"07312acd-cd4b-4853-8db1-a5b6f6ae1a00\") " Sep 07 04:02:44.647824 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:44.647749 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-bound-sa-token\") pod \"07312acd-cd4b-4853-8db1-a5b6f6ae1a00\" (UID: \"07312acd-cd4b-4853-8db1-a5b6f6ae1a00\") " Sep 07 04:02:44.647824 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:44.647788 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-installation-pull-secrets\") pod \"07312acd-cd4b-4853-8db1-a5b6f6ae1a00\" (UID: \"07312acd-cd4b-4853-8db1-a5b6f6ae1a00\") " Sep 07 04:02:44.647934 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:44.647879 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-ca-trust-extracted\") pod \"07312acd-cd4b-4853-8db1-a5b6f6ae1a00\" (UID: \"07312acd-cd4b-4853-8db1-a5b6f6ae1a00\") " Sep 07 04:02:44.647989 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:44.647934 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-registry-certificates\") pod \"07312acd-cd4b-4853-8db1-a5b6f6ae1a00\" (UID: \"07312acd-cd4b-4853-8db1-a5b6f6ae1a00\") " Sep 07 04:02:44.647989 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:44.647981 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-image-registry-private-configuration\") pod \"07312acd-cd4b-4853-8db1-a5b6f6ae1a00\" (UID: \"07312acd-cd4b-4853-8db1-a5b6f6ae1a00\") " Sep 07 04:02:44.648093 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:44.648015 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "07312acd-cd4b-4853-8db1-a5b6f6ae1a00" (UID: "07312acd-cd4b-4853-8db1-a5b6f6ae1a00"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 04:02:44.648362 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:44.648324 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-trusted-ca\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\"" Sep 07 04:02:44.648529 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:44.648502 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "07312acd-cd4b-4853-8db1-a5b6f6ae1a00" (UID: "07312acd-cd4b-4853-8db1-a5b6f6ae1a00"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 04:02:44.650693 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:44.650657 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "07312acd-cd4b-4853-8db1-a5b6f6ae1a00" (UID: "07312acd-cd4b-4853-8db1-a5b6f6ae1a00"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 04:02:44.651021 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:44.650993 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-kube-api-access-rbjfc" (OuterVolumeSpecName: "kube-api-access-rbjfc") pod "07312acd-cd4b-4853-8db1-a5b6f6ae1a00" (UID: "07312acd-cd4b-4853-8db1-a5b6f6ae1a00"). InnerVolumeSpecName "kube-api-access-rbjfc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 04:02:44.651283 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:44.651257 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "07312acd-cd4b-4853-8db1-a5b6f6ae1a00" (UID: "07312acd-cd4b-4853-8db1-a5b6f6ae1a00"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 04:02:44.651382 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:44.651266 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "07312acd-cd4b-4853-8db1-a5b6f6ae1a00" (UID: "07312acd-cd4b-4853-8db1-a5b6f6ae1a00"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 04:02:44.651623 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:44.651583 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "07312acd-cd4b-4853-8db1-a5b6f6ae1a00" (UID: "07312acd-cd4b-4853-8db1-a5b6f6ae1a00"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 04:02:44.658453 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:44.658428 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "07312acd-cd4b-4853-8db1-a5b6f6ae1a00" (UID: "07312acd-cd4b-4853-8db1-a5b6f6ae1a00"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 04:02:44.749615 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:44.749579 2566 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-bound-sa-token\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\"" Sep 07 04:02:44.749615 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:44.749609 2566 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-installation-pull-secrets\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\"" Sep 07 04:02:44.749615 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:44.749621 2566 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-ca-trust-extracted\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\"" Sep 07 04:02:44.749841 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:44.749652 2566 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-registry-certificates\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\"" Sep 07 04:02:44.749841 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:44.749662 2566 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-image-registry-private-configuration\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\"" Sep 07 04:02:44.749841 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:44.749672 2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-registry-tls\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\"" Sep 07 04:02:44.749841 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:44.749680 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rbjfc\" (UniqueName: \"kubernetes.io/projected/07312acd-cd4b-4853-8db1-a5b6f6ae1a00-kube-api-access-rbjfc\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\"" Sep 07 04:02:44.914427 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:44.914390 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-s7vls" Sep 07 04:02:44.965426 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:44.965393 2566 generic.go:356] "Generic (PLEG): container finished" podID="07312acd-cd4b-4853-8db1-a5b6f6ae1a00" containerID="e50df72696fedec965a6654d2d7b6303656a5276d428543cf70445e490f3c85d" exitCode=0 Sep 07 04:02:44.965873 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:44.965448 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c47978b8-5xwws" Sep 07 04:02:44.965873 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:44.965466 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c47978b8-5xwws" event={"ID":"07312acd-cd4b-4853-8db1-a5b6f6ae1a00","Type":"ContainerDied","Data":"e50df72696fedec965a6654d2d7b6303656a5276d428543cf70445e490f3c85d"} Sep 07 04:02:44.965873 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:44.965515 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c47978b8-5xwws" event={"ID":"07312acd-cd4b-4853-8db1-a5b6f6ae1a00","Type":"ContainerDied","Data":"8842c3128b7f39bc581f3929d0f63880000bf50de1cab9c0c52978e3e5ac57c8"} Sep 07 04:02:44.965873 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:44.965535 2566 scope.go:117] "RemoveContainer" containerID="e50df72696fedec965a6654d2d7b6303656a5276d428543cf70445e490f3c85d" Sep 07 04:02:44.967519 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:44.967485 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-hx4sz" event={"ID":"f330bb9a-18cb-4403-b2f3-4cd61c8de0bb","Type":"ContainerStarted","Data":"11053723649b5a25c02f0f5ff7f9f00304bfb2d5bcbc6ba680e656348828f244"} Sep 07 04:02:44.967769 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:44.967675 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-hx4sz" Sep 07 04:02:44.969947 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:44.969926 2566 generic.go:356] "Generic (PLEG): container finished" podID="0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" containerID="687455cfba8da9a3550a1e645c56336e0d092c10b096bdcaa763ba2231907658" exitCode=0 Sep 07 04:02:44.970057 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:44.969971 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436","Type":"ContainerDied","Data":"687455cfba8da9a3550a1e645c56336e0d092c10b096bdcaa763ba2231907658"} Sep 07 04:02:44.974064 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:44.974045 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-hx4sz" Sep 07 04:02:44.977879 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:44.977765 2566 scope.go:117] "RemoveContainer" containerID="e50df72696fedec965a6654d2d7b6303656a5276d428543cf70445e490f3c85d" Sep 07 04:02:44.978569 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:02:44.978544 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e50df72696fedec965a6654d2d7b6303656a5276d428543cf70445e490f3c85d\": container with ID starting with e50df72696fedec965a6654d2d7b6303656a5276d428543cf70445e490f3c85d not found: ID does not exist" containerID="e50df72696fedec965a6654d2d7b6303656a5276d428543cf70445e490f3c85d" Sep 07 04:02:44.978679 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:44.978624 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e50df72696fedec965a6654d2d7b6303656a5276d428543cf70445e490f3c85d"} err="failed to get container status \"e50df72696fedec965a6654d2d7b6303656a5276d428543cf70445e490f3c85d\": rpc error: code = NotFound desc = could not find container \"e50df72696fedec965a6654d2d7b6303656a5276d428543cf70445e490f3c85d\": container with ID starting with e50df72696fedec965a6654d2d7b6303656a5276d428543cf70445e490f3c85d not found: ID does not exist" Sep 07 04:02:44.983696 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:44.983657 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-hx4sz" podStartSLOduration=2.78562102 podStartE2EDuration="3.983621196s" totalImagesPullingTime="1.198000176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:02:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:02:44.983011175 +0000 UTC m=+297.403385899" watchObservedRunningTime="2026-09-07 04:02:44.983621196 +0000 UTC m=+297.403995920" Sep 07 04:02:44.995275 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:44.995242 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5c47978b8-5xwws"] Sep 07 04:02:44.997246 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:44.997225 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5c47978b8-5xwws"] Sep 07 04:02:46.088496 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:46.088459 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07312acd-cd4b-4853-8db1-a5b6f6ae1a00" path="/var/lib/kubelet/pods/07312acd-cd4b-4853-8db1-a5b6f6ae1a00/volumes" Sep 07 04:02:48.218314 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:48.218288 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-bgrfr_9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a/console-operator/2.log" Sep 07 04:02:48.221826 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:48.221801 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-bgrfr_9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a/console-operator/2.log" Sep 07 04:02:48.233615 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:48.233592 2566 kubelet.go:1648] "Image garbage collection succeeded" Sep 07 04:02:48.995759 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:48.995718 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436","Type":"ContainerStarted","Data":"6f9133b3fd2fa0799cc7f307b0245a3bbbdb43226126e7ec267cc0593cc25dc4"} Sep 07 04:02:48.995938 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:48.995827 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436","Type":"ContainerStarted","Data":"5549f792928ae73b4b816b0693f54b1de59fb3c153866bc18752eabd30c024e6"} Sep 07 04:02:51.010322 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:51.010286 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436","Type":"ContainerStarted","Data":"cafd8472aeaa93e56a07525aa43433d2c97a5870a2d76c4ef8acb072c31fa7ce"} Sep 07 04:02:51.010757 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:51.010350 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436","Type":"ContainerStarted","Data":"c5c0315bfe4ae5a7bb157ca978ddb9eacb79341d757abd364b59eaf18bb15876"} Sep 07 04:02:51.010757 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:51.010376 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436","Type":"ContainerStarted","Data":"6868366269c07417f6ea3e1e5b24c0124e9c50b26033a47bf4255f7b36698d12"} Sep 07 04:02:51.010757 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:51.010399 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436","Type":"ContainerStarted","Data":"7c406cfac349ab797002865bf21979ca1cc6121965c46dc25af1b4d285aeb50a"} Sep 07 04:02:51.036833 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:51.036768 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.997608378 podStartE2EDuration="9.036739605s" totalImagesPullingTime="6.020765211s" totalInitContainerRuntime="18.366016ms" isStatefulPod=false podCreationTimestamp="2026-09-07 04:02:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:02:51.035381478 +0000 UTC m=+303.455756183" watchObservedRunningTime="2026-09-07 04:02:51.036739605 +0000 UTC m=+303.457114327" Sep 07 04:02:51.082640 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:51.082591 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bshbg" Sep 07 04:02:51.082926 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:51.082764 2566 scope.go:117] "RemoveContainer" containerID="36283f0fae413e7dc38da1a269cbc5fbfa066a86f60327a0d30b84169fd84c17" Sep 07 04:02:52.016326 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:52.016295 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-bgrfr_9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a/console-operator/2.log" Sep 07 04:02:52.016712 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:52.016411 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-bgrfr" event={"ID":"9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a","Type":"ContainerStarted","Data":"346ccef7322e9f67d960a09a4c0cd9a8e62b9bcd3b27036e5b1a67f00d84ac0d"} Sep 07 04:02:52.036532 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:52.036466 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85b454874b-bgrfr" podStartSLOduration=56.801107954 podStartE2EDuration="59.036444909s" totalImagesPullingTime="2.235336955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:01:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:02:52.034827438 +0000 UTC m=+304.455202162" watchObservedRunningTime="2026-09-07 04:02:52.036444909 +0000 UTC m=+304.456819634" Sep 07 04:02:53.344976 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:02:53.344936 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:03:02.016889 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:03:02.016844 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-bgrfr" Sep 07 04:03:02.020588 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:03:02.020570 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85b454874b-bgrfr" Sep 07 04:03:13.092789 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:03:13.092758 2566 generic.go:356] "Generic (PLEG): container finished" podID="599835cb-1ae6-41a2-a0a8-fabb6f329fbe" containerID="e775bb80fa411595f0a1fe00b572f2152ea34ff98228650e9ab3a954a0ceec1b" exitCode=0 Sep 07 04:03:13.093171 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:03:13.092800 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-mjqjt" event={"ID":"599835cb-1ae6-41a2-a0a8-fabb6f329fbe","Type":"ContainerDied","Data":"e775bb80fa411595f0a1fe00b572f2152ea34ff98228650e9ab3a954a0ceec1b"} Sep 07 04:03:13.093171 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:03:13.093147 2566 scope.go:117] "RemoveContainer" containerID="e775bb80fa411595f0a1fe00b572f2152ea34ff98228650e9ab3a954a0ceec1b" Sep 07 04:03:14.097666 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:03:14.097613 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-mjqjt" event={"ID":"599835cb-1ae6-41a2-a0a8-fabb6f329fbe","Type":"ContainerStarted","Data":"d1acfc77cd7e5ff25d7ed8ef4fa8a9ad13b5a44960c9273af0ed2fcdbe041f08"} Sep 07 04:03:43.345410 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:03:43.345311 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:03:43.364570 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:03:43.364544 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:03:44.229170 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:03:44.229142 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:01.383328 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.383293 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 04:04:01.383874 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.383616 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" containerName="prometheus" containerID="cri-o://5549f792928ae73b4b816b0693f54b1de59fb3c153866bc18752eabd30c024e6" gracePeriod=600 Sep 07 04:04:01.383874 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.383691 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" containerName="kube-rbac-proxy" containerID="cri-o://c5c0315bfe4ae5a7bb157ca978ddb9eacb79341d757abd364b59eaf18bb15876" gracePeriod=600 Sep 07 04:04:01.383874 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.383743 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" containerName="config-reloader" containerID="cri-o://6f9133b3fd2fa0799cc7f307b0245a3bbbdb43226126e7ec267cc0593cc25dc4" gracePeriod=600 Sep 07 04:04:01.383874 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.383691 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" containerName="kube-rbac-proxy-thanos" containerID="cri-o://cafd8472aeaa93e56a07525aa43433d2c97a5870a2d76c4ef8acb072c31fa7ce" gracePeriod=600 Sep 07 04:04:01.384078 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.383747 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" containerName="kube-rbac-proxy-web" containerID="cri-o://6868366269c07417f6ea3e1e5b24c0124e9c50b26033a47bf4255f7b36698d12" gracePeriod=600 Sep 07 04:04:01.384078 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.383704 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" containerName="thanos-sidecar" containerID="cri-o://7c406cfac349ab797002865bf21979ca1cc6121965c46dc25af1b4d285aeb50a" gracePeriod=600 Sep 07 04:04:01.627985 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.627959 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:01.738864 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.738786 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-config\") pod \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " Sep 07 04:04:01.738864 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.738823 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-thanos-prometheus-http-client-file\") pod \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " Sep 07 04:04:01.738864 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.738861 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-prometheus-k8s-rulefiles-0\") pod \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " Sep 07 04:04:01.739128 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.738885 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-tls-assets\") pod \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " Sep 07 04:04:01.739128 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.738913 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-secret-prometheus-k8s-tls\") pod \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " Sep 07 04:04:01.739128 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.738940 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-configmap-kubelet-serving-ca-bundle\") pod \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " Sep 07 04:04:01.739128 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.738996 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-web-config\") pod \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " Sep 07 04:04:01.739128 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.739024 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-prometheus-k8s-db\") pod \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " Sep 07 04:04:01.739128 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.739047 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-secret-metrics-client-certs\") pod \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " Sep 07 04:04:01.739128 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.739094 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-prometheus-k8s-rulefiles-1\") pod \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " Sep 07 04:04:01.739128 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.739119 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-prometheus-trusted-ca-bundle\") pod \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " Sep 07 04:04:01.739529 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.739160 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " Sep 07 04:04:01.739529 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.739183 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-secret-grpc-tls\") pod \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " Sep 07 04:04:01.739529 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.739208 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " Sep 07 04:04:01.739529 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.739237 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-configmap-serving-certs-ca-bundle\") pod \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " Sep 07 04:04:01.739529 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.739265 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pgbbg\" (UniqueName: \"kubernetes.io/projected/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-kube-api-access-pgbbg\") pod \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " Sep 07 04:04:01.739529 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.739293 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-configmap-metrics-client-ca\") pod \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " Sep 07 04:04:01.739529 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.739349 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-prometheus-k8s-rulefiles-2\") pod \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " Sep 07 04:04:01.739529 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.739373 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-config-out\") pod \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " Sep 07 04:04:01.739529 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.739409 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-secret-kube-rbac-proxy\") pod \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\" (UID: \"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436\") " Sep 07 04:04:01.740110 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.740076 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" (UID: "0f99c6f7-eb4a-437c-b6b3-f188c8ce5436"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 04:04:01.740689 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.740654 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" (UID: "0f99c6f7-eb4a-437c-b6b3-f188c8ce5436"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 04:04:01.741139 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.741115 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" (UID: "0f99c6f7-eb4a-437c-b6b3-f188c8ce5436"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 04:04:01.741605 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.741579 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" (UID: "0f99c6f7-eb4a-437c-b6b3-f188c8ce5436"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 04:04:01.741725 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.741657 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" (UID: "0f99c6f7-eb4a-437c-b6b3-f188c8ce5436"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 04:04:01.741921 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.741894 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" (UID: "0f99c6f7-eb4a-437c-b6b3-f188c8ce5436"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 04:04:01.742016 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.741968 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" (UID: "0f99c6f7-eb4a-437c-b6b3-f188c8ce5436"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 04:04:01.742137 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.742110 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" (UID: "0f99c6f7-eb4a-437c-b6b3-f188c8ce5436"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 04:04:01.742279 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.742222 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" (UID: "0f99c6f7-eb4a-437c-b6b3-f188c8ce5436"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 04:04:01.742366 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.742283 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" (UID: "0f99c6f7-eb4a-437c-b6b3-f188c8ce5436"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 04:04:01.742716 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.742445 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" (UID: "0f99c6f7-eb4a-437c-b6b3-f188c8ce5436"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 04:04:01.743753 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.742818 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" (UID: "0f99c6f7-eb4a-437c-b6b3-f188c8ce5436"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 04:04:01.743753 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.742935 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" (UID: "0f99c6f7-eb4a-437c-b6b3-f188c8ce5436"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 04:04:01.743753 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.743102 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-config" (OuterVolumeSpecName: "config") pod "0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" (UID: "0f99c6f7-eb4a-437c-b6b3-f188c8ce5436"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 04:04:01.743957 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.743893 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-kube-api-access-pgbbg" (OuterVolumeSpecName: "kube-api-access-pgbbg") pod "0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" (UID: "0f99c6f7-eb4a-437c-b6b3-f188c8ce5436"). InnerVolumeSpecName "kube-api-access-pgbbg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 04:04:01.744234 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.744214 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-config-out" (OuterVolumeSpecName: "config-out") pod "0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" (UID: "0f99c6f7-eb4a-437c-b6b3-f188c8ce5436"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 04:04:01.744523 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.744494 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" (UID: "0f99c6f7-eb4a-437c-b6b3-f188c8ce5436"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 04:04:01.744650 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.744613 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" (UID: "0f99c6f7-eb4a-437c-b6b3-f188c8ce5436"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 04:04:01.744829 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.744812 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" (UID: "0f99c6f7-eb4a-437c-b6b3-f188c8ce5436"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 04:04:01.751978 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.751956 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-web-config" (OuterVolumeSpecName: "web-config") pod "0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" (UID: "0f99c6f7-eb4a-437c-b6b3-f188c8ce5436"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 04:04:01.840485 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.840435 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\"" Sep 07 04:04:01.840485 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.840479 2566 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-config-out\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\"" Sep 07 04:04:01.840485 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.840489 2566 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-secret-kube-rbac-proxy\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\"" Sep 07 04:04:01.840485 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.840498 2566 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-config\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\"" Sep 07 04:04:01.840774 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.840507 2566 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-thanos-prometheus-http-client-file\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\"" Sep 07 04:04:01.840774 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.840518 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\"" Sep 07 04:04:01.840774 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.840526 2566 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-tls-assets\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\"" Sep 07 04:04:01.840774 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.840534 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-secret-prometheus-k8s-tls\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\"" Sep 07 04:04:01.840774 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.840542 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\"" Sep 07 04:04:01.840774 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.840550 2566 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-web-config\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\"" Sep 07 04:04:01.840774 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.840559 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-prometheus-k8s-db\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\"" Sep 07 04:04:01.840774 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.840567 2566 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-secret-metrics-client-certs\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\"" Sep 07 04:04:01.840774 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.840575 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\"" Sep 07 04:04:01.840774 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.840583 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-prometheus-trusted-ca-bundle\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\"" Sep 07 04:04:01.840774 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.840592 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\"" Sep 07 04:04:01.840774 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.840600 2566 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-secret-grpc-tls\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\"" Sep 07 04:04:01.840774 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.840609 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\"" Sep 07 04:04:01.840774 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.840617 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\"" Sep 07 04:04:01.840774 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.840625 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pgbbg\" (UniqueName: \"kubernetes.io/projected/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-kube-api-access-pgbbg\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\"" Sep 07 04:04:01.840774 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.840654 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436-configmap-metrics-client-ca\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\"" Sep 07 04:04:01.941134 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.941089 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9-metrics-certs\") pod \"network-metrics-daemon-bshbg\" (UID: \"2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9\") " pod="openshift-multus/network-metrics-daemon-bshbg" Sep 07 04:04:01.943344 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:01.943319 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9-metrics-certs\") pod \"network-metrics-daemon-bshbg\" (UID: \"2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9\") " pod="openshift-multus/network-metrics-daemon-bshbg" Sep 07 04:04:02.185465 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.185437 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rbtcj\"" Sep 07 04:04:02.193948 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.193930 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bshbg" Sep 07 04:04:02.284536 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.284504 2566 generic.go:356] "Generic (PLEG): container finished" podID="0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" containerID="cafd8472aeaa93e56a07525aa43433d2c97a5870a2d76c4ef8acb072c31fa7ce" exitCode=0 Sep 07 04:04:02.284536 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.284531 2566 generic.go:356] "Generic (PLEG): container finished" podID="0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" containerID="c5c0315bfe4ae5a7bb157ca978ddb9eacb79341d757abd364b59eaf18bb15876" exitCode=0 Sep 07 04:04:02.284536 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.284541 2566 generic.go:356] "Generic (PLEG): container finished" podID="0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" containerID="6868366269c07417f6ea3e1e5b24c0124e9c50b26033a47bf4255f7b36698d12" exitCode=0 Sep 07 04:04:02.284765 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.284550 2566 generic.go:356] "Generic (PLEG): container finished" podID="0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" containerID="7c406cfac349ab797002865bf21979ca1cc6121965c46dc25af1b4d285aeb50a" exitCode=0 Sep 07 04:04:02.284765 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.284556 2566 generic.go:356] "Generic (PLEG): container finished" podID="0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" containerID="6f9133b3fd2fa0799cc7f307b0245a3bbbdb43226126e7ec267cc0593cc25dc4" exitCode=0 Sep 07 04:04:02.284765 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.284561 2566 generic.go:356] "Generic (PLEG): container finished" podID="0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" containerID="5549f792928ae73b4b816b0693f54b1de59fb3c153866bc18752eabd30c024e6" exitCode=0 Sep 07 04:04:02.284765 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.284562 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436","Type":"ContainerDied","Data":"cafd8472aeaa93e56a07525aa43433d2c97a5870a2d76c4ef8acb072c31fa7ce"} Sep 07 04:04:02.284765 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.284607 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.284765 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.284670 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436","Type":"ContainerDied","Data":"c5c0315bfe4ae5a7bb157ca978ddb9eacb79341d757abd364b59eaf18bb15876"} Sep 07 04:04:02.284765 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.284715 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436","Type":"ContainerDied","Data":"6868366269c07417f6ea3e1e5b24c0124e9c50b26033a47bf4255f7b36698d12"} Sep 07 04:04:02.284765 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.284734 2566 scope.go:117] "RemoveContainer" containerID="cafd8472aeaa93e56a07525aa43433d2c97a5870a2d76c4ef8acb072c31fa7ce" Sep 07 04:04:02.284765 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.284755 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436","Type":"ContainerDied","Data":"7c406cfac349ab797002865bf21979ca1cc6121965c46dc25af1b4d285aeb50a"} Sep 07 04:04:02.285069 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.284797 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436","Type":"ContainerDied","Data":"6f9133b3fd2fa0799cc7f307b0245a3bbbdb43226126e7ec267cc0593cc25dc4"} Sep 07 04:04:02.285069 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.284840 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436","Type":"ContainerDied","Data":"5549f792928ae73b4b816b0693f54b1de59fb3c153866bc18752eabd30c024e6"} Sep 07 04:04:02.285069 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.284881 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0f99c6f7-eb4a-437c-b6b3-f188c8ce5436","Type":"ContainerDied","Data":"c82262f12410568b67ba01e1e8d1681e2626075c3eb46137cdc2df8abe41d4e1"} Sep 07 04:04:02.292834 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.292818 2566 scope.go:117] "RemoveContainer" containerID="c5c0315bfe4ae5a7bb157ca978ddb9eacb79341d757abd364b59eaf18bb15876" Sep 07 04:04:02.299665 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.299648 2566 scope.go:117] "RemoveContainer" containerID="6868366269c07417f6ea3e1e5b24c0124e9c50b26033a47bf4255f7b36698d12" Sep 07 04:04:02.304826 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.304802 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 04:04:02.306792 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.306775 2566 scope.go:117] "RemoveContainer" containerID="7c406cfac349ab797002865bf21979ca1cc6121965c46dc25af1b4d285aeb50a" Sep 07 04:04:02.311780 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.311757 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 04:04:02.314290 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.314273 2566 scope.go:117] "RemoveContainer" containerID="6f9133b3fd2fa0799cc7f307b0245a3bbbdb43226126e7ec267cc0593cc25dc4" Sep 07 04:04:02.320691 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.320673 2566 scope.go:117] "RemoveContainer" containerID="5549f792928ae73b4b816b0693f54b1de59fb3c153866bc18752eabd30c024e6" Sep 07 04:04:02.327944 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.327926 2566 scope.go:117] "RemoveContainer" containerID="687455cfba8da9a3550a1e645c56336e0d092c10b096bdcaa763ba2231907658" Sep 07 04:04:02.334327 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.334299 2566 scope.go:117] "RemoveContainer" containerID="cafd8472aeaa93e56a07525aa43433d2c97a5870a2d76c4ef8acb072c31fa7ce" Sep 07 04:04:02.334711 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:04:02.334688 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cafd8472aeaa93e56a07525aa43433d2c97a5870a2d76c4ef8acb072c31fa7ce\": container with ID starting with cafd8472aeaa93e56a07525aa43433d2c97a5870a2d76c4ef8acb072c31fa7ce not found: ID does not exist" containerID="cafd8472aeaa93e56a07525aa43433d2c97a5870a2d76c4ef8acb072c31fa7ce" Sep 07 04:04:02.334815 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.334721 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cafd8472aeaa93e56a07525aa43433d2c97a5870a2d76c4ef8acb072c31fa7ce"} err="failed to get container status \"cafd8472aeaa93e56a07525aa43433d2c97a5870a2d76c4ef8acb072c31fa7ce\": rpc error: code = NotFound desc = could not find container \"cafd8472aeaa93e56a07525aa43433d2c97a5870a2d76c4ef8acb072c31fa7ce\": container with ID starting with cafd8472aeaa93e56a07525aa43433d2c97a5870a2d76c4ef8acb072c31fa7ce not found: ID does not exist" Sep 07 04:04:02.334815 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.334749 2566 scope.go:117] "RemoveContainer" containerID="c5c0315bfe4ae5a7bb157ca978ddb9eacb79341d757abd364b59eaf18bb15876" Sep 07 04:04:02.335708 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:04:02.335688 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5c0315bfe4ae5a7bb157ca978ddb9eacb79341d757abd364b59eaf18bb15876\": container with ID starting with c5c0315bfe4ae5a7bb157ca978ddb9eacb79341d757abd364b59eaf18bb15876 not found: ID does not exist" containerID="c5c0315bfe4ae5a7bb157ca978ddb9eacb79341d757abd364b59eaf18bb15876" Sep 07 04:04:02.335805 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.335718 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5c0315bfe4ae5a7bb157ca978ddb9eacb79341d757abd364b59eaf18bb15876"} err="failed to get container status \"c5c0315bfe4ae5a7bb157ca978ddb9eacb79341d757abd364b59eaf18bb15876\": rpc error: code = NotFound desc = could not find container \"c5c0315bfe4ae5a7bb157ca978ddb9eacb79341d757abd364b59eaf18bb15876\": container with ID starting with c5c0315bfe4ae5a7bb157ca978ddb9eacb79341d757abd364b59eaf18bb15876 not found: ID does not exist" Sep 07 04:04:02.335805 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.335737 2566 scope.go:117] "RemoveContainer" containerID="6868366269c07417f6ea3e1e5b24c0124e9c50b26033a47bf4255f7b36698d12" Sep 07 04:04:02.336016 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:04:02.335996 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6868366269c07417f6ea3e1e5b24c0124e9c50b26033a47bf4255f7b36698d12\": container with ID starting with 6868366269c07417f6ea3e1e5b24c0124e9c50b26033a47bf4255f7b36698d12 not found: ID does not exist" containerID="6868366269c07417f6ea3e1e5b24c0124e9c50b26033a47bf4255f7b36698d12" Sep 07 04:04:02.336062 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.336022 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6868366269c07417f6ea3e1e5b24c0124e9c50b26033a47bf4255f7b36698d12"} err="failed to get container status \"6868366269c07417f6ea3e1e5b24c0124e9c50b26033a47bf4255f7b36698d12\": rpc error: code = NotFound desc = could not find container \"6868366269c07417f6ea3e1e5b24c0124e9c50b26033a47bf4255f7b36698d12\": container with ID starting with 6868366269c07417f6ea3e1e5b24c0124e9c50b26033a47bf4255f7b36698d12 not found: ID does not exist" Sep 07 04:04:02.336062 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.336038 2566 scope.go:117] "RemoveContainer" containerID="7c406cfac349ab797002865bf21979ca1cc6121965c46dc25af1b4d285aeb50a" Sep 07 04:04:02.336297 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:04:02.336276 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c406cfac349ab797002865bf21979ca1cc6121965c46dc25af1b4d285aeb50a\": container with ID starting with 7c406cfac349ab797002865bf21979ca1cc6121965c46dc25af1b4d285aeb50a not found: ID does not exist" containerID="7c406cfac349ab797002865bf21979ca1cc6121965c46dc25af1b4d285aeb50a" Sep 07 04:04:02.336353 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.336310 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 04:04:02.336407 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.336307 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c406cfac349ab797002865bf21979ca1cc6121965c46dc25af1b4d285aeb50a"} err="failed to get container status \"7c406cfac349ab797002865bf21979ca1cc6121965c46dc25af1b4d285aeb50a\": rpc error: code = NotFound desc = could not find container \"7c406cfac349ab797002865bf21979ca1cc6121965c46dc25af1b4d285aeb50a\": container with ID starting with 7c406cfac349ab797002865bf21979ca1cc6121965c46dc25af1b4d285aeb50a not found: ID does not exist" Sep 07 04:04:02.336464 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.336413 2566 scope.go:117] "RemoveContainer" containerID="6f9133b3fd2fa0799cc7f307b0245a3bbbdb43226126e7ec267cc0593cc25dc4" Sep 07 04:04:02.336597 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.336583 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" containerName="config-reloader" Sep 07 04:04:02.336663 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.336599 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" containerName="config-reloader" Sep 07 04:04:02.336663 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.336611 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" containerName="kube-rbac-proxy-thanos" Sep 07 04:04:02.336663 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.336617 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" containerName="kube-rbac-proxy-thanos" Sep 07 04:04:02.336663 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.336642 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" containerName="init-config-reloader" Sep 07 04:04:02.336663 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.336648 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" containerName="init-config-reloader" Sep 07 04:04:02.336663 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:04:02.336624 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f9133b3fd2fa0799cc7f307b0245a3bbbdb43226126e7ec267cc0593cc25dc4\": container with ID starting with 6f9133b3fd2fa0799cc7f307b0245a3bbbdb43226126e7ec267cc0593cc25dc4 not found: ID does not exist" containerID="6f9133b3fd2fa0799cc7f307b0245a3bbbdb43226126e7ec267cc0593cc25dc4" Sep 07 04:04:02.336663 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.336656 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" containerName="kube-rbac-proxy" Sep 07 04:04:02.336663 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.336661 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" containerName="kube-rbac-proxy" Sep 07 04:04:02.336955 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.336669 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" containerName="kube-rbac-proxy-web" Sep 07 04:04:02.336955 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.336666 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f9133b3fd2fa0799cc7f307b0245a3bbbdb43226126e7ec267cc0593cc25dc4"} err="failed to get container status \"6f9133b3fd2fa0799cc7f307b0245a3bbbdb43226126e7ec267cc0593cc25dc4\": rpc error: code = NotFound desc = could not find container \"6f9133b3fd2fa0799cc7f307b0245a3bbbdb43226126e7ec267cc0593cc25dc4\": container with ID starting with 6f9133b3fd2fa0799cc7f307b0245a3bbbdb43226126e7ec267cc0593cc25dc4 not found: ID does not exist" Sep 07 04:04:02.336955 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.336681 2566 scope.go:117] "RemoveContainer" containerID="5549f792928ae73b4b816b0693f54b1de59fb3c153866bc18752eabd30c024e6" Sep 07 04:04:02.336955 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.336674 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" containerName="kube-rbac-proxy-web" Sep 07 04:04:02.336955 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.336736 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" containerName="prometheus" Sep 07 04:04:02.336955 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.336746 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" containerName="prometheus" Sep 07 04:04:02.336955 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.336756 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07312acd-cd4b-4853-8db1-a5b6f6ae1a00" containerName="registry" Sep 07 04:04:02.336955 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.336762 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="07312acd-cd4b-4853-8db1-a5b6f6ae1a00" containerName="registry" Sep 07 04:04:02.336955 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.336774 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" containerName="thanos-sidecar" Sep 07 04:04:02.336955 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.336781 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" containerName="thanos-sidecar" Sep 07 04:04:02.336955 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.336856 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="07312acd-cd4b-4853-8db1-a5b6f6ae1a00" containerName="registry" Sep 07 04:04:02.336955 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.336868 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" containerName="thanos-sidecar" Sep 07 04:04:02.336955 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.336878 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" containerName="kube-rbac-proxy-web" Sep 07 04:04:02.336955 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.336888 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" containerName="prometheus" Sep 07 04:04:02.336955 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.336896 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" containerName="kube-rbac-proxy" Sep 07 04:04:02.336955 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.336902 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" containerName="kube-rbac-proxy-thanos" Sep 07 04:04:02.336955 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.336908 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" containerName="config-reloader" Sep 07 04:04:02.336955 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:04:02.336910 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5549f792928ae73b4b816b0693f54b1de59fb3c153866bc18752eabd30c024e6\": container with ID starting with 5549f792928ae73b4b816b0693f54b1de59fb3c153866bc18752eabd30c024e6 not found: ID does not exist" containerID="5549f792928ae73b4b816b0693f54b1de59fb3c153866bc18752eabd30c024e6" Sep 07 04:04:02.336955 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.336936 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5549f792928ae73b4b816b0693f54b1de59fb3c153866bc18752eabd30c024e6"} err="failed to get container status \"5549f792928ae73b4b816b0693f54b1de59fb3c153866bc18752eabd30c024e6\": rpc error: code = NotFound desc = could not find container \"5549f792928ae73b4b816b0693f54b1de59fb3c153866bc18752eabd30c024e6\": container with ID starting with 5549f792928ae73b4b816b0693f54b1de59fb3c153866bc18752eabd30c024e6 not found: ID does not exist" Sep 07 04:04:02.336955 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.336950 2566 scope.go:117] "RemoveContainer" containerID="687455cfba8da9a3550a1e645c56336e0d092c10b096bdcaa763ba2231907658" Sep 07 04:04:02.337594 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:04:02.337152 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"687455cfba8da9a3550a1e645c56336e0d092c10b096bdcaa763ba2231907658\": container with ID starting with 687455cfba8da9a3550a1e645c56336e0d092c10b096bdcaa763ba2231907658 not found: ID does not exist" containerID="687455cfba8da9a3550a1e645c56336e0d092c10b096bdcaa763ba2231907658" Sep 07 04:04:02.337594 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.337174 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"687455cfba8da9a3550a1e645c56336e0d092c10b096bdcaa763ba2231907658"} err="failed to get container status \"687455cfba8da9a3550a1e645c56336e0d092c10b096bdcaa763ba2231907658\": rpc error: code = NotFound desc = could not find container \"687455cfba8da9a3550a1e645c56336e0d092c10b096bdcaa763ba2231907658\": container with ID starting with 687455cfba8da9a3550a1e645c56336e0d092c10b096bdcaa763ba2231907658 not found: ID does not exist" Sep 07 04:04:02.337594 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.337190 2566 scope.go:117] "RemoveContainer" containerID="cafd8472aeaa93e56a07525aa43433d2c97a5870a2d76c4ef8acb072c31fa7ce" Sep 07 04:04:02.337594 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.337404 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cafd8472aeaa93e56a07525aa43433d2c97a5870a2d76c4ef8acb072c31fa7ce"} err="failed to get container status \"cafd8472aeaa93e56a07525aa43433d2c97a5870a2d76c4ef8acb072c31fa7ce\": rpc error: code = NotFound desc = could not find container \"cafd8472aeaa93e56a07525aa43433d2c97a5870a2d76c4ef8acb072c31fa7ce\": container with ID starting with cafd8472aeaa93e56a07525aa43433d2c97a5870a2d76c4ef8acb072c31fa7ce not found: ID does not exist" Sep 07 04:04:02.337594 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.337421 2566 scope.go:117] "RemoveContainer" containerID="c5c0315bfe4ae5a7bb157ca978ddb9eacb79341d757abd364b59eaf18bb15876" Sep 07 04:04:02.337780 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.337720 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5c0315bfe4ae5a7bb157ca978ddb9eacb79341d757abd364b59eaf18bb15876"} err="failed to get container status \"c5c0315bfe4ae5a7bb157ca978ddb9eacb79341d757abd364b59eaf18bb15876\": rpc error: code = NotFound desc = could not find container \"c5c0315bfe4ae5a7bb157ca978ddb9eacb79341d757abd364b59eaf18bb15876\": container with ID starting with c5c0315bfe4ae5a7bb157ca978ddb9eacb79341d757abd364b59eaf18bb15876 not found: ID does not exist" Sep 07 04:04:02.337780 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.337737 2566 scope.go:117] "RemoveContainer" containerID="6868366269c07417f6ea3e1e5b24c0124e9c50b26033a47bf4255f7b36698d12" Sep 07 04:04:02.338016 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.337990 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6868366269c07417f6ea3e1e5b24c0124e9c50b26033a47bf4255f7b36698d12"} err="failed to get container status \"6868366269c07417f6ea3e1e5b24c0124e9c50b26033a47bf4255f7b36698d12\": rpc error: code = NotFound desc = could not find container \"6868366269c07417f6ea3e1e5b24c0124e9c50b26033a47bf4255f7b36698d12\": container with ID starting with 6868366269c07417f6ea3e1e5b24c0124e9c50b26033a47bf4255f7b36698d12 not found: ID does not exist" Sep 07 04:04:02.338100 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.338017 2566 scope.go:117] "RemoveContainer" containerID="7c406cfac349ab797002865bf21979ca1cc6121965c46dc25af1b4d285aeb50a" Sep 07 04:04:02.338313 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.338294 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c406cfac349ab797002865bf21979ca1cc6121965c46dc25af1b4d285aeb50a"} err="failed to get container status \"7c406cfac349ab797002865bf21979ca1cc6121965c46dc25af1b4d285aeb50a\": rpc error: code = NotFound desc = could not find container \"7c406cfac349ab797002865bf21979ca1cc6121965c46dc25af1b4d285aeb50a\": container with ID starting with 7c406cfac349ab797002865bf21979ca1cc6121965c46dc25af1b4d285aeb50a not found: ID does not exist" Sep 07 04:04:02.338313 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.338314 2566 scope.go:117] "RemoveContainer" containerID="6f9133b3fd2fa0799cc7f307b0245a3bbbdb43226126e7ec267cc0593cc25dc4" Sep 07 04:04:02.338572 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.338553 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f9133b3fd2fa0799cc7f307b0245a3bbbdb43226126e7ec267cc0593cc25dc4"} err="failed to get container status \"6f9133b3fd2fa0799cc7f307b0245a3bbbdb43226126e7ec267cc0593cc25dc4\": rpc error: code = NotFound desc = could not find container \"6f9133b3fd2fa0799cc7f307b0245a3bbbdb43226126e7ec267cc0593cc25dc4\": container with ID starting with 6f9133b3fd2fa0799cc7f307b0245a3bbbdb43226126e7ec267cc0593cc25dc4 not found: ID does not exist" Sep 07 04:04:02.338645 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.338572 2566 scope.go:117] "RemoveContainer" containerID="5549f792928ae73b4b816b0693f54b1de59fb3c153866bc18752eabd30c024e6" Sep 07 04:04:02.338836 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.338817 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5549f792928ae73b4b816b0693f54b1de59fb3c153866bc18752eabd30c024e6"} err="failed to get container status \"5549f792928ae73b4b816b0693f54b1de59fb3c153866bc18752eabd30c024e6\": rpc error: code = NotFound desc = could not find container \"5549f792928ae73b4b816b0693f54b1de59fb3c153866bc18752eabd30c024e6\": container with ID starting with 5549f792928ae73b4b816b0693f54b1de59fb3c153866bc18752eabd30c024e6 not found: ID does not exist" Sep 07 04:04:02.338883 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.338836 2566 scope.go:117] "RemoveContainer" containerID="687455cfba8da9a3550a1e645c56336e0d092c10b096bdcaa763ba2231907658" Sep 07 04:04:02.339081 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.339061 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"687455cfba8da9a3550a1e645c56336e0d092c10b096bdcaa763ba2231907658"} err="failed to get container status \"687455cfba8da9a3550a1e645c56336e0d092c10b096bdcaa763ba2231907658\": rpc error: code = NotFound desc = could not find container \"687455cfba8da9a3550a1e645c56336e0d092c10b096bdcaa763ba2231907658\": container with ID starting with 687455cfba8da9a3550a1e645c56336e0d092c10b096bdcaa763ba2231907658 not found: ID does not exist" Sep 07 04:04:02.339149 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.339080 2566 scope.go:117] "RemoveContainer" containerID="cafd8472aeaa93e56a07525aa43433d2c97a5870a2d76c4ef8acb072c31fa7ce" Sep 07 04:04:02.339337 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.339312 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cafd8472aeaa93e56a07525aa43433d2c97a5870a2d76c4ef8acb072c31fa7ce"} err="failed to get container status \"cafd8472aeaa93e56a07525aa43433d2c97a5870a2d76c4ef8acb072c31fa7ce\": rpc error: code = NotFound desc = could not find container \"cafd8472aeaa93e56a07525aa43433d2c97a5870a2d76c4ef8acb072c31fa7ce\": container with ID starting with cafd8472aeaa93e56a07525aa43433d2c97a5870a2d76c4ef8acb072c31fa7ce not found: ID does not exist" Sep 07 04:04:02.339337 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.339335 2566 scope.go:117] "RemoveContainer" containerID="c5c0315bfe4ae5a7bb157ca978ddb9eacb79341d757abd364b59eaf18bb15876" Sep 07 04:04:02.339650 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.339614 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5c0315bfe4ae5a7bb157ca978ddb9eacb79341d757abd364b59eaf18bb15876"} err="failed to get container status \"c5c0315bfe4ae5a7bb157ca978ddb9eacb79341d757abd364b59eaf18bb15876\": rpc error: code = NotFound desc = could not find container \"c5c0315bfe4ae5a7bb157ca978ddb9eacb79341d757abd364b59eaf18bb15876\": container with ID starting with c5c0315bfe4ae5a7bb157ca978ddb9eacb79341d757abd364b59eaf18bb15876 not found: ID does not exist" Sep 07 04:04:02.339650 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.339650 2566 scope.go:117] "RemoveContainer" containerID="6868366269c07417f6ea3e1e5b24c0124e9c50b26033a47bf4255f7b36698d12" Sep 07 04:04:02.339889 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.339871 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6868366269c07417f6ea3e1e5b24c0124e9c50b26033a47bf4255f7b36698d12"} err="failed to get container status \"6868366269c07417f6ea3e1e5b24c0124e9c50b26033a47bf4255f7b36698d12\": rpc error: code = NotFound desc = could not find container \"6868366269c07417f6ea3e1e5b24c0124e9c50b26033a47bf4255f7b36698d12\": container with ID starting with 6868366269c07417f6ea3e1e5b24c0124e9c50b26033a47bf4255f7b36698d12 not found: ID does not exist" Sep 07 04:04:02.339935 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.339889 2566 scope.go:117] "RemoveContainer" containerID="7c406cfac349ab797002865bf21979ca1cc6121965c46dc25af1b4d285aeb50a" Sep 07 04:04:02.340135 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.340117 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c406cfac349ab797002865bf21979ca1cc6121965c46dc25af1b4d285aeb50a"} err="failed to get container status \"7c406cfac349ab797002865bf21979ca1cc6121965c46dc25af1b4d285aeb50a\": rpc error: code = NotFound desc = could not find container \"7c406cfac349ab797002865bf21979ca1cc6121965c46dc25af1b4d285aeb50a\": container with ID starting with 7c406cfac349ab797002865bf21979ca1cc6121965c46dc25af1b4d285aeb50a not found: ID does not exist" Sep 07 04:04:02.340135 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.340135 2566 scope.go:117] "RemoveContainer" containerID="6f9133b3fd2fa0799cc7f307b0245a3bbbdb43226126e7ec267cc0593cc25dc4" Sep 07 04:04:02.340354 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.340334 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f9133b3fd2fa0799cc7f307b0245a3bbbdb43226126e7ec267cc0593cc25dc4"} err="failed to get container status \"6f9133b3fd2fa0799cc7f307b0245a3bbbdb43226126e7ec267cc0593cc25dc4\": rpc error: code = NotFound desc = could not find container \"6f9133b3fd2fa0799cc7f307b0245a3bbbdb43226126e7ec267cc0593cc25dc4\": container with ID starting with 6f9133b3fd2fa0799cc7f307b0245a3bbbdb43226126e7ec267cc0593cc25dc4 not found: ID does not exist" Sep 07 04:04:02.340397 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.340357 2566 scope.go:117] "RemoveContainer" containerID="5549f792928ae73b4b816b0693f54b1de59fb3c153866bc18752eabd30c024e6" Sep 07 04:04:02.340687 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.340667 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5549f792928ae73b4b816b0693f54b1de59fb3c153866bc18752eabd30c024e6"} err="failed to get container status \"5549f792928ae73b4b816b0693f54b1de59fb3c153866bc18752eabd30c024e6\": rpc error: code = NotFound desc = could not find container \"5549f792928ae73b4b816b0693f54b1de59fb3c153866bc18752eabd30c024e6\": container with ID starting with 5549f792928ae73b4b816b0693f54b1de59fb3c153866bc18752eabd30c024e6 not found: ID does not exist" Sep 07 04:04:02.340770 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.340688 2566 scope.go:117] "RemoveContainer" containerID="687455cfba8da9a3550a1e645c56336e0d092c10b096bdcaa763ba2231907658" Sep 07 04:04:02.340925 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.340910 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.340987 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.340960 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"687455cfba8da9a3550a1e645c56336e0d092c10b096bdcaa763ba2231907658"} err="failed to get container status \"687455cfba8da9a3550a1e645c56336e0d092c10b096bdcaa763ba2231907658\": rpc error: code = NotFound desc = could not find container \"687455cfba8da9a3550a1e645c56336e0d092c10b096bdcaa763ba2231907658\": container with ID starting with 687455cfba8da9a3550a1e645c56336e0d092c10b096bdcaa763ba2231907658 not found: ID does not exist" Sep 07 04:04:02.340987 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.340983 2566 scope.go:117] "RemoveContainer" containerID="cafd8472aeaa93e56a07525aa43433d2c97a5870a2d76c4ef8acb072c31fa7ce" Sep 07 04:04:02.341553 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.341528 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cafd8472aeaa93e56a07525aa43433d2c97a5870a2d76c4ef8acb072c31fa7ce"} err="failed to get container status \"cafd8472aeaa93e56a07525aa43433d2c97a5870a2d76c4ef8acb072c31fa7ce\": rpc error: code = NotFound desc = could not find container \"cafd8472aeaa93e56a07525aa43433d2c97a5870a2d76c4ef8acb072c31fa7ce\": container with ID starting with cafd8472aeaa93e56a07525aa43433d2c97a5870a2d76c4ef8acb072c31fa7ce not found: ID does not exist" Sep 07 04:04:02.341663 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.341553 2566 scope.go:117] "RemoveContainer" containerID="c5c0315bfe4ae5a7bb157ca978ddb9eacb79341d757abd364b59eaf18bb15876" Sep 07 04:04:02.341860 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.341838 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5c0315bfe4ae5a7bb157ca978ddb9eacb79341d757abd364b59eaf18bb15876"} err="failed to get container status \"c5c0315bfe4ae5a7bb157ca978ddb9eacb79341d757abd364b59eaf18bb15876\": rpc error: code = NotFound desc = could not find container \"c5c0315bfe4ae5a7bb157ca978ddb9eacb79341d757abd364b59eaf18bb15876\": container with ID starting with c5c0315bfe4ae5a7bb157ca978ddb9eacb79341d757abd364b59eaf18bb15876 not found: ID does not exist" Sep 07 04:04:02.341933 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.341862 2566 scope.go:117] "RemoveContainer" containerID="6868366269c07417f6ea3e1e5b24c0124e9c50b26033a47bf4255f7b36698d12" Sep 07 04:04:02.342135 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.342117 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6868366269c07417f6ea3e1e5b24c0124e9c50b26033a47bf4255f7b36698d12"} err="failed to get container status \"6868366269c07417f6ea3e1e5b24c0124e9c50b26033a47bf4255f7b36698d12\": rpc error: code = NotFound desc = could not find container \"6868366269c07417f6ea3e1e5b24c0124e9c50b26033a47bf4255f7b36698d12\": container with ID starting with 6868366269c07417f6ea3e1e5b24c0124e9c50b26033a47bf4255f7b36698d12 not found: ID does not exist" Sep 07 04:04:02.342192 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.342136 2566 scope.go:117] "RemoveContainer" containerID="7c406cfac349ab797002865bf21979ca1cc6121965c46dc25af1b4d285aeb50a" Sep 07 04:04:02.342395 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.342373 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c406cfac349ab797002865bf21979ca1cc6121965c46dc25af1b4d285aeb50a"} err="failed to get container status \"7c406cfac349ab797002865bf21979ca1cc6121965c46dc25af1b4d285aeb50a\": rpc error: code = NotFound desc = could not find container \"7c406cfac349ab797002865bf21979ca1cc6121965c46dc25af1b4d285aeb50a\": container with ID starting with 7c406cfac349ab797002865bf21979ca1cc6121965c46dc25af1b4d285aeb50a not found: ID does not exist" Sep 07 04:04:02.342436 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.342398 2566 scope.go:117] "RemoveContainer" containerID="6f9133b3fd2fa0799cc7f307b0245a3bbbdb43226126e7ec267cc0593cc25dc4" Sep 07 04:04:02.342650 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.342620 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f9133b3fd2fa0799cc7f307b0245a3bbbdb43226126e7ec267cc0593cc25dc4"} err="failed to get container status \"6f9133b3fd2fa0799cc7f307b0245a3bbbdb43226126e7ec267cc0593cc25dc4\": rpc error: code = NotFound desc = could not find container \"6f9133b3fd2fa0799cc7f307b0245a3bbbdb43226126e7ec267cc0593cc25dc4\": container with ID starting with 6f9133b3fd2fa0799cc7f307b0245a3bbbdb43226126e7ec267cc0593cc25dc4 not found: ID does not exist" Sep 07 04:04:02.342693 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.342650 2566 scope.go:117] "RemoveContainer" containerID="5549f792928ae73b4b816b0693f54b1de59fb3c153866bc18752eabd30c024e6" Sep 07 04:04:02.342915 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.342884 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5549f792928ae73b4b816b0693f54b1de59fb3c153866bc18752eabd30c024e6"} err="failed to get container status \"5549f792928ae73b4b816b0693f54b1de59fb3c153866bc18752eabd30c024e6\": rpc error: code = NotFound desc = could not find container \"5549f792928ae73b4b816b0693f54b1de59fb3c153866bc18752eabd30c024e6\": container with ID starting with 5549f792928ae73b4b816b0693f54b1de59fb3c153866bc18752eabd30c024e6 not found: ID does not exist" Sep 07 04:04:02.342915 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.342908 2566 scope.go:117] "RemoveContainer" containerID="687455cfba8da9a3550a1e645c56336e0d092c10b096bdcaa763ba2231907658" Sep 07 04:04:02.343280 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.343058 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 07 04:04:02.343280 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.343114 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-m686k\"" Sep 07 04:04:02.343280 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.343121 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 07 04:04:02.343280 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.343128 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 07 04:04:02.343280 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.343172 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 07 04:04:02.343280 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.343199 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 07 04:04:02.343280 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.343121 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 07 04:04:02.343280 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.343273 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"687455cfba8da9a3550a1e645c56336e0d092c10b096bdcaa763ba2231907658"} err="failed to get container status \"687455cfba8da9a3550a1e645c56336e0d092c10b096bdcaa763ba2231907658\": rpc error: code = NotFound desc = could not find container \"687455cfba8da9a3550a1e645c56336e0d092c10b096bdcaa763ba2231907658\": container with ID starting with 687455cfba8da9a3550a1e645c56336e0d092c10b096bdcaa763ba2231907658 not found: ID does not exist" Sep 07 04:04:02.343726 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.343327 2566 scope.go:117] "RemoveContainer" containerID="cafd8472aeaa93e56a07525aa43433d2c97a5870a2d76c4ef8acb072c31fa7ce" Sep 07 04:04:02.343726 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.343454 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 07 04:04:02.343726 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.343510 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 07 04:04:02.343726 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.343670 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cafd8472aeaa93e56a07525aa43433d2c97a5870a2d76c4ef8acb072c31fa7ce"} err="failed to get container status \"cafd8472aeaa93e56a07525aa43433d2c97a5870a2d76c4ef8acb072c31fa7ce\": rpc error: code = NotFound desc = could not find container \"cafd8472aeaa93e56a07525aa43433d2c97a5870a2d76c4ef8acb072c31fa7ce\": container with ID starting with cafd8472aeaa93e56a07525aa43433d2c97a5870a2d76c4ef8acb072c31fa7ce not found: ID does not exist" Sep 07 04:04:02.343726 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.343692 2566 scope.go:117] "RemoveContainer" containerID="c5c0315bfe4ae5a7bb157ca978ddb9eacb79341d757abd364b59eaf18bb15876" Sep 07 04:04:02.343949 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.343902 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 07 04:04:02.344000 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.343952 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 07 04:04:02.344000 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.343964 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5c0315bfe4ae5a7bb157ca978ddb9eacb79341d757abd364b59eaf18bb15876"} err="failed to get container status \"c5c0315bfe4ae5a7bb157ca978ddb9eacb79341d757abd364b59eaf18bb15876\": rpc error: code = NotFound desc = could not find container \"c5c0315bfe4ae5a7bb157ca978ddb9eacb79341d757abd364b59eaf18bb15876\": container with ID starting with c5c0315bfe4ae5a7bb157ca978ddb9eacb79341d757abd364b59eaf18bb15876 not found: ID does not exist" Sep 07 04:04:02.344000 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.343987 2566 scope.go:117] "RemoveContainer" containerID="6868366269c07417f6ea3e1e5b24c0124e9c50b26033a47bf4255f7b36698d12" Sep 07 04:04:02.344310 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.344254 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6868366269c07417f6ea3e1e5b24c0124e9c50b26033a47bf4255f7b36698d12"} err="failed to get container status \"6868366269c07417f6ea3e1e5b24c0124e9c50b26033a47bf4255f7b36698d12\": rpc error: code = NotFound desc = could not find container \"6868366269c07417f6ea3e1e5b24c0124e9c50b26033a47bf4255f7b36698d12\": container with ID starting with 6868366269c07417f6ea3e1e5b24c0124e9c50b26033a47bf4255f7b36698d12 not found: ID does not exist" Sep 07 04:04:02.344310 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.344272 2566 scope.go:117] "RemoveContainer" containerID="7c406cfac349ab797002865bf21979ca1cc6121965c46dc25af1b4d285aeb50a" Sep 07 04:04:02.344446 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.344310 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 07 04:04:02.344446 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.344367 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 07 04:04:02.344446 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.344367 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 07 04:04:02.344695 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.344664 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2dk60ii37d3q5\"" Sep 07 04:04:02.344812 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.344732 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c406cfac349ab797002865bf21979ca1cc6121965c46dc25af1b4d285aeb50a"} err="failed to get container status \"7c406cfac349ab797002865bf21979ca1cc6121965c46dc25af1b4d285aeb50a\": rpc error: code = NotFound desc = could not find container \"7c406cfac349ab797002865bf21979ca1cc6121965c46dc25af1b4d285aeb50a\": container with ID starting with 7c406cfac349ab797002865bf21979ca1cc6121965c46dc25af1b4d285aeb50a not found: ID does not exist" Sep 07 04:04:02.344812 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.344779 2566 scope.go:117] "RemoveContainer" containerID="6f9133b3fd2fa0799cc7f307b0245a3bbbdb43226126e7ec267cc0593cc25dc4" Sep 07 04:04:02.345122 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.345097 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f9133b3fd2fa0799cc7f307b0245a3bbbdb43226126e7ec267cc0593cc25dc4"} err="failed to get container status \"6f9133b3fd2fa0799cc7f307b0245a3bbbdb43226126e7ec267cc0593cc25dc4\": rpc error: code = NotFound desc = could not find container \"6f9133b3fd2fa0799cc7f307b0245a3bbbdb43226126e7ec267cc0593cc25dc4\": container with ID starting with 6f9133b3fd2fa0799cc7f307b0245a3bbbdb43226126e7ec267cc0593cc25dc4 not found: ID does not exist" Sep 07 04:04:02.345242 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.345125 2566 scope.go:117] "RemoveContainer" containerID="5549f792928ae73b4b816b0693f54b1de59fb3c153866bc18752eabd30c024e6" Sep 07 04:04:02.345468 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.345444 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5549f792928ae73b4b816b0693f54b1de59fb3c153866bc18752eabd30c024e6"} err="failed to get container status \"5549f792928ae73b4b816b0693f54b1de59fb3c153866bc18752eabd30c024e6\": rpc error: code = NotFound desc = could not find container \"5549f792928ae73b4b816b0693f54b1de59fb3c153866bc18752eabd30c024e6\": container with ID starting with 5549f792928ae73b4b816b0693f54b1de59fb3c153866bc18752eabd30c024e6 not found: ID does not exist" Sep 07 04:04:02.345468 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.345471 2566 scope.go:117] "RemoveContainer" containerID="687455cfba8da9a3550a1e645c56336e0d092c10b096bdcaa763ba2231907658" Sep 07 04:04:02.345803 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.345758 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"687455cfba8da9a3550a1e645c56336e0d092c10b096bdcaa763ba2231907658"} err="failed to get container status \"687455cfba8da9a3550a1e645c56336e0d092c10b096bdcaa763ba2231907658\": rpc error: code = NotFound desc = could not find container \"687455cfba8da9a3550a1e645c56336e0d092c10b096bdcaa763ba2231907658\": container with ID starting with 687455cfba8da9a3550a1e645c56336e0d092c10b096bdcaa763ba2231907658 not found: ID does not exist" Sep 07 04:04:02.345803 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.345795 2566 scope.go:117] "RemoveContainer" containerID="cafd8472aeaa93e56a07525aa43433d2c97a5870a2d76c4ef8acb072c31fa7ce" Sep 07 04:04:02.346248 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.346153 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cafd8472aeaa93e56a07525aa43433d2c97a5870a2d76c4ef8acb072c31fa7ce"} err="failed to get container status \"cafd8472aeaa93e56a07525aa43433d2c97a5870a2d76c4ef8acb072c31fa7ce\": rpc error: code = NotFound desc = could not find container \"cafd8472aeaa93e56a07525aa43433d2c97a5870a2d76c4ef8acb072c31fa7ce\": container with ID starting with cafd8472aeaa93e56a07525aa43433d2c97a5870a2d76c4ef8acb072c31fa7ce not found: ID does not exist" Sep 07 04:04:02.346248 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.346178 2566 scope.go:117] "RemoveContainer" containerID="c5c0315bfe4ae5a7bb157ca978ddb9eacb79341d757abd364b59eaf18bb15876" Sep 07 04:04:02.346716 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.346697 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 07 04:04:02.346814 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.346791 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5c0315bfe4ae5a7bb157ca978ddb9eacb79341d757abd364b59eaf18bb15876"} err="failed to get container status \"c5c0315bfe4ae5a7bb157ca978ddb9eacb79341d757abd364b59eaf18bb15876\": rpc error: code = NotFound desc = could not find container \"c5c0315bfe4ae5a7bb157ca978ddb9eacb79341d757abd364b59eaf18bb15876\": container with ID starting with c5c0315bfe4ae5a7bb157ca978ddb9eacb79341d757abd364b59eaf18bb15876 not found: ID does not exist" Sep 07 04:04:02.346885 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.346815 2566 scope.go:117] "RemoveContainer" containerID="6868366269c07417f6ea3e1e5b24c0124e9c50b26033a47bf4255f7b36698d12" Sep 07 04:04:02.347186 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.347167 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6868366269c07417f6ea3e1e5b24c0124e9c50b26033a47bf4255f7b36698d12"} err="failed to get container status \"6868366269c07417f6ea3e1e5b24c0124e9c50b26033a47bf4255f7b36698d12\": rpc error: code = NotFound desc = could not find container \"6868366269c07417f6ea3e1e5b24c0124e9c50b26033a47bf4255f7b36698d12\": container with ID starting with 6868366269c07417f6ea3e1e5b24c0124e9c50b26033a47bf4255f7b36698d12 not found: ID does not exist" Sep 07 04:04:02.347272 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.347188 2566 scope.go:117] "RemoveContainer" containerID="7c406cfac349ab797002865bf21979ca1cc6121965c46dc25af1b4d285aeb50a" Sep 07 04:04:02.347499 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.347481 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c406cfac349ab797002865bf21979ca1cc6121965c46dc25af1b4d285aeb50a"} err="failed to get container status \"7c406cfac349ab797002865bf21979ca1cc6121965c46dc25af1b4d285aeb50a\": rpc error: code = NotFound desc = could not find container \"7c406cfac349ab797002865bf21979ca1cc6121965c46dc25af1b4d285aeb50a\": container with ID starting with 7c406cfac349ab797002865bf21979ca1cc6121965c46dc25af1b4d285aeb50a not found: ID does not exist" Sep 07 04:04:02.347579 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.347525 2566 scope.go:117] "RemoveContainer" containerID="6f9133b3fd2fa0799cc7f307b0245a3bbbdb43226126e7ec267cc0593cc25dc4" Sep 07 04:04:02.347962 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.347938 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f9133b3fd2fa0799cc7f307b0245a3bbbdb43226126e7ec267cc0593cc25dc4"} err="failed to get container status \"6f9133b3fd2fa0799cc7f307b0245a3bbbdb43226126e7ec267cc0593cc25dc4\": rpc error: code = NotFound desc = could not find container \"6f9133b3fd2fa0799cc7f307b0245a3bbbdb43226126e7ec267cc0593cc25dc4\": container with ID starting with 6f9133b3fd2fa0799cc7f307b0245a3bbbdb43226126e7ec267cc0593cc25dc4 not found: ID does not exist" Sep 07 04:04:02.348051 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.347964 2566 scope.go:117] "RemoveContainer" containerID="5549f792928ae73b4b816b0693f54b1de59fb3c153866bc18752eabd30c024e6" Sep 07 04:04:02.348241 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.348220 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5549f792928ae73b4b816b0693f54b1de59fb3c153866bc18752eabd30c024e6"} err="failed to get container status \"5549f792928ae73b4b816b0693f54b1de59fb3c153866bc18752eabd30c024e6\": rpc error: code = NotFound desc = could not find container \"5549f792928ae73b4b816b0693f54b1de59fb3c153866bc18752eabd30c024e6\": container with ID starting with 5549f792928ae73b4b816b0693f54b1de59fb3c153866bc18752eabd30c024e6 not found: ID does not exist" Sep 07 04:04:02.348296 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.348244 2566 scope.go:117] "RemoveContainer" containerID="687455cfba8da9a3550a1e645c56336e0d092c10b096bdcaa763ba2231907658" Sep 07 04:04:02.348561 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.348535 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"687455cfba8da9a3550a1e645c56336e0d092c10b096bdcaa763ba2231907658"} err="failed to get container status \"687455cfba8da9a3550a1e645c56336e0d092c10b096bdcaa763ba2231907658\": rpc error: code = NotFound desc = could not find container \"687455cfba8da9a3550a1e645c56336e0d092c10b096bdcaa763ba2231907658\": container with ID starting with 687455cfba8da9a3550a1e645c56336e0d092c10b096bdcaa763ba2231907658 not found: ID does not exist" Sep 07 04:04:02.348714 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.348680 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 07 04:04:02.355756 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.355737 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 04:04:02.444348 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.444319 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-config\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.444694 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.444355 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.444694 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.444381 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.444694 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.444449 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.444694 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.444505 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.444694 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.444534 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.444694 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.444555 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.444694 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.444574 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.444694 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.444590 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.444694 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.444607 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.444694 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.444667 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.444694 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.444696 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.445020 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.444716 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb9jb\" (UniqueName: \"kubernetes.io/projected/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-kube-api-access-cb9jb\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.445020 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.444736 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.445020 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.444763 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.445020 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.444812 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-config-out\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.445020 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.444831 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.445020 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.444859 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.445020 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.444884 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.445020 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.444926 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-web-config\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.461360 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.461333 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bshbg"] Sep 07 04:04:02.464266 ip-10-0-143-125 kubenswrapper[2566]: W0907 04:04:02.464241 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a95bb08_5b63_4bb7_9f7e_0e60e1c9e3c9.slice/crio-b1ac9aae99b34108fa788fcab1d6c712cc78aef3fcb6ec7cc2f98ce3b7a5e8c7 WatchSource:0}: Error finding container b1ac9aae99b34108fa788fcab1d6c712cc78aef3fcb6ec7cc2f98ce3b7a5e8c7: Status 404 returned error can't find the container with id b1ac9aae99b34108fa788fcab1d6c712cc78aef3fcb6ec7cc2f98ce3b7a5e8c7 Sep 07 04:04:02.466161 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.466145 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 07 04:04:02.545694 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.545616 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.545694 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.545705 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.545947 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.545735 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.545947 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.545754 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.545947 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.545771 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.545947 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.545788 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.545947 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.545812 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.545947 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.545832 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb9jb\" (UniqueName: \"kubernetes.io/projected/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-kube-api-access-cb9jb\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.545947 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.545859 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.545947 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.545887 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.545947 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.545929 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-config-out\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.546383 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.545960 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.546383 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.545983 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.546383 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.546011 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.546383 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.546046 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-web-config\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.546383 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.546084 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-config\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.546383 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.546108 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.546383 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.546145 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.546383 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.546187 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.546383 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.546222 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.546383 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.546334 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.546900 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.546611 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.547678 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.547407 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.549249 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.548016 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.549588 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.549557 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.549700 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.549670 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.550313 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.549815 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.550313 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.549948 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.550313 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.550108 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.550313 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.550258 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.550660 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.550339 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.550660 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.550353 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.550660 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.550608 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.550780 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.550732 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-config-out\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.550941 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.550918 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.551236 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.551215 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.552177 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.552159 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-web-config\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.552259 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.552217 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.552481 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.552463 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-config\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.554554 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.554534 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb9jb\" (UniqueName: \"kubernetes.io/projected/70d82b4e-adfd-4d09-a179-e801eb7d7cf7-kube-api-access-cb9jb\") pod \"prometheus-k8s-0\" (UID: \"70d82b4e-adfd-4d09-a179-e801eb7d7cf7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.651348 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.651259 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:04:02.928590 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:02.928515 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 04:04:02.931639 ip-10-0-143-125 kubenswrapper[2566]: W0907 04:04:02.931600 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70d82b4e_adfd_4d09_a179_e801eb7d7cf7.slice/crio-024985b67fd0e7f0dd5170f50efe83e8c2d69be375f627953c8f8f714ac8ee11 WatchSource:0}: Error finding container 024985b67fd0e7f0dd5170f50efe83e8c2d69be375f627953c8f8f714ac8ee11: Status 404 returned error can't find the container with id 024985b67fd0e7f0dd5170f50efe83e8c2d69be375f627953c8f8f714ac8ee11 Sep 07 04:04:03.291645 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:03.291554 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bshbg" event={"ID":"2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9","Type":"ContainerStarted","Data":"b1ac9aae99b34108fa788fcab1d6c712cc78aef3fcb6ec7cc2f98ce3b7a5e8c7"} Sep 07 04:04:03.293281 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:03.293248 2566 generic.go:356] "Generic (PLEG): container finished" podID="70d82b4e-adfd-4d09-a179-e801eb7d7cf7" containerID="1373f2f9b7d2d6cd357edac742a10867d6580122bd978d8ff274528cfc9457b4" exitCode=0 Sep 07 04:04:03.293402 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:03.293344 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"70d82b4e-adfd-4d09-a179-e801eb7d7cf7","Type":"ContainerDied","Data":"1373f2f9b7d2d6cd357edac742a10867d6580122bd978d8ff274528cfc9457b4"} Sep 07 04:04:03.293475 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:03.293420 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"70d82b4e-adfd-4d09-a179-e801eb7d7cf7","Type":"ContainerStarted","Data":"024985b67fd0e7f0dd5170f50efe83e8c2d69be375f627953c8f8f714ac8ee11"} Sep 07 04:04:04.088093 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:04.088064 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f99c6f7-eb4a-437c-b6b3-f188c8ce5436" path="/var/lib/kubelet/pods/0f99c6f7-eb4a-437c-b6b3-f188c8ce5436/volumes" Sep 07 04:04:04.300222 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:04.300183 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bshbg" event={"ID":"2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9","Type":"ContainerStarted","Data":"d1666c646c9b2a2e2a0b301ffb1e4cb8e1a86f068052266904e0091fe572dd25"} Sep 07 04:04:04.300415 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:04.300236 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bshbg" event={"ID":"2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9","Type":"ContainerStarted","Data":"8d066cb963cde5f664cf2e1dd8695adc28bbb0d64373ffdae09ac9c2680e4330"} Sep 07 04:04:04.303257 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:04.303235 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"70d82b4e-adfd-4d09-a179-e801eb7d7cf7","Type":"ContainerStarted","Data":"728d9e0e076b289728f64e823c87f5e32cd50c0c82637f5f795ef9b60ba8c2d3"} Sep 07 04:04:04.303367 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:04.303284 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"70d82b4e-adfd-4d09-a179-e801eb7d7cf7","Type":"ContainerStarted","Data":"1ea78b7f33486370bc3fb837049489d3d7465777eab1609fdfa7f19ae642f2f9"} Sep 07 04:04:04.303367 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:04.303310 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"70d82b4e-adfd-4d09-a179-e801eb7d7cf7","Type":"ContainerStarted","Data":"7a575c77b658242db486c528fe54ed2b2bb1861a1cb9fa2c269111e7a9367fec"} Sep 07 04:04:04.303367 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:04.303335 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"70d82b4e-adfd-4d09-a179-e801eb7d7cf7","Type":"ContainerStarted","Data":"ad474bbf1779daeb45fc141192d912ac17b5ce8f78e48b230047db193380a67c"} Sep 07 04:04:04.303367 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:04.303362 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"70d82b4e-adfd-4d09-a179-e801eb7d7cf7","Type":"ContainerStarted","Data":"8abf9b2ff646f986567302e07471729bb617dc0f9cf84d1f3bdec714a0c05fb3"} Sep 07 04:04:04.303580 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:04.303394 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"70d82b4e-adfd-4d09-a179-e801eb7d7cf7","Type":"ContainerStarted","Data":"622a5b66f0fd321f9b1afc642d53da5dff0e2f66716752fbecf2dc054c4119cd"} Sep 07 04:04:04.314786 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:04.314740 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bshbg" podStartSLOduration=375.243423483 podStartE2EDuration="6m16.314700412s" totalImagesPullingTime="1.071276929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 03:57:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:04:04.313881173 +0000 UTC m=+376.734255901" watchObservedRunningTime="2026-09-07 04:04:04.314700412 +0000 UTC m=+376.735075132" Sep 07 04:04:04.339325 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:04.339215 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.317763587 podStartE2EDuration="2.339194481s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.430894ms" isStatefulPod=false podCreationTimestamp="2026-09-07 04:04:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:04:04.337044476 +0000 UTC m=+376.757419200" watchObservedRunningTime="2026-09-07 04:04:04.339194481 +0000 UTC m=+376.759569206" Sep 07 04:04:07.651651 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:04:07.651584 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:05:02.651580 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:05:02.651545 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:05:02.666951 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:05:02.666923 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:05:03.537921 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:05:03.537896 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 04:06:55.533451 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:06:55.533406 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-zxpk2"] Sep 07 04:06:55.536706 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:06:55.536689 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-zxpk2" Sep 07 04:06:55.540068 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:06:55.540046 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 07 04:06:55.540857 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:06:55.540842 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\"" Sep 07 04:06:55.541070 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:06:55.541051 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 07 04:06:55.541178 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:06:55.541159 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\"" Sep 07 04:06:55.542678 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:06:55.542655 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-7fl4r\"" Sep 07 04:06:55.544002 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:06:55.543982 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\"" Sep 07 04:06:55.560121 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:06:55.560098 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef56d82c-0dd6-4ff5-9ef3-6f8ba8e3aac0-tmp\") pod \"opendatahub-operator-controller-manager-74f7b546fd-zxpk2\" (UID: \"ef56d82c-0dd6-4ff5-9ef3-6f8ba8e3aac0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-zxpk2" Sep 07 04:06:55.560215 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:06:55.560131 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ef56d82c-0dd6-4ff5-9ef3-6f8ba8e3aac0-manifests\") pod \"opendatahub-operator-controller-manager-74f7b546fd-zxpk2\" (UID: \"ef56d82c-0dd6-4ff5-9ef3-6f8ba8e3aac0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-zxpk2" Sep 07 04:06:55.560215 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:06:55.560165 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef56d82c-0dd6-4ff5-9ef3-6f8ba8e3aac0-webhook-cert\") pod \"opendatahub-operator-controller-manager-74f7b546fd-zxpk2\" (UID: \"ef56d82c-0dd6-4ff5-9ef3-6f8ba8e3aac0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-zxpk2" Sep 07 04:06:55.560351 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:06:55.560215 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ef56d82c-0dd6-4ff5-9ef3-6f8ba8e3aac0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74f7b546fd-zxpk2\" (UID: \"ef56d82c-0dd6-4ff5-9ef3-6f8ba8e3aac0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-zxpk2" Sep 07 04:06:55.560351 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:06:55.560245 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef56d82c-0dd6-4ff5-9ef3-6f8ba8e3aac0-metrics-cert\") pod \"opendatahub-operator-controller-manager-74f7b546fd-zxpk2\" (UID: \"ef56d82c-0dd6-4ff5-9ef3-6f8ba8e3aac0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-zxpk2" Sep 07 04:06:55.560351 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:06:55.560262 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sbcc\" (UniqueName: \"kubernetes.io/projected/ef56d82c-0dd6-4ff5-9ef3-6f8ba8e3aac0-kube-api-access-6sbcc\") pod \"opendatahub-operator-controller-manager-74f7b546fd-zxpk2\" (UID: \"ef56d82c-0dd6-4ff5-9ef3-6f8ba8e3aac0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-zxpk2" Sep 07 04:06:55.570516 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:06:55.570489 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-zxpk2"] Sep 07 04:06:55.661389 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:06:55.661353 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef56d82c-0dd6-4ff5-9ef3-6f8ba8e3aac0-tmp\") pod \"opendatahub-operator-controller-manager-74f7b546fd-zxpk2\" (UID: \"ef56d82c-0dd6-4ff5-9ef3-6f8ba8e3aac0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-zxpk2" Sep 07 04:06:55.661579 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:06:55.661404 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ef56d82c-0dd6-4ff5-9ef3-6f8ba8e3aac0-manifests\") pod \"opendatahub-operator-controller-manager-74f7b546fd-zxpk2\" (UID: \"ef56d82c-0dd6-4ff5-9ef3-6f8ba8e3aac0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-zxpk2" Sep 07 04:06:55.661579 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:06:55.661448 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef56d82c-0dd6-4ff5-9ef3-6f8ba8e3aac0-webhook-cert\") pod \"opendatahub-operator-controller-manager-74f7b546fd-zxpk2\" (UID: \"ef56d82c-0dd6-4ff5-9ef3-6f8ba8e3aac0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-zxpk2" Sep 07 04:06:55.661579 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:06:55.661471 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ef56d82c-0dd6-4ff5-9ef3-6f8ba8e3aac0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74f7b546fd-zxpk2\" (UID: \"ef56d82c-0dd6-4ff5-9ef3-6f8ba8e3aac0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-zxpk2" Sep 07 04:06:55.661579 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:06:55.661497 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef56d82c-0dd6-4ff5-9ef3-6f8ba8e3aac0-metrics-cert\") pod \"opendatahub-operator-controller-manager-74f7b546fd-zxpk2\" (UID: \"ef56d82c-0dd6-4ff5-9ef3-6f8ba8e3aac0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-zxpk2" Sep 07 04:06:55.661579 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:06:55.661523 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sbcc\" (UniqueName: \"kubernetes.io/projected/ef56d82c-0dd6-4ff5-9ef3-6f8ba8e3aac0-kube-api-access-6sbcc\") pod \"opendatahub-operator-controller-manager-74f7b546fd-zxpk2\" (UID: \"ef56d82c-0dd6-4ff5-9ef3-6f8ba8e3aac0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-zxpk2" Sep 07 04:06:55.661900 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:06:55.661869 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ef56d82c-0dd6-4ff5-9ef3-6f8ba8e3aac0-manifests\") pod \"opendatahub-operator-controller-manager-74f7b546fd-zxpk2\" (UID: \"ef56d82c-0dd6-4ff5-9ef3-6f8ba8e3aac0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-zxpk2" Sep 07 04:06:55.663789 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:06:55.663763 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef56d82c-0dd6-4ff5-9ef3-6f8ba8e3aac0-tmp\") pod \"opendatahub-operator-controller-manager-74f7b546fd-zxpk2\" (UID: \"ef56d82c-0dd6-4ff5-9ef3-6f8ba8e3aac0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-zxpk2" Sep 07 04:06:55.664015 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:06:55.663997 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef56d82c-0dd6-4ff5-9ef3-6f8ba8e3aac0-webhook-cert\") pod \"opendatahub-operator-controller-manager-74f7b546fd-zxpk2\" (UID: \"ef56d82c-0dd6-4ff5-9ef3-6f8ba8e3aac0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-zxpk2" Sep 07 04:06:55.664056 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:06:55.664019 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ef56d82c-0dd6-4ff5-9ef3-6f8ba8e3aac0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74f7b546fd-zxpk2\" (UID: \"ef56d82c-0dd6-4ff5-9ef3-6f8ba8e3aac0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-zxpk2" Sep 07 04:06:55.664164 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:06:55.664143 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef56d82c-0dd6-4ff5-9ef3-6f8ba8e3aac0-metrics-cert\") pod \"opendatahub-operator-controller-manager-74f7b546fd-zxpk2\" (UID: \"ef56d82c-0dd6-4ff5-9ef3-6f8ba8e3aac0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-zxpk2" Sep 07 04:06:55.680121 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:06:55.680097 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sbcc\" (UniqueName: \"kubernetes.io/projected/ef56d82c-0dd6-4ff5-9ef3-6f8ba8e3aac0-kube-api-access-6sbcc\") pod \"opendatahub-operator-controller-manager-74f7b546fd-zxpk2\" (UID: \"ef56d82c-0dd6-4ff5-9ef3-6f8ba8e3aac0\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-zxpk2" Sep 07 04:06:55.846936 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:06:55.846905 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-zxpk2" Sep 07 04:06:56.130297 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:06:56.130207 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-zxpk2"] Sep 07 04:06:56.136475 ip-10-0-143-125 kubenswrapper[2566]: W0907 04:06:56.136440 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef56d82c_0dd6_4ff5_9ef3_6f8ba8e3aac0.slice/crio-42bb55601cc67b2285f80b5664482ff3c8a5f864baa231a2cb918e9b6abde851 WatchSource:0}: Error finding container 42bb55601cc67b2285f80b5664482ff3c8a5f864baa231a2cb918e9b6abde851: Status 404 returned error can't find the container with id 42bb55601cc67b2285f80b5664482ff3c8a5f864baa231a2cb918e9b6abde851 Sep 07 04:06:56.954561 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:06:56.954464 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-zxpk2" event={"ID":"ef56d82c-0dd6-4ff5-9ef3-6f8ba8e3aac0","Type":"ContainerStarted","Data":"42bb55601cc67b2285f80b5664482ff3c8a5f864baa231a2cb918e9b6abde851"} Sep 07 04:06:59.970145 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:06:59.970048 2566 generic.go:356] "Generic (PLEG): container finished" podID="ef56d82c-0dd6-4ff5-9ef3-6f8ba8e3aac0" containerID="32188d82e2eced7af4b96dd035f0fea6dd141ac021b6884a5938daf8b55fa6cc" exitCode=0 Sep 07 04:06:59.970498 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:06:59.970140 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-zxpk2" event={"ID":"ef56d82c-0dd6-4ff5-9ef3-6f8ba8e3aac0","Type":"ContainerDied","Data":"32188d82e2eced7af4b96dd035f0fea6dd141ac021b6884a5938daf8b55fa6cc"} Sep 07 04:07:00.976184 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:00.976146 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-zxpk2" event={"ID":"ef56d82c-0dd6-4ff5-9ef3-6f8ba8e3aac0","Type":"ContainerStarted","Data":"c8940b583d3b43ea54dfcea8479b150935954432015479a44264567d4e5981df"} Sep 07 04:07:00.976559 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:00.976250 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-zxpk2" Sep 07 04:07:00.998056 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:00.997999 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-zxpk2" podStartSLOduration=2.253548252 podStartE2EDuration="5.997984593s" totalImagesPullingTime="3.303955083s" totalInitContainerRuntime="440.481258ms" isStatefulPod=false podCreationTimestamp="2026-09-07 04:06:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:07:00.996890236 +0000 UTC m=+553.417264959" watchObservedRunningTime="2026-09-07 04:07:00.997984593 +0000 UTC m=+553.418359387" Sep 07 04:07:11.983298 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:11.983262 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-74f7b546fd-zxpk2" Sep 07 04:07:13.260611 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:13.260576 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-f5lfn"] Sep 07 04:07:13.263952 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:13.263930 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-f5lfn" Sep 07 04:07:13.266090 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:13.266068 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Sep 07 04:07:13.266090 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:13.266085 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-dhv8z\"" Sep 07 04:07:13.266251 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:13.266166 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Sep 07 04:07:13.276544 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:13.276520 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-f5lfn"] Sep 07 04:07:13.312873 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:13.312840 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrslj\" (UniqueName: \"kubernetes.io/projected/676e66b4-0d66-4afa-a69e-d5c207fa0898-kube-api-access-rrslj\") pod \"cert-manager-operator-controller-manager-684f79c9b9-f5lfn\" (UID: \"676e66b4-0d66-4afa-a69e-d5c207fa0898\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-f5lfn" Sep 07 04:07:13.313034 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:13.312881 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/676e66b4-0d66-4afa-a69e-d5c207fa0898-tmp\") pod \"cert-manager-operator-controller-manager-684f79c9b9-f5lfn\" (UID: \"676e66b4-0d66-4afa-a69e-d5c207fa0898\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-f5lfn" Sep 07 04:07:13.413995 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:13.413939 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrslj\" (UniqueName: \"kubernetes.io/projected/676e66b4-0d66-4afa-a69e-d5c207fa0898-kube-api-access-rrslj\") pod \"cert-manager-operator-controller-manager-684f79c9b9-f5lfn\" (UID: \"676e66b4-0d66-4afa-a69e-d5c207fa0898\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-f5lfn" Sep 07 04:07:13.413995 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:13.414001 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/676e66b4-0d66-4afa-a69e-d5c207fa0898-tmp\") pod \"cert-manager-operator-controller-manager-684f79c9b9-f5lfn\" (UID: \"676e66b4-0d66-4afa-a69e-d5c207fa0898\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-f5lfn" Sep 07 04:07:13.414381 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:13.414363 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/676e66b4-0d66-4afa-a69e-d5c207fa0898-tmp\") pod \"cert-manager-operator-controller-manager-684f79c9b9-f5lfn\" (UID: \"676e66b4-0d66-4afa-a69e-d5c207fa0898\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-f5lfn" Sep 07 04:07:13.429432 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:13.429395 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrslj\" (UniqueName: \"kubernetes.io/projected/676e66b4-0d66-4afa-a69e-d5c207fa0898-kube-api-access-rrslj\") pod \"cert-manager-operator-controller-manager-684f79c9b9-f5lfn\" (UID: \"676e66b4-0d66-4afa-a69e-d5c207fa0898\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-f5lfn" Sep 07 04:07:13.572822 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:13.572741 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-f5lfn" Sep 07 04:07:13.859652 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:13.859613 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-f5lfn"] Sep 07 04:07:13.862720 ip-10-0-143-125 kubenswrapper[2566]: W0907 04:07:13.862694 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod676e66b4_0d66_4afa_a69e_d5c207fa0898.slice/crio-be3d47a5b2d6affc05506bfd2fd5d0eb4258f244477f3f913419b92818e65f97 WatchSource:0}: Error finding container be3d47a5b2d6affc05506bfd2fd5d0eb4258f244477f3f913419b92818e65f97: Status 404 returned error can't find the container with id be3d47a5b2d6affc05506bfd2fd5d0eb4258f244477f3f913419b92818e65f97 Sep 07 04:07:14.026975 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:14.026940 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-f5lfn" event={"ID":"676e66b4-0d66-4afa-a69e-d5c207fa0898","Type":"ContainerStarted","Data":"be3d47a5b2d6affc05506bfd2fd5d0eb4258f244477f3f913419b92818e65f97"} Sep 07 04:07:17.045164 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:17.045128 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-f5lfn" event={"ID":"676e66b4-0d66-4afa-a69e-d5c207fa0898","Type":"ContainerStarted","Data":"6835bdb5a6c8ad952aec27baa954c50b463a2997f3eee8005f70e5913dd7a868"} Sep 07 04:07:17.065761 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:17.065700 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-f5lfn" podStartSLOduration=1.300902182 podStartE2EDuration="4.065677733s" totalImagesPullingTime="2.764775551s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:07:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:07:17.063695963 +0000 UTC m=+569.484070687" watchObservedRunningTime="2026-09-07 04:07:17.065677733 +0000 UTC m=+569.486052459" Sep 07 04:07:19.983743 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:19.983705 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-ffcddf5cd-rxtxh"] Sep 07 04:07:19.987066 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:19.987047 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-ffcddf5cd-rxtxh" Sep 07 04:07:19.989325 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:19.989302 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 07 04:07:19.989447 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:19.989302 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 07 04:07:19.989643 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:19.989618 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Sep 07 04:07:19.990070 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:19.990046 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-h4k9r\"" Sep 07 04:07:19.999579 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:19.999556 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-ffcddf5cd-rxtxh"] Sep 07 04:07:20.078069 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:20.078033 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6s7v\" (UniqueName: \"kubernetes.io/projected/338a2503-988e-4e12-a460-3b24fa7f5fd8-kube-api-access-g6s7v\") pod \"dns-operator-controller-manager-ffcddf5cd-rxtxh\" (UID: \"338a2503-988e-4e12-a460-3b24fa7f5fd8\") " pod="kuadrant-system/dns-operator-controller-manager-ffcddf5cd-rxtxh" Sep 07 04:07:20.179027 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:20.178992 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6s7v\" (UniqueName: \"kubernetes.io/projected/338a2503-988e-4e12-a460-3b24fa7f5fd8-kube-api-access-g6s7v\") pod \"dns-operator-controller-manager-ffcddf5cd-rxtxh\" (UID: \"338a2503-988e-4e12-a460-3b24fa7f5fd8\") " pod="kuadrant-system/dns-operator-controller-manager-ffcddf5cd-rxtxh" Sep 07 04:07:20.186387 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:20.186357 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6s7v\" (UniqueName: \"kubernetes.io/projected/338a2503-988e-4e12-a460-3b24fa7f5fd8-kube-api-access-g6s7v\") pod \"dns-operator-controller-manager-ffcddf5cd-rxtxh\" (UID: \"338a2503-988e-4e12-a460-3b24fa7f5fd8\") " pod="kuadrant-system/dns-operator-controller-manager-ffcddf5cd-rxtxh" Sep 07 04:07:20.296623 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:20.296536 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-ffcddf5cd-rxtxh" Sep 07 04:07:20.569834 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:20.569753 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-ffcddf5cd-rxtxh"] Sep 07 04:07:20.572553 ip-10-0-143-125 kubenswrapper[2566]: W0907 04:07:20.572523 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod338a2503_988e_4e12_a460_3b24fa7f5fd8.slice/crio-e502285bc0b3548ffbbf5eabe90f1cea18d3a66e72ba5139ca40fb2f5b00476e WatchSource:0}: Error finding container e502285bc0b3548ffbbf5eabe90f1cea18d3a66e72ba5139ca40fb2f5b00476e: Status 404 returned error can't find the container with id e502285bc0b3548ffbbf5eabe90f1cea18d3a66e72ba5139ca40fb2f5b00476e Sep 07 04:07:21.063189 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:21.063154 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-ffcddf5cd-rxtxh" event={"ID":"338a2503-988e-4e12-a460-3b24fa7f5fd8","Type":"ContainerStarted","Data":"e502285bc0b3548ffbbf5eabe90f1cea18d3a66e72ba5139ca40fb2f5b00476e"} Sep 07 04:07:21.108754 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:21.108711 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-2gf2p"] Sep 07 04:07:21.113662 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:21.113616 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2gf2p" Sep 07 04:07:21.115815 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:21.115784 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 07 04:07:21.115962 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:21.115817 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 07 04:07:21.116443 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:21.116422 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-xvsw8\"" Sep 07 04:07:21.128892 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:21.128867 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-2gf2p"] Sep 07 04:07:21.194388 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:21.194353 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/028cb1ba-ae79-4f82-9afa-b0ba30f66a08-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-2gf2p\" (UID: \"028cb1ba-ae79-4f82-9afa-b0ba30f66a08\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2gf2p" Sep 07 04:07:21.194556 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:21.194481 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fncv5\" (UniqueName: \"kubernetes.io/projected/028cb1ba-ae79-4f82-9afa-b0ba30f66a08-kube-api-access-fncv5\") pod \"cert-manager-cainjector-559cdd8c87-2gf2p\" (UID: \"028cb1ba-ae79-4f82-9afa-b0ba30f66a08\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2gf2p" Sep 07 04:07:21.295090 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:21.295045 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fncv5\" (UniqueName: \"kubernetes.io/projected/028cb1ba-ae79-4f82-9afa-b0ba30f66a08-kube-api-access-fncv5\") pod \"cert-manager-cainjector-559cdd8c87-2gf2p\" (UID: \"028cb1ba-ae79-4f82-9afa-b0ba30f66a08\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2gf2p" Sep 07 04:07:21.295274 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:21.295127 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/028cb1ba-ae79-4f82-9afa-b0ba30f66a08-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-2gf2p\" (UID: \"028cb1ba-ae79-4f82-9afa-b0ba30f66a08\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2gf2p" Sep 07 04:07:21.305012 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:21.304957 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/028cb1ba-ae79-4f82-9afa-b0ba30f66a08-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-2gf2p\" (UID: \"028cb1ba-ae79-4f82-9afa-b0ba30f66a08\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2gf2p" Sep 07 04:07:21.305169 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:21.305017 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fncv5\" (UniqueName: \"kubernetes.io/projected/028cb1ba-ae79-4f82-9afa-b0ba30f66a08-kube-api-access-fncv5\") pod \"cert-manager-cainjector-559cdd8c87-2gf2p\" (UID: \"028cb1ba-ae79-4f82-9afa-b0ba30f66a08\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2gf2p" Sep 07 04:07:21.434420 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:21.434376 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2gf2p" Sep 07 04:07:21.722974 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:21.722714 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-2gf2p"] Sep 07 04:07:21.725871 ip-10-0-143-125 kubenswrapper[2566]: W0907 04:07:21.725822 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod028cb1ba_ae79_4f82_9afa_b0ba30f66a08.slice/crio-e664d030b453fb8e0d3ca9b109645855f410fe9037bfd94cbadaf802a2afd43e WatchSource:0}: Error finding container e664d030b453fb8e0d3ca9b109645855f410fe9037bfd94cbadaf802a2afd43e: Status 404 returned error can't find the container with id e664d030b453fb8e0d3ca9b109645855f410fe9037bfd94cbadaf802a2afd43e Sep 07 04:07:22.070833 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:22.070751 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2gf2p" event={"ID":"028cb1ba-ae79-4f82-9afa-b0ba30f66a08","Type":"ContainerStarted","Data":"e664d030b453fb8e0d3ca9b109645855f410fe9037bfd94cbadaf802a2afd43e"} Sep 07 04:07:23.077762 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:23.077719 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-ffcddf5cd-rxtxh" event={"ID":"338a2503-988e-4e12-a460-3b24fa7f5fd8","Type":"ContainerStarted","Data":"275f922a8a88205b6f97b4565ea44a575d9187d7ff66c94b72fb4019df03eb39"} Sep 07 04:07:23.078163 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:23.077884 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-ffcddf5cd-rxtxh" Sep 07 04:07:23.092968 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:23.092920 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-ffcddf5cd-rxtxh" podStartSLOduration=1.674472529 podStartE2EDuration="4.092900164s" totalImagesPullingTime="2.418427635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:07:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:07:23.09168201 +0000 UTC m=+575.512056733" watchObservedRunningTime="2026-09-07 04:07:23.092900164 +0000 UTC m=+575.513274888" Sep 07 04:07:25.502377 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:25.502339 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-pw9qh"] Sep 07 04:07:25.505805 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:25.505782 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-pw9qh" Sep 07 04:07:25.507652 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:25.507624 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-2zvvg\"" Sep 07 04:07:25.512563 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:25.512534 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-pw9qh"] Sep 07 04:07:25.633715 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:25.633679 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b59rp\" (UniqueName: \"kubernetes.io/projected/ce326a64-a55d-43f5-a057-d45c632a4ee5-kube-api-access-b59rp\") pod \"cert-manager-webhook-6486ffd997-pw9qh\" (UID: \"ce326a64-a55d-43f5-a057-d45c632a4ee5\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pw9qh" Sep 07 04:07:25.633875 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:25.633780 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce326a64-a55d-43f5-a057-d45c632a4ee5-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-pw9qh\" (UID: \"ce326a64-a55d-43f5-a057-d45c632a4ee5\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pw9qh" Sep 07 04:07:25.734995 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:25.734952 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce326a64-a55d-43f5-a057-d45c632a4ee5-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-pw9qh\" (UID: \"ce326a64-a55d-43f5-a057-d45c632a4ee5\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pw9qh" Sep 07 04:07:25.735198 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:25.735017 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b59rp\" (UniqueName: \"kubernetes.io/projected/ce326a64-a55d-43f5-a057-d45c632a4ee5-kube-api-access-b59rp\") pod \"cert-manager-webhook-6486ffd997-pw9qh\" (UID: \"ce326a64-a55d-43f5-a057-d45c632a4ee5\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pw9qh" Sep 07 04:07:25.742694 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:25.742662 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce326a64-a55d-43f5-a057-d45c632a4ee5-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-pw9qh\" (UID: \"ce326a64-a55d-43f5-a057-d45c632a4ee5\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pw9qh" Sep 07 04:07:25.742869 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:25.742848 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b59rp\" (UniqueName: \"kubernetes.io/projected/ce326a64-a55d-43f5-a057-d45c632a4ee5-kube-api-access-b59rp\") pod \"cert-manager-webhook-6486ffd997-pw9qh\" (UID: \"ce326a64-a55d-43f5-a057-d45c632a4ee5\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pw9qh" Sep 07 04:07:25.815848 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:25.815762 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-pw9qh" Sep 07 04:07:26.092271 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:26.092250 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-pw9qh"] Sep 07 04:07:26.093553 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:26.093525 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2gf2p" event={"ID":"028cb1ba-ae79-4f82-9afa-b0ba30f66a08","Type":"ContainerStarted","Data":"80a408ce9391c225da5fc258304e18853c405e0dd40b4cb5ea928594170c7c13"} Sep 07 04:07:26.094425 ip-10-0-143-125 kubenswrapper[2566]: W0907 04:07:26.094401 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce326a64_a55d_43f5_a057_d45c632a4ee5.slice/crio-6ed633f82d42945f92eff476971c719c0d17a76c456429f0cb8f176f03ce2eb4 WatchSource:0}: Error finding container 6ed633f82d42945f92eff476971c719c0d17a76c456429f0cb8f176f03ce2eb4: Status 404 returned error can't find the container with id 6ed633f82d42945f92eff476971c719c0d17a76c456429f0cb8f176f03ce2eb4 Sep 07 04:07:26.112591 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:26.112535 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2gf2p" podStartSLOduration=1.7557845840000001 podStartE2EDuration="5.112514728s" totalImagesPullingTime="3.356730144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:07:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:07:26.110414343 +0000 UTC m=+578.530789067" watchObservedRunningTime="2026-09-07 04:07:26.112514728 +0000 UTC m=+578.532889452" Sep 07 04:07:27.099043 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:27.098998 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-pw9qh" event={"ID":"ce326a64-a55d-43f5-a057-d45c632a4ee5","Type":"ContainerStarted","Data":"b439a6d277b73dc73a4c3a75cf86a768ff869317ee5cbc3b6599a601636ee8b4"} Sep 07 04:07:27.099043 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:27.099045 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-pw9qh" event={"ID":"ce326a64-a55d-43f5-a057-d45c632a4ee5","Type":"ContainerStarted","Data":"6ed633f82d42945f92eff476971c719c0d17a76c456429f0cb8f176f03ce2eb4"} Sep 07 04:07:27.099537 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:27.099221 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-pw9qh" Sep 07 04:07:27.117495 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:27.117448 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-pw9qh" podStartSLOduration=2.117427597 podStartE2EDuration="2.117427597s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:07:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:07:27.116829904 +0000 UTC m=+579.537204618" watchObservedRunningTime="2026-09-07 04:07:27.117427597 +0000 UTC m=+579.537802319" Sep 07 04:07:29.008541 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:29.008509 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-wc8jp"] Sep 07 04:07:29.011999 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:29.011981 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-wc8jp" Sep 07 04:07:29.013927 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:29.013906 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-5f4m5\"" Sep 07 04:07:29.027664 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:29.027614 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-wc8jp"] Sep 07 04:07:29.166312 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:29.166272 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6c28a05f-61e3-42ed-bdbf-9aef711ec933-bound-sa-token\") pod \"cert-manager-55b4d954d5-wc8jp\" (UID: \"6c28a05f-61e3-42ed-bdbf-9aef711ec933\") " pod="cert-manager/cert-manager-55b4d954d5-wc8jp" Sep 07 04:07:29.166492 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:29.166419 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-627q2\" (UniqueName: \"kubernetes.io/projected/6c28a05f-61e3-42ed-bdbf-9aef711ec933-kube-api-access-627q2\") pod \"cert-manager-55b4d954d5-wc8jp\" (UID: \"6c28a05f-61e3-42ed-bdbf-9aef711ec933\") " pod="cert-manager/cert-manager-55b4d954d5-wc8jp" Sep 07 04:07:29.267999 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:29.267899 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-627q2\" (UniqueName: \"kubernetes.io/projected/6c28a05f-61e3-42ed-bdbf-9aef711ec933-kube-api-access-627q2\") pod \"cert-manager-55b4d954d5-wc8jp\" (UID: \"6c28a05f-61e3-42ed-bdbf-9aef711ec933\") " pod="cert-manager/cert-manager-55b4d954d5-wc8jp" Sep 07 04:07:29.267999 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:29.267951 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6c28a05f-61e3-42ed-bdbf-9aef711ec933-bound-sa-token\") pod \"cert-manager-55b4d954d5-wc8jp\" (UID: \"6c28a05f-61e3-42ed-bdbf-9aef711ec933\") " pod="cert-manager/cert-manager-55b4d954d5-wc8jp" Sep 07 04:07:29.277035 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:29.277009 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6c28a05f-61e3-42ed-bdbf-9aef711ec933-bound-sa-token\") pod \"cert-manager-55b4d954d5-wc8jp\" (UID: \"6c28a05f-61e3-42ed-bdbf-9aef711ec933\") " pod="cert-manager/cert-manager-55b4d954d5-wc8jp" Sep 07 04:07:29.277151 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:29.277053 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-627q2\" (UniqueName: \"kubernetes.io/projected/6c28a05f-61e3-42ed-bdbf-9aef711ec933-kube-api-access-627q2\") pod \"cert-manager-55b4d954d5-wc8jp\" (UID: \"6c28a05f-61e3-42ed-bdbf-9aef711ec933\") " pod="cert-manager/cert-manager-55b4d954d5-wc8jp" Sep 07 04:07:29.320451 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:29.320419 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-wc8jp" Sep 07 04:07:29.591152 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:29.591123 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-wc8jp"] Sep 07 04:07:29.593544 ip-10-0-143-125 kubenswrapper[2566]: W0907 04:07:29.593508 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6c28a05f_61e3_42ed_bdbf_9aef711ec933.slice/crio-ea1ba685b7dbe7f5ea239323ffce95a3bbe485c6c7961284580e98065115f9b4 WatchSource:0}: Error finding container ea1ba685b7dbe7f5ea239323ffce95a3bbe485c6c7961284580e98065115f9b4: Status 404 returned error can't find the container with id ea1ba685b7dbe7f5ea239323ffce95a3bbe485c6c7961284580e98065115f9b4 Sep 07 04:07:30.116113 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:30.116074 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-wc8jp" event={"ID":"6c28a05f-61e3-42ed-bdbf-9aef711ec933","Type":"ContainerStarted","Data":"d80601a90fa4d6ee41111737bfe14b6f2013ab79c06f5f32ce506ef9dabcca01"} Sep 07 04:07:30.116113 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:30.116120 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-wc8jp" event={"ID":"6c28a05f-61e3-42ed-bdbf-9aef711ec933","Type":"ContainerStarted","Data":"ea1ba685b7dbe7f5ea239323ffce95a3bbe485c6c7961284580e98065115f9b4"} Sep 07 04:07:30.138701 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:30.138646 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-wc8jp" podStartSLOduration=2.138614749 podStartE2EDuration="2.138614749s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:07:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:07:30.137713138 +0000 UTC m=+582.558087864" watchObservedRunningTime="2026-09-07 04:07:30.138614749 +0000 UTC m=+582.558989471" Sep 07 04:07:33.106218 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:33.106185 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-pw9qh" Sep 07 04:07:34.087666 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:34.087620 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-ffcddf5cd-rxtxh" Sep 07 04:07:37.305349 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:37.305316 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6fd86d77b4-hc58n"] Sep 07 04:07:37.309142 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:37.309121 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6fd86d77b4-hc58n" Sep 07 04:07:37.311519 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:37.311492 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Sep 07 04:07:37.311611 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:37.311553 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 07 04:07:37.311695 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:37.311649 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Sep 07 04:07:37.312258 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:37.312237 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-f4xzj\"" Sep 07 04:07:37.312341 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:37.312273 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 07 04:07:37.320457 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:37.320435 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6fd86d77b4-hc58n"] Sep 07 04:07:37.343971 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:37.343940 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c2ccd4e-3510-4560-954b-d41701d688d5-tmp\") pod \"kube-auth-proxy-6fd86d77b4-hc58n\" (UID: \"0c2ccd4e-3510-4560-954b-d41701d688d5\") " pod="openshift-ingress/kube-auth-proxy-6fd86d77b4-hc58n" Sep 07 04:07:37.344135 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:37.343982 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0c2ccd4e-3510-4560-954b-d41701d688d5-tls-certs\") pod \"kube-auth-proxy-6fd86d77b4-hc58n\" (UID: \"0c2ccd4e-3510-4560-954b-d41701d688d5\") " pod="openshift-ingress/kube-auth-proxy-6fd86d77b4-hc58n" Sep 07 04:07:37.344135 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:37.344090 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d68q5\" (UniqueName: \"kubernetes.io/projected/0c2ccd4e-3510-4560-954b-d41701d688d5-kube-api-access-d68q5\") pod \"kube-auth-proxy-6fd86d77b4-hc58n\" (UID: \"0c2ccd4e-3510-4560-954b-d41701d688d5\") " pod="openshift-ingress/kube-auth-proxy-6fd86d77b4-hc58n" Sep 07 04:07:37.445086 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:37.445049 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c2ccd4e-3510-4560-954b-d41701d688d5-tmp\") pod \"kube-auth-proxy-6fd86d77b4-hc58n\" (UID: \"0c2ccd4e-3510-4560-954b-d41701d688d5\") " pod="openshift-ingress/kube-auth-proxy-6fd86d77b4-hc58n" Sep 07 04:07:37.445274 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:37.445140 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0c2ccd4e-3510-4560-954b-d41701d688d5-tls-certs\") pod \"kube-auth-proxy-6fd86d77b4-hc58n\" (UID: \"0c2ccd4e-3510-4560-954b-d41701d688d5\") " pod="openshift-ingress/kube-auth-proxy-6fd86d77b4-hc58n" Sep 07 04:07:37.445274 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:37.445233 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d68q5\" (UniqueName: \"kubernetes.io/projected/0c2ccd4e-3510-4560-954b-d41701d688d5-kube-api-access-d68q5\") pod \"kube-auth-proxy-6fd86d77b4-hc58n\" (UID: \"0c2ccd4e-3510-4560-954b-d41701d688d5\") " pod="openshift-ingress/kube-auth-proxy-6fd86d77b4-hc58n" Sep 07 04:07:37.445738 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:07:37.445707 2566 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Sep 07 04:07:37.445861 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:07:37.445795 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c2ccd4e-3510-4560-954b-d41701d688d5-tls-certs podName:0c2ccd4e-3510-4560-954b-d41701d688d5 nodeName:}" failed. No retries permitted until 2026-09-07 04:07:37.945771565 +0000 UTC m=+590.366146280 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/0c2ccd4e-3510-4560-954b-d41701d688d5-tls-certs") pod "kube-auth-proxy-6fd86d77b4-hc58n" (UID: "0c2ccd4e-3510-4560-954b-d41701d688d5") : secret "kube-auth-proxy-tls" not found Sep 07 04:07:37.448325 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:37.448302 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c2ccd4e-3510-4560-954b-d41701d688d5-tmp\") pod \"kube-auth-proxy-6fd86d77b4-hc58n\" (UID: \"0c2ccd4e-3510-4560-954b-d41701d688d5\") " pod="openshift-ingress/kube-auth-proxy-6fd86d77b4-hc58n" Sep 07 04:07:37.464743 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:37.464711 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d68q5\" (UniqueName: \"kubernetes.io/projected/0c2ccd4e-3510-4560-954b-d41701d688d5-kube-api-access-d68q5\") pod \"kube-auth-proxy-6fd86d77b4-hc58n\" (UID: \"0c2ccd4e-3510-4560-954b-d41701d688d5\") " pod="openshift-ingress/kube-auth-proxy-6fd86d77b4-hc58n" Sep 07 04:07:37.948050 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:37.948013 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0c2ccd4e-3510-4560-954b-d41701d688d5-tls-certs\") pod \"kube-auth-proxy-6fd86d77b4-hc58n\" (UID: \"0c2ccd4e-3510-4560-954b-d41701d688d5\") " pod="openshift-ingress/kube-auth-proxy-6fd86d77b4-hc58n" Sep 07 04:07:37.950663 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:37.950602 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0c2ccd4e-3510-4560-954b-d41701d688d5-tls-certs\") pod \"kube-auth-proxy-6fd86d77b4-hc58n\" (UID: \"0c2ccd4e-3510-4560-954b-d41701d688d5\") " pod="openshift-ingress/kube-auth-proxy-6fd86d77b4-hc58n" Sep 07 04:07:38.220840 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:38.220760 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6fd86d77b4-hc58n" Sep 07 04:07:38.503936 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:38.503907 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6fd86d77b4-hc58n"] Sep 07 04:07:38.506228 ip-10-0-143-125 kubenswrapper[2566]: W0907 04:07:38.506192 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c2ccd4e_3510_4560_954b_d41701d688d5.slice/crio-b5212468183c1d976966683104f94764327dd54645d0b3f0d52708b3301fa638 WatchSource:0}: Error finding container b5212468183c1d976966683104f94764327dd54645d0b3f0d52708b3301fa638: Status 404 returned error can't find the container with id b5212468183c1d976966683104f94764327dd54645d0b3f0d52708b3301fa638 Sep 07 04:07:39.162337 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:39.162296 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6fd86d77b4-hc58n" event={"ID":"0c2ccd4e-3510-4560-954b-d41701d688d5","Type":"ContainerStarted","Data":"b5212468183c1d976966683104f94764327dd54645d0b3f0d52708b3301fa638"} Sep 07 04:07:41.175067 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:41.175032 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6fd86d77b4-hc58n" event={"ID":"0c2ccd4e-3510-4560-954b-d41701d688d5","Type":"ContainerStarted","Data":"475a98c2325eacc7c9abebbf10441b7f9534a39b8a9a84073046f539cfbaed71"} Sep 07 04:07:41.190070 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:41.190019 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6fd86d77b4-hc58n" podStartSLOduration=1.988237136 podStartE2EDuration="4.189999382s" totalImagesPullingTime="2.201762246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:07:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:07:41.188948242 +0000 UTC m=+593.609322978" watchObservedRunningTime="2026-09-07 04:07:41.189999382 +0000 UTC m=+593.610374108" Sep 07 04:07:47.309645 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:47.309603 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-ltlv4"] Sep 07 04:07:47.313444 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:47.313421 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-ltlv4" Sep 07 04:07:47.315469 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:47.315450 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-45n7m\"" Sep 07 04:07:47.315554 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:47.315456 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Sep 07 04:07:47.322542 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:47.322515 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-ltlv4"] Sep 07 04:07:47.420226 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:47.420193 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-ltlv4"] Sep 07 04:07:47.425752 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:47.425717 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h9l5\" (UniqueName: \"kubernetes.io/projected/287ed5cc-9879-4839-a987-b856604fe4e9-kube-api-access-5h9l5\") pod \"limitador-limitador-859c4d96d6-ltlv4\" (UID: \"287ed5cc-9879-4839-a987-b856604fe4e9\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-ltlv4" Sep 07 04:07:47.425881 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:47.425766 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/287ed5cc-9879-4839-a987-b856604fe4e9-config-file\") pod \"limitador-limitador-859c4d96d6-ltlv4\" (UID: \"287ed5cc-9879-4839-a987-b856604fe4e9\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-ltlv4" Sep 07 04:07:47.527087 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:47.527046 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h9l5\" (UniqueName: \"kubernetes.io/projected/287ed5cc-9879-4839-a987-b856604fe4e9-kube-api-access-5h9l5\") pod \"limitador-limitador-859c4d96d6-ltlv4\" (UID: \"287ed5cc-9879-4839-a987-b856604fe4e9\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-ltlv4" Sep 07 04:07:47.527087 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:47.527087 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/287ed5cc-9879-4839-a987-b856604fe4e9-config-file\") pod \"limitador-limitador-859c4d96d6-ltlv4\" (UID: \"287ed5cc-9879-4839-a987-b856604fe4e9\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-ltlv4" Sep 07 04:07:47.527752 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:47.527734 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/287ed5cc-9879-4839-a987-b856604fe4e9-config-file\") pod \"limitador-limitador-859c4d96d6-ltlv4\" (UID: \"287ed5cc-9879-4839-a987-b856604fe4e9\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-ltlv4" Sep 07 04:07:47.535706 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:47.535673 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h9l5\" (UniqueName: \"kubernetes.io/projected/287ed5cc-9879-4839-a987-b856604fe4e9-kube-api-access-5h9l5\") pod \"limitador-limitador-859c4d96d6-ltlv4\" (UID: \"287ed5cc-9879-4839-a987-b856604fe4e9\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-ltlv4" Sep 07 04:07:47.624671 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:47.624612 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-ltlv4" Sep 07 04:07:47.753135 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:47.753105 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-6xzx4"] Sep 07 04:07:47.756705 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:47.756684 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-6xzx4" Sep 07 04:07:47.758727 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:47.758702 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Sep 07 04:07:47.758857 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:47.758703 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Sep 07 04:07:47.766555 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:47.766530 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-6xzx4"] Sep 07 04:07:47.829523 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:47.829490 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c901f05c-651c-4d08-8fe8-1c3582415288-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-6xzx4\" (UID: \"c901f05c-651c-4d08-8fe8-1c3582415288\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-6xzx4" Sep 07 04:07:47.829719 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:47.829538 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c901f05c-651c-4d08-8fe8-1c3582415288-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-6xzx4\" (UID: \"c901f05c-651c-4d08-8fe8-1c3582415288\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-6xzx4" Sep 07 04:07:47.829719 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:47.829577 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h6pw\" (UniqueName: \"kubernetes.io/projected/c901f05c-651c-4d08-8fe8-1c3582415288-kube-api-access-5h6pw\") pod \"kuadrant-console-plugin-598f86468b-6xzx4\" (UID: \"c901f05c-651c-4d08-8fe8-1c3582415288\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-6xzx4" Sep 07 04:07:47.899980 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:47.899953 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-ltlv4"] Sep 07 04:07:47.902310 ip-10-0-143-125 kubenswrapper[2566]: W0907 04:07:47.902285 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod287ed5cc_9879_4839_a987_b856604fe4e9.slice/crio-1d1953134d21cb266e150baa1d5a850835909ced7d6ac4890f8aac1995248f50 WatchSource:0}: Error finding container 1d1953134d21cb266e150baa1d5a850835909ced7d6ac4890f8aac1995248f50: Status 404 returned error can't find the container with id 1d1953134d21cb266e150baa1d5a850835909ced7d6ac4890f8aac1995248f50 Sep 07 04:07:47.930816 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:47.930789 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c901f05c-651c-4d08-8fe8-1c3582415288-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-6xzx4\" (UID: \"c901f05c-651c-4d08-8fe8-1c3582415288\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-6xzx4" Sep 07 04:07:47.930911 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:47.930827 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c901f05c-651c-4d08-8fe8-1c3582415288-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-6xzx4\" (UID: \"c901f05c-651c-4d08-8fe8-1c3582415288\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-6xzx4" Sep 07 04:07:47.930911 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:47.930870 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h6pw\" (UniqueName: \"kubernetes.io/projected/c901f05c-651c-4d08-8fe8-1c3582415288-kube-api-access-5h6pw\") pod \"kuadrant-console-plugin-598f86468b-6xzx4\" (UID: \"c901f05c-651c-4d08-8fe8-1c3582415288\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-6xzx4" Sep 07 04:07:47.931421 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:47.931385 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c901f05c-651c-4d08-8fe8-1c3582415288-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-6xzx4\" (UID: \"c901f05c-651c-4d08-8fe8-1c3582415288\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-6xzx4" Sep 07 04:07:47.933254 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:47.933232 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c901f05c-651c-4d08-8fe8-1c3582415288-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-6xzx4\" (UID: \"c901f05c-651c-4d08-8fe8-1c3582415288\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-6xzx4" Sep 07 04:07:47.937677 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:47.937648 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h6pw\" (UniqueName: \"kubernetes.io/projected/c901f05c-651c-4d08-8fe8-1c3582415288-kube-api-access-5h6pw\") pod \"kuadrant-console-plugin-598f86468b-6xzx4\" (UID: \"c901f05c-651c-4d08-8fe8-1c3582415288\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-6xzx4" Sep 07 04:07:48.067467 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:48.067438 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-6xzx4" Sep 07 04:07:48.210548 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:48.210401 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-ltlv4" event={"ID":"287ed5cc-9879-4839-a987-b856604fe4e9","Type":"ContainerStarted","Data":"1d1953134d21cb266e150baa1d5a850835909ced7d6ac4890f8aac1995248f50"} Sep 07 04:07:48.254060 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:48.254034 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-bgrfr_9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a/console-operator/2.log" Sep 07 04:07:48.254429 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:48.254405 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-bgrfr_9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a/console-operator/2.log" Sep 07 04:07:48.340285 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:48.340252 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-6xzx4"] Sep 07 04:07:48.343572 ip-10-0-143-125 kubenswrapper[2566]: W0907 04:07:48.343542 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc901f05c_651c_4d08_8fe8_1c3582415288.slice/crio-2e9302bbb7e1273a9bce24fc077dbc427105fafd60946451da137f37edd168cb WatchSource:0}: Error finding container 2e9302bbb7e1273a9bce24fc077dbc427105fafd60946451da137f37edd168cb: Status 404 returned error can't find the container with id 2e9302bbb7e1273a9bce24fc077dbc427105fafd60946451da137f37edd168cb Sep 07 04:07:48.393930 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:48.393897 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-c548b5d7d-x66pv"] Sep 07 04:07:48.398668 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:48.398623 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-x66pv" Sep 07 04:07:48.400695 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:48.400676 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-5zvg7\"" Sep 07 04:07:48.403558 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:48.403535 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-x66pv"] Sep 07 04:07:48.434730 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:48.434697 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbmh6\" (UniqueName: \"kubernetes.io/projected/e5f27982-9f0b-44a1-828d-b227183824d8-kube-api-access-xbmh6\") pod \"authorino-c548b5d7d-x66pv\" (UID: \"e5f27982-9f0b-44a1-828d-b227183824d8\") " pod="kuadrant-system/authorino-c548b5d7d-x66pv" Sep 07 04:07:48.535824 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:48.535752 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbmh6\" (UniqueName: \"kubernetes.io/projected/e5f27982-9f0b-44a1-828d-b227183824d8-kube-api-access-xbmh6\") pod \"authorino-c548b5d7d-x66pv\" (UID: \"e5f27982-9f0b-44a1-828d-b227183824d8\") " pod="kuadrant-system/authorino-c548b5d7d-x66pv" Sep 07 04:07:48.543425 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:48.543391 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbmh6\" (UniqueName: \"kubernetes.io/projected/e5f27982-9f0b-44a1-828d-b227183824d8-kube-api-access-xbmh6\") pod \"authorino-c548b5d7d-x66pv\" (UID: \"e5f27982-9f0b-44a1-828d-b227183824d8\") " pod="kuadrant-system/authorino-c548b5d7d-x66pv" Sep 07 04:07:48.708524 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:48.708486 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-x66pv" Sep 07 04:07:48.975272 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:48.975234 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-x66pv"] Sep 07 04:07:49.164115 ip-10-0-143-125 kubenswrapper[2566]: W0907 04:07:49.164081 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode5f27982_9f0b_44a1_828d_b227183824d8.slice/crio-f72a51439d42faee27139aae151178dd7872d61ea1b0bf7ccfdfd13ed137593b WatchSource:0}: Error finding container f72a51439d42faee27139aae151178dd7872d61ea1b0bf7ccfdfd13ed137593b: Status 404 returned error can't find the container with id f72a51439d42faee27139aae151178dd7872d61ea1b0bf7ccfdfd13ed137593b Sep 07 04:07:49.216248 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:49.216215 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-x66pv" event={"ID":"e5f27982-9f0b-44a1-828d-b227183824d8","Type":"ContainerStarted","Data":"f72a51439d42faee27139aae151178dd7872d61ea1b0bf7ccfdfd13ed137593b"} Sep 07 04:07:49.217544 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:49.217513 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-6xzx4" event={"ID":"c901f05c-651c-4d08-8fe8-1c3582415288","Type":"ContainerStarted","Data":"2e9302bbb7e1273a9bce24fc077dbc427105fafd60946451da137f37edd168cb"} Sep 07 04:07:50.227549 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:50.227509 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-ltlv4" event={"ID":"287ed5cc-9879-4839-a987-b856604fe4e9","Type":"ContainerStarted","Data":"da99214d2683725dbbe54f1b47010fdd8d63037522c86f6e6e936e577d88cea6"} Sep 07 04:07:50.228056 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:50.227623 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-ltlv4" Sep 07 04:07:50.244164 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:50.244102 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-859c4d96d6-ltlv4" podStartSLOduration=1.9265202970000002 podStartE2EDuration="3.244079682s" totalImagesPullingTime="1.317559385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:07:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:07:50.242045783 +0000 UTC m=+602.662420507" watchObservedRunningTime="2026-09-07 04:07:50.244079682 +0000 UTC m=+602.664454407" Sep 07 04:07:54.250924 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:54.250887 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-x66pv" event={"ID":"e5f27982-9f0b-44a1-828d-b227183824d8","Type":"ContainerStarted","Data":"3110fdf6ff1b792b0828e16cf826980ecfa4c9ebc5e3a96492686a65dcbdffa8"} Sep 07 04:07:54.252540 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:54.252513 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-6xzx4" event={"ID":"c901f05c-651c-4d08-8fe8-1c3582415288","Type":"ContainerStarted","Data":"1bb3805d7053d113a519949a0f890ad2fa4e6f7543f18355e672afb71119da93"} Sep 07 04:07:54.263625 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:54.263580 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-c548b5d7d-x66pv" podStartSLOduration=1.85383426 podStartE2EDuration="6.263565086s" totalImagesPullingTime="4.409730826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:07:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:07:54.262595914 +0000 UTC m=+606.682970648" watchObservedRunningTime="2026-09-07 04:07:54.263565086 +0000 UTC m=+606.683939808" Sep 07 04:07:54.277330 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:54.277288 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-6xzx4" podStartSLOduration=1.978750563 podStartE2EDuration="7.277275912s" totalImagesPullingTime="5.298525349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:07:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:07:54.275844577 +0000 UTC m=+606.696219301" watchObservedRunningTime="2026-09-07 04:07:54.277275912 +0000 UTC m=+606.697650634" Sep 07 04:07:57.134607 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:57.134570 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5bff798fc5-wfxmf"] Sep 07 04:07:57.187490 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:57.187452 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5bff798fc5-wfxmf"] Sep 07 04:07:57.187692 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:57.187551 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5bff798fc5-wfxmf" Sep 07 04:07:57.189839 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:57.189811 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Sep 07 04:07:57.190491 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:57.190458 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-pxj4q\"" Sep 07 04:07:57.190596 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:57.190500 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 07 04:07:57.190596 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:57.190506 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Sep 07 04:07:57.190596 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:57.190554 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 07 04:07:57.190789 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:57.190772 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Sep 07 04:07:57.314175 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:57.314145 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/382d33e3-78a3-4910-bf5a-3f14db6dce39-webhook-cert\") pod \"maas-controller-5bff798fc5-wfxmf\" (UID: \"382d33e3-78a3-4910-bf5a-3f14db6dce39\") " pod="opendatahub/maas-controller-5bff798fc5-wfxmf" Sep 07 04:07:57.314345 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:57.314194 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/382d33e3-78a3-4910-bf5a-3f14db6dce39-metrics-certs\") pod \"maas-controller-5bff798fc5-wfxmf\" (UID: \"382d33e3-78a3-4910-bf5a-3f14db6dce39\") " pod="opendatahub/maas-controller-5bff798fc5-wfxmf" Sep 07 04:07:57.314345 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:57.314230 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlvqd\" (UniqueName: \"kubernetes.io/projected/382d33e3-78a3-4910-bf5a-3f14db6dce39-kube-api-access-dlvqd\") pod \"maas-controller-5bff798fc5-wfxmf\" (UID: \"382d33e3-78a3-4910-bf5a-3f14db6dce39\") " pod="opendatahub/maas-controller-5bff798fc5-wfxmf" Sep 07 04:07:57.415082 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:57.415003 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/382d33e3-78a3-4910-bf5a-3f14db6dce39-metrics-certs\") pod \"maas-controller-5bff798fc5-wfxmf\" (UID: \"382d33e3-78a3-4910-bf5a-3f14db6dce39\") " pod="opendatahub/maas-controller-5bff798fc5-wfxmf" Sep 07 04:07:57.415082 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:57.415057 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlvqd\" (UniqueName: \"kubernetes.io/projected/382d33e3-78a3-4910-bf5a-3f14db6dce39-kube-api-access-dlvqd\") pod \"maas-controller-5bff798fc5-wfxmf\" (UID: \"382d33e3-78a3-4910-bf5a-3f14db6dce39\") " pod="opendatahub/maas-controller-5bff798fc5-wfxmf" Sep 07 04:07:57.415283 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:57.415137 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/382d33e3-78a3-4910-bf5a-3f14db6dce39-webhook-cert\") pod \"maas-controller-5bff798fc5-wfxmf\" (UID: \"382d33e3-78a3-4910-bf5a-3f14db6dce39\") " pod="opendatahub/maas-controller-5bff798fc5-wfxmf" Sep 07 04:07:57.415283 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:07:57.415249 2566 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Sep 07 04:07:57.415362 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:07:57.415318 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/382d33e3-78a3-4910-bf5a-3f14db6dce39-webhook-cert podName:382d33e3-78a3-4910-bf5a-3f14db6dce39 nodeName:}" failed. No retries permitted until 2026-09-07 04:07:57.915296463 +0000 UTC m=+610.335671188 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/382d33e3-78a3-4910-bf5a-3f14db6dce39-webhook-cert") pod "maas-controller-5bff798fc5-wfxmf" (UID: "382d33e3-78a3-4910-bf5a-3f14db6dce39") : secret "maas-controller-webhook-cert" not found Sep 07 04:07:57.417491 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:57.417469 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/382d33e3-78a3-4910-bf5a-3f14db6dce39-metrics-certs\") pod \"maas-controller-5bff798fc5-wfxmf\" (UID: \"382d33e3-78a3-4910-bf5a-3f14db6dce39\") " pod="opendatahub/maas-controller-5bff798fc5-wfxmf" Sep 07 04:07:57.426371 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:57.426345 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlvqd\" (UniqueName: \"kubernetes.io/projected/382d33e3-78a3-4910-bf5a-3f14db6dce39-kube-api-access-dlvqd\") pod \"maas-controller-5bff798fc5-wfxmf\" (UID: \"382d33e3-78a3-4910-bf5a-3f14db6dce39\") " pod="opendatahub/maas-controller-5bff798fc5-wfxmf" Sep 07 04:07:57.919012 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:57.918976 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/382d33e3-78a3-4910-bf5a-3f14db6dce39-webhook-cert\") pod \"maas-controller-5bff798fc5-wfxmf\" (UID: \"382d33e3-78a3-4910-bf5a-3f14db6dce39\") " pod="opendatahub/maas-controller-5bff798fc5-wfxmf" Sep 07 04:07:57.921386 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:57.921357 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/382d33e3-78a3-4910-bf5a-3f14db6dce39-webhook-cert\") pod \"maas-controller-5bff798fc5-wfxmf\" (UID: \"382d33e3-78a3-4910-bf5a-3f14db6dce39\") " pod="opendatahub/maas-controller-5bff798fc5-wfxmf" Sep 07 04:07:58.098472 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:58.098445 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5bff798fc5-wfxmf" Sep 07 04:07:58.374861 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:58.374822 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5bff798fc5-wfxmf"] Sep 07 04:07:58.377716 ip-10-0-143-125 kubenswrapper[2566]: W0907 04:07:58.377687 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod382d33e3_78a3_4910_bf5a_3f14db6dce39.slice/crio-66b9a053fdab76638b1b504bf91b3972e0abaaf99ecbfaf3843b0b972aa5f8d7 WatchSource:0}: Error finding container 66b9a053fdab76638b1b504bf91b3972e0abaaf99ecbfaf3843b0b972aa5f8d7: Status 404 returned error can't find the container with id 66b9a053fdab76638b1b504bf91b3972e0abaaf99ecbfaf3843b0b972aa5f8d7 Sep 07 04:07:59.277856 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:07:59.277816 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5bff798fc5-wfxmf" event={"ID":"382d33e3-78a3-4910-bf5a-3f14db6dce39","Type":"ContainerStarted","Data":"66b9a053fdab76638b1b504bf91b3972e0abaaf99ecbfaf3843b0b972aa5f8d7"} Sep 07 04:08:00.284448 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:00.284363 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5bff798fc5-wfxmf" event={"ID":"382d33e3-78a3-4910-bf5a-3f14db6dce39","Type":"ContainerStarted","Data":"11c7d02113ffe151c5225791ce9382584176b18ee5e03f30882c5ba2dd058521"} Sep 07 04:08:00.284844 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:00.284531 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5bff798fc5-wfxmf" Sep 07 04:08:01.234854 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:01.234824 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-ltlv4" Sep 07 04:08:01.250781 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:01.250735 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5bff798fc5-wfxmf" podStartSLOduration=2.679246277 podStartE2EDuration="4.250719536s" totalImagesPullingTime="1.571473259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:07:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:08:00.325011398 +0000 UTC m=+612.745386121" watchObservedRunningTime="2026-09-07 04:08:01.250719536 +0000 UTC m=+613.671094258" Sep 07 04:08:02.456713 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:02.456675 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-ltlv4"] Sep 07 04:08:02.457117 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:02.456874 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-859c4d96d6-ltlv4" podUID="287ed5cc-9879-4839-a987-b856604fe4e9" containerName="limitador" containerID="cri-o://da99214d2683725dbbe54f1b47010fdd8d63037522c86f6e6e936e577d88cea6" gracePeriod=30 Sep 07 04:08:03.299401 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:03.299358 2566 generic.go:356] "Generic (PLEG): container finished" podID="287ed5cc-9879-4839-a987-b856604fe4e9" containerID="da99214d2683725dbbe54f1b47010fdd8d63037522c86f6e6e936e577d88cea6" exitCode=0 Sep 07 04:08:03.299533 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:03.299424 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-ltlv4" event={"ID":"287ed5cc-9879-4839-a987-b856604fe4e9","Type":"ContainerDied","Data":"da99214d2683725dbbe54f1b47010fdd8d63037522c86f6e6e936e577d88cea6"} Sep 07 04:08:03.393942 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:03.393917 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-ltlv4" Sep 07 04:08:03.468958 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:03.468925 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/287ed5cc-9879-4839-a987-b856604fe4e9-config-file\") pod \"287ed5cc-9879-4839-a987-b856604fe4e9\" (UID: \"287ed5cc-9879-4839-a987-b856604fe4e9\") " Sep 07 04:08:03.469289 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:03.469017 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5h9l5\" (UniqueName: \"kubernetes.io/projected/287ed5cc-9879-4839-a987-b856604fe4e9-kube-api-access-5h9l5\") pod \"287ed5cc-9879-4839-a987-b856604fe4e9\" (UID: \"287ed5cc-9879-4839-a987-b856604fe4e9\") " Sep 07 04:08:03.469289 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:03.469271 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/287ed5cc-9879-4839-a987-b856604fe4e9-config-file" (OuterVolumeSpecName: "config-file") pod "287ed5cc-9879-4839-a987-b856604fe4e9" (UID: "287ed5cc-9879-4839-a987-b856604fe4e9"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 04:08:03.471294 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:03.471271 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/287ed5cc-9879-4839-a987-b856604fe4e9-kube-api-access-5h9l5" (OuterVolumeSpecName: "kube-api-access-5h9l5") pod "287ed5cc-9879-4839-a987-b856604fe4e9" (UID: "287ed5cc-9879-4839-a987-b856604fe4e9"). InnerVolumeSpecName "kube-api-access-5h9l5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 04:08:03.570309 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:03.570224 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5h9l5\" (UniqueName: \"kubernetes.io/projected/287ed5cc-9879-4839-a987-b856604fe4e9-kube-api-access-5h9l5\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\"" Sep 07 04:08:03.570309 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:03.570257 2566 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/287ed5cc-9879-4839-a987-b856604fe4e9-config-file\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\"" Sep 07 04:08:04.306528 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:04.306439 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-ltlv4" Sep 07 04:08:04.306528 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:04.306463 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-ltlv4" event={"ID":"287ed5cc-9879-4839-a987-b856604fe4e9","Type":"ContainerDied","Data":"1d1953134d21cb266e150baa1d5a850835909ced7d6ac4890f8aac1995248f50"} Sep 07 04:08:04.306528 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:04.306529 2566 scope.go:117] "RemoveContainer" containerID="da99214d2683725dbbe54f1b47010fdd8d63037522c86f6e6e936e577d88cea6" Sep 07 04:08:04.320828 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:04.320800 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-ltlv4"] Sep 07 04:08:04.322311 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:04.322288 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-ltlv4"] Sep 07 04:08:06.088184 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:06.088151 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="287ed5cc-9879-4839-a987-b856604fe4e9" path="/var/lib/kubelet/pods/287ed5cc-9879-4839-a987-b856604fe4e9/volumes" Sep 07 04:08:11.291675 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:11.291565 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5bff798fc5-wfxmf" Sep 07 04:08:11.420345 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:11.420302 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5bff798fc5-wfxmf"] Sep 07 04:08:11.420624 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:11.420551 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5bff798fc5-wfxmf" podUID="382d33e3-78a3-4910-bf5a-3f14db6dce39" containerName="manager" containerID="cri-o://11c7d02113ffe151c5225791ce9382584176b18ee5e03f30882c5ba2dd058521" gracePeriod=30 Sep 07 04:08:11.660120 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:11.660089 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5bff798fc5-wfxmf" Sep 07 04:08:11.745215 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:11.745182 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dlvqd\" (UniqueName: \"kubernetes.io/projected/382d33e3-78a3-4910-bf5a-3f14db6dce39-kube-api-access-dlvqd\") pod \"382d33e3-78a3-4910-bf5a-3f14db6dce39\" (UID: \"382d33e3-78a3-4910-bf5a-3f14db6dce39\") " Sep 07 04:08:11.745386 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:11.745225 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/382d33e3-78a3-4910-bf5a-3f14db6dce39-webhook-cert\") pod \"382d33e3-78a3-4910-bf5a-3f14db6dce39\" (UID: \"382d33e3-78a3-4910-bf5a-3f14db6dce39\") " Sep 07 04:08:11.745386 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:11.745241 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/382d33e3-78a3-4910-bf5a-3f14db6dce39-metrics-certs\") pod \"382d33e3-78a3-4910-bf5a-3f14db6dce39\" (UID: \"382d33e3-78a3-4910-bf5a-3f14db6dce39\") " Sep 07 04:08:11.747507 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:11.747472 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/382d33e3-78a3-4910-bf5a-3f14db6dce39-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "382d33e3-78a3-4910-bf5a-3f14db6dce39" (UID: "382d33e3-78a3-4910-bf5a-3f14db6dce39"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 04:08:11.747617 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:11.747512 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/382d33e3-78a3-4910-bf5a-3f14db6dce39-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "382d33e3-78a3-4910-bf5a-3f14db6dce39" (UID: "382d33e3-78a3-4910-bf5a-3f14db6dce39"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 04:08:11.747617 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:11.747526 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/382d33e3-78a3-4910-bf5a-3f14db6dce39-kube-api-access-dlvqd" (OuterVolumeSpecName: "kube-api-access-dlvqd") pod "382d33e3-78a3-4910-bf5a-3f14db6dce39" (UID: "382d33e3-78a3-4910-bf5a-3f14db6dce39"). InnerVolumeSpecName "kube-api-access-dlvqd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 04:08:11.846815 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:11.846784 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlvqd\" (UniqueName: \"kubernetes.io/projected/382d33e3-78a3-4910-bf5a-3f14db6dce39-kube-api-access-dlvqd\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\"" Sep 07 04:08:11.846815 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:11.846814 2566 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/382d33e3-78a3-4910-bf5a-3f14db6dce39-webhook-cert\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\"" Sep 07 04:08:11.846993 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:11.846823 2566 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/382d33e3-78a3-4910-bf5a-3f14db6dce39-metrics-certs\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\"" Sep 07 04:08:12.347555 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:12.347517 2566 generic.go:356] "Generic (PLEG): container finished" podID="382d33e3-78a3-4910-bf5a-3f14db6dce39" containerID="11c7d02113ffe151c5225791ce9382584176b18ee5e03f30882c5ba2dd058521" exitCode=0 Sep 07 04:08:12.347968 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:12.347576 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5bff798fc5-wfxmf" event={"ID":"382d33e3-78a3-4910-bf5a-3f14db6dce39","Type":"ContainerDied","Data":"11c7d02113ffe151c5225791ce9382584176b18ee5e03f30882c5ba2dd058521"} Sep 07 04:08:12.347968 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:12.347575 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5bff798fc5-wfxmf" Sep 07 04:08:12.347968 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:12.347648 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5bff798fc5-wfxmf" event={"ID":"382d33e3-78a3-4910-bf5a-3f14db6dce39","Type":"ContainerDied","Data":"66b9a053fdab76638b1b504bf91b3972e0abaaf99ecbfaf3843b0b972aa5f8d7"} Sep 07 04:08:12.347968 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:12.347680 2566 scope.go:117] "RemoveContainer" containerID="11c7d02113ffe151c5225791ce9382584176b18ee5e03f30882c5ba2dd058521" Sep 07 04:08:12.355953 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:12.355936 2566 scope.go:117] "RemoveContainer" containerID="11c7d02113ffe151c5225791ce9382584176b18ee5e03f30882c5ba2dd058521" Sep 07 04:08:12.356209 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:08:12.356190 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11c7d02113ffe151c5225791ce9382584176b18ee5e03f30882c5ba2dd058521\": container with ID starting with 11c7d02113ffe151c5225791ce9382584176b18ee5e03f30882c5ba2dd058521 not found: ID does not exist" containerID="11c7d02113ffe151c5225791ce9382584176b18ee5e03f30882c5ba2dd058521" Sep 07 04:08:12.356289 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:12.356216 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11c7d02113ffe151c5225791ce9382584176b18ee5e03f30882c5ba2dd058521"} err="failed to get container status \"11c7d02113ffe151c5225791ce9382584176b18ee5e03f30882c5ba2dd058521\": rpc error: code = NotFound desc = could not find container \"11c7d02113ffe151c5225791ce9382584176b18ee5e03f30882c5ba2dd058521\": container with ID starting with 11c7d02113ffe151c5225791ce9382584176b18ee5e03f30882c5ba2dd058521 not found: ID does not exist" Sep 07 04:08:12.361557 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:12.361532 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5bff798fc5-wfxmf"] Sep 07 04:08:12.364618 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:12.364598 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5bff798fc5-wfxmf"] Sep 07 04:08:14.088163 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:14.088124 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="382d33e3-78a3-4910-bf5a-3f14db6dce39" path="/var/lib/kubelet/pods/382d33e3-78a3-4910-bf5a-3f14db6dce39/volumes" Sep 07 04:08:29.679647 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:29.679311 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-85d49875c6-7kbmv"] Sep 07 04:08:29.683645 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:29.680182 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="287ed5cc-9879-4839-a987-b856604fe4e9" containerName="limitador" Sep 07 04:08:29.683645 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:29.680208 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="287ed5cc-9879-4839-a987-b856604fe4e9" containerName="limitador" Sep 07 04:08:29.683645 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:29.680230 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="382d33e3-78a3-4910-bf5a-3f14db6dce39" containerName="manager" Sep 07 04:08:29.683645 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:29.680239 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="382d33e3-78a3-4910-bf5a-3f14db6dce39" containerName="manager" Sep 07 04:08:29.683645 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:29.680335 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="382d33e3-78a3-4910-bf5a-3f14db6dce39" containerName="manager" Sep 07 04:08:29.683645 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:29.680350 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="287ed5cc-9879-4839-a987-b856604fe4e9" containerName="limitador" Sep 07 04:08:29.709309 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:29.708140 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-85d49875c6-7kbmv" Sep 07 04:08:29.709309 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:29.708023 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-85d49875c6-7kbmv"] Sep 07 04:08:29.709309 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:29.709010 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-7d548556bc-7pn2m"] Sep 07 04:08:29.718109 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:29.716885 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 07 04:08:29.718109 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:29.717737 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Sep 07 04:08:29.718109 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:29.717817 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-dbzmt\"" Sep 07 04:08:29.718109 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:29.717964 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 07 04:08:29.729240 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:29.723390 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-7d548556bc-7pn2m"] Sep 07 04:08:29.729240 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:29.723541 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-7d548556bc-7pn2m" Sep 07 04:08:29.729240 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:29.726349 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-smjst\"" Sep 07 04:08:29.729240 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:29.726563 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Sep 07 04:08:29.807077 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:29.807037 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/af3c83fe-1cc6-4ee7-95c4-f7aedb0087eb-cert\") pod \"kserve-controller-manager-85d49875c6-7kbmv\" (UID: \"af3c83fe-1cc6-4ee7-95c4-f7aedb0087eb\") " pod="opendatahub/kserve-controller-manager-85d49875c6-7kbmv" Sep 07 04:08:29.807376 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:29.807355 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9fgg\" (UniqueName: \"kubernetes.io/projected/af3c83fe-1cc6-4ee7-95c4-f7aedb0087eb-kube-api-access-v9fgg\") pod \"kserve-controller-manager-85d49875c6-7kbmv\" (UID: \"af3c83fe-1cc6-4ee7-95c4-f7aedb0087eb\") " pod="opendatahub/kserve-controller-manager-85d49875c6-7kbmv" Sep 07 04:08:29.807570 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:29.807553 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp6k6\" (UniqueName: \"kubernetes.io/projected/78f8f80b-8cdf-4ba1-944a-0e02dc3c8cb1-kube-api-access-zp6k6\") pod \"llmisvc-controller-manager-7d548556bc-7pn2m\" (UID: \"78f8f80b-8cdf-4ba1-944a-0e02dc3c8cb1\") " pod="opendatahub/llmisvc-controller-manager-7d548556bc-7pn2m" Sep 07 04:08:29.807778 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:29.807756 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/78f8f80b-8cdf-4ba1-944a-0e02dc3c8cb1-cert\") pod \"llmisvc-controller-manager-7d548556bc-7pn2m\" (UID: \"78f8f80b-8cdf-4ba1-944a-0e02dc3c8cb1\") " pod="opendatahub/llmisvc-controller-manager-7d548556bc-7pn2m" Sep 07 04:08:29.908948 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:29.908908 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/af3c83fe-1cc6-4ee7-95c4-f7aedb0087eb-cert\") pod \"kserve-controller-manager-85d49875c6-7kbmv\" (UID: \"af3c83fe-1cc6-4ee7-95c4-f7aedb0087eb\") " pod="opendatahub/kserve-controller-manager-85d49875c6-7kbmv" Sep 07 04:08:29.909232 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:29.909201 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9fgg\" (UniqueName: \"kubernetes.io/projected/af3c83fe-1cc6-4ee7-95c4-f7aedb0087eb-kube-api-access-v9fgg\") pod \"kserve-controller-manager-85d49875c6-7kbmv\" (UID: \"af3c83fe-1cc6-4ee7-95c4-f7aedb0087eb\") " pod="opendatahub/kserve-controller-manager-85d49875c6-7kbmv" Sep 07 04:08:29.910332 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:29.910305 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zp6k6\" (UniqueName: \"kubernetes.io/projected/78f8f80b-8cdf-4ba1-944a-0e02dc3c8cb1-kube-api-access-zp6k6\") pod \"llmisvc-controller-manager-7d548556bc-7pn2m\" (UID: \"78f8f80b-8cdf-4ba1-944a-0e02dc3c8cb1\") " pod="opendatahub/llmisvc-controller-manager-7d548556bc-7pn2m" Sep 07 04:08:29.910671 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:29.910620 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/78f8f80b-8cdf-4ba1-944a-0e02dc3c8cb1-cert\") pod \"llmisvc-controller-manager-7d548556bc-7pn2m\" (UID: \"78f8f80b-8cdf-4ba1-944a-0e02dc3c8cb1\") " pod="opendatahub/llmisvc-controller-manager-7d548556bc-7pn2m" Sep 07 04:08:29.910987 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:08:29.910970 2566 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Sep 07 04:08:29.911161 ip-10-0-143-125 kubenswrapper[2566]: E0907 04:08:29.911145 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78f8f80b-8cdf-4ba1-944a-0e02dc3c8cb1-cert podName:78f8f80b-8cdf-4ba1-944a-0e02dc3c8cb1 nodeName:}" failed. No retries permitted until 2026-09-07 04:08:30.411123581 +0000 UTC m=+642.831498291 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/78f8f80b-8cdf-4ba1-944a-0e02dc3c8cb1-cert") pod "llmisvc-controller-manager-7d548556bc-7pn2m" (UID: "78f8f80b-8cdf-4ba1-944a-0e02dc3c8cb1") : secret "llmisvc-webhook-server-cert" not found Sep 07 04:08:29.912924 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:29.912898 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/af3c83fe-1cc6-4ee7-95c4-f7aedb0087eb-cert\") pod \"kserve-controller-manager-85d49875c6-7kbmv\" (UID: \"af3c83fe-1cc6-4ee7-95c4-f7aedb0087eb\") " pod="opendatahub/kserve-controller-manager-85d49875c6-7kbmv" Sep 07 04:08:29.926170 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:29.926148 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9fgg\" (UniqueName: \"kubernetes.io/projected/af3c83fe-1cc6-4ee7-95c4-f7aedb0087eb-kube-api-access-v9fgg\") pod \"kserve-controller-manager-85d49875c6-7kbmv\" (UID: \"af3c83fe-1cc6-4ee7-95c4-f7aedb0087eb\") " pod="opendatahub/kserve-controller-manager-85d49875c6-7kbmv" Sep 07 04:08:29.927290 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:29.927256 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp6k6\" (UniqueName: \"kubernetes.io/projected/78f8f80b-8cdf-4ba1-944a-0e02dc3c8cb1-kube-api-access-zp6k6\") pod \"llmisvc-controller-manager-7d548556bc-7pn2m\" (UID: \"78f8f80b-8cdf-4ba1-944a-0e02dc3c8cb1\") " pod="opendatahub/llmisvc-controller-manager-7d548556bc-7pn2m" Sep 07 04:08:30.034561 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:30.034447 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-85d49875c6-7kbmv" Sep 07 04:08:30.310270 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:30.310245 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-85d49875c6-7kbmv"] Sep 07 04:08:30.312709 ip-10-0-143-125 kubenswrapper[2566]: W0907 04:08:30.312679 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf3c83fe_1cc6_4ee7_95c4_f7aedb0087eb.slice/crio-9306007e624514680f0b70ce4a36a619100d26567791d865d702531d5df23e1e WatchSource:0}: Error finding container 9306007e624514680f0b70ce4a36a619100d26567791d865d702531d5df23e1e: Status 404 returned error can't find the container with id 9306007e624514680f0b70ce4a36a619100d26567791d865d702531d5df23e1e Sep 07 04:08:30.414620 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:30.414580 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/78f8f80b-8cdf-4ba1-944a-0e02dc3c8cb1-cert\") pod \"llmisvc-controller-manager-7d548556bc-7pn2m\" (UID: \"78f8f80b-8cdf-4ba1-944a-0e02dc3c8cb1\") " pod="opendatahub/llmisvc-controller-manager-7d548556bc-7pn2m" Sep 07 04:08:30.416973 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:30.416943 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/78f8f80b-8cdf-4ba1-944a-0e02dc3c8cb1-cert\") pod \"llmisvc-controller-manager-7d548556bc-7pn2m\" (UID: \"78f8f80b-8cdf-4ba1-944a-0e02dc3c8cb1\") " pod="opendatahub/llmisvc-controller-manager-7d548556bc-7pn2m" Sep 07 04:08:30.433748 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:30.433718 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-85d49875c6-7kbmv" event={"ID":"af3c83fe-1cc6-4ee7-95c4-f7aedb0087eb","Type":"ContainerStarted","Data":"9306007e624514680f0b70ce4a36a619100d26567791d865d702531d5df23e1e"} Sep 07 04:08:30.644156 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:30.644123 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-7d548556bc-7pn2m" Sep 07 04:08:30.913733 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:30.913682 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-7d548556bc-7pn2m"] Sep 07 04:08:30.915736 ip-10-0-143-125 kubenswrapper[2566]: W0907 04:08:30.915707 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod78f8f80b_8cdf_4ba1_944a_0e02dc3c8cb1.slice/crio-084e87105cedb72ac4e8345bda0f70f8a0d7f0f610f23eb46ae11b1fb061d3bd WatchSource:0}: Error finding container 084e87105cedb72ac4e8345bda0f70f8a0d7f0f610f23eb46ae11b1fb061d3bd: Status 404 returned error can't find the container with id 084e87105cedb72ac4e8345bda0f70f8a0d7f0f610f23eb46ae11b1fb061d3bd Sep 07 04:08:31.441152 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:31.441116 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-7d548556bc-7pn2m" event={"ID":"78f8f80b-8cdf-4ba1-944a-0e02dc3c8cb1","Type":"ContainerStarted","Data":"084e87105cedb72ac4e8345bda0f70f8a0d7f0f610f23eb46ae11b1fb061d3bd"} Sep 07 04:08:33.453858 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:33.453815 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-7d548556bc-7pn2m" event={"ID":"78f8f80b-8cdf-4ba1-944a-0e02dc3c8cb1","Type":"ContainerStarted","Data":"70a88fe9272ccb47a0046afcf4c645668bb5a5e3067777b284e8b37a160025e9"} Sep 07 04:08:33.454258 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:33.453967 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-7d548556bc-7pn2m" Sep 07 04:08:33.455528 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:33.455493 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-85d49875c6-7kbmv" event={"ID":"af3c83fe-1cc6-4ee7-95c4-f7aedb0087eb","Type":"ContainerStarted","Data":"566c3c1064b4d2750f476b860ee9ef4a68aa9ce21bf5e1d396b00761fbbf972e"} Sep 07 04:08:33.455655 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:33.455621 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-85d49875c6-7kbmv" Sep 07 04:08:33.468922 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:33.468877 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-7d548556bc-7pn2m" podStartSLOduration=2.077881403 podStartE2EDuration="4.468862142s" totalImagesPullingTime="2.390980739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:08:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:08:33.466994575 +0000 UTC m=+645.887369298" watchObservedRunningTime="2026-09-07 04:08:33.468862142 +0000 UTC m=+645.889236859" Sep 07 04:08:33.481881 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:08:33.481842 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-85d49875c6-7kbmv" podStartSLOduration=1.489410949 podStartE2EDuration="4.481829135s" totalImagesPullingTime="2.992418186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:08:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:08:33.480897366 +0000 UTC m=+645.901272089" watchObservedRunningTime="2026-09-07 04:08:33.481829135 +0000 UTC m=+645.902203857" Sep 07 04:09:04.462412 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:09:04.462380 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-7d548556bc-7pn2m" Sep 07 04:09:04.465306 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:09:04.465281 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-85d49875c6-7kbmv" Sep 07 04:12:48.285666 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:12:48.285543 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-bgrfr_9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a/console-operator/2.log" Sep 07 04:12:48.286885 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:12:48.286864 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-bgrfr_9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a/console-operator/2.log" Sep 07 04:17:48.313361 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:17:48.313253 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-bgrfr_9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a/console-operator/2.log" Sep 07 04:17:48.317506 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:17:48.315814 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-bgrfr_9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a/console-operator/2.log" Sep 07 04:18:19.453197 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:19.453169 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-c548b5d7d-x66pv_e5f27982-9f0b-44a1-828d-b227183824d8/authorino/0.log" Sep 07 04:18:24.734051 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:24.734007 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-85d49875c6-7kbmv_af3c83fe-1cc6-4ee7-95c4-f7aedb0087eb/manager/0.log" Sep 07 04:18:24.988179 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:24.988098 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-7d548556bc-7pn2m_78f8f80b-8cdf-4ba1-944a-0e02dc3c8cb1/manager/0.log" Sep 07 04:18:26.485268 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:26.485240 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-c548b5d7d-x66pv_e5f27982-9f0b-44a1-828d-b227183824d8/authorino/0.log" Sep 07 04:18:26.717886 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:26.717844 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ffcddf5cd-rxtxh_338a2503-988e-4e12-a460-3b24fa7f5fd8/manager/0.log" Sep 07 04:18:26.828373 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:26.828292 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-6xzx4_c901f05c-651c-4d08-8fe8-1c3582415288/kuadrant-console-plugin/0.log" Sep 07 04:18:27.788302 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:27.788271 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6fd86d77b4-hc58n_0c2ccd4e-3510-4560-954b-d41701d688d5/kube-auth-proxy/0.log" Sep 07 04:18:36.804108 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:36.804048 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7gs6n_27f19200-987c-44ac-b2bd-695e3989a859/global-pull-secret-syncer/0.log" Sep 07 04:18:36.979050 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:36.979014 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zz74s_a3e06efa-aad9-4b2e-8f04-27f5765a2b90/konnectivity-agent/0.log" Sep 07 04:18:37.020577 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:37.020546 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-125.ec2.internal_ba5931dfbb1cb6ce0bae7ffbbefa796b/haproxy/0.log" Sep 07 04:18:41.713599 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:41.713571 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-c548b5d7d-x66pv_e5f27982-9f0b-44a1-828d-b227183824d8/authorino/0.log" Sep 07 04:18:41.769513 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:41.769480 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ffcddf5cd-rxtxh_338a2503-988e-4e12-a460-3b24fa7f5fd8/manager/0.log" Sep 07 04:18:41.796758 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:41.796730 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-6xzx4_c901f05c-651c-4d08-8fe8-1c3582415288/kuadrant-console-plugin/0.log" Sep 07 04:18:43.430168 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:43.430064 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-cvb9h_32f77276-955b-42de-a74d-8a1d6d3db9a2/kube-state-metrics/0.log" Sep 07 04:18:43.448557 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:43.448533 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-cvb9h_32f77276-955b-42de-a74d-8a1d6d3db9a2/kube-rbac-proxy-main/0.log" Sep 07 04:18:43.473812 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:43.473791 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-cvb9h_32f77276-955b-42de-a74d-8a1d6d3db9a2/kube-rbac-proxy-self/0.log" Sep 07 04:18:43.530624 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:43.530597 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-hx4sz_f330bb9a-18cb-4403-b2f3-4cd61c8de0bb/monitoring-plugin/0.log" Sep 07 04:18:43.561171 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:43.561148 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5thz7_4a0a60a5-6b56-4870-b069-3369c7089818/node-exporter/0.log" Sep 07 04:18:43.579047 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:43.579024 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5thz7_4a0a60a5-6b56-4870-b069-3369c7089818/kube-rbac-proxy/0.log" Sep 07 04:18:43.597615 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:43.597575 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5thz7_4a0a60a5-6b56-4870-b069-3369c7089818/init-textfile/0.log" Sep 07 04:18:43.887694 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:43.887654 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_70d82b4e-adfd-4d09-a179-e801eb7d7cf7/prometheus/0.log" Sep 07 04:18:43.909881 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:43.909850 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_70d82b4e-adfd-4d09-a179-e801eb7d7cf7/config-reloader/0.log" Sep 07 04:18:43.931986 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:43.931961 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_70d82b4e-adfd-4d09-a179-e801eb7d7cf7/thanos-sidecar/0.log" Sep 07 04:18:43.951964 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:43.951940 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_70d82b4e-adfd-4d09-a179-e801eb7d7cf7/kube-rbac-proxy-web/0.log" Sep 07 04:18:43.972932 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:43.972913 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_70d82b4e-adfd-4d09-a179-e801eb7d7cf7/kube-rbac-proxy/0.log" Sep 07 04:18:43.996447 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:43.996385 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_70d82b4e-adfd-4d09-a179-e801eb7d7cf7/kube-rbac-proxy-thanos/0.log" Sep 07 04:18:44.015717 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:44.015687 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_70d82b4e-adfd-4d09-a179-e801eb7d7cf7/init-config-reloader/0.log" Sep 07 04:18:44.044355 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:44.044330 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-66dzc_9806780c-648f-438c-8ad0-2ccae8e6e102/prometheus-operator/0.log" Sep 07 04:18:44.062485 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:44.062457 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-66dzc_9806780c-648f-438c-8ad0-2ccae8e6e102/kube-rbac-proxy/0.log" Sep 07 04:18:44.087740 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:44.087719 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-czrvx_befd6ca1-abd6-4055-8780-cd501061ab47/prometheus-operator-admission-webhook/0.log" Sep 07 04:18:46.297772 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:46.297739 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-bgrfr_9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a/console-operator/2.log" Sep 07 04:18:46.305919 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:46.305892 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-bgrfr_9e50e1de-b302-4b6a-8cf1-88d1d1e1bb2a/console-operator/3.log" Sep 07 04:18:46.494939 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:46.494902 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tzmqv/perf-node-gather-daemonset-h268h"] Sep 07 04:18:46.498536 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:46.498506 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tzmqv/perf-node-gather-daemonset-h268h" Sep 07 04:18:46.500645 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:46.500607 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tzmqv\"/\"openshift-service-ca.crt\"" Sep 07 04:18:46.501258 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:46.501241 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tzmqv\"/\"default-dockercfg-b8znq\"" Sep 07 04:18:46.501354 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:46.501242 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tzmqv\"/\"kube-root-ca.crt\"" Sep 07 04:18:46.507799 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:46.507777 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tzmqv/perf-node-gather-daemonset-h268h"] Sep 07 04:18:46.641006 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:46.640969 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da46d7c3-cfd0-4c2e-a53d-7455864883cd-sys\") pod \"perf-node-gather-daemonset-h268h\" (UID: \"da46d7c3-cfd0-4c2e-a53d-7455864883cd\") " pod="openshift-must-gather-tzmqv/perf-node-gather-daemonset-h268h" Sep 07 04:18:46.641006 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:46.641006 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/da46d7c3-cfd0-4c2e-a53d-7455864883cd-lib-modules\") pod \"perf-node-gather-daemonset-h268h\" (UID: \"da46d7c3-cfd0-4c2e-a53d-7455864883cd\") " pod="openshift-must-gather-tzmqv/perf-node-gather-daemonset-h268h" Sep 07 04:18:46.641229 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:46.641079 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/da46d7c3-cfd0-4c2e-a53d-7455864883cd-proc\") pod \"perf-node-gather-daemonset-h268h\" (UID: \"da46d7c3-cfd0-4c2e-a53d-7455864883cd\") " pod="openshift-must-gather-tzmqv/perf-node-gather-daemonset-h268h" Sep 07 04:18:46.641229 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:46.641093 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/da46d7c3-cfd0-4c2e-a53d-7455864883cd-podres\") pod \"perf-node-gather-daemonset-h268h\" (UID: \"da46d7c3-cfd0-4c2e-a53d-7455864883cd\") " pod="openshift-must-gather-tzmqv/perf-node-gather-daemonset-h268h" Sep 07 04:18:46.641229 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:46.641133 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbjhz\" (UniqueName: \"kubernetes.io/projected/da46d7c3-cfd0-4c2e-a53d-7455864883cd-kube-api-access-qbjhz\") pod \"perf-node-gather-daemonset-h268h\" (UID: \"da46d7c3-cfd0-4c2e-a53d-7455864883cd\") " pod="openshift-must-gather-tzmqv/perf-node-gather-daemonset-h268h" Sep 07 04:18:46.742576 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:46.742536 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/da46d7c3-cfd0-4c2e-a53d-7455864883cd-proc\") pod \"perf-node-gather-daemonset-h268h\" (UID: \"da46d7c3-cfd0-4c2e-a53d-7455864883cd\") " pod="openshift-must-gather-tzmqv/perf-node-gather-daemonset-h268h" Sep 07 04:18:46.742576 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:46.742576 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/da46d7c3-cfd0-4c2e-a53d-7455864883cd-podres\") pod \"perf-node-gather-daemonset-h268h\" (UID: \"da46d7c3-cfd0-4c2e-a53d-7455864883cd\") " pod="openshift-must-gather-tzmqv/perf-node-gather-daemonset-h268h" Sep 07 04:18:46.742812 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:46.742597 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbjhz\" (UniqueName: \"kubernetes.io/projected/da46d7c3-cfd0-4c2e-a53d-7455864883cd-kube-api-access-qbjhz\") pod \"perf-node-gather-daemonset-h268h\" (UID: \"da46d7c3-cfd0-4c2e-a53d-7455864883cd\") " pod="openshift-must-gather-tzmqv/perf-node-gather-daemonset-h268h" Sep 07 04:18:46.742812 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:46.742681 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da46d7c3-cfd0-4c2e-a53d-7455864883cd-sys\") pod \"perf-node-gather-daemonset-h268h\" (UID: \"da46d7c3-cfd0-4c2e-a53d-7455864883cd\") " pod="openshift-must-gather-tzmqv/perf-node-gather-daemonset-h268h" Sep 07 04:18:46.742812 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:46.742688 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/da46d7c3-cfd0-4c2e-a53d-7455864883cd-proc\") pod \"perf-node-gather-daemonset-h268h\" (UID: \"da46d7c3-cfd0-4c2e-a53d-7455864883cd\") " pod="openshift-must-gather-tzmqv/perf-node-gather-daemonset-h268h" Sep 07 04:18:46.742812 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:46.742707 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/da46d7c3-cfd0-4c2e-a53d-7455864883cd-lib-modules\") pod \"perf-node-gather-daemonset-h268h\" (UID: \"da46d7c3-cfd0-4c2e-a53d-7455864883cd\") " pod="openshift-must-gather-tzmqv/perf-node-gather-daemonset-h268h" Sep 07 04:18:46.742812 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:46.742732 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/da46d7c3-cfd0-4c2e-a53d-7455864883cd-podres\") pod \"perf-node-gather-daemonset-h268h\" (UID: \"da46d7c3-cfd0-4c2e-a53d-7455864883cd\") " pod="openshift-must-gather-tzmqv/perf-node-gather-daemonset-h268h" Sep 07 04:18:46.742812 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:46.742749 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da46d7c3-cfd0-4c2e-a53d-7455864883cd-sys\") pod \"perf-node-gather-daemonset-h268h\" (UID: \"da46d7c3-cfd0-4c2e-a53d-7455864883cd\") " pod="openshift-must-gather-tzmqv/perf-node-gather-daemonset-h268h" Sep 07 04:18:46.742999 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:46.742837 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/da46d7c3-cfd0-4c2e-a53d-7455864883cd-lib-modules\") pod \"perf-node-gather-daemonset-h268h\" (UID: \"da46d7c3-cfd0-4c2e-a53d-7455864883cd\") " pod="openshift-must-gather-tzmqv/perf-node-gather-daemonset-h268h" Sep 07 04:18:46.749395 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:46.749375 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbjhz\" (UniqueName: \"kubernetes.io/projected/da46d7c3-cfd0-4c2e-a53d-7455864883cd-kube-api-access-qbjhz\") pod \"perf-node-gather-daemonset-h268h\" (UID: \"da46d7c3-cfd0-4c2e-a53d-7455864883cd\") " pod="openshift-must-gather-tzmqv/perf-node-gather-daemonset-h268h" Sep 07 04:18:46.809483 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:46.809450 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tzmqv/perf-node-gather-daemonset-h268h" Sep 07 04:18:47.079679 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:47.079599 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tzmqv/perf-node-gather-daemonset-h268h"] Sep 07 04:18:47.082405 ip-10-0-143-125 kubenswrapper[2566]: W0907 04:18:47.082373 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podda46d7c3_cfd0_4c2e_a53d_7455864883cd.slice/crio-e026b88f3068142a57abf11b92a674312447837234f51ed755b093be39e9a745 WatchSource:0}: Error finding container e026b88f3068142a57abf11b92a674312447837234f51ed755b093be39e9a745: Status 404 returned error can't find the container with id e026b88f3068142a57abf11b92a674312447837234f51ed755b093be39e9a745 Sep 07 04:18:47.302761 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:47.302726 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tzmqv/perf-node-gather-daemonset-h268h" event={"ID":"da46d7c3-cfd0-4c2e-a53d-7455864883cd","Type":"ContainerStarted","Data":"666c25c8ad15ffd213d2d883d27504ccc9f418f8fda83bb2e4b6aa0a3d265694"} Sep 07 04:18:47.303142 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:47.302778 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tzmqv/perf-node-gather-daemonset-h268h" event={"ID":"da46d7c3-cfd0-4c2e-a53d-7455864883cd","Type":"ContainerStarted","Data":"e026b88f3068142a57abf11b92a674312447837234f51ed755b093be39e9a745"} Sep 07 04:18:47.303142 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:47.302858 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tzmqv/perf-node-gather-daemonset-h268h" Sep 07 04:18:47.322741 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:47.322689 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tzmqv/perf-node-gather-daemonset-h268h" podStartSLOduration=1.322672138 podStartE2EDuration="1.322672138s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 04:18:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:18:47.321095182 +0000 UTC m=+1259.741469905" watchObservedRunningTime="2026-09-07 04:18:47.322672138 +0000 UTC m=+1259.743046861" Sep 07 04:18:48.557256 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:48.557226 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s7vls_97c0529d-571d-4f5a-9cf6-594835d9d3f5/dns/0.log" Sep 07 04:18:48.575910 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:48.575881 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s7vls_97c0529d-571d-4f5a-9cf6-594835d9d3f5/kube-rbac-proxy/0.log" Sep 07 04:18:48.622568 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:48.622542 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j2xph_d5c78be9-7199-4898-8b64-335079a42ce2/dns-node-resolver/0.log" Sep 07 04:18:49.173568 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:49.173514 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5476d9d776-sdfhj_a274089c-eeaf-42eb-af23-c0afbdf9470d/registry/0.log" Sep 07 04:18:49.240511 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:49.240474 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hkdpb_9acda50f-310f-4846-a461-5d45a198cd54/node-ca/0.log" Sep 07 04:18:50.171625 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:50.171596 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6fd86d77b4-hc58n_0c2ccd4e-3510-4560-954b-d41701d688d5/kube-auth-proxy/0.log" Sep 07 04:18:50.791609 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:50.791574 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9fkxh_981e0f5c-3f82-4c3f-9623-d3282f75a9af/serve-healthcheck-canary/0.log" Sep 07 04:18:51.313344 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:51.313307 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g9wd9_e03bf6a3-d565-4c87-bf65-cd285eb1ec64/kube-rbac-proxy/0.log" Sep 07 04:18:51.331778 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:51.331754 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g9wd9_e03bf6a3-d565-4c87-bf65-cd285eb1ec64/exporter/0.log" Sep 07 04:18:51.352995 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:51.352966 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g9wd9_e03bf6a3-d565-4c87-bf65-cd285eb1ec64/extractor/0.log" Sep 07 04:18:53.316157 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:53.316129 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tzmqv/perf-node-gather-daemonset-h268h" Sep 07 04:18:53.628853 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:53.628817 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-74f7b546fd-zxpk2_ef56d82c-0dd6-4ff5-9ef3-6f8ba8e3aac0/manager/0.log" Sep 07 04:18:53.643024 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:53.643000 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-74f7b546fd-zxpk2_ef56d82c-0dd6-4ff5-9ef3-6f8ba8e3aac0/copy-manifests/0.log" Sep 07 04:18:55.247166 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:55.247134 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-85d49875c6-7kbmv_af3c83fe-1cc6-4ee7-95c4-f7aedb0087eb/manager/0.log" Sep 07 04:18:55.302886 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:55.302860 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-7d548556bc-7pn2m_78f8f80b-8cdf-4ba1-944a-0e02dc3c8cb1/manager/0.log" Sep 07 04:18:55.400741 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:55.400713 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6fd86d77b4-hc58n_0c2ccd4e-3510-4560-954b-d41701d688d5/kube-auth-proxy/0.log" Sep 07 04:18:56.580682 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:18:56.580652 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6fd86d77b4-hc58n_0c2ccd4e-3510-4560-954b-d41701d688d5/kube-auth-proxy/0.log" Sep 07 04:19:00.691333 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:19:00.691294 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-mjqjt_599835cb-1ae6-41a2-a0a8-fabb6f329fbe/kube-storage-version-migrator-operator/1.log" Sep 07 04:19:00.693180 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:19:00.693157 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-mjqjt_599835cb-1ae6-41a2-a0a8-fabb6f329fbe/kube-storage-version-migrator-operator/0.log" Sep 07 04:19:01.642907 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:19:01.642875 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2fxtz_550f6b92-213b-4ca0-9324-1fdf41107530/kube-multus/0.log" Sep 07 04:19:01.856689 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:19:01.856660 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sg6pk_1cf367ba-8995-4c9e-a64d-2b1b3577d648/kube-multus-additional-cni-plugins/0.log" Sep 07 04:19:01.876292 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:19:01.876259 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sg6pk_1cf367ba-8995-4c9e-a64d-2b1b3577d648/egress-router-binary-copy/0.log" Sep 07 04:19:01.894755 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:19:01.894675 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sg6pk_1cf367ba-8995-4c9e-a64d-2b1b3577d648/cni-plugins/0.log" Sep 07 04:19:01.914176 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:19:01.914109 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sg6pk_1cf367ba-8995-4c9e-a64d-2b1b3577d648/bond-cni-plugin/0.log" Sep 07 04:19:01.933330 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:19:01.933306 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sg6pk_1cf367ba-8995-4c9e-a64d-2b1b3577d648/routeoverride-cni/0.log" Sep 07 04:19:01.951231 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:19:01.951208 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sg6pk_1cf367ba-8995-4c9e-a64d-2b1b3577d648/whereabouts-cni-bincopy/0.log" Sep 07 04:19:01.969662 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:19:01.969617 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sg6pk_1cf367ba-8995-4c9e-a64d-2b1b3577d648/whereabouts-cni/0.log" Sep 07 04:19:02.291812 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:19:02.291736 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bshbg_2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9/network-metrics-daemon/0.log" Sep 07 04:19:02.308910 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:19:02.308887 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bshbg_2a95bb08-5b63-4bb7-9f7e-0e60e1c9e3c9/kube-rbac-proxy/0.log" Sep 07 04:19:03.118689 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:19:03.118653 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6xmb_7f6840b8-fcfe-4c33-8275-80fd1864e452/ovn-controller/0.log" Sep 07 04:19:03.133391 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:19:03.133361 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6xmb_7f6840b8-fcfe-4c33-8275-80fd1864e452/ovn-acl-logging/0.log" Sep 07 04:19:03.159567 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:19:03.159541 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6xmb_7f6840b8-fcfe-4c33-8275-80fd1864e452/kube-rbac-proxy-node/0.log" Sep 07 04:19:03.183218 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:19:03.183196 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6xmb_7f6840b8-fcfe-4c33-8275-80fd1864e452/kube-rbac-proxy-ovn-metrics/0.log" Sep 07 04:19:03.198611 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:19:03.198591 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6xmb_7f6840b8-fcfe-4c33-8275-80fd1864e452/northd/0.log" Sep 07 04:19:03.216479 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:19:03.216458 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6xmb_7f6840b8-fcfe-4c33-8275-80fd1864e452/nbdb/0.log" Sep 07 04:19:03.235077 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:19:03.235057 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6xmb_7f6840b8-fcfe-4c33-8275-80fd1864e452/sbdb/0.log" Sep 07 04:19:03.281077 ip-10-0-143-125 kubenswrapper[2566]: I0907 04:19:03.281049 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f6xmb_7f6840b8-fcfe-4c33-8275-80fd1864e452/ovnkube-controller/0.log"