Jul 01 17:16:09.841284 ip-10-0-137-141 systemd[1]: Starting Kubernetes Kubelet... Jul 01 17:16:10.258703 ip-10-0-137-141 kubenswrapper[2547]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 17:16:10.258703 ip-10-0-137-141 kubenswrapper[2547]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 01 17:16:10.258703 ip-10-0-137-141 kubenswrapper[2547]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 17:16:10.258703 ip-10-0-137-141 kubenswrapper[2547]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 01 17:16:10.258703 ip-10-0-137-141 kubenswrapper[2547]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 17:16:10.260723 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.260627 2547 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 01 17:16:10.266140 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266120 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 17:16:10.266140 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266138 2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 17:16:10.266140 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266143 2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 17:16:10.266140 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266148 2547 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 17:16:10.266391 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266152 2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 17:16:10.266391 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266156 2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 17:16:10.266391 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266160 2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 17:16:10.266391 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266166 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 17:16:10.266391 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266169 2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 17:16:10.266391 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266173 2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 17:16:10.266391 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266176 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 17:16:10.266391 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266180 2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 17:16:10.266391 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266184 2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 17:16:10.266391 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266187 2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 17:16:10.266391 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266191 2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 17:16:10.266391 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266195 2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 17:16:10.266391 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266199 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 17:16:10.266391 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266203 2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 17:16:10.266391 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266207 2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 17:16:10.266391 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266212 2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 17:16:10.266391 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266218 2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 17:16:10.266391 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266223 2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 17:16:10.266391 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266227 2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 17:16:10.267126 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266232 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 17:16:10.267126 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266248 2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 17:16:10.267126 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266253 2547 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 17:16:10.267126 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266257 2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 17:16:10.267126 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266263 2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 17:16:10.267126 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266268 2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 17:16:10.267126 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266273 2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 17:16:10.267126 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266278 2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 17:16:10.267126 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266282 2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 17:16:10.267126 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266287 2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 17:16:10.267126 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266291 2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 17:16:10.267126 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266295 2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 17:16:10.267126 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266299 2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 17:16:10.267126 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266304 2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 17:16:10.267126 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266309 2547 feature_gate.go:328] unrecognized feature gate: Example Jul 01 17:16:10.267126 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266314 2547 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 17:16:10.267126 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266318 2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 17:16:10.267126 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266322 2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 17:16:10.267126 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266326 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 17:16:10.267602 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266331 2547 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 17:16:10.267602 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266335 2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 17:16:10.267602 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266339 2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 17:16:10.267602 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266343 2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 17:16:10.267602 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266347 2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 17:16:10.267602 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266352 2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 17:16:10.267602 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266357 2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 17:16:10.267602 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266361 2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 17:16:10.267602 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266365 2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 17:16:10.267602 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266370 2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 17:16:10.267602 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266374 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 17:16:10.267602 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266379 2547 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 17:16:10.267602 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266383 2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 17:16:10.267602 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266387 2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 17:16:10.267602 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266391 2547 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 17:16:10.267602 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266395 2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 17:16:10.267602 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266399 2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 17:16:10.267602 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266403 2547 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 17:16:10.267602 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266407 2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 17:16:10.267602 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266411 2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 17:16:10.268135 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266416 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 17:16:10.268135 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266422 2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 17:16:10.268135 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266427 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 17:16:10.268135 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266434 2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 17:16:10.268135 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266441 2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 17:16:10.268135 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266448 2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 17:16:10.268135 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266453 2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 17:16:10.268135 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266458 2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 17:16:10.268135 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266463 2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 17:16:10.268135 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266469 2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 17:16:10.268135 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266473 2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 17:16:10.268135 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266478 2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 17:16:10.268135 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266483 2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 17:16:10.268135 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266487 2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 17:16:10.268135 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266491 2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 17:16:10.268135 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266495 2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 17:16:10.268135 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266499 2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 17:16:10.268135 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266503 2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 17:16:10.268135 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266507 2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 17:16:10.268638 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266512 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 17:16:10.268638 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266516 2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 17:16:10.268638 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266520 2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 17:16:10.268638 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266524 2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 17:16:10.268638 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266529 2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 17:16:10.268638 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266533 2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 17:16:10.268638 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266537 2547 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 17:16:10.268638 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266542 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 17:16:10.268638 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266546 2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 17:16:10.268638 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266550 2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 17:16:10.268638 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266554 2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 17:16:10.268638 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266559 2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 17:16:10.268638 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266564 2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 17:16:10.268638 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266568 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 17:16:10.268638 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266573 2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 17:16:10.268638 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266577 2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 17:16:10.268638 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266581 2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 17:16:10.268638 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.266585 2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 17:16:10.268638 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267578 2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 17:16:10.268638 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267592 2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 17:16:10.269146 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267595 2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 17:16:10.269146 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267598 2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 17:16:10.269146 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267601 2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 17:16:10.269146 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267606 2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 17:16:10.269146 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267609 2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 17:16:10.269146 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267612 2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 17:16:10.269146 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267615 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 17:16:10.269146 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267618 2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 17:16:10.269146 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267621 2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 17:16:10.269146 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267624 2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 17:16:10.269146 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267626 2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 17:16:10.269146 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267629 2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 17:16:10.269146 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267632 2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 17:16:10.269146 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267635 2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 17:16:10.269146 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267638 2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 17:16:10.269146 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267641 2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 17:16:10.269146 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267645 2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 17:16:10.269146 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267649 2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 17:16:10.269146 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267652 2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 17:16:10.269614 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267655 2547 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 17:16:10.269614 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267658 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 17:16:10.269614 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267660 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 17:16:10.269614 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267663 2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 17:16:10.269614 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267666 2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 17:16:10.269614 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267668 2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 17:16:10.269614 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267671 2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 17:16:10.269614 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267674 2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 17:16:10.269614 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267677 2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 17:16:10.269614 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267679 2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 17:16:10.269614 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267681 2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 17:16:10.269614 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267684 2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 17:16:10.269614 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267688 2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 17:16:10.269614 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267691 2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 17:16:10.269614 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267693 2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 17:16:10.269614 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267696 2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 17:16:10.269614 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267698 2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 17:16:10.269614 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267700 2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 17:16:10.269614 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267703 2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 17:16:10.269614 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267705 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 17:16:10.270117 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267708 2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 17:16:10.270117 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267710 2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 17:16:10.270117 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267713 2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 17:16:10.270117 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267715 2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 17:16:10.270117 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267718 2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 17:16:10.270117 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267720 2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 17:16:10.270117 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267722 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 17:16:10.270117 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267725 2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 17:16:10.270117 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267727 2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 17:16:10.270117 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267730 2547 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 17:16:10.270117 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267733 2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 17:16:10.270117 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267735 2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 17:16:10.270117 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267738 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 17:16:10.270117 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267740 2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 17:16:10.270117 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267743 2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 17:16:10.270117 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267746 2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 17:16:10.270117 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267748 2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 17:16:10.270117 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267751 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 17:16:10.270117 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267754 2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 17:16:10.270577 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267756 2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 17:16:10.270577 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267759 2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 17:16:10.270577 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267763 2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 17:16:10.270577 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267767 2547 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 17:16:10.270577 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267770 2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 17:16:10.270577 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267773 2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 17:16:10.270577 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267777 2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 17:16:10.270577 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267779 2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 17:16:10.270577 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267782 2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 17:16:10.270577 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267785 2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 17:16:10.270577 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267788 2547 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 17:16:10.270577 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267791 2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 17:16:10.270577 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267793 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 17:16:10.270577 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267797 2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 17:16:10.270577 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267801 2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 17:16:10.270577 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267803 2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 17:16:10.270577 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267806 2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 17:16:10.270577 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267809 2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 17:16:10.270577 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267811 2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 17:16:10.271054 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267814 2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 17:16:10.271054 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267817 2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 17:16:10.271054 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267820 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 17:16:10.271054 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267822 2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 17:16:10.271054 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267825 2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 17:16:10.271054 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267827 2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 17:16:10.271054 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267830 2547 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 17:16:10.271054 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267832 2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 17:16:10.271054 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267835 2547 feature_gate.go:328] unrecognized feature gate: Example Jul 01 17:16:10.271054 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267837 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 17:16:10.271054 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267840 2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 17:16:10.271054 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267842 2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 17:16:10.271054 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267848 2547 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 17:16:10.271054 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267850 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 17:16:10.271054 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267853 2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 17:16:10.271054 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267855 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 17:16:10.271054 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267858 2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 17:16:10.271054 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267861 2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 17:16:10.271054 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267864 2547 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 17:16:10.271054 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.267866 2547 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 17:16:10.271548 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268254 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 17:16:10.271548 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268259 2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 17:16:10.271548 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268262 2547 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 17:16:10.271548 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268265 2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 17:16:10.271548 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268268 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 17:16:10.271548 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268271 2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 17:16:10.271548 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268273 2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 17:16:10.271548 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268276 2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 17:16:10.271548 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268278 2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 17:16:10.271548 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268281 2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 17:16:10.271548 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268284 2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 17:16:10.271548 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268286 2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 17:16:10.271548 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268289 2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 17:16:10.271548 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268292 2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 17:16:10.271548 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268294 2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 17:16:10.271548 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268296 2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 17:16:10.271548 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268299 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 17:16:10.271548 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268302 2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 17:16:10.271548 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268304 2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 17:16:10.271548 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268307 2547 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 17:16:10.272058 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268309 2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 17:16:10.272058 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268312 2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 17:16:10.272058 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268314 2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 17:16:10.272058 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268317 2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 17:16:10.272058 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268321 2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 17:16:10.272058 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268323 2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 17:16:10.272058 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268326 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 17:16:10.272058 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268328 2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 17:16:10.272058 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268331 2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 17:16:10.272058 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268333 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 17:16:10.272058 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268336 2547 feature_gate.go:328] unrecognized feature gate: Example Jul 01 17:16:10.272058 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268339 2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 17:16:10.272058 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268342 2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 17:16:10.272058 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268345 2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 17:16:10.272058 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268348 2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 17:16:10.272058 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268350 2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 17:16:10.272058 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268353 2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 17:16:10.272058 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268355 2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 17:16:10.272058 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268358 2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 17:16:10.272058 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268360 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 17:16:10.272541 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268363 2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 17:16:10.272541 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268365 2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 17:16:10.272541 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268368 2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 17:16:10.272541 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268370 2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 17:16:10.272541 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268373 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 17:16:10.272541 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268375 2547 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 17:16:10.272541 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268377 2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 17:16:10.272541 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268380 2547 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 17:16:10.272541 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268382 2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 17:16:10.272541 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268385 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 17:16:10.272541 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268388 2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 17:16:10.272541 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268391 2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 17:16:10.272541 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268393 2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 17:16:10.272541 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268396 2547 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 17:16:10.272541 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268398 2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 17:16:10.272541 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268400 2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 17:16:10.272541 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268404 2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 17:16:10.272541 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268407 2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 17:16:10.272541 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268409 2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 17:16:10.272541 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268412 2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 17:16:10.273026 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268414 2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 17:16:10.273026 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268417 2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 17:16:10.273026 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268421 2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 17:16:10.273026 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268423 2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 17:16:10.273026 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268426 2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 17:16:10.273026 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268429 2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 17:16:10.273026 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268432 2547 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 17:16:10.273026 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268434 2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 17:16:10.273026 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268437 2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 17:16:10.273026 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268439 2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 17:16:10.273026 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268442 2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 17:16:10.273026 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268444 2547 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 17:16:10.273026 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268446 2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 17:16:10.273026 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268449 2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 17:16:10.273026 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268451 2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 17:16:10.273026 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268454 2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 17:16:10.273026 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268456 2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 17:16:10.273026 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268460 2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 17:16:10.273026 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268463 2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 17:16:10.273553 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268468 2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 17:16:10.273553 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268471 2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 17:16:10.273553 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268474 2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 17:16:10.273553 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268477 2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 17:16:10.273553 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268480 2547 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 17:16:10.273553 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268483 2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 17:16:10.273553 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268485 2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 17:16:10.273553 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268488 2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 17:16:10.273553 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268491 2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 17:16:10.273553 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268496 2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 17:16:10.273553 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268498 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 17:16:10.273553 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268501 2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 17:16:10.273553 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268505 2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 17:16:10.273553 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268508 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 17:16:10.273553 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268511 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 17:16:10.273553 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268515 2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 17:16:10.273553 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268518 2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 17:16:10.273553 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268521 2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 17:16:10.273553 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268524 2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 17:16:10.274043 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.268527 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 17:16:10.274043 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268595 2547 flags.go:64] FLAG: --address="0.0.0.0" Jul 01 17:16:10.274043 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268602 2547 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 01 17:16:10.274043 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268620 2547 flags.go:64] FLAG: --anonymous-auth="true" Jul 01 17:16:10.274043 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268632 2547 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 01 17:16:10.274043 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268636 2547 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 01 17:16:10.274043 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268640 2547 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 01 17:16:10.274043 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268644 2547 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 01 17:16:10.274043 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268648 2547 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 01 17:16:10.274043 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268651 2547 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 01 17:16:10.274043 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268655 2547 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 01 17:16:10.274043 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268658 2547 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 01 17:16:10.274043 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268662 2547 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 01 17:16:10.274043 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268665 2547 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 01 17:16:10.274043 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268668 2547 flags.go:64] FLAG: --cgroup-root="" Jul 01 17:16:10.274043 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268671 2547 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 01 17:16:10.274043 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268674 2547 flags.go:64] FLAG: --client-ca-file="" Jul 01 17:16:10.274043 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268677 2547 flags.go:64] FLAG: --cloud-provider="external" Jul 01 17:16:10.274043 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268680 2547 flags.go:64] FLAG: --cluster-dns="[]" Jul 01 17:16:10.274043 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268684 2547 flags.go:64] FLAG: --cluster-domain="" Jul 01 17:16:10.274043 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268687 2547 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 01 17:16:10.274043 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268690 2547 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 01 17:16:10.274043 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268694 2547 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 01 17:16:10.274043 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268698 2547 flags.go:64] FLAG: --container-log-max-files="5" Jul 01 17:16:10.274696 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268702 2547 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 01 17:16:10.274696 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268705 2547 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 01 17:16:10.274696 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268708 2547 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 01 17:16:10.274696 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268711 2547 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 01 17:16:10.274696 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268716 2547 flags.go:64] FLAG: --contention-profiling="false" Jul 01 17:16:10.274696 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268719 2547 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 01 17:16:10.274696 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268721 2547 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 01 17:16:10.274696 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268724 2547 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 01 17:16:10.274696 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268727 2547 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 01 17:16:10.274696 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268736 2547 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 01 17:16:10.274696 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268739 2547 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 01 17:16:10.274696 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268742 2547 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 01 17:16:10.274696 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268745 2547 flags.go:64] FLAG: --enable-load-reader="false" Jul 01 17:16:10.274696 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268748 2547 flags.go:64] FLAG: --enable-server="true" Jul 01 17:16:10.274696 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268751 2547 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 01 17:16:10.274696 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268756 2547 flags.go:64] FLAG: --event-burst="100" Jul 01 17:16:10.274696 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268759 2547 flags.go:64] FLAG: --event-qps="50" Jul 01 17:16:10.274696 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268762 2547 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 01 17:16:10.274696 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268765 2547 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 01 17:16:10.274696 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268768 2547 flags.go:64] FLAG: --eviction-hard="" Jul 01 17:16:10.274696 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268772 2547 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 01 17:16:10.274696 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268775 2547 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 01 17:16:10.274696 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268777 2547 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 01 17:16:10.274696 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268780 2547 flags.go:64] FLAG: --eviction-soft="" Jul 01 17:16:10.274696 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268783 2547 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 01 17:16:10.275310 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268786 2547 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 01 17:16:10.275310 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268789 2547 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 01 17:16:10.275310 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268792 2547 flags.go:64] FLAG: --experimental-mounter-path="" Jul 01 17:16:10.275310 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268794 2547 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 01 17:16:10.275310 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268797 2547 flags.go:64] FLAG: --fail-swap-on="true" Jul 01 17:16:10.275310 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268801 2547 flags.go:64] FLAG: --feature-gates="" Jul 01 17:16:10.275310 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268805 2547 flags.go:64] FLAG: --file-check-frequency="20s" Jul 01 17:16:10.275310 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268808 2547 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 01 17:16:10.275310 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268811 2547 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 01 17:16:10.275310 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268814 2547 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 01 17:16:10.275310 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268817 2547 flags.go:64] FLAG: --healthz-port="10248" Jul 01 17:16:10.275310 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268821 2547 flags.go:64] FLAG: --help="false" Jul 01 17:16:10.275310 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268824 2547 flags.go:64] FLAG: --hostname-override="ip-10-0-137-141.ec2.internal" Jul 01 17:16:10.275310 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268827 2547 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 01 17:16:10.275310 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268830 2547 flags.go:64] FLAG: --http-check-frequency="20s" Jul 01 17:16:10.275310 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268833 2547 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 01 17:16:10.275310 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268837 2547 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 01 17:16:10.275310 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268841 2547 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 01 17:16:10.275310 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268843 2547 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 01 17:16:10.275310 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268846 2547 flags.go:64] FLAG: --image-service-endpoint="" Jul 01 17:16:10.275310 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268849 2547 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 01 17:16:10.275310 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268852 2547 flags.go:64] FLAG: --kube-api-burst="100" Jul 01 17:16:10.275310 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268854 2547 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 01 17:16:10.275911 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268858 2547 flags.go:64] FLAG: --kube-api-qps="50" Jul 01 17:16:10.275911 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268860 2547 flags.go:64] FLAG: --kube-reserved="" Jul 01 17:16:10.275911 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268863 2547 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 01 17:16:10.275911 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268866 2547 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 01 17:16:10.275911 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268869 2547 flags.go:64] FLAG: --kubelet-cgroups="" Jul 01 17:16:10.275911 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268872 2547 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 01 17:16:10.275911 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268874 2547 flags.go:64] FLAG: --lock-file="" Jul 01 17:16:10.275911 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268877 2547 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 01 17:16:10.275911 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268880 2547 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 01 17:16:10.275911 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268883 2547 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 01 17:16:10.275911 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268888 2547 flags.go:64] FLAG: --log-json-split-stream="false" Jul 01 17:16:10.275911 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268891 2547 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 01 17:16:10.275911 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268893 2547 flags.go:64] FLAG: --log-text-split-stream="false" Jul 01 17:16:10.275911 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268896 2547 flags.go:64] FLAG: --logging-format="text" Jul 01 17:16:10.275911 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268900 2547 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 01 17:16:10.275911 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268903 2547 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 01 17:16:10.275911 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268907 2547 flags.go:64] FLAG: --manifest-url="" Jul 01 17:16:10.275911 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268909 2547 flags.go:64] FLAG: --manifest-url-header="" Jul 01 17:16:10.275911 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268913 2547 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 01 17:16:10.275911 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268916 2547 flags.go:64] FLAG: --max-open-files="1000000" Jul 01 17:16:10.275911 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268921 2547 flags.go:64] FLAG: --max-pods="110" Jul 01 17:16:10.275911 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268924 2547 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 01 17:16:10.275911 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268927 2547 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 01 17:16:10.275911 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268930 2547 flags.go:64] FLAG: --memory-manager-policy="None" Jul 01 17:16:10.275911 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268933 2547 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 01 17:16:10.276553 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268936 2547 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 01 17:16:10.276553 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268939 2547 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 01 17:16:10.276553 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268942 2547 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 01 17:16:10.276553 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268964 2547 flags.go:64] FLAG: --node-status-max-images="50" Jul 01 17:16:10.276553 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268967 2547 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 01 17:16:10.276553 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268970 2547 flags.go:64] FLAG: --oom-score-adj="-999" Jul 01 17:16:10.276553 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268973 2547 flags.go:64] FLAG: --pod-cidr="" Jul 01 17:16:10.276553 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268976 2547 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 01 17:16:10.276553 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268981 2547 flags.go:64] FLAG: --pod-manifest-path="" Jul 01 17:16:10.276553 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268984 2547 flags.go:64] FLAG: --pod-max-pids="-1" Jul 01 17:16:10.276553 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268987 2547 flags.go:64] FLAG: --pods-per-core="0" Jul 01 17:16:10.276553 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268989 2547 flags.go:64] FLAG: --port="10250" Jul 01 17:16:10.276553 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268992 2547 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 01 17:16:10.276553 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268995 2547 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-040c847682bf0d62e" Jul 01 17:16:10.276553 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.268999 2547 flags.go:64] FLAG: --qos-reserved="" Jul 01 17:16:10.276553 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.269001 2547 flags.go:64] FLAG: --read-only-port="10255" Jul 01 17:16:10.276553 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.269004 2547 flags.go:64] FLAG: --register-node="true" Jul 01 17:16:10.276553 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.269007 2547 flags.go:64] FLAG: --register-with-taints="" Jul 01 17:16:10.276553 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.269010 2547 flags.go:64] FLAG: --registry-burst="10" Jul 01 17:16:10.276553 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.269013 2547 flags.go:64] FLAG: --registry-qps="5" Jul 01 17:16:10.276553 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.269016 2547 flags.go:64] FLAG: --reserved-cpus="" Jul 01 17:16:10.276553 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.269018 2547 flags.go:64] FLAG: --reserved-memory="" Jul 01 17:16:10.276553 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.269023 2547 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 01 17:16:10.276553 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.269026 2547 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 01 17:16:10.276553 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.269029 2547 flags.go:64] FLAG: --rotate-certificates="false" Jul 01 17:16:10.277197 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.269032 2547 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 01 17:16:10.277197 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.269035 2547 flags.go:64] FLAG: --runonce="false" Jul 01 17:16:10.277197 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.269039 2547 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 01 17:16:10.277197 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.269042 2547 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 01 17:16:10.277197 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.269045 2547 flags.go:64] FLAG: --seccomp-default="false" Jul 01 17:16:10.277197 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.269048 2547 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 01 17:16:10.277197 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.269051 2547 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 01 17:16:10.277197 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.269054 2547 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 01 17:16:10.277197 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.269057 2547 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 01 17:16:10.277197 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.269060 2547 flags.go:64] FLAG: --storage-driver-password="root" Jul 01 17:16:10.277197 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.269063 2547 flags.go:64] FLAG: --storage-driver-secure="false" Jul 01 17:16:10.277197 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.269066 2547 flags.go:64] FLAG: --storage-driver-table="stats" Jul 01 17:16:10.277197 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.269069 2547 flags.go:64] FLAG: --storage-driver-user="root" Jul 01 17:16:10.277197 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.269071 2547 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 01 17:16:10.277197 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.269074 2547 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 01 17:16:10.277197 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.269077 2547 flags.go:64] FLAG: --system-cgroups="" Jul 01 17:16:10.277197 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.269080 2547 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 01 17:16:10.277197 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.269086 2547 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 01 17:16:10.277197 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.269088 2547 flags.go:64] FLAG: --tls-cert-file="" Jul 01 17:16:10.277197 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.269091 2547 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 01 17:16:10.277197 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.269095 2547 flags.go:64] FLAG: --tls-min-version="" Jul 01 17:16:10.277197 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.269098 2547 flags.go:64] FLAG: --tls-private-key-file="" Jul 01 17:16:10.277197 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.269100 2547 flags.go:64] FLAG: --topology-manager-policy="none" Jul 01 17:16:10.277197 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.269103 2547 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 01 17:16:10.277197 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.269105 2547 flags.go:64] FLAG: --topology-manager-scope="container" Jul 01 17:16:10.277815 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.269109 2547 flags.go:64] FLAG: --v="2" Jul 01 17:16:10.277815 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.269112 2547 flags.go:64] FLAG: --version="false" Jul 01 17:16:10.277815 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.269116 2547 flags.go:64] FLAG: --vmodule="" Jul 01 17:16:10.277815 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.269119 2547 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 01 17:16:10.277815 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.269125 2547 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 01 17:16:10.277815 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269241 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 17:16:10.277815 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269246 2547 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 17:16:10.277815 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269249 2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 17:16:10.277815 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269251 2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 17:16:10.277815 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269255 2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 17:16:10.277815 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269258 2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 17:16:10.277815 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269261 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 17:16:10.277815 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269263 2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 17:16:10.277815 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269266 2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 17:16:10.277815 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269269 2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 17:16:10.277815 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269271 2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 17:16:10.277815 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269274 2547 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 17:16:10.277815 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269276 2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 17:16:10.277815 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269281 2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 17:16:10.277815 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269284 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 17:16:10.277815 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269288 2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 17:16:10.278349 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269291 2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 17:16:10.278349 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269294 2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 17:16:10.278349 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269296 2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 17:16:10.278349 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269298 2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 17:16:10.278349 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269301 2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 17:16:10.278349 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269303 2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 17:16:10.278349 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269306 2547 feature_gate.go:328] unrecognized feature gate: Example Jul 01 17:16:10.278349 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269309 2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 17:16:10.278349 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269311 2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 17:16:10.278349 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269313 2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 17:16:10.278349 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269317 2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 17:16:10.278349 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269320 2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 17:16:10.278349 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269323 2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 17:16:10.278349 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269327 2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 17:16:10.278349 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269331 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 17:16:10.278349 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269336 2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 17:16:10.278349 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269339 2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 17:16:10.278349 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269341 2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 17:16:10.278349 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269344 2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 17:16:10.278814 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269346 2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 17:16:10.278814 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269350 2547 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 17:16:10.278814 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269353 2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 17:16:10.278814 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269356 2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 17:16:10.278814 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269359 2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 17:16:10.278814 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269361 2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 17:16:10.278814 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269364 2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 17:16:10.278814 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269366 2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 17:16:10.278814 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269369 2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 17:16:10.278814 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269371 2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 17:16:10.278814 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269374 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 17:16:10.278814 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269377 2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 17:16:10.278814 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269379 2547 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 17:16:10.278814 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269382 2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 17:16:10.278814 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269385 2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 17:16:10.278814 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269387 2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 17:16:10.278814 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269389 2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 17:16:10.278814 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269392 2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 17:16:10.278814 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269395 2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 17:16:10.278814 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269398 2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 17:16:10.279322 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269400 2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 17:16:10.279322 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269403 2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 17:16:10.279322 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269406 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 17:16:10.279322 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269408 2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 17:16:10.279322 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269410 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 17:16:10.279322 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269413 2547 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 17:16:10.279322 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269415 2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 17:16:10.279322 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269418 2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 17:16:10.279322 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269421 2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 17:16:10.279322 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269424 2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 17:16:10.279322 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269427 2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 17:16:10.279322 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269429 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 17:16:10.279322 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269431 2547 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 17:16:10.279322 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269436 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 17:16:10.279322 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269438 2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 17:16:10.279322 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269441 2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 17:16:10.279322 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269443 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 17:16:10.279322 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269446 2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 17:16:10.279322 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269448 2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 17:16:10.279322 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269451 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 17:16:10.279815 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269453 2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 17:16:10.279815 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269456 2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 17:16:10.279815 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269459 2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 17:16:10.279815 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269461 2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 17:16:10.279815 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269464 2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 17:16:10.279815 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269467 2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 17:16:10.279815 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269469 2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 17:16:10.279815 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269472 2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 17:16:10.279815 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269474 2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 17:16:10.279815 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269477 2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 17:16:10.279815 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269479 2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 17:16:10.279815 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269481 2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 17:16:10.279815 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269484 2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 17:16:10.279815 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269486 2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 17:16:10.279815 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269489 2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 17:16:10.279815 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269491 2547 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 17:16:10.279815 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269494 2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 17:16:10.279815 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269496 2547 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 17:16:10.279815 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269499 2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 17:16:10.279815 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269501 2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 17:16:10.280329 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269506 2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 17:16:10.280329 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269509 2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 17:16:10.280329 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269512 2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 17:16:10.280329 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.269514 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 17:16:10.280329 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.270119 2547 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 17:16:10.280329 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.276858 2547 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 01 17:16:10.280329 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.276875 2547 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 01 17:16:10.280329 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.277685 2547 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 01 17:16:10.280329 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.277696 2547 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 01 17:16:10.280329 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277754 2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 17:16:10.280329 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277760 2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 17:16:10.280329 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277764 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 17:16:10.280329 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277768 2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 17:16:10.280329 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277771 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 17:16:10.280329 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277774 2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 17:16:10.280743 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277777 2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 17:16:10.280743 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277781 2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 17:16:10.280743 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277784 2547 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 17:16:10.280743 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277787 2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 17:16:10.280743 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277789 2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 17:16:10.280743 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277792 2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 17:16:10.280743 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277794 2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 17:16:10.280743 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277797 2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 17:16:10.280743 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277799 2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 17:16:10.280743 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277802 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 17:16:10.280743 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277804 2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 17:16:10.280743 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277807 2547 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 17:16:10.280743 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277811 2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 17:16:10.280743 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277815 2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 17:16:10.280743 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277818 2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 17:16:10.280743 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277821 2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 17:16:10.280743 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277824 2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 17:16:10.280743 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277827 2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 17:16:10.280743 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277830 2547 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 17:16:10.281224 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277833 2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 17:16:10.281224 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277835 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 17:16:10.281224 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277838 2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 17:16:10.281224 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277840 2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 17:16:10.281224 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277844 2547 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 17:16:10.281224 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277847 2547 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 17:16:10.281224 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277849 2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 17:16:10.281224 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277852 2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 17:16:10.281224 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277855 2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 17:16:10.281224 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277857 2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 17:16:10.281224 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277860 2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 17:16:10.281224 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277863 2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 17:16:10.281224 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277866 2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 17:16:10.281224 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277868 2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 17:16:10.281224 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277871 2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 17:16:10.281224 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277874 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 17:16:10.281224 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277877 2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 17:16:10.281224 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277879 2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 17:16:10.281224 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277882 2547 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 17:16:10.281689 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277884 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 17:16:10.281689 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277887 2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 17:16:10.281689 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277889 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 17:16:10.281689 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277891 2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 17:16:10.281689 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277894 2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 17:16:10.281689 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277897 2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 17:16:10.281689 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277899 2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 17:16:10.281689 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277902 2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 17:16:10.281689 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277904 2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 17:16:10.281689 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277907 2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 17:16:10.281689 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277909 2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 17:16:10.281689 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277911 2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 17:16:10.281689 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277914 2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 17:16:10.281689 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277917 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 17:16:10.281689 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277919 2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 17:16:10.281689 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277923 2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 17:16:10.281689 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277926 2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 17:16:10.281689 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277930 2547 feature_gate.go:328] unrecognized feature gate: Example Jul 01 17:16:10.281689 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277933 2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 17:16:10.281689 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277935 2547 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 17:16:10.282190 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277938 2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 17:16:10.282190 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277941 2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 17:16:10.282190 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277943 2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 17:16:10.282190 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277958 2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 17:16:10.282190 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277961 2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 17:16:10.282190 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277964 2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 17:16:10.282190 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277967 2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 17:16:10.282190 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277969 2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 17:16:10.282190 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277972 2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 17:16:10.282190 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277975 2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 17:16:10.282190 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277977 2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 17:16:10.282190 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277980 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 17:16:10.282190 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277983 2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 17:16:10.282190 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277985 2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 17:16:10.282190 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277988 2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 17:16:10.282190 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277990 2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 17:16:10.282190 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277993 2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 17:16:10.282190 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277995 2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 17:16:10.282190 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.277998 2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 17:16:10.282190 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278000 2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 17:16:10.282686 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278002 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 17:16:10.282686 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278005 2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 17:16:10.282686 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278008 2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 17:16:10.282686 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278011 2547 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 17:16:10.282686 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278013 2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 17:16:10.282686 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278016 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 17:16:10.282686 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278019 2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 17:16:10.282686 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278021 2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 17:16:10.282686 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278024 2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 17:16:10.282686 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278027 2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 17:16:10.282686 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278030 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 17:16:10.282686 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278032 2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 17:16:10.282686 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278035 2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 17:16:10.282686 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278039 2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 17:16:10.282686 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278042 2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 17:16:10.283069 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.278047 2547 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 17:16:10.283069 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278165 2547 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 17:16:10.283069 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278170 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 17:16:10.283069 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278173 2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 17:16:10.283069 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278176 2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 17:16:10.283069 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278179 2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 17:16:10.283069 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278181 2547 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 17:16:10.283069 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278185 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 17:16:10.283069 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278187 2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 17:16:10.283069 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278190 2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 17:16:10.283069 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278193 2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 17:16:10.283069 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278195 2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 17:16:10.283069 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278198 2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 17:16:10.283069 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278200 2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 17:16:10.283069 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278203 2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 17:16:10.283459 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278205 2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 17:16:10.283459 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278208 2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 17:16:10.283459 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278210 2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 17:16:10.283459 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278213 2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 17:16:10.283459 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278217 2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 17:16:10.283459 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278221 2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 17:16:10.283459 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278224 2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 17:16:10.283459 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278227 2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 17:16:10.283459 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278230 2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 17:16:10.283459 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278233 2547 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 17:16:10.283459 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278235 2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 17:16:10.283459 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278238 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 17:16:10.283459 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278241 2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 17:16:10.283459 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278244 2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 17:16:10.283459 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278247 2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 17:16:10.283459 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278249 2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 17:16:10.283459 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278252 2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 17:16:10.283459 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278254 2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 17:16:10.283459 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278256 2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 17:16:10.283911 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278259 2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 17:16:10.283911 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278261 2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 17:16:10.283911 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278264 2547 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 17:16:10.283911 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278266 2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 17:16:10.283911 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278269 2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 17:16:10.283911 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278271 2547 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 17:16:10.283911 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278274 2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 17:16:10.283911 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278277 2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 17:16:10.283911 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278279 2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 17:16:10.283911 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278281 2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 17:16:10.283911 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278284 2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 17:16:10.283911 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278286 2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 17:16:10.283911 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278289 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 17:16:10.283911 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278291 2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 17:16:10.283911 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278295 2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 17:16:10.283911 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278299 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 17:16:10.283911 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278301 2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 17:16:10.283911 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278304 2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 17:16:10.283911 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278306 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 17:16:10.283911 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278324 2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 17:16:10.284448 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278328 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 17:16:10.284448 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278331 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 17:16:10.284448 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278334 2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 17:16:10.284448 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278337 2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 17:16:10.284448 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278340 2547 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 17:16:10.284448 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278344 2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 17:16:10.284448 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278346 2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 17:16:10.284448 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278349 2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 17:16:10.284448 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278352 2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 17:16:10.284448 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278355 2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 17:16:10.284448 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278358 2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 17:16:10.284448 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278361 2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 17:16:10.284448 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278364 2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 17:16:10.284448 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278380 2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 17:16:10.284448 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278383 2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 17:16:10.284448 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278386 2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 17:16:10.284448 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278389 2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 17:16:10.284448 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278391 2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 17:16:10.284448 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278394 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 17:16:10.284448 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278397 2547 feature_gate.go:328] unrecognized feature gate: Example Jul 01 17:16:10.284962 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278400 2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 17:16:10.284962 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278402 2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 17:16:10.284962 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278405 2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 17:16:10.284962 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278407 2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 17:16:10.284962 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278410 2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 17:16:10.284962 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278412 2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 17:16:10.284962 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278415 2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 17:16:10.284962 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278418 2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 17:16:10.284962 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278421 2547 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 17:16:10.284962 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278423 2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 17:16:10.284962 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278426 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 17:16:10.284962 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278428 2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 17:16:10.284962 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278430 2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 17:16:10.284962 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278433 2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 17:16:10.284962 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278435 2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 17:16:10.284962 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278438 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 17:16:10.284962 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278441 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 17:16:10.284962 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278443 2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 17:16:10.284962 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278446 2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 17:16:10.285442 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278449 2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 17:16:10.285442 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278453 2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 17:16:10.285442 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278456 2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 17:16:10.285442 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278459 2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 17:16:10.285442 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278461 2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 17:16:10.285442 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278464 2547 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 17:16:10.285442 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:10.278467 2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 17:16:10.285442 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.278471 2547 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 17:16:10.285442 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.278581 2547 server.go:962] "Client rotation is on, will bootstrap in background" Jul 01 17:16:10.285442 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.280520 2547 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 01 17:16:10.285442 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.281883 2547 server.go:1019] "Starting client certificate rotation" Jul 01 17:16:10.285442 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.281987 2547 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 17:16:10.285442 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.282026 2547 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 17:16:10.285807 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.284757 2547 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 17:16:10.290585 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.290554 2547 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 17:16:10.303664 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.303645 2547 log.go:25] "Validated CRI v1 runtime API" Jul 01 17:16:10.305764 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.305749 2547 log.go:25] "Validated CRI v1 image API" Jul 01 17:16:10.307513 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.307495 2547 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 01 17:16:10.310165 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.310136 2547 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 dcf5c677-6c37-49e3-a466-8e9adf3034e1:/dev/nvme0n1p3 fcd643e5-1846-485a-b823-7c208fa2a0b6:/dev/nvme0n1p4] Jul 01 17:16:10.310247 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.310163 2547 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 01 17:16:10.315155 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.315135 2547 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 17:16:10.315506 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.315398 2547 manager.go:216] Machine: {Timestamp:2026-07-01 17:16:10.314034567 +0000 UTC m=+0.346031837 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099874 MemoryCapacity:32812183552 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d7d9ea339b16498c929ef13603f3c SystemUUID:ec2d7d9e-a339-b164-98c9-29ef13603f3c BootID:a954a1ac-a9d7-4e77-adfb-2828b02be83d Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406093824 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:61:bb:7f:44:15 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:61:bb:7f:44:15 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:36:10:89:f9:bd:43 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812183552 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 01 17:16:10.315506 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.315501 2547 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 01 17:16:10.315643 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.315586 2547 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 01 17:16:10.320364 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.320333 2547 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 01 17:16:10.320497 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.320366 2547 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-141.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 01 17:16:10.321208 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.321197 2547 topology_manager.go:138] "Creating topology manager with none policy" Jul 01 17:16:10.321246 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.321210 2547 container_manager_linux.go:309] "Creating device plugin manager" Jul 01 17:16:10.321246 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.321218 2547 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 17:16:10.322561 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.322551 2547 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 17:16:10.324056 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.324046 2547 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 01 17:16:10.327197 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.327185 2547 state_mem.go:36] "Initialized new in-memory state store" Jul 01 17:16:10.327324 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.327307 2547 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 01 17:16:10.327361 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.327348 2547 kubelet.go:486] "Attempting to sync node with API server" Jul 01 17:16:10.327392 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.327363 2547 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 01 17:16:10.327392 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.327386 2547 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 01 17:16:10.327448 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.327403 2547 kubelet.go:398] "Adding apiserver pod source" Jul 01 17:16:10.327448 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.327414 2547 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 01 17:16:10.327936 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.327921 2547 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 17:16:10.328040 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.327959 2547 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 17:16:10.330343 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.330329 2547 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 01 17:16:10.331844 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.331830 2547 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 01 17:16:10.331892 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.331860 2547 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 01 17:16:10.332514 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.332503 2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 01 17:16:10.332546 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.332518 2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 01 17:16:10.332546 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.332524 2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 01 17:16:10.332546 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.332530 2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 01 17:16:10.332635 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.332544 2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 01 17:16:10.332635 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.332556 2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 01 17:16:10.332635 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.332564 2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 01 17:16:10.332635 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.332569 2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 01 17:16:10.332635 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.332576 2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 01 17:16:10.332635 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.332581 2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 01 17:16:10.332635 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.332590 2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 01 17:16:10.332635 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.332597 2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 01 17:16:10.334247 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.334235 2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 01 17:16:10.334247 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.334248 2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 01 17:16:10.337738 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:10.337708 2547 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-141.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 01 17:16:10.337863 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:10.337727 2547 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 01 17:16:10.338594 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.338574 2547 server.go:1268] "Started kubelet" Jul 01 17:16:10.339035 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.338997 2547 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 01 17:16:10.339117 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.339062 2547 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 01 17:16:10.339554 ip-10-0-137-141 systemd[1]: Started Kubernetes Kubelet. Jul 01 17:16:10.339931 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.339864 2547 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 01 17:16:10.340730 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.340656 2547 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 01 17:16:10.342072 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.342056 2547 server.go:310] "Adding debug handlers to kubelet server" Jul 01 17:16:10.345819 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:10.345799 2547 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 01 17:16:10.347339 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.347326 2547 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-141.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 01 17:16:10.348460 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:10.347485 2547 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-141.ec2.internal.18be39e7d3c6911c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-141.ec2.internal,UID:ip-10-0-137-141.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-141.ec2.internal,},FirstTimestamp:2026-07-01 17:16:10.338529564 +0000 UTC m=+0.370526817,LastTimestamp:2026-07-01 17:16:10.338529564 +0000 UTC m=+0.370526817,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-141.ec2.internal,}" Jul 01 17:16:10.354621 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.354595 2547 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 01 17:16:10.354621 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.354600 2547 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 01 17:16:10.354768 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:10.354728 2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-141.ec2.internal\" not found" Jul 01 17:16:10.355300 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.355261 2547 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 01 17:16:10.355406 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.355389 2547 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 01 17:16:10.355466 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.355409 2547 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 01 17:16:10.355512 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.355491 2547 reconstruct.go:97] "Volume reconstruction finished" Jul 01 17:16:10.355512 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.355501 2547 reconciler.go:29] "Reconciler: start to sync state" Jul 01 17:16:10.355592 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.355547 2547 factory.go:55] Registering systemd factory Jul 01 17:16:10.355592 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.355564 2547 factory.go:223] Registration of the systemd container factory successfully Jul 01 17:16:10.355783 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.355766 2547 factory.go:153] Registering CRI-O factory Jul 01 17:16:10.355846 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.355786 2547 factory.go:223] Registration of the crio container factory successfully Jul 01 17:16:10.355846 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.355837 2547 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 01 17:16:10.355938 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.355859 2547 factory.go:103] Registering Raw factory Jul 01 17:16:10.355938 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.355871 2547 manager.go:1196] Started watching for new ooms in manager Jul 01 17:16:10.356496 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.356480 2547 manager.go:349] Starting recovery of all containers Jul 01 17:16:10.364858 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:10.364834 2547 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 01 17:16:10.365014 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:10.364850 2547 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-141.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 01 17:16:10.367327 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.367195 2547 manager.go:354] Recovery completed Jul 01 17:16:10.371256 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.371244 2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 17:16:10.373163 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.373147 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-141.ec2.internal" event="NodeHasSufficientMemory" Jul 01 17:16:10.373224 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.373194 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-141.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 17:16:10.373224 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.373205 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-141.ec2.internal" event="NodeHasSufficientPID" Jul 01 17:16:10.373788 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.373774 2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 17:16:10.373864 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.373774 2547 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 01 17:16:10.373864 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.373811 2547 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 01 17:16:10.373864 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.373861 2547 state_mem.go:36] "Initialized new in-memory state store" Jul 01 17:16:10.374528 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.374511 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-141.ec2.internal" event="NodeHasSufficientMemory" Jul 01 17:16:10.374590 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.374544 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-141.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 17:16:10.374590 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.374554 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-141.ec2.internal" event="NodeHasSufficientPID" Jul 01 17:16:10.375249 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.375236 2547 policy_none.go:49] "None policy: Start" Jul 01 17:16:10.375297 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.375252 2547 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 01 17:16:10.375297 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.375270 2547 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 01 17:16:10.376683 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.376673 2547 policy_none.go:47] "Start" Jul 01 17:16:10.383964 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:10.383885 2547 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-141.ec2.internal.18be39e7d5d700e0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-141.ec2.internal,UID:ip-10-0-137-141.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-141.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-141.ec2.internal,},FirstTimestamp:2026-07-01 17:16:10.373161184 +0000 UTC m=+0.405158435,LastTimestamp:2026-07-01 17:16:10.373161184 +0000 UTC m=+0.405158435,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-141.ec2.internal,}" Jul 01 17:16:10.389235 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:10.389144 2547 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-141.ec2.internal.18be39e7d5d797d2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-141.ec2.internal,UID:ip-10-0-137-141.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-141.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-141.ec2.internal,},FirstTimestamp:2026-07-01 17:16:10.373199826 +0000 UTC m=+0.405197078,LastTimestamp:2026-07-01 17:16:10.373199826 +0000 UTC m=+0.405197078,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-141.ec2.internal,}" Jul 01 17:16:10.390737 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:10.390678 2547 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-141.ec2.internal.18be39e7d5d7bf86 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-141.ec2.internal,UID:ip-10-0-137-141.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-137-141.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-137-141.ec2.internal,},FirstTimestamp:2026-07-01 17:16:10.37320999 +0000 UTC m=+0.405207241,LastTimestamp:2026-07-01 17:16:10.37320999 +0000 UTC m=+0.405207241,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-141.ec2.internal,}" Jul 01 17:16:10.401883 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:10.401324 2547 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-137-141.ec2.internal.18be39e7d5d700e0\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-141.ec2.internal.18be39e7d5d700e0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-141.ec2.internal,UID:ip-10-0-137-141.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-141.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-141.ec2.internal,},FirstTimestamp:2026-07-01 17:16:10.373161184 +0000 UTC m=+0.405158435,LastTimestamp:2026-07-01 17:16:10.374527651 +0000 UTC m=+0.406524905,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-141.ec2.internal,}" Jul 01 17:16:10.423175 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:10.411101 2547 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-137-141.ec2.internal.18be39e7d5d797d2\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-141.ec2.internal.18be39e7d5d797d2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-141.ec2.internal,UID:ip-10-0-137-141.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-141.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-141.ec2.internal,},FirstTimestamp:2026-07-01 17:16:10.373199826 +0000 UTC m=+0.405197078,LastTimestamp:2026-07-01 17:16:10.374548848 +0000 UTC m=+0.406546099,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-141.ec2.internal,}" Jul 01 17:16:10.423175 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.412663 2547 manager.go:337] "Starting Device Plugin manager" Jul 01 17:16:10.423175 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:10.412702 2547 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 01 17:16:10.423175 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.412714 2547 server.go:87] "Starting device plugin registration server" Jul 01 17:16:10.423175 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.413022 2547 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 01 17:16:10.423175 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.413036 2547 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 01 17:16:10.423175 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.413111 2547 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 01 17:16:10.423175 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.413192 2547 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 01 17:16:10.423175 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.413201 2547 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 01 17:16:10.423175 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:10.413823 2547 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 01 17:16:10.423175 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:10.413867 2547 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-141.ec2.internal\" not found" Jul 01 17:16:10.423175 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.416647 2547 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 01 17:16:10.423175 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.418125 2547 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 01 17:16:10.423175 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.418162 2547 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 01 17:16:10.423175 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.418186 2547 kubelet.go:2448] "Starting kubelet main sync loop" Jul 01 17:16:10.423175 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:10.418227 2547 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 01 17:16:10.423708 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:10.423595 2547 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-137-141.ec2.internal.18be39e7d5d7bf86\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-141.ec2.internal.18be39e7d5d7bf86 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-141.ec2.internal,UID:ip-10-0-137-141.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-137-141.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-137-141.ec2.internal,},FirstTimestamp:2026-07-01 17:16:10.37320999 +0000 UTC m=+0.405207241,LastTimestamp:2026-07-01 17:16:10.374558274 +0000 UTC m=+0.406555525,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-141.ec2.internal,}" Jul 01 17:16:10.423708 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:10.423665 2547 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Jul 01 17:16:10.424325 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.424310 2547 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ffjw2" Jul 01 17:16:10.428369 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:10.428307 2547 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-141.ec2.internal.18be39e7d8587310 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-141.ec2.internal,UID:ip-10-0-137-141.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-137-141.ec2.internal,},FirstTimestamp:2026-07-01 17:16:10.415198992 +0000 UTC m=+0.447196229,LastTimestamp:2026-07-01 17:16:10.415198992 +0000 UTC m=+0.447196229,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-141.ec2.internal,}" Jul 01 17:16:10.433391 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.433375 2547 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ffjw2" Jul 01 17:16:10.513479 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.513397 2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 17:16:10.514401 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.514369 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-141.ec2.internal" event="NodeHasSufficientMemory" Jul 01 17:16:10.514401 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.514405 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-141.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 17:16:10.514543 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.514416 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-141.ec2.internal" event="NodeHasSufficientPID" Jul 01 17:16:10.514543 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.514446 2547 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-141.ec2.internal" Jul 01 17:16:10.516156 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:10.516060 2547 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-137-141.ec2.internal.18be39e7d5d700e0\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-141.ec2.internal.18be39e7d5d700e0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-141.ec2.internal,UID:ip-10-0-137-141.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-141.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-141.ec2.internal,},FirstTimestamp:2026-07-01 17:16:10.373161184 +0000 UTC m=+0.405158435,LastTimestamp:2026-07-01 17:16:10.514388563 +0000 UTC m=+0.546385814,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-141.ec2.internal,}" Jul 01 17:16:10.518566 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.518545 2547 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-141.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-141.ec2.internal"] Jul 01 17:16:10.518614 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.518609 2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 17:16:10.520027 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.520007 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-141.ec2.internal" event="NodeHasSufficientMemory" Jul 01 17:16:10.520115 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.520038 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-141.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 17:16:10.520115 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.520047 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-141.ec2.internal" event="NodeHasSufficientPID" Jul 01 17:16:10.521422 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.521411 2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 17:16:10.521554 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.521540 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-141.ec2.internal" Jul 01 17:16:10.521588 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.521571 2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 17:16:10.522146 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.522132 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-141.ec2.internal" event="NodeHasSufficientMemory" Jul 01 17:16:10.522213 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.522156 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-141.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 17:16:10.522213 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.522165 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-141.ec2.internal" event="NodeHasSufficientPID" Jul 01 17:16:10.522213 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.522132 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-141.ec2.internal" event="NodeHasSufficientMemory" Jul 01 17:16:10.522306 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.522226 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-141.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 17:16:10.522306 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.522236 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-141.ec2.internal" event="NodeHasSufficientPID" Jul 01 17:16:10.523512 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.523498 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-141.ec2.internal" Jul 01 17:16:10.523553 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.523530 2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 17:16:10.524320 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.524303 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-141.ec2.internal" event="NodeHasSufficientMemory" Jul 01 17:16:10.524390 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.524336 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-141.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 17:16:10.524390 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.524348 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-141.ec2.internal" event="NodeHasSufficientPID" Jul 01 17:16:10.529057 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:10.529042 2547 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-137-141.ec2.internal\" not found" node="ip-10-0-137-141.ec2.internal" Jul 01 17:16:10.541522 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:10.541504 2547 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-141.ec2.internal\" not found" node="ip-10-0-137-141.ec2.internal" Jul 01 17:16:10.544931 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:10.544915 2547 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-141.ec2.internal\" not found" node="ip-10-0-137-141.ec2.internal" Jul 01 17:16:10.556913 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.556895 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ee44633fc0c12eba9ee147b91525d614-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-141.ec2.internal\" (UID: \"ee44633fc0c12eba9ee147b91525d614\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-141.ec2.internal" Jul 01 17:16:10.557018 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.556918 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee44633fc0c12eba9ee147b91525d614-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-141.ec2.internal\" (UID: \"ee44633fc0c12eba9ee147b91525d614\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-141.ec2.internal" Jul 01 17:16:10.557018 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.556937 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a7186fa112b18e5dc69ae2ad2e5c6386-config\") pod \"kube-apiserver-proxy-ip-10-0-137-141.ec2.internal\" (UID: \"a7186fa112b18e5dc69ae2ad2e5c6386\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-141.ec2.internal" Jul 01 17:16:10.572638 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:10.572621 2547 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-141.ec2.internal\" not found" node="ip-10-0-137-141.ec2.internal" Jul 01 17:16:10.657919 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.657885 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ee44633fc0c12eba9ee147b91525d614-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-141.ec2.internal\" (UID: \"ee44633fc0c12eba9ee147b91525d614\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-141.ec2.internal" Jul 01 17:16:10.657919 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.657906 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ee44633fc0c12eba9ee147b91525d614-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-141.ec2.internal\" (UID: \"ee44633fc0c12eba9ee147b91525d614\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-141.ec2.internal" Jul 01 17:16:10.658117 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.657935 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee44633fc0c12eba9ee147b91525d614-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-141.ec2.internal\" (UID: \"ee44633fc0c12eba9ee147b91525d614\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-141.ec2.internal" Jul 01 17:16:10.658117 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.657981 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a7186fa112b18e5dc69ae2ad2e5c6386-config\") pod \"kube-apiserver-proxy-ip-10-0-137-141.ec2.internal\" (UID: \"a7186fa112b18e5dc69ae2ad2e5c6386\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-141.ec2.internal" Jul 01 17:16:10.658117 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.658010 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a7186fa112b18e5dc69ae2ad2e5c6386-config\") pod \"kube-apiserver-proxy-ip-10-0-137-141.ec2.internal\" (UID: \"a7186fa112b18e5dc69ae2ad2e5c6386\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-141.ec2.internal" Jul 01 17:16:10.658117 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.658035 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee44633fc0c12eba9ee147b91525d614-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-141.ec2.internal\" (UID: \"ee44633fc0c12eba9ee147b91525d614\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-141.ec2.internal" Jul 01 17:16:10.730049 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.730006 2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 17:16:10.732380 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.732362 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-141.ec2.internal" event="NodeHasSufficientMemory" Jul 01 17:16:10.732470 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.732393 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-141.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 17:16:10.732470 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.732403 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-141.ec2.internal" event="NodeHasSufficientPID" Jul 01 17:16:10.732470 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.732436 2547 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-141.ec2.internal" Jul 01 17:16:10.739179 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.739166 2547 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-141.ec2.internal" Jul 01 17:16:10.739226 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:10.739188 2547 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-141.ec2.internal\": node \"ip-10-0-137-141.ec2.internal\" not found" Jul 01 17:16:10.761490 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:10.761462 2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-141.ec2.internal\" not found" Jul 01 17:16:10.844918 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.844846 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-141.ec2.internal" Jul 01 17:16:10.848462 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:10.848083 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-141.ec2.internal" Jul 01 17:16:10.862018 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:10.861993 2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-141.ec2.internal\" not found" Jul 01 17:16:10.962905 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:10.962602 2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-141.ec2.internal\" not found" Jul 01 17:16:11.063558 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:11.063521 2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-141.ec2.internal\" not found" Jul 01 17:16:11.164407 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:11.164317 2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-141.ec2.internal\" not found" Jul 01 17:16:11.265046 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:11.265025 2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-141.ec2.internal\" not found" Jul 01 17:16:11.281671 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:11.281633 2547 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 01 17:16:11.365481 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:11.365446 2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-141.ec2.internal\" not found" Jul 01 17:16:11.391016 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:11.390999 2547 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 17:16:11.437609 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:11.437578 2547 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-30 17:11:10 +0000 UTC" deadline="2028-02-10 10:09:29.911066653 +0000 UTC" Jul 01 17:16:11.437609 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:11.437606 2547 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14128h53m18.473463944s" Jul 01 17:16:11.466452 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:11.466422 2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-141.ec2.internal\" not found" Jul 01 17:16:11.512124 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:11.512090 2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 17:16:11.513438 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:11.513414 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-141.ec2.internal" event="NodeHasSufficientMemory" Jul 01 17:16:11.513555 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:11.513457 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-141.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 17:16:11.513555 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:11.513472 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-141.ec2.internal" event="NodeHasSufficientPID" Jul 01 17:16:11.532879 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:11.532844 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee44633fc0c12eba9ee147b91525d614.slice/crio-c03ce856640e6858a8cee1d0caa3a7ffba99f443785e6e56c7793a8b0a4ba592 WatchSource:0}: Error finding container c03ce856640e6858a8cee1d0caa3a7ffba99f443785e6e56c7793a8b0a4ba592: Status 404 returned error can't find the container with id c03ce856640e6858a8cee1d0caa3a7ffba99f443785e6e56c7793a8b0a4ba592 Jul 01 17:16:11.538433 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:11.538418 2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 17:16:11.567122 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:11.567093 2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-141.ec2.internal\" not found" Jul 01 17:16:11.583947 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:11.583922 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7186fa112b18e5dc69ae2ad2e5c6386.slice/crio-4743f7b0a7fd339929f1c5fe5546bf6a09d75c22d38fda8f9250eed6d7fb9bf6 WatchSource:0}: Error finding container 4743f7b0a7fd339929f1c5fe5546bf6a09d75c22d38fda8f9250eed6d7fb9bf6: Status 404 returned error can't find the container with id 4743f7b0a7fd339929f1c5fe5546bf6a09d75c22d38fda8f9250eed6d7fb9bf6 Jul 01 17:16:11.667991 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:11.667935 2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-141.ec2.internal\" not found" Jul 01 17:16:11.768599 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:11.768517 2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-141.ec2.internal\" not found" Jul 01 17:16:11.789295 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:11.789267 2547 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 17:16:11.831498 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:11.831467 2547 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 17:16:11.855381 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:11.855345 2547 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-141.ec2.internal" Jul 01 17:16:11.868252 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:11.868228 2547 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 17:16:11.869287 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:11.869271 2547 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-141.ec2.internal" Jul 01 17:16:11.876523 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:11.876499 2547 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 17:16:11.929988 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:11.929963 2547 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 17:16:12.328483 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.328451 2547 apiserver.go:52] "Watching apiserver" Jul 01 17:16:12.338397 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.338363 2547 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 01 17:16:12.338975 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.338926 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-s96pk","openshift-image-registry/node-ca-9ksbn","openshift-multus/multus-bvz2x","openshift-multus/network-metrics-daemon-wx5ff","openshift-network-diagnostics/network-check-target-9zsrw","kube-system/global-pull-secret-syncer-8h2fn","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcdwg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-141.ec2.internal","openshift-multus/multus-additional-cni-plugins-fw624","openshift-network-operator/iptables-alerter-dgtqc","openshift-ovn-kubernetes/ovnkube-node-qh49d","kube-system/konnectivity-agent-dd5mp","kube-system/kube-apiserver-proxy-ip-10-0-137-141.ec2.internal","openshift-cluster-node-tuning-operator/tuned-k6fj4"] Jul 01 17:16:12.341215 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.340754 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcdwg" Jul 01 17:16:12.342662 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.342635 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.345193 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.344237 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 01 17:16:12.345193 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.344474 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 01 17:16:12.345193 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.344583 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 01 17:16:12.345193 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.344729 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9rjn4\"" Jul 01 17:16:12.345193 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.344791 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.350574 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.345971 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 01 17:16:12.350574 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.346554 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 01 17:16:12.350574 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.346763 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tfpld\"" Jul 01 17:16:12.350574 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.346969 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 01 17:16:12.350574 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.347189 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 01 17:16:12.350574 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.347705 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wx5ff" Jul 01 17:16:12.350574 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:12.347777 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wx5ff" podUID="ec5b1126-9d68-4911-ad3d-6f8369cf5a5d" Jul 01 17:16:12.350574 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.348338 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 01 17:16:12.354493 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.354466 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hb6zx\"" Jul 01 17:16:12.358603 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.358582 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 01 17:16:12.359190 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.359172 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 01 17:16:12.359584 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.359570 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 01 17:16:12.361169 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.360683 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 01 17:16:12.361169 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.361039 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fw624" Jul 01 17:16:12.363521 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.361541 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 01 17:16:12.363521 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.361748 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8h2fn" Jul 01 17:16:12.363521 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:12.361965 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8h2fn" podUID="32557f5d-39c9-49c0-bc63-3a9666e0ba57" Jul 01 17:16:12.363521 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.362507 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k6fj4" Jul 01 17:16:12.363521 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.362878 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9ksbn" Jul 01 17:16:12.363521 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.363043 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9zsrw" Jul 01 17:16:12.363521 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.363076 2547 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 01 17:16:12.363521 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:12.363104 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9zsrw" podUID="cecb7d35-1004-44b8-8eef-ca0efbf803cb" Jul 01 17:16:12.364761 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.364548 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dgtqc" Jul 01 17:16:12.367074 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.367056 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 01 17:16:12.367479 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.367461 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2n2jp\"" Jul 01 17:16:12.368480 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.367736 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 01 17:16:12.368480 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.367776 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-s96pk" Jul 01 17:16:12.368480 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.367477 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dd5mp" Jul 01 17:16:12.368480 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.367754 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5rqc7\"" Jul 01 17:16:12.368480 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.367136 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 01 17:16:12.368480 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.368412 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/aa1fdd8a-5b35-4bac-9836-028a3292e25c-systemd-units\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.368480 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.368441 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2b616970-957c-43eb-8efd-98cfa7957cf9-etc-modprobe-d\") pod \"tuned-k6fj4\" (UID: \"2b616970-957c-43eb-8efd-98cfa7957cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fj4" Jul 01 17:16:12.368480 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.368465 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2b616970-957c-43eb-8efd-98cfa7957cf9-etc-sysconfig\") pod \"tuned-k6fj4\" (UID: \"2b616970-957c-43eb-8efd-98cfa7957cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fj4" Jul 01 17:16:12.368921 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.368487 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2b616970-957c-43eb-8efd-98cfa7957cf9-etc-systemd\") pod \"tuned-k6fj4\" (UID: \"2b616970-957c-43eb-8efd-98cfa7957cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fj4" Jul 01 17:16:12.368921 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.368508 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b616970-957c-43eb-8efd-98cfa7957cf9-sys\") pod \"tuned-k6fj4\" (UID: \"2b616970-957c-43eb-8efd-98cfa7957cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fj4" Jul 01 17:16:12.368921 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.368530 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b616970-957c-43eb-8efd-98cfa7957cf9-var-lib-kubelet\") pod \"tuned-k6fj4\" (UID: \"2b616970-957c-43eb-8efd-98cfa7957cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fj4" Jul 01 17:16:12.368921 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.368552 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/aa1fdd8a-5b35-4bac-9836-028a3292e25c-ovnkube-script-lib\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.368921 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.368573 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd657e38-8571-4b17-90b6-952c0e06ddbe-system-cni-dir\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.368921 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.368598 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1cb2e486-78b2-4b87-9cc5-6286495cbc2b-system-cni-dir\") pod \"multus-additional-cni-plugins-fw624\" (UID: \"1cb2e486-78b2-4b87-9cc5-6286495cbc2b\") " pod="openshift-multus/multus-additional-cni-plugins-fw624" Jul 01 17:16:12.368921 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.368625 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1cb2e486-78b2-4b87-9cc5-6286495cbc2b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fw624\" (UID: \"1cb2e486-78b2-4b87-9cc5-6286495cbc2b\") " pod="openshift-multus/multus-additional-cni-plugins-fw624" Jul 01 17:16:12.368921 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.368650 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/aa1fdd8a-5b35-4bac-9836-028a3292e25c-node-log\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.368921 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.368672 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/aa1fdd8a-5b35-4bac-9836-028a3292e25c-log-socket\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.368921 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.368695 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aa1fdd8a-5b35-4bac-9836-028a3292e25c-host-cni-bin\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.368921 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.368718 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fd657e38-8571-4b17-90b6-952c0e06ddbe-host-var-lib-kubelet\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.368921 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.368739 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c87a9aa8-cd15-41a5-9879-d6c448cc62eb-host\") pod \"node-ca-9ksbn\" (UID: \"c87a9aa8-cd15-41a5-9879-d6c448cc62eb\") " pod="openshift-image-registry/node-ca-9ksbn" Jul 01 17:16:12.368921 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.368771 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fd657e38-8571-4b17-90b6-952c0e06ddbe-host-run-k8s-cni-cncf-io\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.368921 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.368824 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32557f5d-39c9-49c0-bc63-3a9666e0ba57-original-pull-secret\") pod \"global-pull-secret-syncer-8h2fn\" (UID: \"32557f5d-39c9-49c0-bc63-3a9666e0ba57\") " pod="kube-system/global-pull-secret-syncer-8h2fn" Jul 01 17:16:12.368921 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.368851 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8ff09cca-3b59-44ef-9db6-6e5b89491314-socket-dir\") pod \"aws-ebs-csi-driver-node-hcdwg\" (UID: \"8ff09cca-3b59-44ef-9db6-6e5b89491314\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcdwg" Jul 01 17:16:12.368921 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.368867 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec5b1126-9d68-4911-ad3d-6f8369cf5a5d-metrics-certs\") pod \"network-metrics-daemon-wx5ff\" (UID: \"ec5b1126-9d68-4911-ad3d-6f8369cf5a5d\") " pod="openshift-multus/network-metrics-daemon-wx5ff" Jul 01 17:16:12.369673 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.368893 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd657e38-8571-4b17-90b6-952c0e06ddbe-multus-cni-dir\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.369673 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.368918 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8ff09cca-3b59-44ef-9db6-6e5b89491314-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hcdwg\" (UID: \"8ff09cca-3b59-44ef-9db6-6e5b89491314\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcdwg" Jul 01 17:16:12.369673 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.368989 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fd657e38-8571-4b17-90b6-952c0e06ddbe-host-var-lib-cni-multus\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.369673 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.369035 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fd657e38-8571-4b17-90b6-952c0e06ddbe-hostroot\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.369673 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.369062 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fd657e38-8571-4b17-90b6-952c0e06ddbe-host-run-multus-certs\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.369673 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.369088 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mmd8\" (UniqueName: \"kubernetes.io/projected/cecb7d35-1004-44b8-8eef-ca0efbf803cb-kube-api-access-8mmd8\") pod \"network-check-target-9zsrw\" (UID: \"cecb7d35-1004-44b8-8eef-ca0efbf803cb\") " pod="openshift-network-diagnostics/network-check-target-9zsrw" Jul 01 17:16:12.369673 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.369111 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aa1fdd8a-5b35-4bac-9836-028a3292e25c-host-run-netns\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.369673 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.369147 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/aa1fdd8a-5b35-4bac-9836-028a3292e25c-run-ovn\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.369673 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.369173 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fd657e38-8571-4b17-90b6-952c0e06ddbe-host-var-lib-cni-bin\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.369673 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.369204 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/32557f5d-39c9-49c0-bc63-3a9666e0ba57-kubelet-config\") pod \"global-pull-secret-syncer-8h2fn\" (UID: \"32557f5d-39c9-49c0-bc63-3a9666e0ba57\") " pod="kube-system/global-pull-secret-syncer-8h2fn" Jul 01 17:16:12.369673 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.369227 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa1fdd8a-5b35-4bac-9836-028a3292e25c-host-kubelet\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.369673 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.369251 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aa1fdd8a-5b35-4bac-9836-028a3292e25c-host-slash\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.369673 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.369278 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa1fdd8a-5b35-4bac-9836-028a3292e25c-host-run-ovn-kubernetes\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.369673 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.369313 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gssjx\" (UniqueName: \"kubernetes.io/projected/aa1fdd8a-5b35-4bac-9836-028a3292e25c-kube-api-access-gssjx\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.369673 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.369362 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9hpp\" (UniqueName: \"kubernetes.io/projected/2b616970-957c-43eb-8efd-98cfa7957cf9-kube-api-access-g9hpp\") pod \"tuned-k6fj4\" (UID: \"2b616970-957c-43eb-8efd-98cfa7957cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fj4" Jul 01 17:16:12.369673 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.369390 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1cb2e486-78b2-4b87-9cc5-6286495cbc2b-cni-binary-copy\") pod \"multus-additional-cni-plugins-fw624\" (UID: \"1cb2e486-78b2-4b87-9cc5-6286495cbc2b\") " pod="openshift-multus/multus-additional-cni-plugins-fw624" Jul 01 17:16:12.370471 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.369414 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fd657e38-8571-4b17-90b6-952c0e06ddbe-multus-socket-dir-parent\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.370471 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.369450 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 01 17:16:12.370471 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.369453 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fd657e38-8571-4b17-90b6-952c0e06ddbe-multus-daemon-config\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.370471 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.369498 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2bx4\" (UniqueName: \"kubernetes.io/projected/fd657e38-8571-4b17-90b6-952c0e06ddbe-kube-api-access-g2bx4\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.370471 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.369527 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b616970-957c-43eb-8efd-98cfa7957cf9-etc-kubernetes\") pod \"tuned-k6fj4\" (UID: \"2b616970-957c-43eb-8efd-98cfa7957cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fj4" Jul 01 17:16:12.370471 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.369553 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b616970-957c-43eb-8efd-98cfa7957cf9-lib-modules\") pod \"tuned-k6fj4\" (UID: \"2b616970-957c-43eb-8efd-98cfa7957cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fj4" Jul 01 17:16:12.370471 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.369574 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b616970-957c-43eb-8efd-98cfa7957cf9-tmp\") pod \"tuned-k6fj4\" (UID: \"2b616970-957c-43eb-8efd-98cfa7957cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fj4" Jul 01 17:16:12.370471 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.369595 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm5qd\" (UniqueName: \"kubernetes.io/projected/c87a9aa8-cd15-41a5-9879-d6c448cc62eb-kube-api-access-tm5qd\") pod \"node-ca-9ksbn\" (UID: \"c87a9aa8-cd15-41a5-9879-d6c448cc62eb\") " pod="openshift-image-registry/node-ca-9ksbn" Jul 01 17:16:12.370471 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.369618 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa1fdd8a-5b35-4bac-9836-028a3292e25c-var-lib-openvswitch\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.370471 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.369649 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa1fdd8a-5b35-4bac-9836-028a3292e25c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.370471 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.369681 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8ff09cca-3b59-44ef-9db6-6e5b89491314-device-dir\") pod \"aws-ebs-csi-driver-node-hcdwg\" (UID: \"8ff09cca-3b59-44ef-9db6-6e5b89491314\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcdwg" Jul 01 17:16:12.370471 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.369707 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/aa1fdd8a-5b35-4bac-9836-028a3292e25c-host-cni-netd\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.370471 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.369730 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fd657e38-8571-4b17-90b6-952c0e06ddbe-cnibin\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.370471 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.369761 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fd657e38-8571-4b17-90b6-952c0e06ddbe-etc-kubernetes\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.370471 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.369801 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2b616970-957c-43eb-8efd-98cfa7957cf9-etc-tuned\") pod \"tuned-k6fj4\" (UID: \"2b616970-957c-43eb-8efd-98cfa7957cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fj4" Jul 01 17:16:12.370471 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.369824 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjdft\" (UniqueName: \"kubernetes.io/projected/8ff09cca-3b59-44ef-9db6-6e5b89491314-kube-api-access-cjdft\") pod \"aws-ebs-csi-driver-node-hcdwg\" (UID: \"8ff09cca-3b59-44ef-9db6-6e5b89491314\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcdwg" Jul 01 17:16:12.370471 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.369864 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fd657e38-8571-4b17-90b6-952c0e06ddbe-os-release\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.371256 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.369892 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fd657e38-8571-4b17-90b6-952c0e06ddbe-multus-conf-dir\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.371256 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.369915 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/32557f5d-39c9-49c0-bc63-3a9666e0ba57-dbus\") pod \"global-pull-secret-syncer-8h2fn\" (UID: \"32557f5d-39c9-49c0-bc63-3a9666e0ba57\") " pod="kube-system/global-pull-secret-syncer-8h2fn" Jul 01 17:16:12.371256 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.369977 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2b616970-957c-43eb-8efd-98cfa7957cf9-run\") pod \"tuned-k6fj4\" (UID: \"2b616970-957c-43eb-8efd-98cfa7957cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fj4" Jul 01 17:16:12.371256 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.370007 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1cb2e486-78b2-4b87-9cc5-6286495cbc2b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fw624\" (UID: \"1cb2e486-78b2-4b87-9cc5-6286495cbc2b\") " pod="openshift-multus/multus-additional-cni-plugins-fw624" Jul 01 17:16:12.371256 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.370038 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/aa1fdd8a-5b35-4bac-9836-028a3292e25c-ovnkube-config\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.371256 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.370061 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fd657e38-8571-4b17-90b6-952c0e06ddbe-cni-binary-copy\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.371256 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.370083 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2b616970-957c-43eb-8efd-98cfa7957cf9-host\") pod \"tuned-k6fj4\" (UID: \"2b616970-957c-43eb-8efd-98cfa7957cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fj4" Jul 01 17:16:12.371256 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.370105 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c87a9aa8-cd15-41a5-9879-d6c448cc62eb-serviceca\") pod \"node-ca-9ksbn\" (UID: \"c87a9aa8-cd15-41a5-9879-d6c448cc62eb\") " pod="openshift-image-registry/node-ca-9ksbn" Jul 01 17:16:12.371256 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.370127 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1cb2e486-78b2-4b87-9cc5-6286495cbc2b-os-release\") pod \"multus-additional-cni-plugins-fw624\" (UID: \"1cb2e486-78b2-4b87-9cc5-6286495cbc2b\") " pod="openshift-multus/multus-additional-cni-plugins-fw624" Jul 01 17:16:12.371256 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.370157 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/aa1fdd8a-5b35-4bac-9836-028a3292e25c-env-overrides\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.371256 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.370180 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2b616970-957c-43eb-8efd-98cfa7957cf9-etc-sysctl-d\") pod \"tuned-k6fj4\" (UID: \"2b616970-957c-43eb-8efd-98cfa7957cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fj4" Jul 01 17:16:12.371256 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.370202 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8ff09cca-3b59-44ef-9db6-6e5b89491314-etc-selinux\") pod \"aws-ebs-csi-driver-node-hcdwg\" (UID: \"8ff09cca-3b59-44ef-9db6-6e5b89491314\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcdwg" Jul 01 17:16:12.371256 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.370224 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8ff09cca-3b59-44ef-9db6-6e5b89491314-sys-fs\") pod \"aws-ebs-csi-driver-node-hcdwg\" (UID: \"8ff09cca-3b59-44ef-9db6-6e5b89491314\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcdwg" Jul 01 17:16:12.371256 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.370266 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bj9h9\" (UniqueName: \"kubernetes.io/projected/ec5b1126-9d68-4911-ad3d-6f8369cf5a5d-kube-api-access-bj9h9\") pod \"network-metrics-daemon-wx5ff\" (UID: \"ec5b1126-9d68-4911-ad3d-6f8369cf5a5d\") " pod="openshift-multus/network-metrics-daemon-wx5ff" Jul 01 17:16:12.371256 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.370288 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmpsk\" (UniqueName: \"kubernetes.io/projected/1cb2e486-78b2-4b87-9cc5-6286495cbc2b-kube-api-access-fmpsk\") pod \"multus-additional-cni-plugins-fw624\" (UID: \"1cb2e486-78b2-4b87-9cc5-6286495cbc2b\") " pod="openshift-multus/multus-additional-cni-plugins-fw624" Jul 01 17:16:12.371256 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.370330 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa1fdd8a-5b35-4bac-9836-028a3292e25c-etc-openvswitch\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.372179 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.370351 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa1fdd8a-5b35-4bac-9836-028a3292e25c-run-openvswitch\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.372179 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.370372 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/aa1fdd8a-5b35-4bac-9836-028a3292e25c-ovn-node-metrics-cert\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.372179 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.370394 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2b616970-957c-43eb-8efd-98cfa7957cf9-etc-sysctl-conf\") pod \"tuned-k6fj4\" (UID: \"2b616970-957c-43eb-8efd-98cfa7957cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fj4" Jul 01 17:16:12.372179 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.370432 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8ff09cca-3b59-44ef-9db6-6e5b89491314-registration-dir\") pod \"aws-ebs-csi-driver-node-hcdwg\" (UID: \"8ff09cca-3b59-44ef-9db6-6e5b89491314\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcdwg" Jul 01 17:16:12.372179 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.370375 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 01 17:16:12.372179 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.370465 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1cb2e486-78b2-4b87-9cc5-6286495cbc2b-cnibin\") pod \"multus-additional-cni-plugins-fw624\" (UID: \"1cb2e486-78b2-4b87-9cc5-6286495cbc2b\") " pod="openshift-multus/multus-additional-cni-plugins-fw624" Jul 01 17:16:12.372179 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.370513 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1cb2e486-78b2-4b87-9cc5-6286495cbc2b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fw624\" (UID: \"1cb2e486-78b2-4b87-9cc5-6286495cbc2b\") " pod="openshift-multus/multus-additional-cni-plugins-fw624" Jul 01 17:16:12.372179 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.370537 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/aa1fdd8a-5b35-4bac-9836-028a3292e25c-run-systemd\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.372179 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.370560 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fd657e38-8571-4b17-90b6-952c0e06ddbe-host-run-netns\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.372179 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.371047 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-cmjhx\"" Jul 01 17:16:12.372179 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.371488 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 01 17:16:12.372179 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.371620 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 01 17:16:12.372179 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.371625 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-sh8fg\"" Jul 01 17:16:12.372179 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.371714 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 01 17:16:12.372179 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.371915 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 01 17:16:12.373567 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.373508 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 01 17:16:12.373567 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.373512 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 01 17:16:12.374047 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.373978 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qrxfl\"" Jul 01 17:16:12.374047 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.374007 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 01 17:16:12.374047 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.374018 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 01 17:16:12.374257 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.374230 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7hz74\"" Jul 01 17:16:12.374432 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.374318 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 01 17:16:12.381682 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.381660 2547 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 17:16:12.424762 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.424723 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-141.ec2.internal" event={"ID":"a7186fa112b18e5dc69ae2ad2e5c6386","Type":"ContainerStarted","Data":"4743f7b0a7fd339929f1c5fe5546bf6a09d75c22d38fda8f9250eed6d7fb9bf6"} Jul 01 17:16:12.426744 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.426711 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-141.ec2.internal" event={"ID":"ee44633fc0c12eba9ee147b91525d614","Type":"ContainerStarted","Data":"c03ce856640e6858a8cee1d0caa3a7ffba99f443785e6e56c7793a8b0a4ba592"} Jul 01 17:16:12.456684 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.456657 2547 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 01 17:16:12.474563 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.474531 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9lpc\" (UniqueName: \"kubernetes.io/projected/b04b8848-2a26-42ab-adf6-46a857cbd6f2-kube-api-access-v9lpc\") pod \"node-resolver-s96pk\" (UID: \"b04b8848-2a26-42ab-adf6-46a857cbd6f2\") " pod="openshift-dns/node-resolver-s96pk" Jul 01 17:16:12.474670 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.474578 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1cb2e486-78b2-4b87-9cc5-6286495cbc2b-system-cni-dir\") pod \"multus-additional-cni-plugins-fw624\" (UID: \"1cb2e486-78b2-4b87-9cc5-6286495cbc2b\") " pod="openshift-multus/multus-additional-cni-plugins-fw624" Jul 01 17:16:12.474670 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.474608 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1cb2e486-78b2-4b87-9cc5-6286495cbc2b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fw624\" (UID: \"1cb2e486-78b2-4b87-9cc5-6286495cbc2b\") " pod="openshift-multus/multus-additional-cni-plugins-fw624" Jul 01 17:16:12.474670 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.474631 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/aa1fdd8a-5b35-4bac-9836-028a3292e25c-node-log\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.474670 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.474648 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/aa1fdd8a-5b35-4bac-9836-028a3292e25c-log-socket\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.474670 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.474667 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aa1fdd8a-5b35-4bac-9836-028a3292e25c-host-cni-bin\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.474853 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.474692 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fd657e38-8571-4b17-90b6-952c0e06ddbe-host-var-lib-kubelet\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.474853 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.474711 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c87a9aa8-cd15-41a5-9879-d6c448cc62eb-host\") pod \"node-ca-9ksbn\" (UID: \"c87a9aa8-cd15-41a5-9879-d6c448cc62eb\") " pod="openshift-image-registry/node-ca-9ksbn" Jul 01 17:16:12.474853 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.474729 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bef5840a-0d6b-45ed-8bcc-39df0049715f-host-slash\") pod \"iptables-alerter-dgtqc\" (UID: \"bef5840a-0d6b-45ed-8bcc-39df0049715f\") " pod="openshift-network-operator/iptables-alerter-dgtqc" Jul 01 17:16:12.474853 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.474746 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fd657e38-8571-4b17-90b6-952c0e06ddbe-host-run-k8s-cni-cncf-io\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.474853 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.474766 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32557f5d-39c9-49c0-bc63-3a9666e0ba57-original-pull-secret\") pod \"global-pull-secret-syncer-8h2fn\" (UID: \"32557f5d-39c9-49c0-bc63-3a9666e0ba57\") " pod="kube-system/global-pull-secret-syncer-8h2fn" Jul 01 17:16:12.474853 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.474788 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8ff09cca-3b59-44ef-9db6-6e5b89491314-socket-dir\") pod \"aws-ebs-csi-driver-node-hcdwg\" (UID: \"8ff09cca-3b59-44ef-9db6-6e5b89491314\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcdwg" Jul 01 17:16:12.474853 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.474812 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bef5840a-0d6b-45ed-8bcc-39df0049715f-iptables-alerter-script\") pod \"iptables-alerter-dgtqc\" (UID: \"bef5840a-0d6b-45ed-8bcc-39df0049715f\") " pod="openshift-network-operator/iptables-alerter-dgtqc" Jul 01 17:16:12.474853 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.474829 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qb2g\" (UniqueName: \"kubernetes.io/projected/bef5840a-0d6b-45ed-8bcc-39df0049715f-kube-api-access-2qb2g\") pod \"iptables-alerter-dgtqc\" (UID: \"bef5840a-0d6b-45ed-8bcc-39df0049715f\") " pod="openshift-network-operator/iptables-alerter-dgtqc" Jul 01 17:16:12.474853 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.474847 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/627d8da6-a395-4d8c-87f1-075a1402e2dc-konnectivity-ca\") pod \"konnectivity-agent-dd5mp\" (UID: \"627d8da6-a395-4d8c-87f1-075a1402e2dc\") " pod="kube-system/konnectivity-agent-dd5mp" Jul 01 17:16:12.475173 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.474871 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec5b1126-9d68-4911-ad3d-6f8369cf5a5d-metrics-certs\") pod \"network-metrics-daemon-wx5ff\" (UID: \"ec5b1126-9d68-4911-ad3d-6f8369cf5a5d\") " pod="openshift-multus/network-metrics-daemon-wx5ff" Jul 01 17:16:12.475173 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.474892 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd657e38-8571-4b17-90b6-952c0e06ddbe-multus-cni-dir\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.475173 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.474927 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8ff09cca-3b59-44ef-9db6-6e5b89491314-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hcdwg\" (UID: \"8ff09cca-3b59-44ef-9db6-6e5b89491314\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcdwg" Jul 01 17:16:12.475173 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.474962 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fd657e38-8571-4b17-90b6-952c0e06ddbe-host-var-lib-cni-multus\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.475173 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.474990 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fd657e38-8571-4b17-90b6-952c0e06ddbe-hostroot\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.475173 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.475018 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fd657e38-8571-4b17-90b6-952c0e06ddbe-host-run-multus-certs\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.475173 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.475049 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b04b8848-2a26-42ab-adf6-46a857cbd6f2-hosts-file\") pod \"node-resolver-s96pk\" (UID: \"b04b8848-2a26-42ab-adf6-46a857cbd6f2\") " pod="openshift-dns/node-resolver-s96pk" Jul 01 17:16:12.475173 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.475070 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mmd8\" (UniqueName: \"kubernetes.io/projected/cecb7d35-1004-44b8-8eef-ca0efbf803cb-kube-api-access-8mmd8\") pod \"network-check-target-9zsrw\" (UID: \"cecb7d35-1004-44b8-8eef-ca0efbf803cb\") " pod="openshift-network-diagnostics/network-check-target-9zsrw" Jul 01 17:16:12.475173 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.475090 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aa1fdd8a-5b35-4bac-9836-028a3292e25c-host-run-netns\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.475173 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.475113 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/aa1fdd8a-5b35-4bac-9836-028a3292e25c-run-ovn\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.475173 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.475135 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fd657e38-8571-4b17-90b6-952c0e06ddbe-host-var-lib-cni-bin\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.475173 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.475155 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/32557f5d-39c9-49c0-bc63-3a9666e0ba57-kubelet-config\") pod \"global-pull-secret-syncer-8h2fn\" (UID: \"32557f5d-39c9-49c0-bc63-3a9666e0ba57\") " pod="kube-system/global-pull-secret-syncer-8h2fn" Jul 01 17:16:12.475173 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.475173 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa1fdd8a-5b35-4bac-9836-028a3292e25c-host-kubelet\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.475582 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.475189 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aa1fdd8a-5b35-4bac-9836-028a3292e25c-host-slash\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.475582 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.475208 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa1fdd8a-5b35-4bac-9836-028a3292e25c-host-run-ovn-kubernetes\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.475582 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.475226 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gssjx\" (UniqueName: \"kubernetes.io/projected/aa1fdd8a-5b35-4bac-9836-028a3292e25c-kube-api-access-gssjx\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.475582 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.475245 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9hpp\" (UniqueName: \"kubernetes.io/projected/2b616970-957c-43eb-8efd-98cfa7957cf9-kube-api-access-g9hpp\") pod \"tuned-k6fj4\" (UID: \"2b616970-957c-43eb-8efd-98cfa7957cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fj4" Jul 01 17:16:12.475582 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.475265 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1cb2e486-78b2-4b87-9cc5-6286495cbc2b-cni-binary-copy\") pod \"multus-additional-cni-plugins-fw624\" (UID: \"1cb2e486-78b2-4b87-9cc5-6286495cbc2b\") " pod="openshift-multus/multus-additional-cni-plugins-fw624" Jul 01 17:16:12.475582 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.475281 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fd657e38-8571-4b17-90b6-952c0e06ddbe-multus-socket-dir-parent\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.475582 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.475305 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fd657e38-8571-4b17-90b6-952c0e06ddbe-multus-daemon-config\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.475582 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.475329 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2bx4\" (UniqueName: \"kubernetes.io/projected/fd657e38-8571-4b17-90b6-952c0e06ddbe-kube-api-access-g2bx4\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.475582 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.475347 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b616970-957c-43eb-8efd-98cfa7957cf9-etc-kubernetes\") pod \"tuned-k6fj4\" (UID: \"2b616970-957c-43eb-8efd-98cfa7957cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fj4" Jul 01 17:16:12.475582 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.475364 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b616970-957c-43eb-8efd-98cfa7957cf9-lib-modules\") pod \"tuned-k6fj4\" (UID: \"2b616970-957c-43eb-8efd-98cfa7957cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fj4" Jul 01 17:16:12.475582 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.475382 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b616970-957c-43eb-8efd-98cfa7957cf9-tmp\") pod \"tuned-k6fj4\" (UID: \"2b616970-957c-43eb-8efd-98cfa7957cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fj4" Jul 01 17:16:12.475582 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.475400 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm5qd\" (UniqueName: \"kubernetes.io/projected/c87a9aa8-cd15-41a5-9879-d6c448cc62eb-kube-api-access-tm5qd\") pod \"node-ca-9ksbn\" (UID: \"c87a9aa8-cd15-41a5-9879-d6c448cc62eb\") " pod="openshift-image-registry/node-ca-9ksbn" Jul 01 17:16:12.475582 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.475416 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa1fdd8a-5b35-4bac-9836-028a3292e25c-var-lib-openvswitch\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.475582 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.475436 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa1fdd8a-5b35-4bac-9836-028a3292e25c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.475582 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.475455 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8ff09cca-3b59-44ef-9db6-6e5b89491314-device-dir\") pod \"aws-ebs-csi-driver-node-hcdwg\" (UID: \"8ff09cca-3b59-44ef-9db6-6e5b89491314\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcdwg" Jul 01 17:16:12.475582 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.475474 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b04b8848-2a26-42ab-adf6-46a857cbd6f2-tmp-dir\") pod \"node-resolver-s96pk\" (UID: \"b04b8848-2a26-42ab-adf6-46a857cbd6f2\") " pod="openshift-dns/node-resolver-s96pk" Jul 01 17:16:12.475582 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.475497 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/aa1fdd8a-5b35-4bac-9836-028a3292e25c-host-cni-netd\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.476206 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.475529 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fd657e38-8571-4b17-90b6-952c0e06ddbe-cnibin\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.476206 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.475563 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fd657e38-8571-4b17-90b6-952c0e06ddbe-etc-kubernetes\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.476206 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.475598 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2b616970-957c-43eb-8efd-98cfa7957cf9-etc-tuned\") pod \"tuned-k6fj4\" (UID: \"2b616970-957c-43eb-8efd-98cfa7957cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fj4" Jul 01 17:16:12.476206 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.475637 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjdft\" (UniqueName: \"kubernetes.io/projected/8ff09cca-3b59-44ef-9db6-6e5b89491314-kube-api-access-cjdft\") pod \"aws-ebs-csi-driver-node-hcdwg\" (UID: \"8ff09cca-3b59-44ef-9db6-6e5b89491314\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcdwg" Jul 01 17:16:12.476206 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.475654 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fd657e38-8571-4b17-90b6-952c0e06ddbe-os-release\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.476206 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.475676 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fd657e38-8571-4b17-90b6-952c0e06ddbe-multus-conf-dir\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.476206 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.475705 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/32557f5d-39c9-49c0-bc63-3a9666e0ba57-dbus\") pod \"global-pull-secret-syncer-8h2fn\" (UID: \"32557f5d-39c9-49c0-bc63-3a9666e0ba57\") " pod="kube-system/global-pull-secret-syncer-8h2fn" Jul 01 17:16:12.476206 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.475724 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2b616970-957c-43eb-8efd-98cfa7957cf9-run\") pod \"tuned-k6fj4\" (UID: \"2b616970-957c-43eb-8efd-98cfa7957cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fj4" Jul 01 17:16:12.476206 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.475742 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1cb2e486-78b2-4b87-9cc5-6286495cbc2b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fw624\" (UID: \"1cb2e486-78b2-4b87-9cc5-6286495cbc2b\") " pod="openshift-multus/multus-additional-cni-plugins-fw624" Jul 01 17:16:12.476206 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.475759 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/aa1fdd8a-5b35-4bac-9836-028a3292e25c-ovnkube-config\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.476206 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.475778 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fd657e38-8571-4b17-90b6-952c0e06ddbe-cni-binary-copy\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.476206 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.475807 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2b616970-957c-43eb-8efd-98cfa7957cf9-host\") pod \"tuned-k6fj4\" (UID: \"2b616970-957c-43eb-8efd-98cfa7957cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fj4" Jul 01 17:16:12.476206 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.475835 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c87a9aa8-cd15-41a5-9879-d6c448cc62eb-serviceca\") pod \"node-ca-9ksbn\" (UID: \"c87a9aa8-cd15-41a5-9879-d6c448cc62eb\") " pod="openshift-image-registry/node-ca-9ksbn" Jul 01 17:16:12.476206 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.475852 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/627d8da6-a395-4d8c-87f1-075a1402e2dc-agent-certs\") pod \"konnectivity-agent-dd5mp\" (UID: \"627d8da6-a395-4d8c-87f1-075a1402e2dc\") " pod="kube-system/konnectivity-agent-dd5mp" Jul 01 17:16:12.476206 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.475872 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1cb2e486-78b2-4b87-9cc5-6286495cbc2b-os-release\") pod \"multus-additional-cni-plugins-fw624\" (UID: \"1cb2e486-78b2-4b87-9cc5-6286495cbc2b\") " pod="openshift-multus/multus-additional-cni-plugins-fw624" Jul 01 17:16:12.476206 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.475897 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/aa1fdd8a-5b35-4bac-9836-028a3292e25c-env-overrides\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.476206 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.475925 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2b616970-957c-43eb-8efd-98cfa7957cf9-etc-sysctl-d\") pod \"tuned-k6fj4\" (UID: \"2b616970-957c-43eb-8efd-98cfa7957cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fj4" Jul 01 17:16:12.476206 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.475943 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8ff09cca-3b59-44ef-9db6-6e5b89491314-etc-selinux\") pod \"aws-ebs-csi-driver-node-hcdwg\" (UID: \"8ff09cca-3b59-44ef-9db6-6e5b89491314\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcdwg" Jul 01 17:16:12.476750 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.475984 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8ff09cca-3b59-44ef-9db6-6e5b89491314-sys-fs\") pod \"aws-ebs-csi-driver-node-hcdwg\" (UID: \"8ff09cca-3b59-44ef-9db6-6e5b89491314\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcdwg" Jul 01 17:16:12.476750 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.476004 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bj9h9\" (UniqueName: \"kubernetes.io/projected/ec5b1126-9d68-4911-ad3d-6f8369cf5a5d-kube-api-access-bj9h9\") pod \"network-metrics-daemon-wx5ff\" (UID: \"ec5b1126-9d68-4911-ad3d-6f8369cf5a5d\") " pod="openshift-multus/network-metrics-daemon-wx5ff" Jul 01 17:16:12.476750 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.476024 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmpsk\" (UniqueName: \"kubernetes.io/projected/1cb2e486-78b2-4b87-9cc5-6286495cbc2b-kube-api-access-fmpsk\") pod \"multus-additional-cni-plugins-fw624\" (UID: \"1cb2e486-78b2-4b87-9cc5-6286495cbc2b\") " pod="openshift-multus/multus-additional-cni-plugins-fw624" Jul 01 17:16:12.476750 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.476042 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa1fdd8a-5b35-4bac-9836-028a3292e25c-etc-openvswitch\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.476750 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.476063 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa1fdd8a-5b35-4bac-9836-028a3292e25c-run-openvswitch\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.476750 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.476085 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/aa1fdd8a-5b35-4bac-9836-028a3292e25c-ovn-node-metrics-cert\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.476750 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.476103 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2b616970-957c-43eb-8efd-98cfa7957cf9-etc-sysctl-conf\") pod \"tuned-k6fj4\" (UID: \"2b616970-957c-43eb-8efd-98cfa7957cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fj4" Jul 01 17:16:12.476750 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.476128 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8ff09cca-3b59-44ef-9db6-6e5b89491314-registration-dir\") pod \"aws-ebs-csi-driver-node-hcdwg\" (UID: \"8ff09cca-3b59-44ef-9db6-6e5b89491314\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcdwg" Jul 01 17:16:12.476750 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.476153 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1cb2e486-78b2-4b87-9cc5-6286495cbc2b-cnibin\") pod \"multus-additional-cni-plugins-fw624\" (UID: \"1cb2e486-78b2-4b87-9cc5-6286495cbc2b\") " pod="openshift-multus/multus-additional-cni-plugins-fw624" Jul 01 17:16:12.476750 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.476173 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1cb2e486-78b2-4b87-9cc5-6286495cbc2b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fw624\" (UID: \"1cb2e486-78b2-4b87-9cc5-6286495cbc2b\") " pod="openshift-multus/multus-additional-cni-plugins-fw624" Jul 01 17:16:12.476750 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.476201 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/aa1fdd8a-5b35-4bac-9836-028a3292e25c-run-systemd\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.476750 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.476221 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fd657e38-8571-4b17-90b6-952c0e06ddbe-host-run-netns\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.476750 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.476240 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/aa1fdd8a-5b35-4bac-9836-028a3292e25c-systemd-units\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.476750 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.476259 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2b616970-957c-43eb-8efd-98cfa7957cf9-etc-modprobe-d\") pod \"tuned-k6fj4\" (UID: \"2b616970-957c-43eb-8efd-98cfa7957cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fj4" Jul 01 17:16:12.476750 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.476279 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2b616970-957c-43eb-8efd-98cfa7957cf9-etc-sysconfig\") pod \"tuned-k6fj4\" (UID: \"2b616970-957c-43eb-8efd-98cfa7957cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fj4" Jul 01 17:16:12.476750 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.476299 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2b616970-957c-43eb-8efd-98cfa7957cf9-etc-systemd\") pod \"tuned-k6fj4\" (UID: \"2b616970-957c-43eb-8efd-98cfa7957cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fj4" Jul 01 17:16:12.476750 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.476324 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b616970-957c-43eb-8efd-98cfa7957cf9-sys\") pod \"tuned-k6fj4\" (UID: \"2b616970-957c-43eb-8efd-98cfa7957cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fj4" Jul 01 17:16:12.477554 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.476349 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b616970-957c-43eb-8efd-98cfa7957cf9-var-lib-kubelet\") pod \"tuned-k6fj4\" (UID: \"2b616970-957c-43eb-8efd-98cfa7957cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fj4" Jul 01 17:16:12.477554 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.476366 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/aa1fdd8a-5b35-4bac-9836-028a3292e25c-ovnkube-script-lib\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.477554 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.476387 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd657e38-8571-4b17-90b6-952c0e06ddbe-system-cni-dir\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.477554 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.476493 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd657e38-8571-4b17-90b6-952c0e06ddbe-system-cni-dir\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.477554 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.476552 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1cb2e486-78b2-4b87-9cc5-6286495cbc2b-system-cni-dir\") pod \"multus-additional-cni-plugins-fw624\" (UID: \"1cb2e486-78b2-4b87-9cc5-6286495cbc2b\") " pod="openshift-multus/multus-additional-cni-plugins-fw624" Jul 01 17:16:12.477554 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.477055 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1cb2e486-78b2-4b87-9cc5-6286495cbc2b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fw624\" (UID: \"1cb2e486-78b2-4b87-9cc5-6286495cbc2b\") " pod="openshift-multus/multus-additional-cni-plugins-fw624" Jul 01 17:16:12.477554 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.477161 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/aa1fdd8a-5b35-4bac-9836-028a3292e25c-node-log\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.477554 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.477213 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/aa1fdd8a-5b35-4bac-9836-028a3292e25c-log-socket\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.477554 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.477244 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aa1fdd8a-5b35-4bac-9836-028a3292e25c-host-cni-bin\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.477554 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.477274 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fd657e38-8571-4b17-90b6-952c0e06ddbe-host-var-lib-kubelet\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.477554 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.477302 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c87a9aa8-cd15-41a5-9879-d6c448cc62eb-host\") pod \"node-ca-9ksbn\" (UID: \"c87a9aa8-cd15-41a5-9879-d6c448cc62eb\") " pod="openshift-image-registry/node-ca-9ksbn" Jul 01 17:16:12.477554 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.477345 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fd657e38-8571-4b17-90b6-952c0e06ddbe-host-run-k8s-cni-cncf-io\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.478092 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:12.477837 2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 17:16:12.478092 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:12.477968 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32557f5d-39c9-49c0-bc63-3a9666e0ba57-original-pull-secret podName:32557f5d-39c9-49c0-bc63-3a9666e0ba57 nodeName:}" failed. No retries permitted until 2026-07-01 17:16:12.977898969 +0000 UTC m=+3.009896221 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/32557f5d-39c9-49c0-bc63-3a9666e0ba57-original-pull-secret") pod "global-pull-secret-syncer-8h2fn" (UID: "32557f5d-39c9-49c0-bc63-3a9666e0ba57") : object "kube-system"/"original-pull-secret" not registered Jul 01 17:16:12.478244 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.478225 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fd657e38-8571-4b17-90b6-952c0e06ddbe-etc-kubernetes\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.478386 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.478357 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8ff09cca-3b59-44ef-9db6-6e5b89491314-socket-dir\") pod \"aws-ebs-csi-driver-node-hcdwg\" (UID: \"8ff09cca-3b59-44ef-9db6-6e5b89491314\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcdwg" Jul 01 17:16:12.478528 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:12.478509 2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:16:12.478594 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:12.478573 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec5b1126-9d68-4911-ad3d-6f8369cf5a5d-metrics-certs podName:ec5b1126-9d68-4911-ad3d-6f8369cf5a5d nodeName:}" failed. No retries permitted until 2026-07-01 17:16:12.978555606 +0000 UTC m=+3.010552862 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec5b1126-9d68-4911-ad3d-6f8369cf5a5d-metrics-certs") pod "network-metrics-daemon-wx5ff" (UID: "ec5b1126-9d68-4911-ad3d-6f8369cf5a5d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:16:12.478754 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.478732 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd657e38-8571-4b17-90b6-952c0e06ddbe-multus-cni-dir\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.478871 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.478773 2547 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 01 17:16:12.478871 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.478799 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8ff09cca-3b59-44ef-9db6-6e5b89491314-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hcdwg\" (UID: \"8ff09cca-3b59-44ef-9db6-6e5b89491314\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcdwg" Jul 01 17:16:12.479056 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.479038 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa1fdd8a-5b35-4bac-9836-028a3292e25c-etc-openvswitch\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.479134 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.479064 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aa1fdd8a-5b35-4bac-9836-028a3292e25c-host-run-netns\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.479134 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.479101 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fd657e38-8571-4b17-90b6-952c0e06ddbe-host-run-multus-certs\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.479236 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.479133 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/aa1fdd8a-5b35-4bac-9836-028a3292e25c-run-ovn\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.479236 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.479160 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa1fdd8a-5b35-4bac-9836-028a3292e25c-run-openvswitch\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.479334 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.479235 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/32557f5d-39c9-49c0-bc63-3a9666e0ba57-kubelet-config\") pod \"global-pull-secret-syncer-8h2fn\" (UID: \"32557f5d-39c9-49c0-bc63-3a9666e0ba57\") " pod="kube-system/global-pull-secret-syncer-8h2fn" Jul 01 17:16:12.479334 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.479240 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1cb2e486-78b2-4b87-9cc5-6286495cbc2b-cnibin\") pod \"multus-additional-cni-plugins-fw624\" (UID: \"1cb2e486-78b2-4b87-9cc5-6286495cbc2b\") " pod="openshift-multus/multus-additional-cni-plugins-fw624" Jul 01 17:16:12.479334 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.479298 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa1fdd8a-5b35-4bac-9836-028a3292e25c-host-kubelet\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.479478 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.479345 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aa1fdd8a-5b35-4bac-9836-028a3292e25c-host-slash\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.479588 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.479550 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fd657e38-8571-4b17-90b6-952c0e06ddbe-host-var-lib-cni-multus\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.479588 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.479011 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fd657e38-8571-4b17-90b6-952c0e06ddbe-hostroot\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.479707 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.479182 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fd657e38-8571-4b17-90b6-952c0e06ddbe-host-var-lib-cni-bin\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.479762 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.479735 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa1fdd8a-5b35-4bac-9836-028a3292e25c-host-run-ovn-kubernetes\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.479762 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.479752 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/aa1fdd8a-5b35-4bac-9836-028a3292e25c-systemd-units\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.479854 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.479770 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fd657e38-8571-4b17-90b6-952c0e06ddbe-host-run-netns\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.479934 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.479917 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2b616970-957c-43eb-8efd-98cfa7957cf9-etc-systemd\") pod \"tuned-k6fj4\" (UID: \"2b616970-957c-43eb-8efd-98cfa7957cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fj4" Jul 01 17:16:12.480018 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.479920 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fd657e38-8571-4b17-90b6-952c0e06ddbe-multus-socket-dir-parent\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.480070 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.480015 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b616970-957c-43eb-8efd-98cfa7957cf9-var-lib-kubelet\") pod \"tuned-k6fj4\" (UID: \"2b616970-957c-43eb-8efd-98cfa7957cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fj4" Jul 01 17:16:12.480141 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.480124 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1cb2e486-78b2-4b87-9cc5-6286495cbc2b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fw624\" (UID: \"1cb2e486-78b2-4b87-9cc5-6286495cbc2b\") " pod="openshift-multus/multus-additional-cni-plugins-fw624" Jul 01 17:16:12.480228 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.480205 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2b616970-957c-43eb-8efd-98cfa7957cf9-etc-modprobe-d\") pod \"tuned-k6fj4\" (UID: \"2b616970-957c-43eb-8efd-98cfa7957cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fj4" Jul 01 17:16:12.480653 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.480628 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/aa1fdd8a-5b35-4bac-9836-028a3292e25c-ovnkube-script-lib\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.480734 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.480656 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa1fdd8a-5b35-4bac-9836-028a3292e25c-var-lib-openvswitch\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.480734 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.480703 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2b616970-957c-43eb-8efd-98cfa7957cf9-etc-sysconfig\") pod \"tuned-k6fj4\" (UID: \"2b616970-957c-43eb-8efd-98cfa7957cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fj4" Jul 01 17:16:12.480734 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.480705 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa1fdd8a-5b35-4bac-9836-028a3292e25c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.480887 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.480785 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/aa1fdd8a-5b35-4bac-9836-028a3292e25c-host-cni-netd\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.480887 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.480842 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fd657e38-8571-4b17-90b6-952c0e06ddbe-cnibin\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.480887 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.480864 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fd657e38-8571-4b17-90b6-952c0e06ddbe-os-release\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.481046 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.480964 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b616970-957c-43eb-8efd-98cfa7957cf9-etc-kubernetes\") pod \"tuned-k6fj4\" (UID: \"2b616970-957c-43eb-8efd-98cfa7957cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fj4" Jul 01 17:16:12.481046 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.481005 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b616970-957c-43eb-8efd-98cfa7957cf9-lib-modules\") pod \"tuned-k6fj4\" (UID: \"2b616970-957c-43eb-8efd-98cfa7957cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fj4" Jul 01 17:16:12.481156 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.481117 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8ff09cca-3b59-44ef-9db6-6e5b89491314-registration-dir\") pod \"aws-ebs-csi-driver-node-hcdwg\" (UID: \"8ff09cca-3b59-44ef-9db6-6e5b89491314\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcdwg" Jul 01 17:16:12.481156 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.481122 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2b616970-957c-43eb-8efd-98cfa7957cf9-run\") pod \"tuned-k6fj4\" (UID: \"2b616970-957c-43eb-8efd-98cfa7957cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fj4" Jul 01 17:16:12.481256 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.481222 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1cb2e486-78b2-4b87-9cc5-6286495cbc2b-cni-binary-copy\") pod \"multus-additional-cni-plugins-fw624\" (UID: \"1cb2e486-78b2-4b87-9cc5-6286495cbc2b\") " pod="openshift-multus/multus-additional-cni-plugins-fw624" Jul 01 17:16:12.481311 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.481293 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1cb2e486-78b2-4b87-9cc5-6286495cbc2b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fw624\" (UID: \"1cb2e486-78b2-4b87-9cc5-6286495cbc2b\") " pod="openshift-multus/multus-additional-cni-plugins-fw624" Jul 01 17:16:12.481370 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.481341 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/aa1fdd8a-5b35-4bac-9836-028a3292e25c-run-systemd\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.481503 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.481485 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fd657e38-8571-4b17-90b6-952c0e06ddbe-multus-daemon-config\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.481564 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.481509 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fd657e38-8571-4b17-90b6-952c0e06ddbe-cni-binary-copy\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.481652 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.481638 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2b616970-957c-43eb-8efd-98cfa7957cf9-host\") pod \"tuned-k6fj4\" (UID: \"2b616970-957c-43eb-8efd-98cfa7957cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fj4" Jul 01 17:16:12.481685 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.481648 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8ff09cca-3b59-44ef-9db6-6e5b89491314-device-dir\") pod \"aws-ebs-csi-driver-node-hcdwg\" (UID: \"8ff09cca-3b59-44ef-9db6-6e5b89491314\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcdwg" Jul 01 17:16:12.481734 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.481696 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b616970-957c-43eb-8efd-98cfa7957cf9-sys\") pod \"tuned-k6fj4\" (UID: \"2b616970-957c-43eb-8efd-98cfa7957cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fj4" Jul 01 17:16:12.481734 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.481701 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1cb2e486-78b2-4b87-9cc5-6286495cbc2b-os-release\") pod \"multus-additional-cni-plugins-fw624\" (UID: \"1cb2e486-78b2-4b87-9cc5-6286495cbc2b\") " pod="openshift-multus/multus-additional-cni-plugins-fw624" Jul 01 17:16:12.481856 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.481813 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2b616970-957c-43eb-8efd-98cfa7957cf9-etc-sysctl-conf\") pod \"tuned-k6fj4\" (UID: \"2b616970-957c-43eb-8efd-98cfa7957cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fj4" Jul 01 17:16:12.482463 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.482234 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fd657e38-8571-4b17-90b6-952c0e06ddbe-multus-conf-dir\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.482463 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.482308 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2b616970-957c-43eb-8efd-98cfa7957cf9-etc-sysctl-d\") pod \"tuned-k6fj4\" (UID: \"2b616970-957c-43eb-8efd-98cfa7957cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fj4" Jul 01 17:16:12.482833 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.482755 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c87a9aa8-cd15-41a5-9879-d6c448cc62eb-serviceca\") pod \"node-ca-9ksbn\" (UID: \"c87a9aa8-cd15-41a5-9879-d6c448cc62eb\") " pod="openshift-image-registry/node-ca-9ksbn" Jul 01 17:16:12.482833 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.482786 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/32557f5d-39c9-49c0-bc63-3a9666e0ba57-dbus\") pod \"global-pull-secret-syncer-8h2fn\" (UID: \"32557f5d-39c9-49c0-bc63-3a9666e0ba57\") " pod="kube-system/global-pull-secret-syncer-8h2fn" Jul 01 17:16:12.482833 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.482814 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8ff09cca-3b59-44ef-9db6-6e5b89491314-sys-fs\") pod \"aws-ebs-csi-driver-node-hcdwg\" (UID: \"8ff09cca-3b59-44ef-9db6-6e5b89491314\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcdwg" Jul 01 17:16:12.483039 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.482988 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/aa1fdd8a-5b35-4bac-9836-028a3292e25c-env-overrides\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.483309 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.483288 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/aa1fdd8a-5b35-4bac-9836-028a3292e25c-ovnkube-config\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.484070 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.484041 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8ff09cca-3b59-44ef-9db6-6e5b89491314-etc-selinux\") pod \"aws-ebs-csi-driver-node-hcdwg\" (UID: \"8ff09cca-3b59-44ef-9db6-6e5b89491314\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcdwg" Jul 01 17:16:12.484146 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.484131 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b616970-957c-43eb-8efd-98cfa7957cf9-tmp\") pod \"tuned-k6fj4\" (UID: \"2b616970-957c-43eb-8efd-98cfa7957cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fj4" Jul 01 17:16:12.484222 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.484205 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2b616970-957c-43eb-8efd-98cfa7957cf9-etc-tuned\") pod \"tuned-k6fj4\" (UID: \"2b616970-957c-43eb-8efd-98cfa7957cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fj4" Jul 01 17:16:12.485152 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.485132 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/aa1fdd8a-5b35-4bac-9836-028a3292e25c-ovn-node-metrics-cert\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.489639 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.489618 2547 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jtv9b" Jul 01 17:16:12.492390 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.492368 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bj9h9\" (UniqueName: \"kubernetes.io/projected/ec5b1126-9d68-4911-ad3d-6f8369cf5a5d-kube-api-access-bj9h9\") pod \"network-metrics-daemon-wx5ff\" (UID: \"ec5b1126-9d68-4911-ad3d-6f8369cf5a5d\") " pod="openshift-multus/network-metrics-daemon-wx5ff" Jul 01 17:16:12.495508 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:12.495485 2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 17:16:12.495607 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:12.495516 2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 17:16:12.495607 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:12.495531 2547 projected.go:196] Error preparing data for projected volume kube-api-access-8mmd8 for pod openshift-network-diagnostics/network-check-target-9zsrw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:16:12.495607 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:12.495586 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cecb7d35-1004-44b8-8eef-ca0efbf803cb-kube-api-access-8mmd8 podName:cecb7d35-1004-44b8-8eef-ca0efbf803cb nodeName:}" failed. No retries permitted until 2026-07-01 17:16:12.995568378 +0000 UTC m=+3.027565632 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8mmd8" (UniqueName: "kubernetes.io/projected/cecb7d35-1004-44b8-8eef-ca0efbf803cb-kube-api-access-8mmd8") pod "network-check-target-9zsrw" (UID: "cecb7d35-1004-44b8-8eef-ca0efbf803cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:16:12.495782 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.495771 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmpsk\" (UniqueName: \"kubernetes.io/projected/1cb2e486-78b2-4b87-9cc5-6286495cbc2b-kube-api-access-fmpsk\") pod \"multus-additional-cni-plugins-fw624\" (UID: \"1cb2e486-78b2-4b87-9cc5-6286495cbc2b\") " pod="openshift-multus/multus-additional-cni-plugins-fw624" Jul 01 17:16:12.498450 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.498393 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjdft\" (UniqueName: \"kubernetes.io/projected/8ff09cca-3b59-44ef-9db6-6e5b89491314-kube-api-access-cjdft\") pod \"aws-ebs-csi-driver-node-hcdwg\" (UID: \"8ff09cca-3b59-44ef-9db6-6e5b89491314\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcdwg" Jul 01 17:16:12.498450 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.498398 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9hpp\" (UniqueName: \"kubernetes.io/projected/2b616970-957c-43eb-8efd-98cfa7957cf9-kube-api-access-g9hpp\") pod \"tuned-k6fj4\" (UID: \"2b616970-957c-43eb-8efd-98cfa7957cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-k6fj4" Jul 01 17:16:12.499090 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.499073 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gssjx\" (UniqueName: \"kubernetes.io/projected/aa1fdd8a-5b35-4bac-9836-028a3292e25c-kube-api-access-gssjx\") pod \"ovnkube-node-qh49d\" (UID: \"aa1fdd8a-5b35-4bac-9836-028a3292e25c\") " pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.499294 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.499275 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2bx4\" (UniqueName: \"kubernetes.io/projected/fd657e38-8571-4b17-90b6-952c0e06ddbe-kube-api-access-g2bx4\") pod \"multus-bvz2x\" (UID: \"fd657e38-8571-4b17-90b6-952c0e06ddbe\") " pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.500245 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.500223 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm5qd\" (UniqueName: \"kubernetes.io/projected/c87a9aa8-cd15-41a5-9879-d6c448cc62eb-kube-api-access-tm5qd\") pod \"node-ca-9ksbn\" (UID: \"c87a9aa8-cd15-41a5-9879-d6c448cc62eb\") " pod="openshift-image-registry/node-ca-9ksbn" Jul 01 17:16:12.502858 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.502837 2547 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jtv9b" Jul 01 17:16:12.576959 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.576919 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b04b8848-2a26-42ab-adf6-46a857cbd6f2-tmp-dir\") pod \"node-resolver-s96pk\" (UID: \"b04b8848-2a26-42ab-adf6-46a857cbd6f2\") " pod="openshift-dns/node-resolver-s96pk" Jul 01 17:16:12.577142 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.576988 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/627d8da6-a395-4d8c-87f1-075a1402e2dc-agent-certs\") pod \"konnectivity-agent-dd5mp\" (UID: \"627d8da6-a395-4d8c-87f1-075a1402e2dc\") " pod="kube-system/konnectivity-agent-dd5mp" Jul 01 17:16:12.577142 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.577033 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9lpc\" (UniqueName: \"kubernetes.io/projected/b04b8848-2a26-42ab-adf6-46a857cbd6f2-kube-api-access-v9lpc\") pod \"node-resolver-s96pk\" (UID: \"b04b8848-2a26-42ab-adf6-46a857cbd6f2\") " pod="openshift-dns/node-resolver-s96pk" Jul 01 17:16:12.577142 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.577064 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bef5840a-0d6b-45ed-8bcc-39df0049715f-host-slash\") pod \"iptables-alerter-dgtqc\" (UID: \"bef5840a-0d6b-45ed-8bcc-39df0049715f\") " pod="openshift-network-operator/iptables-alerter-dgtqc" Jul 01 17:16:12.577142 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.577103 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bef5840a-0d6b-45ed-8bcc-39df0049715f-iptables-alerter-script\") pod \"iptables-alerter-dgtqc\" (UID: \"bef5840a-0d6b-45ed-8bcc-39df0049715f\") " pod="openshift-network-operator/iptables-alerter-dgtqc" Jul 01 17:16:12.577142 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.577127 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qb2g\" (UniqueName: \"kubernetes.io/projected/bef5840a-0d6b-45ed-8bcc-39df0049715f-kube-api-access-2qb2g\") pod \"iptables-alerter-dgtqc\" (UID: \"bef5840a-0d6b-45ed-8bcc-39df0049715f\") " pod="openshift-network-operator/iptables-alerter-dgtqc" Jul 01 17:16:12.577422 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.577153 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/627d8da6-a395-4d8c-87f1-075a1402e2dc-konnectivity-ca\") pod \"konnectivity-agent-dd5mp\" (UID: \"627d8da6-a395-4d8c-87f1-075a1402e2dc\") " pod="kube-system/konnectivity-agent-dd5mp" Jul 01 17:16:12.577422 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.577198 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b04b8848-2a26-42ab-adf6-46a857cbd6f2-hosts-file\") pod \"node-resolver-s96pk\" (UID: \"b04b8848-2a26-42ab-adf6-46a857cbd6f2\") " pod="openshift-dns/node-resolver-s96pk" Jul 01 17:16:12.577422 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.577223 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bef5840a-0d6b-45ed-8bcc-39df0049715f-host-slash\") pod \"iptables-alerter-dgtqc\" (UID: \"bef5840a-0d6b-45ed-8bcc-39df0049715f\") " pod="openshift-network-operator/iptables-alerter-dgtqc" Jul 01 17:16:12.577422 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.577284 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b04b8848-2a26-42ab-adf6-46a857cbd6f2-hosts-file\") pod \"node-resolver-s96pk\" (UID: \"b04b8848-2a26-42ab-adf6-46a857cbd6f2\") " pod="openshift-dns/node-resolver-s96pk" Jul 01 17:16:12.577422 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.577335 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b04b8848-2a26-42ab-adf6-46a857cbd6f2-tmp-dir\") pod \"node-resolver-s96pk\" (UID: \"b04b8848-2a26-42ab-adf6-46a857cbd6f2\") " pod="openshift-dns/node-resolver-s96pk" Jul 01 17:16:12.577795 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.577777 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bef5840a-0d6b-45ed-8bcc-39df0049715f-iptables-alerter-script\") pod \"iptables-alerter-dgtqc\" (UID: \"bef5840a-0d6b-45ed-8bcc-39df0049715f\") " pod="openshift-network-operator/iptables-alerter-dgtqc" Jul 01 17:16:12.577862 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.577827 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/627d8da6-a395-4d8c-87f1-075a1402e2dc-konnectivity-ca\") pod \"konnectivity-agent-dd5mp\" (UID: \"627d8da6-a395-4d8c-87f1-075a1402e2dc\") " pod="kube-system/konnectivity-agent-dd5mp" Jul 01 17:16:12.580201 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.580146 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/627d8da6-a395-4d8c-87f1-075a1402e2dc-agent-certs\") pod \"konnectivity-agent-dd5mp\" (UID: \"627d8da6-a395-4d8c-87f1-075a1402e2dc\") " pod="kube-system/konnectivity-agent-dd5mp" Jul 01 17:16:12.587288 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.587246 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qb2g\" (UniqueName: \"kubernetes.io/projected/bef5840a-0d6b-45ed-8bcc-39df0049715f-kube-api-access-2qb2g\") pod \"iptables-alerter-dgtqc\" (UID: \"bef5840a-0d6b-45ed-8bcc-39df0049715f\") " pod="openshift-network-operator/iptables-alerter-dgtqc" Jul 01 17:16:12.588379 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.588358 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9lpc\" (UniqueName: \"kubernetes.io/projected/b04b8848-2a26-42ab-adf6-46a857cbd6f2-kube-api-access-v9lpc\") pod \"node-resolver-s96pk\" (UID: \"b04b8848-2a26-42ab-adf6-46a857cbd6f2\") " pod="openshift-dns/node-resolver-s96pk" Jul 01 17:16:12.664114 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.664081 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcdwg" Jul 01 17:16:12.675137 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.675113 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:12.685273 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.685247 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bvz2x" Jul 01 17:16:12.689236 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.689216 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fw624" Jul 01 17:16:12.699897 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.699875 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k6fj4" Jul 01 17:16:12.709780 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.709760 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9ksbn" Jul 01 17:16:12.721372 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.721347 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dgtqc" Jul 01 17:16:12.731365 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.731346 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-s96pk" Jul 01 17:16:12.738053 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.738034 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dd5mp" Jul 01 17:16:12.980558 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.980482 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32557f5d-39c9-49c0-bc63-3a9666e0ba57-original-pull-secret\") pod \"global-pull-secret-syncer-8h2fn\" (UID: \"32557f5d-39c9-49c0-bc63-3a9666e0ba57\") " pod="kube-system/global-pull-secret-syncer-8h2fn" Jul 01 17:16:12.980558 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:12.980527 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec5b1126-9d68-4911-ad3d-6f8369cf5a5d-metrics-certs\") pod \"network-metrics-daemon-wx5ff\" (UID: \"ec5b1126-9d68-4911-ad3d-6f8369cf5a5d\") " pod="openshift-multus/network-metrics-daemon-wx5ff" Jul 01 17:16:12.980761 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:12.980632 2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:16:12.980761 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:12.980635 2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 17:16:12.980761 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:12.980707 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec5b1126-9d68-4911-ad3d-6f8369cf5a5d-metrics-certs podName:ec5b1126-9d68-4911-ad3d-6f8369cf5a5d nodeName:}" failed. No retries permitted until 2026-07-01 17:16:13.980683918 +0000 UTC m=+4.012681170 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec5b1126-9d68-4911-ad3d-6f8369cf5a5d-metrics-certs") pod "network-metrics-daemon-wx5ff" (UID: "ec5b1126-9d68-4911-ad3d-6f8369cf5a5d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:16:12.980761 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:12.980727 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32557f5d-39c9-49c0-bc63-3a9666e0ba57-original-pull-secret podName:32557f5d-39c9-49c0-bc63-3a9666e0ba57 nodeName:}" failed. No retries permitted until 2026-07-01 17:16:13.980716987 +0000 UTC m=+4.012714226 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/32557f5d-39c9-49c0-bc63-3a9666e0ba57-original-pull-secret") pod "global-pull-secret-syncer-8h2fn" (UID: "32557f5d-39c9-49c0-bc63-3a9666e0ba57") : object "kube-system"/"original-pull-secret" not registered Jul 01 17:16:13.081294 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:13.081262 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mmd8\" (UniqueName: \"kubernetes.io/projected/cecb7d35-1004-44b8-8eef-ca0efbf803cb-kube-api-access-8mmd8\") pod \"network-check-target-9zsrw\" (UID: \"cecb7d35-1004-44b8-8eef-ca0efbf803cb\") " pod="openshift-network-diagnostics/network-check-target-9zsrw" Jul 01 17:16:13.081485 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:13.081458 2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 17:16:13.081485 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:13.081486 2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 17:16:13.081670 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:13.081499 2547 projected.go:196] Error preparing data for projected volume kube-api-access-8mmd8 for pod openshift-network-diagnostics/network-check-target-9zsrw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:16:13.081670 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:13.081576 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cecb7d35-1004-44b8-8eef-ca0efbf803cb-kube-api-access-8mmd8 podName:cecb7d35-1004-44b8-8eef-ca0efbf803cb nodeName:}" failed. No retries permitted until 2026-07-01 17:16:14.081551935 +0000 UTC m=+4.113549214 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8mmd8" (UniqueName: "kubernetes.io/projected/cecb7d35-1004-44b8-8eef-ca0efbf803cb-kube-api-access-8mmd8") pod "network-check-target-9zsrw" (UID: "cecb7d35-1004-44b8-8eef-ca0efbf803cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:16:13.419236 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:13.419210 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9zsrw" Jul 01 17:16:13.419883 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:13.419364 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9zsrw" podUID="cecb7d35-1004-44b8-8eef-ca0efbf803cb" Jul 01 17:16:13.506708 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:13.506307 2547 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 17:11:12 +0000 UTC" deadline="2027-12-22 07:57:23.545195933 +0000 UTC" Jul 01 17:16:13.506708 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:13.506705 2547 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12926h41m10.038500402s" Jul 01 17:16:13.642706 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:13.636673 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cb2e486_78b2_4b87_9cc5_6286495cbc2b.slice/crio-336e92277bc357c8a1aa16ec4f740eaf5926b7b0c686a42dada4e47a243aa265 WatchSource:0}: Error finding container 336e92277bc357c8a1aa16ec4f740eaf5926b7b0c686a42dada4e47a243aa265: Status 404 returned error can't find the container with id 336e92277bc357c8a1aa16ec4f740eaf5926b7b0c686a42dada4e47a243aa265 Jul 01 17:16:13.642706 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:13.637466 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb04b8848_2a26_42ab_adf6_46a857cbd6f2.slice/crio-278802bfa31ad0b402675b09eb55f82dbac1eb18e1cc9cb9d75b7a280f785556 WatchSource:0}: Error finding container 278802bfa31ad0b402675b09eb55f82dbac1eb18e1cc9cb9d75b7a280f785556: Status 404 returned error can't find the container with id 278802bfa31ad0b402675b09eb55f82dbac1eb18e1cc9cb9d75b7a280f785556 Jul 01 17:16:13.988397 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:13.988193 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32557f5d-39c9-49c0-bc63-3a9666e0ba57-original-pull-secret\") pod \"global-pull-secret-syncer-8h2fn\" (UID: \"32557f5d-39c9-49c0-bc63-3a9666e0ba57\") " pod="kube-system/global-pull-secret-syncer-8h2fn" Jul 01 17:16:13.988570 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:13.988414 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec5b1126-9d68-4911-ad3d-6f8369cf5a5d-metrics-certs\") pod \"network-metrics-daemon-wx5ff\" (UID: \"ec5b1126-9d68-4911-ad3d-6f8369cf5a5d\") " pod="openshift-multus/network-metrics-daemon-wx5ff" Jul 01 17:16:13.988570 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:13.988364 2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 17:16:13.988570 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:13.988523 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32557f5d-39c9-49c0-bc63-3a9666e0ba57-original-pull-secret podName:32557f5d-39c9-49c0-bc63-3a9666e0ba57 nodeName:}" failed. No retries permitted until 2026-07-01 17:16:15.988507443 +0000 UTC m=+6.020504681 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/32557f5d-39c9-49c0-bc63-3a9666e0ba57-original-pull-secret") pod "global-pull-secret-syncer-8h2fn" (UID: "32557f5d-39c9-49c0-bc63-3a9666e0ba57") : object "kube-system"/"original-pull-secret" not registered Jul 01 17:16:13.988570 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:13.988523 2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:16:13.988570 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:13.988567 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec5b1126-9d68-4911-ad3d-6f8369cf5a5d-metrics-certs podName:ec5b1126-9d68-4911-ad3d-6f8369cf5a5d nodeName:}" failed. No retries permitted until 2026-07-01 17:16:15.988553599 +0000 UTC m=+6.020550837 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec5b1126-9d68-4911-ad3d-6f8369cf5a5d-metrics-certs") pod "network-metrics-daemon-wx5ff" (UID: "ec5b1126-9d68-4911-ad3d-6f8369cf5a5d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:16:14.089232 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:14.089194 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mmd8\" (UniqueName: \"kubernetes.io/projected/cecb7d35-1004-44b8-8eef-ca0efbf803cb-kube-api-access-8mmd8\") pod \"network-check-target-9zsrw\" (UID: \"cecb7d35-1004-44b8-8eef-ca0efbf803cb\") " pod="openshift-network-diagnostics/network-check-target-9zsrw" Jul 01 17:16:14.089416 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:14.089381 2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 17:16:14.089416 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:14.089402 2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 17:16:14.089416 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:14.089415 2547 projected.go:196] Error preparing data for projected volume kube-api-access-8mmd8 for pod openshift-network-diagnostics/network-check-target-9zsrw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:16:14.089571 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:14.089476 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cecb7d35-1004-44b8-8eef-ca0efbf803cb-kube-api-access-8mmd8 podName:cecb7d35-1004-44b8-8eef-ca0efbf803cb nodeName:}" failed. No retries permitted until 2026-07-01 17:16:16.089458016 +0000 UTC m=+6.121455271 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8mmd8" (UniqueName: "kubernetes.io/projected/cecb7d35-1004-44b8-8eef-ca0efbf803cb-kube-api-access-8mmd8") pod "network-check-target-9zsrw" (UID: "cecb7d35-1004-44b8-8eef-ca0efbf803cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:16:14.424765 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:14.424101 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8h2fn" Jul 01 17:16:14.424765 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:14.424232 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8h2fn" podUID="32557f5d-39c9-49c0-bc63-3a9666e0ba57" Jul 01 17:16:14.424765 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:14.424626 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wx5ff" Jul 01 17:16:14.424765 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:14.424718 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wx5ff" podUID="ec5b1126-9d68-4911-ad3d-6f8369cf5a5d" Jul 01 17:16:14.448845 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:14.448806 2547 generic.go:356] "Generic (PLEG): container finished" podID="ee44633fc0c12eba9ee147b91525d614" containerID="582150ead2e2940f6a593269886a58bd37f7e7712970675953e1ffc7d568ced4" exitCode=0 Jul 01 17:16:14.449033 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:14.449010 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-141.ec2.internal" event={"ID":"ee44633fc0c12eba9ee147b91525d614","Type":"ContainerDied","Data":"582150ead2e2940f6a593269886a58bd37f7e7712970675953e1ffc7d568ced4"} Jul 01 17:16:14.452411 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:14.451133 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dgtqc" event={"ID":"bef5840a-0d6b-45ed-8bcc-39df0049715f","Type":"ContainerStarted","Data":"47dc92f49b437383e0ab54ea37c5a72af9d735f59423096d8ff06ecd086ca9e1"} Jul 01 17:16:14.454922 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:14.454847 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-s96pk" event={"ID":"b04b8848-2a26-42ab-adf6-46a857cbd6f2","Type":"ContainerStarted","Data":"278802bfa31ad0b402675b09eb55f82dbac1eb18e1cc9cb9d75b7a280f785556"} Jul 01 17:16:14.457498 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:14.457427 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fw624" event={"ID":"1cb2e486-78b2-4b87-9cc5-6286495cbc2b","Type":"ContainerStarted","Data":"336e92277bc357c8a1aa16ec4f740eaf5926b7b0c686a42dada4e47a243aa265"} Jul 01 17:16:14.463356 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:14.463224 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" event={"ID":"aa1fdd8a-5b35-4bac-9836-028a3292e25c","Type":"ContainerStarted","Data":"52ceaa14b3abb252e4d30ba26c29e8583865f3aa7570e5effc5ee1b0cec58ef9"} Jul 01 17:16:14.470424 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:14.470355 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dd5mp" event={"ID":"627d8da6-a395-4d8c-87f1-075a1402e2dc","Type":"ContainerStarted","Data":"c0223429fc488937575625ac6a5315516889df4597108a170ccd74dfd66295f5"} Jul 01 17:16:14.471858 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:14.471783 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bvz2x" event={"ID":"fd657e38-8571-4b17-90b6-952c0e06ddbe","Type":"ContainerStarted","Data":"44f7377cdfa7940489ec49034fc8a6625fbc8e256a5eafdff209de6c6d0d0f23"} Jul 01 17:16:14.477205 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:14.477177 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9ksbn" event={"ID":"c87a9aa8-cd15-41a5-9879-d6c448cc62eb","Type":"ContainerStarted","Data":"4261869e91f4a24336594b253bdaf6351cd794756e15be3312db17c1bf0cc1dd"} Jul 01 17:16:14.478883 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:14.478858 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k6fj4" event={"ID":"2b616970-957c-43eb-8efd-98cfa7957cf9","Type":"ContainerStarted","Data":"5c2be03c82b7e1388cf2991230d126ccb842cb07228714e17ffb2c671bef5d1e"} Jul 01 17:16:14.484094 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:14.484062 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcdwg" event={"ID":"8ff09cca-3b59-44ef-9db6-6e5b89491314","Type":"ContainerStarted","Data":"881c790eb2c6388ab332e45ebdd2517826345bfa44b3731ed998459afde4474e"} Jul 01 17:16:14.499234 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:14.499204 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-141.ec2.internal" event={"ID":"a7186fa112b18e5dc69ae2ad2e5c6386","Type":"ContainerStarted","Data":"52c9b0961f7ae499c77156997e500680350fb238091e90c9ff9c55e1bcd9f1b1"} Jul 01 17:16:14.507222 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:14.507168 2547 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 17:11:12 +0000 UTC" deadline="2027-11-28 00:03:51.061443989 +0000 UTC" Jul 01 17:16:14.507222 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:14.507222 2547 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12342h47m36.55422621s" Jul 01 17:16:15.419007 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:15.418941 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9zsrw" Jul 01 17:16:15.419198 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:15.419097 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9zsrw" podUID="cecb7d35-1004-44b8-8eef-ca0efbf803cb" Jul 01 17:16:15.519793 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:15.519692 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-141.ec2.internal" event={"ID":"ee44633fc0c12eba9ee147b91525d614","Type":"ContainerStarted","Data":"1af4fa53368e4f61257c8b6d83db11cc37c95c2e3ec4a1f15296a9ecdf82d378"} Jul 01 17:16:15.537078 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:15.536684 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-141.ec2.internal" podStartSLOduration=4.536662018 podStartE2EDuration="4.536662018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:16:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:16:14.514977692 +0000 UTC m=+4.546974960" watchObservedRunningTime="2026-07-01 17:16:15.536662018 +0000 UTC m=+5.568659279" Jul 01 17:16:16.006248 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:16.005638 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32557f5d-39c9-49c0-bc63-3a9666e0ba57-original-pull-secret\") pod \"global-pull-secret-syncer-8h2fn\" (UID: \"32557f5d-39c9-49c0-bc63-3a9666e0ba57\") " pod="kube-system/global-pull-secret-syncer-8h2fn" Jul 01 17:16:16.006248 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:16.005692 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec5b1126-9d68-4911-ad3d-6f8369cf5a5d-metrics-certs\") pod \"network-metrics-daemon-wx5ff\" (UID: \"ec5b1126-9d68-4911-ad3d-6f8369cf5a5d\") " pod="openshift-multus/network-metrics-daemon-wx5ff" Jul 01 17:16:16.006248 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:16.005812 2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:16:16.006248 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:16.005872 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec5b1126-9d68-4911-ad3d-6f8369cf5a5d-metrics-certs podName:ec5b1126-9d68-4911-ad3d-6f8369cf5a5d nodeName:}" failed. No retries permitted until 2026-07-01 17:16:20.005853875 +0000 UTC m=+10.037851116 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec5b1126-9d68-4911-ad3d-6f8369cf5a5d-metrics-certs") pod "network-metrics-daemon-wx5ff" (UID: "ec5b1126-9d68-4911-ad3d-6f8369cf5a5d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:16:16.006248 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:16.006097 2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 17:16:16.006248 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:16.006172 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32557f5d-39c9-49c0-bc63-3a9666e0ba57-original-pull-secret podName:32557f5d-39c9-49c0-bc63-3a9666e0ba57 nodeName:}" failed. No retries permitted until 2026-07-01 17:16:20.006143212 +0000 UTC m=+10.038140461 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/32557f5d-39c9-49c0-bc63-3a9666e0ba57-original-pull-secret") pod "global-pull-secret-syncer-8h2fn" (UID: "32557f5d-39c9-49c0-bc63-3a9666e0ba57") : object "kube-system"/"original-pull-secret" not registered Jul 01 17:16:16.107060 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:16.107001 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mmd8\" (UniqueName: \"kubernetes.io/projected/cecb7d35-1004-44b8-8eef-ca0efbf803cb-kube-api-access-8mmd8\") pod \"network-check-target-9zsrw\" (UID: \"cecb7d35-1004-44b8-8eef-ca0efbf803cb\") " pod="openshift-network-diagnostics/network-check-target-9zsrw" Jul 01 17:16:16.107278 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:16.107257 2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 17:16:16.107361 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:16.107286 2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 17:16:16.107361 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:16.107300 2547 projected.go:196] Error preparing data for projected volume kube-api-access-8mmd8 for pod openshift-network-diagnostics/network-check-target-9zsrw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:16:16.107361 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:16.107360 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cecb7d35-1004-44b8-8eef-ca0efbf803cb-kube-api-access-8mmd8 podName:cecb7d35-1004-44b8-8eef-ca0efbf803cb nodeName:}" failed. No retries permitted until 2026-07-01 17:16:20.107341115 +0000 UTC m=+10.139338368 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8mmd8" (UniqueName: "kubernetes.io/projected/cecb7d35-1004-44b8-8eef-ca0efbf803cb-kube-api-access-8mmd8") pod "network-check-target-9zsrw" (UID: "cecb7d35-1004-44b8-8eef-ca0efbf803cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:16:16.420666 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:16.420077 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8h2fn" Jul 01 17:16:16.420666 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:16.420249 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8h2fn" podUID="32557f5d-39c9-49c0-bc63-3a9666e0ba57" Jul 01 17:16:16.420666 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:16.420316 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wx5ff" Jul 01 17:16:16.420666 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:16.420425 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wx5ff" podUID="ec5b1126-9d68-4911-ad3d-6f8369cf5a5d" Jul 01 17:16:17.419001 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:17.418964 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9zsrw" Jul 01 17:16:17.419461 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:17.419106 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9zsrw" podUID="cecb7d35-1004-44b8-8eef-ca0efbf803cb" Jul 01 17:16:18.419219 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:18.419185 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8h2fn" Jul 01 17:16:18.419608 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:18.419323 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8h2fn" podUID="32557f5d-39c9-49c0-bc63-3a9666e0ba57" Jul 01 17:16:18.419747 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:18.419721 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wx5ff" Jul 01 17:16:18.419866 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:18.419841 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wx5ff" podUID="ec5b1126-9d68-4911-ad3d-6f8369cf5a5d" Jul 01 17:16:19.419276 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:19.419243 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9zsrw" Jul 01 17:16:19.419685 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:19.419368 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9zsrw" podUID="cecb7d35-1004-44b8-8eef-ca0efbf803cb" Jul 01 17:16:20.039150 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:20.039116 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec5b1126-9d68-4911-ad3d-6f8369cf5a5d-metrics-certs\") pod \"network-metrics-daemon-wx5ff\" (UID: \"ec5b1126-9d68-4911-ad3d-6f8369cf5a5d\") " pod="openshift-multus/network-metrics-daemon-wx5ff" Jul 01 17:16:20.039379 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:20.039208 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32557f5d-39c9-49c0-bc63-3a9666e0ba57-original-pull-secret\") pod \"global-pull-secret-syncer-8h2fn\" (UID: \"32557f5d-39c9-49c0-bc63-3a9666e0ba57\") " pod="kube-system/global-pull-secret-syncer-8h2fn" Jul 01 17:16:20.039379 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:20.039297 2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 17:16:20.039379 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:20.039344 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32557f5d-39c9-49c0-bc63-3a9666e0ba57-original-pull-secret podName:32557f5d-39c9-49c0-bc63-3a9666e0ba57 nodeName:}" failed. No retries permitted until 2026-07-01 17:16:28.039330924 +0000 UTC m=+18.071328161 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/32557f5d-39c9-49c0-bc63-3a9666e0ba57-original-pull-secret") pod "global-pull-secret-syncer-8h2fn" (UID: "32557f5d-39c9-49c0-bc63-3a9666e0ba57") : object "kube-system"/"original-pull-secret" not registered Jul 01 17:16:20.039754 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:20.039670 2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:16:20.039754 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:20.039721 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec5b1126-9d68-4911-ad3d-6f8369cf5a5d-metrics-certs podName:ec5b1126-9d68-4911-ad3d-6f8369cf5a5d nodeName:}" failed. No retries permitted until 2026-07-01 17:16:28.039704295 +0000 UTC m=+18.071701536 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec5b1126-9d68-4911-ad3d-6f8369cf5a5d-metrics-certs") pod "network-metrics-daemon-wx5ff" (UID: "ec5b1126-9d68-4911-ad3d-6f8369cf5a5d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:16:20.139997 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:20.139897 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mmd8\" (UniqueName: \"kubernetes.io/projected/cecb7d35-1004-44b8-8eef-ca0efbf803cb-kube-api-access-8mmd8\") pod \"network-check-target-9zsrw\" (UID: \"cecb7d35-1004-44b8-8eef-ca0efbf803cb\") " pod="openshift-network-diagnostics/network-check-target-9zsrw" Jul 01 17:16:20.140159 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:20.140087 2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 17:16:20.140159 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:20.140110 2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 17:16:20.140159 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:20.140124 2547 projected.go:196] Error preparing data for projected volume kube-api-access-8mmd8 for pod openshift-network-diagnostics/network-check-target-9zsrw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:16:20.140293 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:20.140183 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cecb7d35-1004-44b8-8eef-ca0efbf803cb-kube-api-access-8mmd8 podName:cecb7d35-1004-44b8-8eef-ca0efbf803cb nodeName:}" failed. No retries permitted until 2026-07-01 17:16:28.140164641 +0000 UTC m=+18.172161880 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8mmd8" (UniqueName: "kubernetes.io/projected/cecb7d35-1004-44b8-8eef-ca0efbf803cb-kube-api-access-8mmd8") pod "network-check-target-9zsrw" (UID: "cecb7d35-1004-44b8-8eef-ca0efbf803cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:16:20.419265 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:20.419186 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wx5ff" Jul 01 17:16:20.419413 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:20.419280 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wx5ff" podUID="ec5b1126-9d68-4911-ad3d-6f8369cf5a5d" Jul 01 17:16:20.419758 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:20.419661 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8h2fn" Jul 01 17:16:20.419758 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:20.419741 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8h2fn" podUID="32557f5d-39c9-49c0-bc63-3a9666e0ba57" Jul 01 17:16:21.419078 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:21.419042 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9zsrw" Jul 01 17:16:21.419254 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:21.419172 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9zsrw" podUID="cecb7d35-1004-44b8-8eef-ca0efbf803cb" Jul 01 17:16:22.420092 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:22.420058 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8h2fn" Jul 01 17:16:22.420578 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:22.420186 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8h2fn" podUID="32557f5d-39c9-49c0-bc63-3a9666e0ba57" Jul 01 17:16:22.420710 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:22.420654 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wx5ff" Jul 01 17:16:22.420788 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:22.420763 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wx5ff" podUID="ec5b1126-9d68-4911-ad3d-6f8369cf5a5d" Jul 01 17:16:23.418860 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:23.418825 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9zsrw" Jul 01 17:16:23.419049 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:23.418972 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9zsrw" podUID="cecb7d35-1004-44b8-8eef-ca0efbf803cb" Jul 01 17:16:24.418998 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:24.418967 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8h2fn" Jul 01 17:16:24.419434 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:24.419004 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wx5ff" Jul 01 17:16:24.419434 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:24.419096 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8h2fn" podUID="32557f5d-39c9-49c0-bc63-3a9666e0ba57" Jul 01 17:16:24.419546 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:24.419469 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wx5ff" podUID="ec5b1126-9d68-4911-ad3d-6f8369cf5a5d" Jul 01 17:16:25.418962 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:25.418913 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9zsrw" Jul 01 17:16:25.419110 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:25.419055 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9zsrw" podUID="cecb7d35-1004-44b8-8eef-ca0efbf803cb" Jul 01 17:16:26.419203 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:26.419169 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8h2fn" Jul 01 17:16:26.419652 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:26.419169 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wx5ff" Jul 01 17:16:26.419652 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:26.419294 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8h2fn" podUID="32557f5d-39c9-49c0-bc63-3a9666e0ba57" Jul 01 17:16:26.419652 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:26.419410 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wx5ff" podUID="ec5b1126-9d68-4911-ad3d-6f8369cf5a5d" Jul 01 17:16:27.419016 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:27.418981 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9zsrw" Jul 01 17:16:27.419294 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:27.419107 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9zsrw" podUID="cecb7d35-1004-44b8-8eef-ca0efbf803cb" Jul 01 17:16:28.096642 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:28.096614 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32557f5d-39c9-49c0-bc63-3a9666e0ba57-original-pull-secret\") pod \"global-pull-secret-syncer-8h2fn\" (UID: \"32557f5d-39c9-49c0-bc63-3a9666e0ba57\") " pod="kube-system/global-pull-secret-syncer-8h2fn" Jul 01 17:16:28.096642 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:28.096650 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec5b1126-9d68-4911-ad3d-6f8369cf5a5d-metrics-certs\") pod \"network-metrics-daemon-wx5ff\" (UID: \"ec5b1126-9d68-4911-ad3d-6f8369cf5a5d\") " pod="openshift-multus/network-metrics-daemon-wx5ff" Jul 01 17:16:28.096901 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:28.096759 2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:16:28.096901 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:28.096759 2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 17:16:28.096901 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:28.096813 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32557f5d-39c9-49c0-bc63-3a9666e0ba57-original-pull-secret podName:32557f5d-39c9-49c0-bc63-3a9666e0ba57 nodeName:}" failed. No retries permitted until 2026-07-01 17:16:44.096795289 +0000 UTC m=+34.128792528 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/32557f5d-39c9-49c0-bc63-3a9666e0ba57-original-pull-secret") pod "global-pull-secret-syncer-8h2fn" (UID: "32557f5d-39c9-49c0-bc63-3a9666e0ba57") : object "kube-system"/"original-pull-secret" not registered Jul 01 17:16:28.096901 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:28.096830 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec5b1126-9d68-4911-ad3d-6f8369cf5a5d-metrics-certs podName:ec5b1126-9d68-4911-ad3d-6f8369cf5a5d nodeName:}" failed. No retries permitted until 2026-07-01 17:16:44.096821565 +0000 UTC m=+34.128818805 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec5b1126-9d68-4911-ad3d-6f8369cf5a5d-metrics-certs") pod "network-metrics-daemon-wx5ff" (UID: "ec5b1126-9d68-4911-ad3d-6f8369cf5a5d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:16:28.197268 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:28.197224 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mmd8\" (UniqueName: \"kubernetes.io/projected/cecb7d35-1004-44b8-8eef-ca0efbf803cb-kube-api-access-8mmd8\") pod \"network-check-target-9zsrw\" (UID: \"cecb7d35-1004-44b8-8eef-ca0efbf803cb\") " pod="openshift-network-diagnostics/network-check-target-9zsrw" Jul 01 17:16:28.197440 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:28.197415 2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 17:16:28.197490 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:28.197444 2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 17:16:28.197490 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:28.197459 2547 projected.go:196] Error preparing data for projected volume kube-api-access-8mmd8 for pod openshift-network-diagnostics/network-check-target-9zsrw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:16:28.197581 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:28.197517 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cecb7d35-1004-44b8-8eef-ca0efbf803cb-kube-api-access-8mmd8 podName:cecb7d35-1004-44b8-8eef-ca0efbf803cb nodeName:}" failed. No retries permitted until 2026-07-01 17:16:44.197498085 +0000 UTC m=+34.229495330 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8mmd8" (UniqueName: "kubernetes.io/projected/cecb7d35-1004-44b8-8eef-ca0efbf803cb-kube-api-access-8mmd8") pod "network-check-target-9zsrw" (UID: "cecb7d35-1004-44b8-8eef-ca0efbf803cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:16:28.418620 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:28.418547 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8h2fn" Jul 01 17:16:28.418620 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:28.418595 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wx5ff" Jul 01 17:16:28.418794 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:28.418675 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8h2fn" podUID="32557f5d-39c9-49c0-bc63-3a9666e0ba57" Jul 01 17:16:28.418794 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:28.418771 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wx5ff" podUID="ec5b1126-9d68-4911-ad3d-6f8369cf5a5d" Jul 01 17:16:29.418840 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:29.418811 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9zsrw" Jul 01 17:16:29.419303 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:29.418931 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9zsrw" podUID="cecb7d35-1004-44b8-8eef-ca0efbf803cb" Jul 01 17:16:30.420086 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:30.420046 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8h2fn" Jul 01 17:16:30.420519 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:30.420150 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8h2fn" podUID="32557f5d-39c9-49c0-bc63-3a9666e0ba57" Jul 01 17:16:30.420519 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:30.420254 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wx5ff" Jul 01 17:16:30.420519 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:30.420379 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wx5ff" podUID="ec5b1126-9d68-4911-ad3d-6f8369cf5a5d" Jul 01 17:16:31.419333 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:31.419301 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9zsrw" Jul 01 17:16:31.419487 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:31.419423 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9zsrw" podUID="cecb7d35-1004-44b8-8eef-ca0efbf803cb" Jul 01 17:16:32.424725 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:32.424513 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8h2fn" Jul 01 17:16:32.425092 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:32.424824 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8h2fn" podUID="32557f5d-39c9-49c0-bc63-3a9666e0ba57" Jul 01 17:16:32.425092 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:32.424917 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wx5ff" Jul 01 17:16:32.425092 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:32.425058 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wx5ff" podUID="ec5b1126-9d68-4911-ad3d-6f8369cf5a5d" Jul 01 17:16:32.556001 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:32.555978 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qh49d_aa1fdd8a-5b35-4bac-9836-028a3292e25c/ovn-acl-logging/0.log" Jul 01 17:16:32.556488 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:32.556458 2547 generic.go:356] "Generic (PLEG): container finished" podID="aa1fdd8a-5b35-4bac-9836-028a3292e25c" containerID="5578289dcd9d0336c89ad0109dc3cc41a84d0110e48a83bfd785fe223cc66007" exitCode=1 Jul 01 17:16:32.556542 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:32.556495 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" event={"ID":"aa1fdd8a-5b35-4bac-9836-028a3292e25c","Type":"ContainerDied","Data":"5578289dcd9d0336c89ad0109dc3cc41a84d0110e48a83bfd785fe223cc66007"} Jul 01 17:16:32.556617 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:32.556595 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" event={"ID":"aa1fdd8a-5b35-4bac-9836-028a3292e25c","Type":"ContainerStarted","Data":"5922bc7f280c51d2dda585ed2106053ed22b24658b4bf3ddf6f60ae08b9025db"} Jul 01 17:16:32.558078 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:32.558051 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dd5mp" event={"ID":"627d8da6-a395-4d8c-87f1-075a1402e2dc","Type":"ContainerStarted","Data":"342b7d59bab277388d6e13eff3c3d4637ab89e0601cec9666ac49a4ec4e543bd"} Jul 01 17:16:32.559545 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:32.559524 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bvz2x" event={"ID":"fd657e38-8571-4b17-90b6-952c0e06ddbe","Type":"ContainerStarted","Data":"1a26da5fea51e5d89951818b4f939d6edbdfd9863f27acefedc8861cf37b311b"} Jul 01 17:16:32.561400 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:32.561215 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9ksbn" event={"ID":"c87a9aa8-cd15-41a5-9879-d6c448cc62eb","Type":"ContainerStarted","Data":"3f9318c291ced35d4ccb155a3f7b46655e762838a775cd99faa5f9597387a713"} Jul 01 17:16:32.562940 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:32.562914 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k6fj4" event={"ID":"2b616970-957c-43eb-8efd-98cfa7957cf9","Type":"ContainerStarted","Data":"1760ab2a3f5fc2dbfbb7a1ef912430833109211e325f08f4c44816d5d891b7f6"} Jul 01 17:16:32.564624 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:32.564598 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcdwg" event={"ID":"8ff09cca-3b59-44ef-9db6-6e5b89491314","Type":"ContainerStarted","Data":"8e63b12a39a3fa5897df9f6a2f4922989dcb69174081b91fe88f6dacb6fe19e1"} Jul 01 17:16:32.566389 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:32.566366 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-s96pk" event={"ID":"b04b8848-2a26-42ab-adf6-46a857cbd6f2","Type":"ContainerStarted","Data":"917d5ef049965d7c573653939560a449d94a69203bfaea3d26c640db82a64338"} Jul 01 17:16:32.567926 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:32.567901 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fw624" event={"ID":"1cb2e486-78b2-4b87-9cc5-6286495cbc2b","Type":"ContainerStarted","Data":"990e30d687c7305bbc25b02bef817b35fb83609932c5abb11bb355d2c1ee3524"} Jul 01 17:16:32.585164 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:32.585117 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-141.ec2.internal" podStartSLOduration=21.585102937 podStartE2EDuration="21.585102937s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:16:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:16:15.537060614 +0000 UTC m=+5.569057889" watchObservedRunningTime="2026-07-01 17:16:32.585102937 +0000 UTC m=+22.617100197" Jul 01 17:16:32.585504 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:32.585473 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dd5mp" podStartSLOduration=7.7715353270000005 podStartE2EDuration="22.58546164s" totalImagesPullingTime="14.813926313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:16:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:16:32.585323773 +0000 UTC m=+22.617321034" watchObservedRunningTime="2026-07-01 17:16:32.58546164 +0000 UTC m=+22.617458899" Jul 01 17:16:32.641854 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:32.641816 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bvz2x" podStartSLOduration=3.984610913 podStartE2EDuration="22.64179822s" totalImagesPullingTime="18.657187307s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:16:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:16:32.610006672 +0000 UTC m=+22.642003951" watchObservedRunningTime="2026-07-01 17:16:32.64179822 +0000 UTC m=+22.673795479" Jul 01 17:16:32.676026 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:32.675982 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-k6fj4" podStartSLOduration=4.057750758 podStartE2EDuration="22.675966308s" totalImagesPullingTime="18.61821555s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:16:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:16:32.675828808 +0000 UTC m=+22.707826124" watchObservedRunningTime="2026-07-01 17:16:32.675966308 +0000 UTC m=+22.707963559" Jul 01 17:16:32.703889 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:32.703756 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9ksbn" podStartSLOduration=7.880923012 podStartE2EDuration="22.703740402s" totalImagesPullingTime="14.82281739s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:16:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:16:32.703436205 +0000 UTC m=+22.735433490" watchObservedRunningTime="2026-07-01 17:16:32.703740402 +0000 UTC m=+22.735737852" Jul 01 17:16:32.728496 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:32.728456 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-s96pk" podStartSLOduration=4.127699082 podStartE2EDuration="22.728440612s" totalImagesPullingTime="18.60074153s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:16:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:16:32.72799099 +0000 UTC m=+22.759988275" watchObservedRunningTime="2026-07-01 17:16:32.728440612 +0000 UTC m=+22.760437869" Jul 01 17:16:33.418678 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:33.418649 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9zsrw" Jul 01 17:16:33.418861 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:33.418767 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9zsrw" podUID="cecb7d35-1004-44b8-8eef-ca0efbf803cb" Jul 01 17:16:33.572910 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:33.572835 2547 generic.go:356] "Generic (PLEG): container finished" podID="1cb2e486-78b2-4b87-9cc5-6286495cbc2b" containerID="990e30d687c7305bbc25b02bef817b35fb83609932c5abb11bb355d2c1ee3524" exitCode=0 Jul 01 17:16:33.573655 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:33.572974 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fw624" event={"ID":"1cb2e486-78b2-4b87-9cc5-6286495cbc2b","Type":"ContainerDied","Data":"990e30d687c7305bbc25b02bef817b35fb83609932c5abb11bb355d2c1ee3524"} Jul 01 17:16:33.576284 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:33.576267 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qh49d_aa1fdd8a-5b35-4bac-9836-028a3292e25c/ovn-acl-logging/0.log" Jul 01 17:16:33.576561 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:33.576543 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" event={"ID":"aa1fdd8a-5b35-4bac-9836-028a3292e25c","Type":"ContainerStarted","Data":"72c271b8ff4df5eb9f99b42e66e5ef850d8db823363861780b4d90d2ba83561a"} Jul 01 17:16:33.576610 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:33.576596 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" event={"ID":"aa1fdd8a-5b35-4bac-9836-028a3292e25c","Type":"ContainerStarted","Data":"949deea6eacb4ded4953b305d6b89e053bb1afd1c1ffc5fa5a5a7a34ea74ac57"} Jul 01 17:16:33.576646 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:33.576624 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" event={"ID":"aa1fdd8a-5b35-4bac-9836-028a3292e25c","Type":"ContainerStarted","Data":"11be76ccd565f184c0a5831053f361d7d6791099dab73b2f5bbc95eb5258546f"} Jul 01 17:16:33.576678 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:33.576650 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" event={"ID":"aa1fdd8a-5b35-4bac-9836-028a3292e25c","Type":"ContainerStarted","Data":"7c2b49df16257909e49e25678dfb1bb6501ad7955cecd79d3fbf0472615fe44a"} Jul 01 17:16:33.577923 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:33.577897 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dgtqc" event={"ID":"bef5840a-0d6b-45ed-8bcc-39df0049715f","Type":"ContainerStarted","Data":"bd36f10f1476ccf880938785eea96602a77b0cbd514bb2c47f1de42fd07772a1"} Jul 01 17:16:33.614746 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:33.614695 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dgtqc" podStartSLOduration=5.016828583 podStartE2EDuration="23.614683145s" totalImagesPullingTime="18.597854562s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:16:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:16:33.614664693 +0000 UTC m=+23.646661952" watchObservedRunningTime="2026-07-01 17:16:33.614683145 +0000 UTC m=+23.646680399" Jul 01 17:16:33.998097 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:33.998066 2547 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 01 17:16:34.418738 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:34.418695 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8h2fn" Jul 01 17:16:34.419012 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:34.418778 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wx5ff" Jul 01 17:16:34.419012 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:34.418934 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8h2fn" podUID="32557f5d-39c9-49c0-bc63-3a9666e0ba57" Jul 01 17:16:34.419137 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:34.419083 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wx5ff" podUID="ec5b1126-9d68-4911-ad3d-6f8369cf5a5d" Jul 01 17:16:34.427665 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:34.427594 2547 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-01T17:16:33.998091202Z","UUID":"afd83306-7418-455b-88d2-dbeb5a4fb975","Handler":null,"Name":"","Endpoint":""} Jul 01 17:16:34.429265 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:34.429246 2547 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 01 17:16:34.429401 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:34.429288 2547 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 01 17:16:34.582770 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:34.582740 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcdwg" event={"ID":"8ff09cca-3b59-44ef-9db6-6e5b89491314","Type":"ContainerStarted","Data":"8feda47a2fde68ffc566409a778dd8ae58d8887fc8fab67b52fc82dd2a7dc1e3"} Jul 01 17:16:35.419256 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:35.419172 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9zsrw" Jul 01 17:16:35.419421 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:35.419277 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9zsrw" podUID="cecb7d35-1004-44b8-8eef-ca0efbf803cb" Jul 01 17:16:35.588763 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:35.588736 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qh49d_aa1fdd8a-5b35-4bac-9836-028a3292e25c/ovn-acl-logging/0.log" Jul 01 17:16:35.589211 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:35.589190 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" event={"ID":"aa1fdd8a-5b35-4bac-9836-028a3292e25c","Type":"ContainerStarted","Data":"295adbd19288123961216d40ad18646eb9bf070230b9f7994f9428613019f52b"} Jul 01 17:16:36.419157 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:36.418985 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wx5ff" Jul 01 17:16:36.419373 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:36.419034 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8h2fn" Jul 01 17:16:36.419373 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:36.419251 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wx5ff" podUID="ec5b1126-9d68-4911-ad3d-6f8369cf5a5d" Jul 01 17:16:36.419373 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:36.419320 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8h2fn" podUID="32557f5d-39c9-49c0-bc63-3a9666e0ba57" Jul 01 17:16:36.593995 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:36.593938 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcdwg" event={"ID":"8ff09cca-3b59-44ef-9db6-6e5b89491314","Type":"ContainerStarted","Data":"fcd9a80381abef7eb6711dd7e7eeb807a2b2b663e1099264618de660fee16383"} Jul 01 17:16:36.616633 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:36.616585 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcdwg" podStartSLOduration=5.035294111 podStartE2EDuration="26.616568492s" totalImagesPullingTime="21.581274381s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:16:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:16:36.616314178 +0000 UTC m=+26.648311439" watchObservedRunningTime="2026-07-01 17:16:36.616568492 +0000 UTC m=+26.648565753" Jul 01 17:16:37.418786 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:37.418718 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9zsrw" Jul 01 17:16:37.418932 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:37.418817 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9zsrw" podUID="cecb7d35-1004-44b8-8eef-ca0efbf803cb" Jul 01 17:16:37.494889 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:37.494858 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dd5mp" Jul 01 17:16:37.495540 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:37.495521 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dd5mp" Jul 01 17:16:37.595628 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:37.595591 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dd5mp" Jul 01 17:16:37.596006 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:37.595981 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dd5mp" Jul 01 17:16:38.419283 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:38.419062 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wx5ff" Jul 01 17:16:38.419432 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:38.419076 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8h2fn" Jul 01 17:16:38.419432 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:38.419347 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wx5ff" podUID="ec5b1126-9d68-4911-ad3d-6f8369cf5a5d" Jul 01 17:16:38.419432 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:38.419371 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8h2fn" podUID="32557f5d-39c9-49c0-bc63-3a9666e0ba57" Jul 01 17:16:38.598739 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:38.598709 2547 generic.go:356] "Generic (PLEG): container finished" podID="1cb2e486-78b2-4b87-9cc5-6286495cbc2b" containerID="5a35209c3e3ce4dc21df40f80a3214b05cbc8606075398b232706b32bdfb248a" exitCode=0 Jul 01 17:16:38.599397 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:38.598780 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fw624" event={"ID":"1cb2e486-78b2-4b87-9cc5-6286495cbc2b","Type":"ContainerDied","Data":"5a35209c3e3ce4dc21df40f80a3214b05cbc8606075398b232706b32bdfb248a"} Jul 01 17:16:38.602313 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:38.602293 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qh49d_aa1fdd8a-5b35-4bac-9836-028a3292e25c/ovn-acl-logging/0.log" Jul 01 17:16:38.602737 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:38.602711 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" event={"ID":"aa1fdd8a-5b35-4bac-9836-028a3292e25c","Type":"ContainerStarted","Data":"ebad40625defe13969d5ce1294e49659f32a0461a45dc1abe4bc806caa6b8409"} Jul 01 17:16:38.602937 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:38.602919 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:38.603076 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:38.603063 2547 scope.go:117] "RemoveContainer" containerID="5578289dcd9d0336c89ad0109dc3cc41a84d0110e48a83bfd785fe223cc66007" Jul 01 17:16:39.418782 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:39.418751 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9zsrw" Jul 01 17:16:39.419040 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:39.418887 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9zsrw" podUID="cecb7d35-1004-44b8-8eef-ca0efbf803cb" Jul 01 17:16:39.609263 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:39.609198 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qh49d_aa1fdd8a-5b35-4bac-9836-028a3292e25c/ovn-acl-logging/0.log" Jul 01 17:16:39.609701 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:39.609598 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" event={"ID":"aa1fdd8a-5b35-4bac-9836-028a3292e25c","Type":"ContainerStarted","Data":"80af142ba8d8d687b68d1f433d9136a0bf70ed540012c9a21f6f927ea0d75bf3"} Jul 01 17:16:39.609833 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:39.609809 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:39.610135 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:39.609985 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:39.627313 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:39.627286 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:39.627491 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:39.627476 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:16:39.644844 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:39.644804 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" podStartSLOduration=10.991500087 podStartE2EDuration="29.644786493s" totalImagesPullingTime="18.653286406s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:16:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:16:39.644676566 +0000 UTC m=+29.676673847" watchObservedRunningTime="2026-07-01 17:16:39.644786493 +0000 UTC m=+29.676783755" Jul 01 17:16:39.761396 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:39.761224 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8h2fn"] Jul 01 17:16:39.761540 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:39.761493 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8h2fn" Jul 01 17:16:39.761628 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:39.761604 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8h2fn" podUID="32557f5d-39c9-49c0-bc63-3a9666e0ba57" Jul 01 17:16:39.761913 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:39.761875 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9zsrw"] Jul 01 17:16:39.762040 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:39.761994 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9zsrw" Jul 01 17:16:39.762107 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:39.762091 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9zsrw" podUID="cecb7d35-1004-44b8-8eef-ca0efbf803cb" Jul 01 17:16:39.762661 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:39.762633 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wx5ff"] Jul 01 17:16:39.762752 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:39.762739 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wx5ff" Jul 01 17:16:39.762910 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:39.762855 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wx5ff" podUID="ec5b1126-9d68-4911-ad3d-6f8369cf5a5d" Jul 01 17:16:40.613873 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:40.613836 2547 generic.go:356] "Generic (PLEG): container finished" podID="1cb2e486-78b2-4b87-9cc5-6286495cbc2b" containerID="43de917b15f4ee9c62aab79b71d3e1a6c59cbe14fb078880dc0ea4042d9d03af" exitCode=0 Jul 01 17:16:40.614248 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:40.613917 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fw624" event={"ID":"1cb2e486-78b2-4b87-9cc5-6286495cbc2b","Type":"ContainerDied","Data":"43de917b15f4ee9c62aab79b71d3e1a6c59cbe14fb078880dc0ea4042d9d03af"} Jul 01 17:16:41.418579 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:41.418549 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9zsrw" Jul 01 17:16:41.418758 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:41.418595 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8h2fn" Jul 01 17:16:41.418758 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:41.418660 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wx5ff" Jul 01 17:16:41.418758 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:41.418672 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9zsrw" podUID="cecb7d35-1004-44b8-8eef-ca0efbf803cb" Jul 01 17:16:41.418758 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:41.418729 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8h2fn" podUID="32557f5d-39c9-49c0-bc63-3a9666e0ba57" Jul 01 17:16:41.419002 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:41.418834 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wx5ff" podUID="ec5b1126-9d68-4911-ad3d-6f8369cf5a5d" Jul 01 17:16:42.620540 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:42.620505 2547 generic.go:356] "Generic (PLEG): container finished" podID="1cb2e486-78b2-4b87-9cc5-6286495cbc2b" containerID="b7e75314f02744037d1e41aed0c7828b58da15cb30a7e3ab78b9d54c3fb99ace" exitCode=0 Jul 01 17:16:42.621172 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:42.620560 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fw624" event={"ID":"1cb2e486-78b2-4b87-9cc5-6286495cbc2b","Type":"ContainerDied","Data":"b7e75314f02744037d1e41aed0c7828b58da15cb30a7e3ab78b9d54c3fb99ace"} Jul 01 17:16:43.419396 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:43.419362 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8h2fn" Jul 01 17:16:43.419574 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:43.419364 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9zsrw" Jul 01 17:16:43.419574 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:43.419489 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8h2fn" podUID="32557f5d-39c9-49c0-bc63-3a9666e0ba57" Jul 01 17:16:43.419574 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:43.419363 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wx5ff" Jul 01 17:16:43.419726 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:43.419571 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9zsrw" podUID="cecb7d35-1004-44b8-8eef-ca0efbf803cb" Jul 01 17:16:43.419726 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:43.419679 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wx5ff" podUID="ec5b1126-9d68-4911-ad3d-6f8369cf5a5d" Jul 01 17:16:44.120736 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:44.120705 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32557f5d-39c9-49c0-bc63-3a9666e0ba57-original-pull-secret\") pod \"global-pull-secret-syncer-8h2fn\" (UID: \"32557f5d-39c9-49c0-bc63-3a9666e0ba57\") " pod="kube-system/global-pull-secret-syncer-8h2fn" Jul 01 17:16:44.120736 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:44.120739 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec5b1126-9d68-4911-ad3d-6f8369cf5a5d-metrics-certs\") pod \"network-metrics-daemon-wx5ff\" (UID: \"ec5b1126-9d68-4911-ad3d-6f8369cf5a5d\") " pod="openshift-multus/network-metrics-daemon-wx5ff" Jul 01 17:16:44.121369 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:44.120864 2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:16:44.121369 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:44.120867 2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 17:16:44.121369 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:44.120923 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec5b1126-9d68-4911-ad3d-6f8369cf5a5d-metrics-certs podName:ec5b1126-9d68-4911-ad3d-6f8369cf5a5d nodeName:}" failed. No retries permitted until 2026-07-01 17:17:16.12090621 +0000 UTC m=+66.152903448 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec5b1126-9d68-4911-ad3d-6f8369cf5a5d-metrics-certs") pod "network-metrics-daemon-wx5ff" (UID: "ec5b1126-9d68-4911-ad3d-6f8369cf5a5d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 17:16:44.121369 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:44.120939 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32557f5d-39c9-49c0-bc63-3a9666e0ba57-original-pull-secret podName:32557f5d-39c9-49c0-bc63-3a9666e0ba57 nodeName:}" failed. No retries permitted until 2026-07-01 17:17:16.120932327 +0000 UTC m=+66.152929566 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/32557f5d-39c9-49c0-bc63-3a9666e0ba57-original-pull-secret") pod "global-pull-secret-syncer-8h2fn" (UID: "32557f5d-39c9-49c0-bc63-3a9666e0ba57") : object "kube-system"/"original-pull-secret" not registered Jul 01 17:16:44.221208 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:44.221181 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mmd8\" (UniqueName: \"kubernetes.io/projected/cecb7d35-1004-44b8-8eef-ca0efbf803cb-kube-api-access-8mmd8\") pod \"network-check-target-9zsrw\" (UID: \"cecb7d35-1004-44b8-8eef-ca0efbf803cb\") " pod="openshift-network-diagnostics/network-check-target-9zsrw" Jul 01 17:16:44.221375 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:44.221294 2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 17:16:44.221375 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:44.221310 2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 17:16:44.221375 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:44.221320 2547 projected.go:196] Error preparing data for projected volume kube-api-access-8mmd8 for pod openshift-network-diagnostics/network-check-target-9zsrw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:16:44.221375 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:44.221368 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cecb7d35-1004-44b8-8eef-ca0efbf803cb-kube-api-access-8mmd8 podName:cecb7d35-1004-44b8-8eef-ca0efbf803cb nodeName:}" failed. No retries permitted until 2026-07-01 17:17:16.22135115 +0000 UTC m=+66.253348396 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8mmd8" (UniqueName: "kubernetes.io/projected/cecb7d35-1004-44b8-8eef-ca0efbf803cb-kube-api-access-8mmd8") pod "network-check-target-9zsrw" (UID: "cecb7d35-1004-44b8-8eef-ca0efbf803cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 17:16:45.312567 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:45.312535 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-141.ec2.internal" event="NodeReady" Jul 01 17:16:45.312993 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:45.312689 2547 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 01 17:16:45.361920 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:45.361886 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-s5qpl"] Jul 01 17:16:45.364770 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:45.364750 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s5qpl" Jul 01 17:16:45.367524 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:45.367501 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-tczxv"] Jul 01 17:16:45.368059 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:45.368035 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-n25z7\"" Jul 01 17:16:45.368159 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:45.368146 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 01 17:16:45.368227 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:45.368178 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 01 17:16:45.369327 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:45.369308 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tczxv" Jul 01 17:16:45.372615 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:45.372416 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 01 17:16:45.372615 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:45.372474 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xqdpm\"" Jul 01 17:16:45.372764 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:45.372739 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 01 17:16:45.372898 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:45.372881 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 01 17:16:45.378437 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:45.378384 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s5qpl"] Jul 01 17:16:45.381690 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:45.381667 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tczxv"] Jul 01 17:16:45.419418 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:45.419394 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9zsrw" Jul 01 17:16:45.419418 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:45.419415 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8h2fn" Jul 01 17:16:45.419615 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:45.419419 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wx5ff" Jul 01 17:16:45.423375 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:45.423350 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 17:16:45.423375 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:45.423354 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 17:16:45.423551 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:45.423424 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gs6qb\"" Jul 01 17:16:45.423740 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:45.423725 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 17:16:45.423936 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:45.423919 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 17:16:45.424664 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:45.424650 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hbjh4\"" Jul 01 17:16:45.530810 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:45.530781 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01ad38f7-44ce-4388-9906-431090926394-cert\") pod \"ingress-canary-tczxv\" (UID: \"01ad38f7-44ce-4388-9906-431090926394\") " pod="openshift-ingress-canary/ingress-canary-tczxv" Jul 01 17:16:45.530810 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:45.530815 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/374e3f60-2885-4bf0-848a-10a1a3c0003a-config-volume\") pod \"dns-default-s5qpl\" (UID: \"374e3f60-2885-4bf0-848a-10a1a3c0003a\") " pod="openshift-dns/dns-default-s5qpl" Jul 01 17:16:45.531060 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:45.530852 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/374e3f60-2885-4bf0-848a-10a1a3c0003a-metrics-tls\") pod \"dns-default-s5qpl\" (UID: \"374e3f60-2885-4bf0-848a-10a1a3c0003a\") " pod="openshift-dns/dns-default-s5qpl" Jul 01 17:16:45.531060 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:45.530988 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtpj7\" (UniqueName: \"kubernetes.io/projected/01ad38f7-44ce-4388-9906-431090926394-kube-api-access-rtpj7\") pod \"ingress-canary-tczxv\" (UID: \"01ad38f7-44ce-4388-9906-431090926394\") " pod="openshift-ingress-canary/ingress-canary-tczxv" Jul 01 17:16:45.531060 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:45.531044 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clwfx\" (UniqueName: \"kubernetes.io/projected/374e3f60-2885-4bf0-848a-10a1a3c0003a-kube-api-access-clwfx\") pod \"dns-default-s5qpl\" (UID: \"374e3f60-2885-4bf0-848a-10a1a3c0003a\") " pod="openshift-dns/dns-default-s5qpl" Jul 01 17:16:45.531182 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:45.531095 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/374e3f60-2885-4bf0-848a-10a1a3c0003a-tmp-dir\") pod \"dns-default-s5qpl\" (UID: \"374e3f60-2885-4bf0-848a-10a1a3c0003a\") " pod="openshift-dns/dns-default-s5qpl" Jul 01 17:16:45.631819 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:45.631738 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01ad38f7-44ce-4388-9906-431090926394-cert\") pod \"ingress-canary-tczxv\" (UID: \"01ad38f7-44ce-4388-9906-431090926394\") " pod="openshift-ingress-canary/ingress-canary-tczxv" Jul 01 17:16:45.631819 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:45.631777 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/374e3f60-2885-4bf0-848a-10a1a3c0003a-config-volume\") pod \"dns-default-s5qpl\" (UID: \"374e3f60-2885-4bf0-848a-10a1a3c0003a\") " pod="openshift-dns/dns-default-s5qpl" Jul 01 17:16:45.632046 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:45.631838 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/374e3f60-2885-4bf0-848a-10a1a3c0003a-metrics-tls\") pod \"dns-default-s5qpl\" (UID: \"374e3f60-2885-4bf0-848a-10a1a3c0003a\") " pod="openshift-dns/dns-default-s5qpl" Jul 01 17:16:45.632046 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:45.631900 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtpj7\" (UniqueName: \"kubernetes.io/projected/01ad38f7-44ce-4388-9906-431090926394-kube-api-access-rtpj7\") pod \"ingress-canary-tczxv\" (UID: \"01ad38f7-44ce-4388-9906-431090926394\") " pod="openshift-ingress-canary/ingress-canary-tczxv" Jul 01 17:16:45.632046 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:45.631940 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clwfx\" (UniqueName: \"kubernetes.io/projected/374e3f60-2885-4bf0-848a-10a1a3c0003a-kube-api-access-clwfx\") pod \"dns-default-s5qpl\" (UID: \"374e3f60-2885-4bf0-848a-10a1a3c0003a\") " pod="openshift-dns/dns-default-s5qpl" Jul 01 17:16:45.632046 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:45.632009 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/374e3f60-2885-4bf0-848a-10a1a3c0003a-tmp-dir\") pod \"dns-default-s5qpl\" (UID: \"374e3f60-2885-4bf0-848a-10a1a3c0003a\") " pod="openshift-dns/dns-default-s5qpl" Jul 01 17:16:45.632289 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:45.632275 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/374e3f60-2885-4bf0-848a-10a1a3c0003a-tmp-dir\") pod \"dns-default-s5qpl\" (UID: \"374e3f60-2885-4bf0-848a-10a1a3c0003a\") " pod="openshift-dns/dns-default-s5qpl" Jul 01 17:16:45.632386 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:45.632370 2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 17:16:45.632427 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:45.632422 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/374e3f60-2885-4bf0-848a-10a1a3c0003a-metrics-tls podName:374e3f60-2885-4bf0-848a-10a1a3c0003a nodeName:}" failed. No retries permitted until 2026-07-01 17:16:46.132409652 +0000 UTC m=+36.164406890 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/374e3f60-2885-4bf0-848a-10a1a3c0003a-metrics-tls") pod "dns-default-s5qpl" (UID: "374e3f60-2885-4bf0-848a-10a1a3c0003a") : secret "dns-default-metrics-tls" not found Jul 01 17:16:45.632469 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:45.632420 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/374e3f60-2885-4bf0-848a-10a1a3c0003a-config-volume\") pod \"dns-default-s5qpl\" (UID: \"374e3f60-2885-4bf0-848a-10a1a3c0003a\") " pod="openshift-dns/dns-default-s5qpl" Jul 01 17:16:45.636661 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:45.636642 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01ad38f7-44ce-4388-9906-431090926394-cert\") pod \"ingress-canary-tczxv\" (UID: \"01ad38f7-44ce-4388-9906-431090926394\") " pod="openshift-ingress-canary/ingress-canary-tczxv" Jul 01 17:16:45.642066 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:45.642042 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clwfx\" (UniqueName: \"kubernetes.io/projected/374e3f60-2885-4bf0-848a-10a1a3c0003a-kube-api-access-clwfx\") pod \"dns-default-s5qpl\" (UID: \"374e3f60-2885-4bf0-848a-10a1a3c0003a\") " pod="openshift-dns/dns-default-s5qpl" Jul 01 17:16:45.642555 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:45.642536 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtpj7\" (UniqueName: \"kubernetes.io/projected/01ad38f7-44ce-4388-9906-431090926394-kube-api-access-rtpj7\") pod \"ingress-canary-tczxv\" (UID: \"01ad38f7-44ce-4388-9906-431090926394\") " pod="openshift-ingress-canary/ingress-canary-tczxv" Jul 01 17:16:45.685479 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:45.685444 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tczxv" Jul 01 17:16:46.136231 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:46.136003 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/374e3f60-2885-4bf0-848a-10a1a3c0003a-metrics-tls\") pod \"dns-default-s5qpl\" (UID: \"374e3f60-2885-4bf0-848a-10a1a3c0003a\") " pod="openshift-dns/dns-default-s5qpl" Jul 01 17:16:46.136424 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:46.136156 2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 17:16:46.136424 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:46.136353 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/374e3f60-2885-4bf0-848a-10a1a3c0003a-metrics-tls podName:374e3f60-2885-4bf0-848a-10a1a3c0003a nodeName:}" failed. No retries permitted until 2026-07-01 17:16:47.136335108 +0000 UTC m=+37.168332365 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/374e3f60-2885-4bf0-848a-10a1a3c0003a-metrics-tls") pod "dns-default-s5qpl" (UID: "374e3f60-2885-4bf0-848a-10a1a3c0003a") : secret "dns-default-metrics-tls" not found Jul 01 17:16:46.839770 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:46.839742 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tczxv"] Jul 01 17:16:46.843913 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:46.843888 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01ad38f7_44ce_4388_9906_431090926394.slice/crio-8fba29e3eabd2d7b2bc41059c2605003c86d706a4f8a83d931901b36872553a7 WatchSource:0}: Error finding container 8fba29e3eabd2d7b2bc41059c2605003c86d706a4f8a83d931901b36872553a7: Status 404 returned error can't find the container with id 8fba29e3eabd2d7b2bc41059c2605003c86d706a4f8a83d931901b36872553a7 Jul 01 17:16:47.143891 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:47.143853 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/374e3f60-2885-4bf0-848a-10a1a3c0003a-metrics-tls\") pod \"dns-default-s5qpl\" (UID: \"374e3f60-2885-4bf0-848a-10a1a3c0003a\") " pod="openshift-dns/dns-default-s5qpl" Jul 01 17:16:47.144090 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:47.144020 2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 17:16:47.144090 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:47.144076 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/374e3f60-2885-4bf0-848a-10a1a3c0003a-metrics-tls podName:374e3f60-2885-4bf0-848a-10a1a3c0003a nodeName:}" failed. No retries permitted until 2026-07-01 17:16:49.144061718 +0000 UTC m=+39.176058956 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/374e3f60-2885-4bf0-848a-10a1a3c0003a-metrics-tls") pod "dns-default-s5qpl" (UID: "374e3f60-2885-4bf0-848a-10a1a3c0003a") : secret "dns-default-metrics-tls" not found Jul 01 17:16:47.636351 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:47.636308 2547 generic.go:356] "Generic (PLEG): container finished" podID="1cb2e486-78b2-4b87-9cc5-6286495cbc2b" containerID="577a4cc418734f7b73f3c20fd05f8f1f8cfd2fcd0ec0f8296acd65d7d46f0b1c" exitCode=0 Jul 01 17:16:47.636531 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:47.636396 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fw624" event={"ID":"1cb2e486-78b2-4b87-9cc5-6286495cbc2b","Type":"ContainerDied","Data":"577a4cc418734f7b73f3c20fd05f8f1f8cfd2fcd0ec0f8296acd65d7d46f0b1c"} Jul 01 17:16:47.638020 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:47.637992 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tczxv" event={"ID":"01ad38f7-44ce-4388-9906-431090926394","Type":"ContainerStarted","Data":"8fba29e3eabd2d7b2bc41059c2605003c86d706a4f8a83d931901b36872553a7"} Jul 01 17:16:48.644256 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:48.643986 2547 generic.go:356] "Generic (PLEG): container finished" podID="1cb2e486-78b2-4b87-9cc5-6286495cbc2b" containerID="13514df6be3397ca1b21aeb6ed83d4f73eb98cf0cee1788a5616279a29306fa5" exitCode=0 Jul 01 17:16:48.644712 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:48.644082 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fw624" event={"ID":"1cb2e486-78b2-4b87-9cc5-6286495cbc2b","Type":"ContainerDied","Data":"13514df6be3397ca1b21aeb6ed83d4f73eb98cf0cee1788a5616279a29306fa5"} Jul 01 17:16:49.159013 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:49.158971 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/374e3f60-2885-4bf0-848a-10a1a3c0003a-metrics-tls\") pod \"dns-default-s5qpl\" (UID: \"374e3f60-2885-4bf0-848a-10a1a3c0003a\") " pod="openshift-dns/dns-default-s5qpl" Jul 01 17:16:49.159163 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:49.159118 2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 17:16:49.159210 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:49.159181 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/374e3f60-2885-4bf0-848a-10a1a3c0003a-metrics-tls podName:374e3f60-2885-4bf0-848a-10a1a3c0003a nodeName:}" failed. No retries permitted until 2026-07-01 17:16:53.159166374 +0000 UTC m=+43.191163612 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/374e3f60-2885-4bf0-848a-10a1a3c0003a-metrics-tls") pod "dns-default-s5qpl" (UID: "374e3f60-2885-4bf0-848a-10a1a3c0003a") : secret "dns-default-metrics-tls" not found Jul 01 17:16:49.651403 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:49.651320 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fw624" event={"ID":"1cb2e486-78b2-4b87-9cc5-6286495cbc2b","Type":"ContainerStarted","Data":"1f6090cf75eb4cbc28fb64645db3414cda7777dc14b59a739c985a64c745cc7c"} Jul 01 17:16:49.652911 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:49.652888 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tczxv" event={"ID":"01ad38f7-44ce-4388-9906-431090926394","Type":"ContainerStarted","Data":"6c65df46bcb880f220e34998af4584c846491889936431603e725ac562dda2ef"} Jul 01 17:16:49.679536 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:49.679488 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fw624" podStartSLOduration=10.319491831 podStartE2EDuration="39.679473364s" totalImagesPullingTime="29.359981533s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:16:10 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:16:49.677542669 +0000 UTC m=+39.709539938" watchObservedRunningTime="2026-07-01 17:16:49.679473364 +0000 UTC m=+39.711470623" Jul 01 17:16:49.705801 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:49.705754 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-tczxv" podStartSLOduration=2.165659492 podStartE2EDuration="4.705739937s" totalImagesPullingTime="2.540080445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:16:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:16:49.705249423 +0000 UTC m=+39.737246682" watchObservedRunningTime="2026-07-01 17:16:49.705739937 +0000 UTC m=+39.737737213" Jul 01 17:16:53.187058 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:53.187013 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/374e3f60-2885-4bf0-848a-10a1a3c0003a-metrics-tls\") pod \"dns-default-s5qpl\" (UID: \"374e3f60-2885-4bf0-848a-10a1a3c0003a\") " pod="openshift-dns/dns-default-s5qpl" Jul 01 17:16:53.187422 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:53.187143 2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 17:16:53.187422 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:16:53.187198 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/374e3f60-2885-4bf0-848a-10a1a3c0003a-metrics-tls podName:374e3f60-2885-4bf0-848a-10a1a3c0003a nodeName:}" failed. No retries permitted until 2026-07-01 17:17:01.187184525 +0000 UTC m=+51.219181762 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/374e3f60-2885-4bf0-848a-10a1a3c0003a-metrics-tls") pod "dns-default-s5qpl" (UID: "374e3f60-2885-4bf0-848a-10a1a3c0003a") : secret "dns-default-metrics-tls" not found Jul 01 17:16:53.964796 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:53.964760 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65d8975744-6bw7k"] Jul 01 17:16:54.002122 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:54.002088 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65d8975744-6bw7k"] Jul 01 17:16:54.002122 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:54.002123 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8b9f547-tnp25"] Jul 01 17:16:54.002356 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:54.002224 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65d8975744-6bw7k" Jul 01 17:16:54.007235 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:54.007207 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 01 17:16:54.007235 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:54.007224 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-5cdtr\"" Jul 01 17:16:54.007235 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:54.007231 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 01 17:16:54.007450 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:54.007206 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 01 17:16:54.007450 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:54.007223 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 01 17:16:54.015113 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:54.015094 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8b9f547-tnp25"] Jul 01 17:16:54.015216 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:54.015170 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8b9f547-tnp25" Jul 01 17:16:54.018089 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:54.018073 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 01 17:16:54.093383 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:54.093346 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ba01f62c-1c20-480c-90eb-e19df424947f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-65d8975744-6bw7k\" (UID: \"ba01f62c-1c20-480c-90eb-e19df424947f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65d8975744-6bw7k" Jul 01 17:16:54.093522 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:54.093414 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzbmw\" (UniqueName: \"kubernetes.io/projected/ba01f62c-1c20-480c-90eb-e19df424947f-kube-api-access-gzbmw\") pod \"managed-serviceaccount-addon-agent-65d8975744-6bw7k\" (UID: \"ba01f62c-1c20-480c-90eb-e19df424947f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65d8975744-6bw7k" Jul 01 17:16:54.194076 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:54.194049 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gps64\" (UniqueName: \"kubernetes.io/projected/bb6bfd4f-d75b-4ae2-97f7-573ec3d2824c-kube-api-access-gps64\") pod \"klusterlet-addon-workmgr-5b8b9f547-tnp25\" (UID: \"bb6bfd4f-d75b-4ae2-97f7-573ec3d2824c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8b9f547-tnp25" Jul 01 17:16:54.194393 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:54.194109 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bb6bfd4f-d75b-4ae2-97f7-573ec3d2824c-klusterlet-config\") pod \"klusterlet-addon-workmgr-5b8b9f547-tnp25\" (UID: \"bb6bfd4f-d75b-4ae2-97f7-573ec3d2824c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8b9f547-tnp25" Jul 01 17:16:54.194393 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:54.194135 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb6bfd4f-d75b-4ae2-97f7-573ec3d2824c-tmp\") pod \"klusterlet-addon-workmgr-5b8b9f547-tnp25\" (UID: \"bb6bfd4f-d75b-4ae2-97f7-573ec3d2824c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8b9f547-tnp25" Jul 01 17:16:54.194393 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:54.194160 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ba01f62c-1c20-480c-90eb-e19df424947f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-65d8975744-6bw7k\" (UID: \"ba01f62c-1c20-480c-90eb-e19df424947f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65d8975744-6bw7k" Jul 01 17:16:54.194393 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:54.194202 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzbmw\" (UniqueName: \"kubernetes.io/projected/ba01f62c-1c20-480c-90eb-e19df424947f-kube-api-access-gzbmw\") pod \"managed-serviceaccount-addon-agent-65d8975744-6bw7k\" (UID: \"ba01f62c-1c20-480c-90eb-e19df424947f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65d8975744-6bw7k" Jul 01 17:16:54.198519 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:54.198489 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ba01f62c-1c20-480c-90eb-e19df424947f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-65d8975744-6bw7k\" (UID: \"ba01f62c-1c20-480c-90eb-e19df424947f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65d8975744-6bw7k" Jul 01 17:16:54.207469 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:54.207445 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzbmw\" (UniqueName: \"kubernetes.io/projected/ba01f62c-1c20-480c-90eb-e19df424947f-kube-api-access-gzbmw\") pod \"managed-serviceaccount-addon-agent-65d8975744-6bw7k\" (UID: \"ba01f62c-1c20-480c-90eb-e19df424947f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65d8975744-6bw7k" Jul 01 17:16:54.294731 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:54.294697 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bb6bfd4f-d75b-4ae2-97f7-573ec3d2824c-klusterlet-config\") pod \"klusterlet-addon-workmgr-5b8b9f547-tnp25\" (UID: \"bb6bfd4f-d75b-4ae2-97f7-573ec3d2824c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8b9f547-tnp25" Jul 01 17:16:54.294884 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:54.294737 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb6bfd4f-d75b-4ae2-97f7-573ec3d2824c-tmp\") pod \"klusterlet-addon-workmgr-5b8b9f547-tnp25\" (UID: \"bb6bfd4f-d75b-4ae2-97f7-573ec3d2824c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8b9f547-tnp25" Jul 01 17:16:54.294884 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:54.294790 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gps64\" (UniqueName: \"kubernetes.io/projected/bb6bfd4f-d75b-4ae2-97f7-573ec3d2824c-kube-api-access-gps64\") pod \"klusterlet-addon-workmgr-5b8b9f547-tnp25\" (UID: \"bb6bfd4f-d75b-4ae2-97f7-573ec3d2824c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8b9f547-tnp25" Jul 01 17:16:54.295240 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:54.295219 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb6bfd4f-d75b-4ae2-97f7-573ec3d2824c-tmp\") pod \"klusterlet-addon-workmgr-5b8b9f547-tnp25\" (UID: \"bb6bfd4f-d75b-4ae2-97f7-573ec3d2824c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8b9f547-tnp25" Jul 01 17:16:54.297412 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:54.297390 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bb6bfd4f-d75b-4ae2-97f7-573ec3d2824c-klusterlet-config\") pod \"klusterlet-addon-workmgr-5b8b9f547-tnp25\" (UID: \"bb6bfd4f-d75b-4ae2-97f7-573ec3d2824c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8b9f547-tnp25" Jul 01 17:16:54.305614 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:54.305584 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gps64\" (UniqueName: \"kubernetes.io/projected/bb6bfd4f-d75b-4ae2-97f7-573ec3d2824c-kube-api-access-gps64\") pod \"klusterlet-addon-workmgr-5b8b9f547-tnp25\" (UID: \"bb6bfd4f-d75b-4ae2-97f7-573ec3d2824c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8b9f547-tnp25" Jul 01 17:16:54.326575 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:54.326549 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65d8975744-6bw7k" Jul 01 17:16:54.332842 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:54.332817 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8b9f547-tnp25" Jul 01 17:16:54.513743 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:54.513711 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65d8975744-6bw7k"] Jul 01 17:16:54.518480 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:54.518455 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podba01f62c_1c20_480c_90eb_e19df424947f.slice/crio-5c57ea4d204ca898cacb000e9b0c9fe403701f581f15b2243c942c7e5c0eb745 WatchSource:0}: Error finding container 5c57ea4d204ca898cacb000e9b0c9fe403701f581f15b2243c942c7e5c0eb745: Status 404 returned error can't find the container with id 5c57ea4d204ca898cacb000e9b0c9fe403701f581f15b2243c942c7e5c0eb745 Jul 01 17:16:54.530450 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:54.530423 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8b9f547-tnp25"] Jul 01 17:16:54.533411 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:16:54.533390 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb6bfd4f_d75b_4ae2_97f7_573ec3d2824c.slice/crio-638ae408003ece01e407bbbf4191c33254286afcb4ad115f4350756fe6b1cf2f WatchSource:0}: Error finding container 638ae408003ece01e407bbbf4191c33254286afcb4ad115f4350756fe6b1cf2f: Status 404 returned error can't find the container with id 638ae408003ece01e407bbbf4191c33254286afcb4ad115f4350756fe6b1cf2f Jul 01 17:16:54.666183 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:54.666088 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8b9f547-tnp25" event={"ID":"bb6bfd4f-d75b-4ae2-97f7-573ec3d2824c","Type":"ContainerStarted","Data":"638ae408003ece01e407bbbf4191c33254286afcb4ad115f4350756fe6b1cf2f"} Jul 01 17:16:54.667138 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:54.667116 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65d8975744-6bw7k" event={"ID":"ba01f62c-1c20-480c-90eb-e19df424947f","Type":"ContainerStarted","Data":"5c57ea4d204ca898cacb000e9b0c9fe403701f581f15b2243c942c7e5c0eb745"} Jul 01 17:16:59.684871 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:59.684834 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65d8975744-6bw7k" event={"ID":"ba01f62c-1c20-480c-90eb-e19df424947f","Type":"ContainerStarted","Data":"a98f3133c30c293c98cdf8f5d7bca46c4d0dee2a965f5d0165261cf83ef6288d"} Jul 01 17:16:59.701967 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:16:59.701906 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65d8975744-6bw7k" podStartSLOduration=1.682519443 podStartE2EDuration="6.701890247s" totalImagesPullingTime="5.019370804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:16:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:16:59.701225001 +0000 UTC m=+49.733222260" watchObservedRunningTime="2026-07-01 17:16:59.701890247 +0000 UTC m=+49.733887507" Jul 01 17:17:00.688674 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:00.688630 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8b9f547-tnp25" event={"ID":"bb6bfd4f-d75b-4ae2-97f7-573ec3d2824c","Type":"ContainerStarted","Data":"a122629a3e26d636512562c537bbe9242f09f47b944ab6714d8404e79d0396e5"} Jul 01 17:17:00.707072 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:00.707023 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8b9f547-tnp25" podStartSLOduration=2.377132298 podStartE2EDuration="7.7070092s" totalImagesPullingTime="5.329876902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:16:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:17:00.706140354 +0000 UTC m=+50.738137614" watchObservedRunningTime="2026-07-01 17:17:00.7070092 +0000 UTC m=+50.739006459" Jul 01 17:17:01.253026 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:01.252989 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/374e3f60-2885-4bf0-848a-10a1a3c0003a-metrics-tls\") pod \"dns-default-s5qpl\" (UID: \"374e3f60-2885-4bf0-848a-10a1a3c0003a\") " pod="openshift-dns/dns-default-s5qpl" Jul 01 17:17:01.253217 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:01.253132 2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 17:17:01.253217 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:01.253196 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/374e3f60-2885-4bf0-848a-10a1a3c0003a-metrics-tls podName:374e3f60-2885-4bf0-848a-10a1a3c0003a nodeName:}" failed. No retries permitted until 2026-07-01 17:17:17.253179952 +0000 UTC m=+67.285177189 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/374e3f60-2885-4bf0-848a-10a1a3c0003a-metrics-tls") pod "dns-default-s5qpl" (UID: "374e3f60-2885-4bf0-848a-10a1a3c0003a") : secret "dns-default-metrics-tls" not found Jul 01 17:17:01.691556 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:01.691467 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8b9f547-tnp25" Jul 01 17:17:01.693118 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:01.693089 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8b9f547-tnp25" Jul 01 17:17:11.633215 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:11.633181 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qh49d" Jul 01 17:17:16.147086 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:16.147049 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32557f5d-39c9-49c0-bc63-3a9666e0ba57-original-pull-secret\") pod \"global-pull-secret-syncer-8h2fn\" (UID: \"32557f5d-39c9-49c0-bc63-3a9666e0ba57\") " pod="kube-system/global-pull-secret-syncer-8h2fn" Jul 01 17:17:16.147086 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:16.147092 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec5b1126-9d68-4911-ad3d-6f8369cf5a5d-metrics-certs\") pod \"network-metrics-daemon-wx5ff\" (UID: \"ec5b1126-9d68-4911-ad3d-6f8369cf5a5d\") " pod="openshift-multus/network-metrics-daemon-wx5ff" Jul 01 17:17:16.150491 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:16.150473 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 17:17:16.150491 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:16.150483 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 17:17:16.157738 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:16.157715 2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 01 17:17:16.157851 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:16.157772 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec5b1126-9d68-4911-ad3d-6f8369cf5a5d-metrics-certs podName:ec5b1126-9d68-4911-ad3d-6f8369cf5a5d nodeName:}" failed. No retries permitted until 2026-07-01 17:18:20.157756277 +0000 UTC m=+130.189753514 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec5b1126-9d68-4911-ad3d-6f8369cf5a5d-metrics-certs") pod "network-metrics-daemon-wx5ff" (UID: "ec5b1126-9d68-4911-ad3d-6f8369cf5a5d") : secret "metrics-daemon-secret" not found Jul 01 17:17:16.160020 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:16.159997 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32557f5d-39c9-49c0-bc63-3a9666e0ba57-original-pull-secret\") pod \"global-pull-secret-syncer-8h2fn\" (UID: \"32557f5d-39c9-49c0-bc63-3a9666e0ba57\") " pod="kube-system/global-pull-secret-syncer-8h2fn" Jul 01 17:17:16.247780 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:16.247742 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mmd8\" (UniqueName: \"kubernetes.io/projected/cecb7d35-1004-44b8-8eef-ca0efbf803cb-kube-api-access-8mmd8\") pod \"network-check-target-9zsrw\" (UID: \"cecb7d35-1004-44b8-8eef-ca0efbf803cb\") " pod="openshift-network-diagnostics/network-check-target-9zsrw" Jul 01 17:17:16.251138 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:16.251114 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 17:17:16.261395 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:16.261375 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 17:17:16.271124 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:16.271097 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mmd8\" (UniqueName: \"kubernetes.io/projected/cecb7d35-1004-44b8-8eef-ca0efbf803cb-kube-api-access-8mmd8\") pod \"network-check-target-9zsrw\" (UID: \"cecb7d35-1004-44b8-8eef-ca0efbf803cb\") " pod="openshift-network-diagnostics/network-check-target-9zsrw" Jul 01 17:17:16.333712 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:16.333685 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hbjh4\"" Jul 01 17:17:16.340490 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:16.340465 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9zsrw" Jul 01 17:17:16.344444 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:16.344429 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8h2fn" Jul 01 17:17:16.475133 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:16.475103 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9zsrw"] Jul 01 17:17:16.478315 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:17:16.478283 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcecb7d35_1004_44b8_8eef_ca0efbf803cb.slice/crio-448acc93625829f4a732503a840f5c8c44c23960b5860a31df7bf6812b13a259 WatchSource:0}: Error finding container 448acc93625829f4a732503a840f5c8c44c23960b5860a31df7bf6812b13a259: Status 404 returned error can't find the container with id 448acc93625829f4a732503a840f5c8c44c23960b5860a31df7bf6812b13a259 Jul 01 17:17:16.494528 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:16.494508 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8h2fn"] Jul 01 17:17:16.496656 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:17:16.496628 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32557f5d_39c9_49c0_bc63_3a9666e0ba57.slice/crio-6905d656e1c0054b46d3dbf897ee0c01fcdea41003d25107fbd22292a35254c0 WatchSource:0}: Error finding container 6905d656e1c0054b46d3dbf897ee0c01fcdea41003d25107fbd22292a35254c0: Status 404 returned error can't find the container with id 6905d656e1c0054b46d3dbf897ee0c01fcdea41003d25107fbd22292a35254c0 Jul 01 17:17:16.730292 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:16.730195 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8h2fn" event={"ID":"32557f5d-39c9-49c0-bc63-3a9666e0ba57","Type":"ContainerStarted","Data":"6905d656e1c0054b46d3dbf897ee0c01fcdea41003d25107fbd22292a35254c0"} Jul 01 17:17:16.731259 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:16.731236 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9zsrw" event={"ID":"cecb7d35-1004-44b8-8eef-ca0efbf803cb","Type":"ContainerStarted","Data":"448acc93625829f4a732503a840f5c8c44c23960b5860a31df7bf6812b13a259"} Jul 01 17:17:17.255412 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:17.255371 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/374e3f60-2885-4bf0-848a-10a1a3c0003a-metrics-tls\") pod \"dns-default-s5qpl\" (UID: \"374e3f60-2885-4bf0-848a-10a1a3c0003a\") " pod="openshift-dns/dns-default-s5qpl" Jul 01 17:17:17.255846 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:17.255552 2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 17:17:17.255846 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:17.255622 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/374e3f60-2885-4bf0-848a-10a1a3c0003a-metrics-tls podName:374e3f60-2885-4bf0-848a-10a1a3c0003a nodeName:}" failed. No retries permitted until 2026-07-01 17:17:49.255604877 +0000 UTC m=+99.287602120 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/374e3f60-2885-4bf0-848a-10a1a3c0003a-metrics-tls") pod "dns-default-s5qpl" (UID: "374e3f60-2885-4bf0-848a-10a1a3c0003a") : secret "dns-default-metrics-tls" not found Jul 01 17:17:21.746905 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:21.746865 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8h2fn" event={"ID":"32557f5d-39c9-49c0-bc63-3a9666e0ba57","Type":"ContainerStarted","Data":"2ccf8fa355e25ec039c99be869456cc4e32bcfa6f05ba0265e9c2813cb7d9db3"} Jul 01 17:17:21.748259 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:21.748235 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9zsrw" event={"ID":"cecb7d35-1004-44b8-8eef-ca0efbf803cb","Type":"ContainerStarted","Data":"d858d94ae7cfe9b0ac66e72e4211c9daf565ececfcbeac8cde3b70859a01baa3"} Jul 01 17:17:21.748373 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:21.748361 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9zsrw" Jul 01 17:17:21.763359 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:21.763317 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8h2fn" podStartSLOduration=67.099955215 podStartE2EDuration="1m11.763302582s" totalImagesPullingTime="4.663347367s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:16:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:17:21.762701263 +0000 UTC m=+71.794698536" watchObservedRunningTime="2026-07-01 17:17:21.763302582 +0000 UTC m=+71.795299841" Jul 01 17:17:21.778679 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:21.778645 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9zsrw" podStartSLOduration=67.100023604 podStartE2EDuration="1m11.778632302s" totalImagesPullingTime="4.678608698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:16:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:17:21.778290014 +0000 UTC m=+71.810287274" watchObservedRunningTime="2026-07-01 17:17:21.778632302 +0000 UTC m=+71.810629540" Jul 01 17:17:31.030547 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:31.030427 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-999px"] Jul 01 17:17:31.032311 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:31.032295 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-999px" Jul 01 17:17:31.035885 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:31.035848 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 01 17:17:31.035995 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:31.035885 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 01 17:17:31.037605 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:31.037587 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 01 17:17:31.039781 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:31.039764 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-6fddr\"" Jul 01 17:17:31.040904 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:31.040890 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 01 17:17:31.044709 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:31.044686 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-999px"] Jul 01 17:17:31.138217 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:31.138192 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5856f4f55b-m9442"] Jul 01 17:17:31.140336 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:31.140322 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5856f4f55b-m9442" Jul 01 17:17:31.146616 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:31.146593 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 01 17:17:31.146717 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:31.146694 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ggrg5\"" Jul 01 17:17:31.149426 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:31.149409 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 01 17:17:31.149854 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:31.149840 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 01 17:17:31.155623 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:31.155605 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 01 17:17:31.157589 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:31.157573 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ddb7b80a-d562-4021-ada0-8299226092cb-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-999px\" (UID: \"ddb7b80a-d562-4021-ada0-8299226092cb\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-999px" Jul 01 17:17:31.157670 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:31.157596 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ddb7b80a-d562-4021-ada0-8299226092cb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-999px\" (UID: \"ddb7b80a-d562-4021-ada0-8299226092cb\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-999px" Jul 01 17:17:31.157670 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:31.157621 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5d9n4\" (UniqueName: \"kubernetes.io/projected/ddb7b80a-d562-4021-ada0-8299226092cb-kube-api-access-5d9n4\") pod \"cluster-monitoring-operator-54cb84584-999px\" (UID: \"ddb7b80a-d562-4021-ada0-8299226092cb\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-999px" Jul 01 17:17:31.168473 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:31.168451 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5856f4f55b-m9442"] Jul 01 17:17:31.258786 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:31.258752 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-installation-pull-secrets\") pod \"image-registry-5856f4f55b-m9442\" (UID: \"e4c4eec4-7129-4d71-bebe-2a2c6093ea12\") " pod="openshift-image-registry/image-registry-5856f4f55b-m9442" Jul 01 17:17:31.258786 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:31.258789 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-image-registry-private-configuration\") pod \"image-registry-5856f4f55b-m9442\" (UID: \"e4c4eec4-7129-4d71-bebe-2a2c6093ea12\") " pod="openshift-image-registry/image-registry-5856f4f55b-m9442" Jul 01 17:17:31.259139 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:31.258812 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-ca-trust-extracted\") pod \"image-registry-5856f4f55b-m9442\" (UID: \"e4c4eec4-7129-4d71-bebe-2a2c6093ea12\") " pod="openshift-image-registry/image-registry-5856f4f55b-m9442" Jul 01 17:17:31.259139 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:31.258886 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-registry-certificates\") pod \"image-registry-5856f4f55b-m9442\" (UID: \"e4c4eec4-7129-4d71-bebe-2a2c6093ea12\") " pod="openshift-image-registry/image-registry-5856f4f55b-m9442" Jul 01 17:17:31.259139 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:31.258924 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ddb7b80a-d562-4021-ada0-8299226092cb-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-999px\" (UID: \"ddb7b80a-d562-4021-ada0-8299226092cb\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-999px" Jul 01 17:17:31.259139 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:31.258963 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ddb7b80a-d562-4021-ada0-8299226092cb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-999px\" (UID: \"ddb7b80a-d562-4021-ada0-8299226092cb\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-999px" Jul 01 17:17:31.259139 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:31.258982 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wj7nl\" (UniqueName: \"kubernetes.io/projected/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-kube-api-access-wj7nl\") pod \"image-registry-5856f4f55b-m9442\" (UID: \"e4c4eec4-7129-4d71-bebe-2a2c6093ea12\") " pod="openshift-image-registry/image-registry-5856f4f55b-m9442" Jul 01 17:17:31.259139 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:31.259008 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-registry-tls\") pod \"image-registry-5856f4f55b-m9442\" (UID: \"e4c4eec4-7129-4d71-bebe-2a2c6093ea12\") " pod="openshift-image-registry/image-registry-5856f4f55b-m9442" Jul 01 17:17:31.259139 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:31.259024 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-bound-sa-token\") pod \"image-registry-5856f4f55b-m9442\" (UID: \"e4c4eec4-7129-4d71-bebe-2a2c6093ea12\") " pod="openshift-image-registry/image-registry-5856f4f55b-m9442" Jul 01 17:17:31.259139 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:31.259049 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5d9n4\" (UniqueName: \"kubernetes.io/projected/ddb7b80a-d562-4021-ada0-8299226092cb-kube-api-access-5d9n4\") pod \"cluster-monitoring-operator-54cb84584-999px\" (UID: \"ddb7b80a-d562-4021-ada0-8299226092cb\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-999px" Jul 01 17:17:31.259139 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:31.259067 2547 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 17:17:31.259139 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:31.259067 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-trusted-ca\") pod \"image-registry-5856f4f55b-m9442\" (UID: \"e4c4eec4-7129-4d71-bebe-2a2c6093ea12\") " pod="openshift-image-registry/image-registry-5856f4f55b-m9442" Jul 01 17:17:31.259139 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:31.259128 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddb7b80a-d562-4021-ada0-8299226092cb-cluster-monitoring-operator-tls podName:ddb7b80a-d562-4021-ada0-8299226092cb nodeName:}" failed. No retries permitted until 2026-07-01 17:17:31.759114499 +0000 UTC m=+81.791111737 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ddb7b80a-d562-4021-ada0-8299226092cb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-999px" (UID: "ddb7b80a-d562-4021-ada0-8299226092cb") : secret "cluster-monitoring-operator-tls" not found Jul 01 17:17:31.259725 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:31.259705 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ddb7b80a-d562-4021-ada0-8299226092cb-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-999px\" (UID: \"ddb7b80a-d562-4021-ada0-8299226092cb\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-999px" Jul 01 17:17:31.271184 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:31.271167 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5d9n4\" (UniqueName: \"kubernetes.io/projected/ddb7b80a-d562-4021-ada0-8299226092cb-kube-api-access-5d9n4\") pod \"cluster-monitoring-operator-54cb84584-999px\" (UID: \"ddb7b80a-d562-4021-ada0-8299226092cb\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-999px" Jul 01 17:17:31.359501 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:31.359420 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-trusted-ca\") pod \"image-registry-5856f4f55b-m9442\" (UID: \"e4c4eec4-7129-4d71-bebe-2a2c6093ea12\") " pod="openshift-image-registry/image-registry-5856f4f55b-m9442" Jul 01 17:17:31.359501 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:31.359458 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-installation-pull-secrets\") pod \"image-registry-5856f4f55b-m9442\" (UID: \"e4c4eec4-7129-4d71-bebe-2a2c6093ea12\") " pod="openshift-image-registry/image-registry-5856f4f55b-m9442" Jul 01 17:17:31.359501 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:31.359480 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-image-registry-private-configuration\") pod \"image-registry-5856f4f55b-m9442\" (UID: \"e4c4eec4-7129-4d71-bebe-2a2c6093ea12\") " pod="openshift-image-registry/image-registry-5856f4f55b-m9442" Jul 01 17:17:31.359501 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:31.359499 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-ca-trust-extracted\") pod \"image-registry-5856f4f55b-m9442\" (UID: \"e4c4eec4-7129-4d71-bebe-2a2c6093ea12\") " pod="openshift-image-registry/image-registry-5856f4f55b-m9442" Jul 01 17:17:31.359736 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:31.359690 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-registry-certificates\") pod \"image-registry-5856f4f55b-m9442\" (UID: \"e4c4eec4-7129-4d71-bebe-2a2c6093ea12\") " pod="openshift-image-registry/image-registry-5856f4f55b-m9442" Jul 01 17:17:31.359780 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:31.359746 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wj7nl\" (UniqueName: \"kubernetes.io/projected/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-kube-api-access-wj7nl\") pod \"image-registry-5856f4f55b-m9442\" (UID: \"e4c4eec4-7129-4d71-bebe-2a2c6093ea12\") " pod="openshift-image-registry/image-registry-5856f4f55b-m9442" Jul 01 17:17:31.359826 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:31.359778 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-registry-tls\") pod \"image-registry-5856f4f55b-m9442\" (UID: \"e4c4eec4-7129-4d71-bebe-2a2c6093ea12\") " pod="openshift-image-registry/image-registry-5856f4f55b-m9442" Jul 01 17:17:31.359826 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:31.359804 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-bound-sa-token\") pod \"image-registry-5856f4f55b-m9442\" (UID: \"e4c4eec4-7129-4d71-bebe-2a2c6093ea12\") " pod="openshift-image-registry/image-registry-5856f4f55b-m9442" Jul 01 17:17:31.359921 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:31.359888 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-ca-trust-extracted\") pod \"image-registry-5856f4f55b-m9442\" (UID: \"e4c4eec4-7129-4d71-bebe-2a2c6093ea12\") " pod="openshift-image-registry/image-registry-5856f4f55b-m9442" Jul 01 17:17:31.359997 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:31.359982 2547 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 17:17:31.360053 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:31.360002 2547 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5856f4f55b-m9442: secret "image-registry-tls" not found Jul 01 17:17:31.360098 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:31.360071 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-registry-tls podName:e4c4eec4-7129-4d71-bebe-2a2c6093ea12 nodeName:}" failed. No retries permitted until 2026-07-01 17:17:31.860052342 +0000 UTC m=+81.892049581 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-registry-tls") pod "image-registry-5856f4f55b-m9442" (UID: "e4c4eec4-7129-4d71-bebe-2a2c6093ea12") : secret "image-registry-tls" not found Jul 01 17:17:31.360588 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:31.360570 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-trusted-ca\") pod \"image-registry-5856f4f55b-m9442\" (UID: \"e4c4eec4-7129-4d71-bebe-2a2c6093ea12\") " pod="openshift-image-registry/image-registry-5856f4f55b-m9442" Jul 01 17:17:31.360646 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:31.360615 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-registry-certificates\") pod \"image-registry-5856f4f55b-m9442\" (UID: \"e4c4eec4-7129-4d71-bebe-2a2c6093ea12\") " pod="openshift-image-registry/image-registry-5856f4f55b-m9442" Jul 01 17:17:31.362170 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:31.362141 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-image-registry-private-configuration\") pod \"image-registry-5856f4f55b-m9442\" (UID: \"e4c4eec4-7129-4d71-bebe-2a2c6093ea12\") " pod="openshift-image-registry/image-registry-5856f4f55b-m9442" Jul 01 17:17:31.362264 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:31.362245 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-installation-pull-secrets\") pod \"image-registry-5856f4f55b-m9442\" (UID: \"e4c4eec4-7129-4d71-bebe-2a2c6093ea12\") " pod="openshift-image-registry/image-registry-5856f4f55b-m9442" Jul 01 17:17:31.371707 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:31.371682 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wj7nl\" (UniqueName: \"kubernetes.io/projected/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-kube-api-access-wj7nl\") pod \"image-registry-5856f4f55b-m9442\" (UID: \"e4c4eec4-7129-4d71-bebe-2a2c6093ea12\") " pod="openshift-image-registry/image-registry-5856f4f55b-m9442" Jul 01 17:17:31.372104 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:31.372083 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-bound-sa-token\") pod \"image-registry-5856f4f55b-m9442\" (UID: \"e4c4eec4-7129-4d71-bebe-2a2c6093ea12\") " pod="openshift-image-registry/image-registry-5856f4f55b-m9442" Jul 01 17:17:31.763366 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:31.763327 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ddb7b80a-d562-4021-ada0-8299226092cb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-999px\" (UID: \"ddb7b80a-d562-4021-ada0-8299226092cb\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-999px" Jul 01 17:17:31.763557 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:31.763496 2547 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 17:17:31.763649 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:31.763584 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddb7b80a-d562-4021-ada0-8299226092cb-cluster-monitoring-operator-tls podName:ddb7b80a-d562-4021-ada0-8299226092cb nodeName:}" failed. No retries permitted until 2026-07-01 17:17:32.763562795 +0000 UTC m=+82.795560032 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ddb7b80a-d562-4021-ada0-8299226092cb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-999px" (UID: "ddb7b80a-d562-4021-ada0-8299226092cb") : secret "cluster-monitoring-operator-tls" not found Jul 01 17:17:31.864628 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:31.864589 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-registry-tls\") pod \"image-registry-5856f4f55b-m9442\" (UID: \"e4c4eec4-7129-4d71-bebe-2a2c6093ea12\") " pod="openshift-image-registry/image-registry-5856f4f55b-m9442" Jul 01 17:17:31.864801 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:31.864723 2547 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 17:17:31.864801 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:31.864735 2547 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5856f4f55b-m9442: secret "image-registry-tls" not found Jul 01 17:17:31.864801 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:31.864781 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-registry-tls podName:e4c4eec4-7129-4d71-bebe-2a2c6093ea12 nodeName:}" failed. No retries permitted until 2026-07-01 17:17:32.864768172 +0000 UTC m=+82.896765411 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-registry-tls") pod "image-registry-5856f4f55b-m9442" (UID: "e4c4eec4-7129-4d71-bebe-2a2c6093ea12") : secret "image-registry-tls" not found Jul 01 17:17:32.771288 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:32.771249 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ddb7b80a-d562-4021-ada0-8299226092cb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-999px\" (UID: \"ddb7b80a-d562-4021-ada0-8299226092cb\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-999px" Jul 01 17:17:32.771743 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:32.771384 2547 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 17:17:32.771743 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:32.771457 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddb7b80a-d562-4021-ada0-8299226092cb-cluster-monitoring-operator-tls podName:ddb7b80a-d562-4021-ada0-8299226092cb nodeName:}" failed. No retries permitted until 2026-07-01 17:17:34.771438097 +0000 UTC m=+84.803435358 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ddb7b80a-d562-4021-ada0-8299226092cb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-999px" (UID: "ddb7b80a-d562-4021-ada0-8299226092cb") : secret "cluster-monitoring-operator-tls" not found Jul 01 17:17:32.872102 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:32.872071 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-registry-tls\") pod \"image-registry-5856f4f55b-m9442\" (UID: \"e4c4eec4-7129-4d71-bebe-2a2c6093ea12\") " pod="openshift-image-registry/image-registry-5856f4f55b-m9442" Jul 01 17:17:32.872292 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:32.872215 2547 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 17:17:32.872292 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:32.872230 2547 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5856f4f55b-m9442: secret "image-registry-tls" not found Jul 01 17:17:32.872405 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:32.872302 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-registry-tls podName:e4c4eec4-7129-4d71-bebe-2a2c6093ea12 nodeName:}" failed. No retries permitted until 2026-07-01 17:17:34.872282358 +0000 UTC m=+84.904279596 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-registry-tls") pod "image-registry-5856f4f55b-m9442" (UID: "e4c4eec4-7129-4d71-bebe-2a2c6093ea12") : secret "image-registry-tls" not found Jul 01 17:17:34.783494 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:34.783460 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ddb7b80a-d562-4021-ada0-8299226092cb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-999px\" (UID: \"ddb7b80a-d562-4021-ada0-8299226092cb\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-999px" Jul 01 17:17:34.783870 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:34.783597 2547 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 17:17:34.783870 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:34.783663 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddb7b80a-d562-4021-ada0-8299226092cb-cluster-monitoring-operator-tls podName:ddb7b80a-d562-4021-ada0-8299226092cb nodeName:}" failed. No retries permitted until 2026-07-01 17:17:38.783645222 +0000 UTC m=+88.815642467 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ddb7b80a-d562-4021-ada0-8299226092cb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-999px" (UID: "ddb7b80a-d562-4021-ada0-8299226092cb") : secret "cluster-monitoring-operator-tls" not found Jul 01 17:17:34.884051 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:34.884016 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-registry-tls\") pod \"image-registry-5856f4f55b-m9442\" (UID: \"e4c4eec4-7129-4d71-bebe-2a2c6093ea12\") " pod="openshift-image-registry/image-registry-5856f4f55b-m9442" Jul 01 17:17:34.884243 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:34.884140 2547 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 17:17:34.884243 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:34.884151 2547 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5856f4f55b-m9442: secret "image-registry-tls" not found Jul 01 17:17:34.884243 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:34.884201 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-registry-tls podName:e4c4eec4-7129-4d71-bebe-2a2c6093ea12 nodeName:}" failed. No retries permitted until 2026-07-01 17:17:38.884187915 +0000 UTC m=+88.916185153 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-registry-tls") pod "image-registry-5856f4f55b-m9442" (UID: "e4c4eec4-7129-4d71-bebe-2a2c6093ea12") : secret "image-registry-tls" not found Jul 01 17:17:37.382430 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:37.382396 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pbnbg"] Jul 01 17:17:37.387456 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:37.387433 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pbnbg" Jul 01 17:17:37.390733 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:37.390704 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 01 17:17:37.390733 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:37.390708 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 01 17:17:37.390896 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:37.390741 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 01 17:17:37.392200 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:37.392185 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 01 17:17:37.392268 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:37.392185 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5vpc8\"" Jul 01 17:17:37.403380 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:37.403358 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pbnbg"] Jul 01 17:17:37.502078 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:37.502044 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2vf6\" (UniqueName: \"kubernetes.io/projected/9b3d3b2b-3e29-406c-a0a7-fb990537bab4-kube-api-access-j2vf6\") pod \"insights-runtime-extractor-pbnbg\" (UID: \"9b3d3b2b-3e29-406c-a0a7-fb990537bab4\") " pod="openshift-insights/insights-runtime-extractor-pbnbg" Jul 01 17:17:37.502261 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:37.502087 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9b3d3b2b-3e29-406c-a0a7-fb990537bab4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pbnbg\" (UID: \"9b3d3b2b-3e29-406c-a0a7-fb990537bab4\") " pod="openshift-insights/insights-runtime-extractor-pbnbg" Jul 01 17:17:37.502261 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:37.502181 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b3d3b2b-3e29-406c-a0a7-fb990537bab4-data-volume\") pod \"insights-runtime-extractor-pbnbg\" (UID: \"9b3d3b2b-3e29-406c-a0a7-fb990537bab4\") " pod="openshift-insights/insights-runtime-extractor-pbnbg" Jul 01 17:17:37.502364 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:37.502267 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9b3d3b2b-3e29-406c-a0a7-fb990537bab4-crio-socket\") pod \"insights-runtime-extractor-pbnbg\" (UID: \"9b3d3b2b-3e29-406c-a0a7-fb990537bab4\") " pod="openshift-insights/insights-runtime-extractor-pbnbg" Jul 01 17:17:37.502364 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:37.502318 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b3d3b2b-3e29-406c-a0a7-fb990537bab4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pbnbg\" (UID: \"9b3d3b2b-3e29-406c-a0a7-fb990537bab4\") " pod="openshift-insights/insights-runtime-extractor-pbnbg" Jul 01 17:17:37.602705 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:37.602673 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b3d3b2b-3e29-406c-a0a7-fb990537bab4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pbnbg\" (UID: \"9b3d3b2b-3e29-406c-a0a7-fb990537bab4\") " pod="openshift-insights/insights-runtime-extractor-pbnbg" Jul 01 17:17:37.602864 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:37.602732 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2vf6\" (UniqueName: \"kubernetes.io/projected/9b3d3b2b-3e29-406c-a0a7-fb990537bab4-kube-api-access-j2vf6\") pod \"insights-runtime-extractor-pbnbg\" (UID: \"9b3d3b2b-3e29-406c-a0a7-fb990537bab4\") " pod="openshift-insights/insights-runtime-extractor-pbnbg" Jul 01 17:17:37.602864 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:37.602756 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9b3d3b2b-3e29-406c-a0a7-fb990537bab4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pbnbg\" (UID: \"9b3d3b2b-3e29-406c-a0a7-fb990537bab4\") " pod="openshift-insights/insights-runtime-extractor-pbnbg" Jul 01 17:17:37.602864 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:37.602804 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b3d3b2b-3e29-406c-a0a7-fb990537bab4-data-volume\") pod \"insights-runtime-extractor-pbnbg\" (UID: \"9b3d3b2b-3e29-406c-a0a7-fb990537bab4\") " pod="openshift-insights/insights-runtime-extractor-pbnbg" Jul 01 17:17:37.602864 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:37.602811 2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 17:17:37.602864 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:37.602837 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9b3d3b2b-3e29-406c-a0a7-fb990537bab4-crio-socket\") pod \"insights-runtime-extractor-pbnbg\" (UID: \"9b3d3b2b-3e29-406c-a0a7-fb990537bab4\") " pod="openshift-insights/insights-runtime-extractor-pbnbg" Jul 01 17:17:37.603152 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:37.602874 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b3d3b2b-3e29-406c-a0a7-fb990537bab4-insights-runtime-extractor-tls podName:9b3d3b2b-3e29-406c-a0a7-fb990537bab4 nodeName:}" failed. No retries permitted until 2026-07-01 17:17:38.102858964 +0000 UTC m=+88.134856202 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9b3d3b2b-3e29-406c-a0a7-fb990537bab4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pbnbg" (UID: "9b3d3b2b-3e29-406c-a0a7-fb990537bab4") : secret "insights-runtime-extractor-tls" not found Jul 01 17:17:37.603152 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:37.602881 2547 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 17:17:37.603152 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:37.602919 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9b3d3b2b-3e29-406c-a0a7-fb990537bab4-crio-socket\") pod \"insights-runtime-extractor-pbnbg\" (UID: \"9b3d3b2b-3e29-406c-a0a7-fb990537bab4\") " pod="openshift-insights/insights-runtime-extractor-pbnbg" Jul 01 17:17:37.603152 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:37.602938 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9b3d3b2b-3e29-406c-a0a7-fb990537bab4-kube-rbac-proxy-cm podName:9b3d3b2b-3e29-406c-a0a7-fb990537bab4 nodeName:}" failed. No retries permitted until 2026-07-01 17:17:38.102920971 +0000 UTC m=+88.134918210 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9b3d3b2b-3e29-406c-a0a7-fb990537bab4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pbnbg" (UID: "9b3d3b2b-3e29-406c-a0a7-fb990537bab4") : configmap "kube-rbac-proxy" not found Jul 01 17:17:37.603322 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:37.603204 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b3d3b2b-3e29-406c-a0a7-fb990537bab4-data-volume\") pod \"insights-runtime-extractor-pbnbg\" (UID: \"9b3d3b2b-3e29-406c-a0a7-fb990537bab4\") " pod="openshift-insights/insights-runtime-extractor-pbnbg" Jul 01 17:17:37.612095 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:37.612070 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2vf6\" (UniqueName: \"kubernetes.io/projected/9b3d3b2b-3e29-406c-a0a7-fb990537bab4-kube-api-access-j2vf6\") pod \"insights-runtime-extractor-pbnbg\" (UID: \"9b3d3b2b-3e29-406c-a0a7-fb990537bab4\") " pod="openshift-insights/insights-runtime-extractor-pbnbg" Jul 01 17:17:38.107857 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:38.107818 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9b3d3b2b-3e29-406c-a0a7-fb990537bab4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pbnbg\" (UID: \"9b3d3b2b-3e29-406c-a0a7-fb990537bab4\") " pod="openshift-insights/insights-runtime-extractor-pbnbg" Jul 01 17:17:38.108069 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:38.107904 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b3d3b2b-3e29-406c-a0a7-fb990537bab4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pbnbg\" (UID: \"9b3d3b2b-3e29-406c-a0a7-fb990537bab4\") " pod="openshift-insights/insights-runtime-extractor-pbnbg" Jul 01 17:17:38.108069 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:38.107973 2547 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 17:17:38.108069 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:38.108032 2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 17:17:38.108069 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:38.108046 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9b3d3b2b-3e29-406c-a0a7-fb990537bab4-kube-rbac-proxy-cm podName:9b3d3b2b-3e29-406c-a0a7-fb990537bab4 nodeName:}" failed. No retries permitted until 2026-07-01 17:17:39.108025838 +0000 UTC m=+89.140023091 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9b3d3b2b-3e29-406c-a0a7-fb990537bab4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pbnbg" (UID: "9b3d3b2b-3e29-406c-a0a7-fb990537bab4") : configmap "kube-rbac-proxy" not found Jul 01 17:17:38.108223 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:38.108085 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b3d3b2b-3e29-406c-a0a7-fb990537bab4-insights-runtime-extractor-tls podName:9b3d3b2b-3e29-406c-a0a7-fb990537bab4 nodeName:}" failed. No retries permitted until 2026-07-01 17:17:39.108074533 +0000 UTC m=+89.140071771 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9b3d3b2b-3e29-406c-a0a7-fb990537bab4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pbnbg" (UID: "9b3d3b2b-3e29-406c-a0a7-fb990537bab4") : secret "insights-runtime-extractor-tls" not found Jul 01 17:17:38.815179 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:38.815140 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ddb7b80a-d562-4021-ada0-8299226092cb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-999px\" (UID: \"ddb7b80a-d562-4021-ada0-8299226092cb\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-999px" Jul 01 17:17:38.815557 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:38.815282 2547 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 17:17:38.815557 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:38.815343 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddb7b80a-d562-4021-ada0-8299226092cb-cluster-monitoring-operator-tls podName:ddb7b80a-d562-4021-ada0-8299226092cb nodeName:}" failed. No retries permitted until 2026-07-01 17:17:46.815328275 +0000 UTC m=+96.847325512 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ddb7b80a-d562-4021-ada0-8299226092cb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-999px" (UID: "ddb7b80a-d562-4021-ada0-8299226092cb") : secret "cluster-monitoring-operator-tls" not found Jul 01 17:17:38.915654 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:38.915617 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-registry-tls\") pod \"image-registry-5856f4f55b-m9442\" (UID: \"e4c4eec4-7129-4d71-bebe-2a2c6093ea12\") " pod="openshift-image-registry/image-registry-5856f4f55b-m9442" Jul 01 17:17:38.915821 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:38.915767 2547 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 17:17:38.915821 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:38.915781 2547 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5856f4f55b-m9442: secret "image-registry-tls" not found Jul 01 17:17:38.915893 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:38.915837 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-registry-tls podName:e4c4eec4-7129-4d71-bebe-2a2c6093ea12 nodeName:}" failed. No retries permitted until 2026-07-01 17:17:46.915820831 +0000 UTC m=+96.947818085 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-registry-tls") pod "image-registry-5856f4f55b-m9442" (UID: "e4c4eec4-7129-4d71-bebe-2a2c6093ea12") : secret "image-registry-tls" not found Jul 01 17:17:39.117600 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:39.117509 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b3d3b2b-3e29-406c-a0a7-fb990537bab4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pbnbg\" (UID: \"9b3d3b2b-3e29-406c-a0a7-fb990537bab4\") " pod="openshift-insights/insights-runtime-extractor-pbnbg" Jul 01 17:17:39.117600 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:39.117581 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9b3d3b2b-3e29-406c-a0a7-fb990537bab4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pbnbg\" (UID: \"9b3d3b2b-3e29-406c-a0a7-fb990537bab4\") " pod="openshift-insights/insights-runtime-extractor-pbnbg" Jul 01 17:17:39.117827 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:39.117650 2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 17:17:39.117827 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:39.117678 2547 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 17:17:39.117827 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:39.117714 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b3d3b2b-3e29-406c-a0a7-fb990537bab4-insights-runtime-extractor-tls podName:9b3d3b2b-3e29-406c-a0a7-fb990537bab4 nodeName:}" failed. No retries permitted until 2026-07-01 17:17:41.11770023 +0000 UTC m=+91.149697469 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9b3d3b2b-3e29-406c-a0a7-fb990537bab4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pbnbg" (UID: "9b3d3b2b-3e29-406c-a0a7-fb990537bab4") : secret "insights-runtime-extractor-tls" not found Jul 01 17:17:39.117827 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:39.117729 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9b3d3b2b-3e29-406c-a0a7-fb990537bab4-kube-rbac-proxy-cm podName:9b3d3b2b-3e29-406c-a0a7-fb990537bab4 nodeName:}" failed. No retries permitted until 2026-07-01 17:17:41.117722468 +0000 UTC m=+91.149719706 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9b3d3b2b-3e29-406c-a0a7-fb990537bab4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pbnbg" (UID: "9b3d3b2b-3e29-406c-a0a7-fb990537bab4") : configmap "kube-rbac-proxy" not found Jul 01 17:17:39.663094 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:39.663066 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-s96pk_b04b8848-2a26-42ab-adf6-46a857cbd6f2/dns-node-resolver/0.log" Jul 01 17:17:40.457970 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:40.457918 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9ksbn_c87a9aa8-cd15-41a5-9879-d6c448cc62eb/node-ca/0.log" Jul 01 17:17:41.133138 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:41.133083 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9b3d3b2b-3e29-406c-a0a7-fb990537bab4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pbnbg\" (UID: \"9b3d3b2b-3e29-406c-a0a7-fb990537bab4\") " pod="openshift-insights/insights-runtime-extractor-pbnbg" Jul 01 17:17:41.133339 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:41.133206 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b3d3b2b-3e29-406c-a0a7-fb990537bab4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pbnbg\" (UID: \"9b3d3b2b-3e29-406c-a0a7-fb990537bab4\") " pod="openshift-insights/insights-runtime-extractor-pbnbg" Jul 01 17:17:41.133339 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:41.133224 2547 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 17:17:41.133339 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:41.133293 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9b3d3b2b-3e29-406c-a0a7-fb990537bab4-kube-rbac-proxy-cm podName:9b3d3b2b-3e29-406c-a0a7-fb990537bab4 nodeName:}" failed. No retries permitted until 2026-07-01 17:17:45.133273386 +0000 UTC m=+95.165270650 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9b3d3b2b-3e29-406c-a0a7-fb990537bab4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pbnbg" (UID: "9b3d3b2b-3e29-406c-a0a7-fb990537bab4") : configmap "kube-rbac-proxy" not found Jul 01 17:17:41.133447 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:41.133352 2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 17:17:41.133447 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:41.133406 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b3d3b2b-3e29-406c-a0a7-fb990537bab4-insights-runtime-extractor-tls podName:9b3d3b2b-3e29-406c-a0a7-fb990537bab4 nodeName:}" failed. No retries permitted until 2026-07-01 17:17:45.133393378 +0000 UTC m=+95.165390616 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9b3d3b2b-3e29-406c-a0a7-fb990537bab4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pbnbg" (UID: "9b3d3b2b-3e29-406c-a0a7-fb990537bab4") : secret "insights-runtime-extractor-tls" not found Jul 01 17:17:41.458549 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:41.458461 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tczxv_01ad38f7-44ce-4388-9906-431090926394/serve-healthcheck-canary/0.log" Jul 01 17:17:45.166922 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:45.166889 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9b3d3b2b-3e29-406c-a0a7-fb990537bab4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pbnbg\" (UID: \"9b3d3b2b-3e29-406c-a0a7-fb990537bab4\") " pod="openshift-insights/insights-runtime-extractor-pbnbg" Jul 01 17:17:45.167333 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:45.167009 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b3d3b2b-3e29-406c-a0a7-fb990537bab4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pbnbg\" (UID: \"9b3d3b2b-3e29-406c-a0a7-fb990537bab4\") " pod="openshift-insights/insights-runtime-extractor-pbnbg" Jul 01 17:17:45.167333 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:45.167016 2547 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 17:17:45.167333 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:45.167077 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9b3d3b2b-3e29-406c-a0a7-fb990537bab4-kube-rbac-proxy-cm podName:9b3d3b2b-3e29-406c-a0a7-fb990537bab4 nodeName:}" failed. No retries permitted until 2026-07-01 17:17:53.167060136 +0000 UTC m=+103.199057378 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9b3d3b2b-3e29-406c-a0a7-fb990537bab4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pbnbg" (UID: "9b3d3b2b-3e29-406c-a0a7-fb990537bab4") : configmap "kube-rbac-proxy" not found Jul 01 17:17:45.167333 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:45.167110 2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 17:17:45.167333 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:45.167157 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b3d3b2b-3e29-406c-a0a7-fb990537bab4-insights-runtime-extractor-tls podName:9b3d3b2b-3e29-406c-a0a7-fb990537bab4 nodeName:}" failed. No retries permitted until 2026-07-01 17:17:53.167146718 +0000 UTC m=+103.199143957 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9b3d3b2b-3e29-406c-a0a7-fb990537bab4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pbnbg" (UID: "9b3d3b2b-3e29-406c-a0a7-fb990537bab4") : secret "insights-runtime-extractor-tls" not found Jul 01 17:17:46.880629 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:46.880594 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ddb7b80a-d562-4021-ada0-8299226092cb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-999px\" (UID: \"ddb7b80a-d562-4021-ada0-8299226092cb\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-999px" Jul 01 17:17:46.881075 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:46.880724 2547 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 17:17:46.881075 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:17:46.880785 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddb7b80a-d562-4021-ada0-8299226092cb-cluster-monitoring-operator-tls podName:ddb7b80a-d562-4021-ada0-8299226092cb nodeName:}" failed. No retries permitted until 2026-07-01 17:18:02.880767272 +0000 UTC m=+112.912764510 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ddb7b80a-d562-4021-ada0-8299226092cb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-999px" (UID: "ddb7b80a-d562-4021-ada0-8299226092cb") : secret "cluster-monitoring-operator-tls" not found Jul 01 17:17:46.981131 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:46.981092 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-registry-tls\") pod \"image-registry-5856f4f55b-m9442\" (UID: \"e4c4eec4-7129-4d71-bebe-2a2c6093ea12\") " pod="openshift-image-registry/image-registry-5856f4f55b-m9442" Jul 01 17:17:46.983717 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:46.983692 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-registry-tls\") pod \"image-registry-5856f4f55b-m9442\" (UID: \"e4c4eec4-7129-4d71-bebe-2a2c6093ea12\") " pod="openshift-image-registry/image-registry-5856f4f55b-m9442" Jul 01 17:17:47.048834 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:47.048805 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5856f4f55b-m9442" Jul 01 17:17:47.176899 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:47.176830 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5856f4f55b-m9442"] Jul 01 17:17:47.179803 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:17:47.179772 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4c4eec4_7129_4d71_bebe_2a2c6093ea12.slice/crio-940bbb96d8bd14487770c1c484cbf1c19173861a4edacd1940284822be056818 WatchSource:0}: Error finding container 940bbb96d8bd14487770c1c484cbf1c19173861a4edacd1940284822be056818: Status 404 returned error can't find the container with id 940bbb96d8bd14487770c1c484cbf1c19173861a4edacd1940284822be056818 Jul 01 17:17:47.831897 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:47.831855 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5856f4f55b-m9442" event={"ID":"e4c4eec4-7129-4d71-bebe-2a2c6093ea12","Type":"ContainerStarted","Data":"bc28165d2aecd54d14d3eacaf7c73016df9bb0ab09380abef03dde2fd5943473"} Jul 01 17:17:47.832224 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:47.831908 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5856f4f55b-m9442" event={"ID":"e4c4eec4-7129-4d71-bebe-2a2c6093ea12","Type":"ContainerStarted","Data":"940bbb96d8bd14487770c1c484cbf1c19173861a4edacd1940284822be056818"} Jul 01 17:17:47.832224 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:47.831994 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5856f4f55b-m9442" Jul 01 17:17:47.854673 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:47.854621 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5856f4f55b-m9442" podStartSLOduration=16.854607136 podStartE2EDuration="16.854607136s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:17:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:17:47.853571039 +0000 UTC m=+97.885568307" watchObservedRunningTime="2026-07-01 17:17:47.854607136 +0000 UTC m=+97.886604396" Jul 01 17:17:49.300674 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:49.300635 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/374e3f60-2885-4bf0-848a-10a1a3c0003a-metrics-tls\") pod \"dns-default-s5qpl\" (UID: \"374e3f60-2885-4bf0-848a-10a1a3c0003a\") " pod="openshift-dns/dns-default-s5qpl" Jul 01 17:17:49.303039 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:49.303015 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/374e3f60-2885-4bf0-848a-10a1a3c0003a-metrics-tls\") pod \"dns-default-s5qpl\" (UID: \"374e3f60-2885-4bf0-848a-10a1a3c0003a\") " pod="openshift-dns/dns-default-s5qpl" Jul 01 17:17:49.582052 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:49.581966 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-n25z7\"" Jul 01 17:17:49.589249 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:49.589216 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s5qpl" Jul 01 17:17:49.717015 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:49.716995 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s5qpl"] Jul 01 17:17:49.719431 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:17:49.719405 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod374e3f60_2885_4bf0_848a_10a1a3c0003a.slice/crio-daf0aeef43acc0d30f7304b4e145a3e0f4ef6b6b89bdbd6b95b4bc5992f60499 WatchSource:0}: Error finding container daf0aeef43acc0d30f7304b4e145a3e0f4ef6b6b89bdbd6b95b4bc5992f60499: Status 404 returned error can't find the container with id daf0aeef43acc0d30f7304b4e145a3e0f4ef6b6b89bdbd6b95b4bc5992f60499 Jul 01 17:17:49.839039 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:49.838938 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s5qpl" event={"ID":"374e3f60-2885-4bf0-848a-10a1a3c0003a","Type":"ContainerStarted","Data":"daf0aeef43acc0d30f7304b4e145a3e0f4ef6b6b89bdbd6b95b4bc5992f60499"} Jul 01 17:17:52.753774 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:52.753744 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9zsrw" Jul 01 17:17:53.237124 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:53.237090 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9b3d3b2b-3e29-406c-a0a7-fb990537bab4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pbnbg\" (UID: \"9b3d3b2b-3e29-406c-a0a7-fb990537bab4\") " pod="openshift-insights/insights-runtime-extractor-pbnbg" Jul 01 17:17:53.237298 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:53.237173 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b3d3b2b-3e29-406c-a0a7-fb990537bab4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pbnbg\" (UID: \"9b3d3b2b-3e29-406c-a0a7-fb990537bab4\") " pod="openshift-insights/insights-runtime-extractor-pbnbg" Jul 01 17:17:53.237759 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:53.237738 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9b3d3b2b-3e29-406c-a0a7-fb990537bab4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pbnbg\" (UID: \"9b3d3b2b-3e29-406c-a0a7-fb990537bab4\") " pod="openshift-insights/insights-runtime-extractor-pbnbg" Jul 01 17:17:53.239607 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:53.239587 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b3d3b2b-3e29-406c-a0a7-fb990537bab4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pbnbg\" (UID: \"9b3d3b2b-3e29-406c-a0a7-fb990537bab4\") " pod="openshift-insights/insights-runtime-extractor-pbnbg" Jul 01 17:17:53.296017 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:53.295980 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pbnbg" Jul 01 17:17:53.447968 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:53.447911 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pbnbg"] Jul 01 17:17:53.452107 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:17:53.452079 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b3d3b2b_3e29_406c_a0a7_fb990537bab4.slice/crio-e2ea1b0d6b80d5a04dae772a40ff9a8568005f62dd0ef81ad2932b9f18259760 WatchSource:0}: Error finding container e2ea1b0d6b80d5a04dae772a40ff9a8568005f62dd0ef81ad2932b9f18259760: Status 404 returned error can't find the container with id e2ea1b0d6b80d5a04dae772a40ff9a8568005f62dd0ef81ad2932b9f18259760 Jul 01 17:17:53.852442 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:53.852397 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s5qpl" event={"ID":"374e3f60-2885-4bf0-848a-10a1a3c0003a","Type":"ContainerStarted","Data":"3bf174171d43b98ae9265e97789ec56cd62d00bed69c7dcf7d9fc63a37178d8c"} Jul 01 17:17:53.852909 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:53.852458 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s5qpl" event={"ID":"374e3f60-2885-4bf0-848a-10a1a3c0003a","Type":"ContainerStarted","Data":"71a1b7d02c361928b88b991f5a4309e37a9ca84341bc5707a55886473cfdf9a7"} Jul 01 17:17:53.852909 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:53.852485 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-s5qpl" Jul 01 17:17:53.853535 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:53.853509 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pbnbg" event={"ID":"9b3d3b2b-3e29-406c-a0a7-fb990537bab4","Type":"ContainerStarted","Data":"e2ea1b0d6b80d5a04dae772a40ff9a8568005f62dd0ef81ad2932b9f18259760"} Jul 01 17:17:53.871617 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:53.871565 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-s5qpl" podStartSLOduration=65.687748549 podStartE2EDuration="1m8.871547838s" totalImagesPullingTime="3.183799289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:16:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:17:53.871100161 +0000 UTC m=+103.903097444" watchObservedRunningTime="2026-07-01 17:17:53.871547838 +0000 UTC m=+103.903545097" Jul 01 17:17:57.870441 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:57.870402 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pbnbg" event={"ID":"9b3d3b2b-3e29-406c-a0a7-fb990537bab4","Type":"ContainerStarted","Data":"584ae5e91bfaec5f26ac08904211e887252db4db44a3f6bbf65fc6850655598a"} Jul 01 17:17:58.210537 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:58.210444 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-l47gf"] Jul 01 17:17:58.212392 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:58.212375 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-l47gf" Jul 01 17:17:58.217805 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:58.217777 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 01 17:17:58.217998 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:58.217779 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-5tp2k\"" Jul 01 17:17:58.217998 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:58.217785 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 01 17:17:58.225026 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:58.224998 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-l47gf"] Jul 01 17:17:58.262597 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:58.262559 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5856f4f55b-m9442"] Jul 01 17:17:58.382139 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:58.382108 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9de0f437-edda-4798-bbb3-61a7420a859e-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-l47gf\" (UID: \"9de0f437-edda-4798-bbb3-61a7420a859e\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-l47gf" Jul 01 17:17:58.382374 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:58.382220 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9de0f437-edda-4798-bbb3-61a7420a859e-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-l47gf\" (UID: \"9de0f437-edda-4798-bbb3-61a7420a859e\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-l47gf" Jul 01 17:17:58.482859 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:58.482825 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9de0f437-edda-4798-bbb3-61a7420a859e-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-l47gf\" (UID: \"9de0f437-edda-4798-bbb3-61a7420a859e\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-l47gf" Jul 01 17:17:58.483059 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:58.482876 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9de0f437-edda-4798-bbb3-61a7420a859e-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-l47gf\" (UID: \"9de0f437-edda-4798-bbb3-61a7420a859e\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-l47gf" Jul 01 17:17:58.483715 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:58.483669 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9de0f437-edda-4798-bbb3-61a7420a859e-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-l47gf\" (UID: \"9de0f437-edda-4798-bbb3-61a7420a859e\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-l47gf" Jul 01 17:17:58.485430 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:58.485406 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9de0f437-edda-4798-bbb3-61a7420a859e-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-l47gf\" (UID: \"9de0f437-edda-4798-bbb3-61a7420a859e\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-l47gf" Jul 01 17:17:58.521497 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:58.521459 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-l47gf" Jul 01 17:17:58.652840 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:58.652804 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-l47gf"] Jul 01 17:17:58.656026 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:17:58.655996 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9de0f437_edda_4798_bbb3_61a7420a859e.slice/crio-62397ab91a6dcf8d92f934ea6ca470772d2d5402e538209d0da1d3b0000b8e60 WatchSource:0}: Error finding container 62397ab91a6dcf8d92f934ea6ca470772d2d5402e538209d0da1d3b0000b8e60: Status 404 returned error can't find the container with id 62397ab91a6dcf8d92f934ea6ca470772d2d5402e538209d0da1d3b0000b8e60 Jul 01 17:17:58.875124 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:58.875082 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pbnbg" event={"ID":"9b3d3b2b-3e29-406c-a0a7-fb990537bab4","Type":"ContainerStarted","Data":"e79cd8c402860bfe1fb4947d52e5c346873d94c0dbf30018cc44c9b6fe502d5a"} Jul 01 17:17:58.876316 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:17:58.876292 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-l47gf" event={"ID":"9de0f437-edda-4798-bbb3-61a7420a859e","Type":"ContainerStarted","Data":"62397ab91a6dcf8d92f934ea6ca470772d2d5402e538209d0da1d3b0000b8e60"} Jul 01 17:18:00.885608 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:00.885567 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-l47gf" event={"ID":"9de0f437-edda-4798-bbb3-61a7420a859e","Type":"ContainerStarted","Data":"62e744e03e0beabe1cf82ec6471a32d4b764888d590890dddfe8691b3f5f56b3"} Jul 01 17:18:00.907347 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:00.907286 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-l47gf" podStartSLOduration=1.107556326 podStartE2EDuration="2.907262343s" totalImagesPullingTime="1.799706017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:17:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:18:00.906760665 +0000 UTC m=+110.938757944" watchObservedRunningTime="2026-07-01 17:18:00.907262343 +0000 UTC m=+110.939259603" Jul 01 17:18:01.890418 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:01.890377 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pbnbg" event={"ID":"9b3d3b2b-3e29-406c-a0a7-fb990537bab4","Type":"ContainerStarted","Data":"1bfe487b329e952527a56c9901b9cdde8ab193c3d6b538139397ad11b54154c3"} Jul 01 17:18:01.914827 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:01.914723 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pbnbg" podStartSLOduration=16.81342532 podStartE2EDuration="24.914706783s" totalImagesPullingTime="8.101281463s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:17:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:18:01.91441213 +0000 UTC m=+111.946409420" watchObservedRunningTime="2026-07-01 17:18:01.914706783 +0000 UTC m=+111.946704042" Jul 01 17:18:02.915771 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:02.915733 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ddb7b80a-d562-4021-ada0-8299226092cb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-999px\" (UID: \"ddb7b80a-d562-4021-ada0-8299226092cb\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-999px" Jul 01 17:18:02.918307 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:02.918288 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ddb7b80a-d562-4021-ada0-8299226092cb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-999px\" (UID: \"ddb7b80a-d562-4021-ada0-8299226092cb\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-999px" Jul 01 17:18:03.141118 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:03.141066 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-999px" Jul 01 17:18:03.288743 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:03.288713 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-999px"] Jul 01 17:18:03.291663 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:18:03.291629 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddb7b80a_d562_4021_ada0_8299226092cb.slice/crio-563ac79251a1222c7d58d888c707a0a1a67ab72032396c4986cfc45e4b453d2b WatchSource:0}: Error finding container 563ac79251a1222c7d58d888c707a0a1a67ab72032396c4986cfc45e4b453d2b: Status 404 returned error can't find the container with id 563ac79251a1222c7d58d888c707a0a1a67ab72032396c4986cfc45e4b453d2b Jul 01 17:18:03.859616 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:03.859588 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-s5qpl" Jul 01 17:18:03.897156 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:03.897120 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-999px" event={"ID":"ddb7b80a-d562-4021-ada0-8299226092cb","Type":"ContainerStarted","Data":"563ac79251a1222c7d58d888c707a0a1a67ab72032396c4986cfc45e4b453d2b"} Jul 01 17:18:05.905331 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:05.905244 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-999px" event={"ID":"ddb7b80a-d562-4021-ada0-8299226092cb","Type":"ContainerStarted","Data":"b7802bdff5beaf4b40a08cd5fd124cdcf65c574f57bc77fbe06cef2374e51200"} Jul 01 17:18:05.957347 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:05.957279 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-999px" podStartSLOduration=32.597848465 podStartE2EDuration="34.957261848s" totalImagesPullingTime="2.359413383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:17:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:18:05.945867736 +0000 UTC m=+115.977864998" watchObservedRunningTime="2026-07-01 17:18:05.957261848 +0000 UTC m=+115.989259132" Jul 01 17:18:06.220639 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:06.220553 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-sf4vn"] Jul 01 17:18:06.223190 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:06.223170 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-sf4vn" Jul 01 17:18:06.227407 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:06.227376 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 01 17:18:06.227924 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:06.227907 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-mkjr5\"" Jul 01 17:18:06.245280 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:06.245242 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-sf4vn"] Jul 01 17:18:06.346675 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:06.346625 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c34bc306-c8ac-4df6-ba96-5ccb5e843556-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-sf4vn\" (UID: \"c34bc306-c8ac-4df6-ba96-5ccb5e843556\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-sf4vn" Jul 01 17:18:06.447640 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:06.447600 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c34bc306-c8ac-4df6-ba96-5ccb5e843556-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-sf4vn\" (UID: \"c34bc306-c8ac-4df6-ba96-5ccb5e843556\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-sf4vn" Jul 01 17:18:06.447851 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:18:06.447782 2547 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 01 17:18:06.447927 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:18:06.447866 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c34bc306-c8ac-4df6-ba96-5ccb5e843556-tls-certificates podName:c34bc306-c8ac-4df6-ba96-5ccb5e843556 nodeName:}" failed. No retries permitted until 2026-07-01 17:18:06.94784445 +0000 UTC m=+116.979841701 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/c34bc306-c8ac-4df6-ba96-5ccb5e843556-tls-certificates") pod "prometheus-operator-admission-webhook-7ddc8784d4-sf4vn" (UID: "c34bc306-c8ac-4df6-ba96-5ccb5e843556") : secret "prometheus-operator-admission-webhook-tls" not found Jul 01 17:18:06.951858 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:06.951775 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c34bc306-c8ac-4df6-ba96-5ccb5e843556-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-sf4vn\" (UID: \"c34bc306-c8ac-4df6-ba96-5ccb5e843556\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-sf4vn" Jul 01 17:18:06.956006 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:06.955898 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c34bc306-c8ac-4df6-ba96-5ccb5e843556-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-sf4vn\" (UID: \"c34bc306-c8ac-4df6-ba96-5ccb5e843556\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-sf4vn" Jul 01 17:18:07.131874 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:07.131828 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-sf4vn" Jul 01 17:18:07.269228 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:07.269191 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-sf4vn"] Jul 01 17:18:07.271841 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:18:07.271811 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc34bc306_c8ac_4df6_ba96_5ccb5e843556.slice/crio-3b81fea7f91f034724ff9325ff58315b74a318b29cdaad40a2c3b924e0ea9292 WatchSource:0}: Error finding container 3b81fea7f91f034724ff9325ff58315b74a318b29cdaad40a2c3b924e0ea9292: Status 404 returned error can't find the container with id 3b81fea7f91f034724ff9325ff58315b74a318b29cdaad40a2c3b924e0ea9292 Jul 01 17:18:07.912027 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:07.911992 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-sf4vn" event={"ID":"c34bc306-c8ac-4df6-ba96-5ccb5e843556","Type":"ContainerStarted","Data":"3b81fea7f91f034724ff9325ff58315b74a318b29cdaad40a2c3b924e0ea9292"} Jul 01 17:18:08.269073 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:08.269041 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5856f4f55b-m9442" Jul 01 17:18:08.916772 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:08.916731 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-sf4vn" event={"ID":"c34bc306-c8ac-4df6-ba96-5ccb5e843556","Type":"ContainerStarted","Data":"d6b34605cf84b7b355b4879aaf9653ee37dc0becfc799ce3e1dd671c730e1cbe"} Jul 01 17:18:08.916992 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:08.916975 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-sf4vn" Jul 01 17:18:08.921629 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:08.921605 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-sf4vn" Jul 01 17:18:08.935137 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:08.935082 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-sf4vn" podStartSLOduration=1.440413008 podStartE2EDuration="2.935068177s" totalImagesPullingTime="1.494655169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:18:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:18:08.934202369 +0000 UTC m=+118.966199653" watchObservedRunningTime="2026-07-01 17:18:08.935068177 +0000 UTC m=+118.967065436" Jul 01 17:18:09.578637 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:09.578597 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5674d46676-b7vkh"] Jul 01 17:18:09.581223 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:09.581206 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5674d46676-b7vkh" Jul 01 17:18:09.584715 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:09.584615 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 01 17:18:09.584868 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:09.584820 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 01 17:18:09.585444 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:09.585131 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 01 17:18:09.589332 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:09.586240 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 01 17:18:09.589332 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:09.586506 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 01 17:18:09.589332 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:09.586703 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 01 17:18:09.589332 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:09.586939 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gt4t2\"" Jul 01 17:18:09.589332 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:09.587208 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 01 17:18:09.591365 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:09.591342 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5674d46676-b7vkh"] Jul 01 17:18:09.772346 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:09.772307 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fjl9\" (UniqueName: \"kubernetes.io/projected/120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9-kube-api-access-6fjl9\") pod \"console-5674d46676-b7vkh\" (UID: \"120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9\") " pod="openshift-console/console-5674d46676-b7vkh" Jul 01 17:18:09.772530 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:09.772358 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9-console-oauth-config\") pod \"console-5674d46676-b7vkh\" (UID: \"120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9\") " pod="openshift-console/console-5674d46676-b7vkh" Jul 01 17:18:09.772530 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:09.772433 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9-service-ca\") pod \"console-5674d46676-b7vkh\" (UID: \"120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9\") " pod="openshift-console/console-5674d46676-b7vkh" Jul 01 17:18:09.772530 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:09.772473 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9-console-config\") pod \"console-5674d46676-b7vkh\" (UID: \"120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9\") " pod="openshift-console/console-5674d46676-b7vkh" Jul 01 17:18:09.772530 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:09.772497 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9-oauth-serving-cert\") pod \"console-5674d46676-b7vkh\" (UID: \"120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9\") " pod="openshift-console/console-5674d46676-b7vkh" Jul 01 17:18:09.772664 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:09.772569 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9-console-serving-cert\") pod \"console-5674d46676-b7vkh\" (UID: \"120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9\") " pod="openshift-console/console-5674d46676-b7vkh" Jul 01 17:18:09.873691 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:09.873594 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9-console-serving-cert\") pod \"console-5674d46676-b7vkh\" (UID: \"120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9\") " pod="openshift-console/console-5674d46676-b7vkh" Jul 01 17:18:09.873691 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:09.873634 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fjl9\" (UniqueName: \"kubernetes.io/projected/120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9-kube-api-access-6fjl9\") pod \"console-5674d46676-b7vkh\" (UID: \"120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9\") " pod="openshift-console/console-5674d46676-b7vkh" Jul 01 17:18:09.873691 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:09.873659 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9-console-oauth-config\") pod \"console-5674d46676-b7vkh\" (UID: \"120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9\") " pod="openshift-console/console-5674d46676-b7vkh" Jul 01 17:18:09.873691 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:09.873681 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9-service-ca\") pod \"console-5674d46676-b7vkh\" (UID: \"120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9\") " pod="openshift-console/console-5674d46676-b7vkh" Jul 01 17:18:09.874028 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:09.873712 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9-console-config\") pod \"console-5674d46676-b7vkh\" (UID: \"120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9\") " pod="openshift-console/console-5674d46676-b7vkh" Jul 01 17:18:09.874028 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:09.873739 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9-oauth-serving-cert\") pod \"console-5674d46676-b7vkh\" (UID: \"120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9\") " pod="openshift-console/console-5674d46676-b7vkh" Jul 01 17:18:09.874622 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:09.874595 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9-oauth-serving-cert\") pod \"console-5674d46676-b7vkh\" (UID: \"120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9\") " pod="openshift-console/console-5674d46676-b7vkh" Jul 01 17:18:09.874722 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:09.874595 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9-service-ca\") pod \"console-5674d46676-b7vkh\" (UID: \"120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9\") " pod="openshift-console/console-5674d46676-b7vkh" Jul 01 17:18:09.874722 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:09.874600 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9-console-config\") pod \"console-5674d46676-b7vkh\" (UID: \"120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9\") " pod="openshift-console/console-5674d46676-b7vkh" Jul 01 17:18:09.876208 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:09.876184 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9-console-oauth-config\") pod \"console-5674d46676-b7vkh\" (UID: \"120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9\") " pod="openshift-console/console-5674d46676-b7vkh" Jul 01 17:18:09.876317 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:09.876297 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9-console-serving-cert\") pod \"console-5674d46676-b7vkh\" (UID: \"120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9\") " pod="openshift-console/console-5674d46676-b7vkh" Jul 01 17:18:09.883396 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:09.883371 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fjl9\" (UniqueName: \"kubernetes.io/projected/120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9-kube-api-access-6fjl9\") pod \"console-5674d46676-b7vkh\" (UID: \"120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9\") " pod="openshift-console/console-5674d46676-b7vkh" Jul 01 17:18:09.892178 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:09.892150 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5674d46676-b7vkh" Jul 01 17:18:10.029917 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:10.029891 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5674d46676-b7vkh"] Jul 01 17:18:10.032333 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:18:10.032306 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod120d9dff_9034_4b6e_a2b7_fd69cc2eb5a9.slice/crio-8cf5bcd4543178cf0f81f3ee131b69f5a54dc7c028ebb55796f1be28fb1d5d55 WatchSource:0}: Error finding container 8cf5bcd4543178cf0f81f3ee131b69f5a54dc7c028ebb55796f1be28fb1d5d55: Status 404 returned error can't find the container with id 8cf5bcd4543178cf0f81f3ee131b69f5a54dc7c028ebb55796f1be28fb1d5d55 Jul 01 17:18:10.923678 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:10.923640 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5674d46676-b7vkh" event={"ID":"120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9","Type":"ContainerStarted","Data":"8cf5bcd4543178cf0f81f3ee131b69f5a54dc7c028ebb55796f1be28fb1d5d55"} Jul 01 17:18:11.954637 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:11.954603 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f574b7957-c26kt"] Jul 01 17:18:11.956904 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:11.956874 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f574b7957-c26kt" Jul 01 17:18:11.971256 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:11.970805 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f574b7957-c26kt"] Jul 01 17:18:11.972876 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:11.972015 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 01 17:18:11.989126 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:11.989089 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ef840556-8d22-4c83-8c8f-3ed7a4b056f7-console-oauth-config\") pod \"console-5f574b7957-c26kt\" (UID: \"ef840556-8d22-4c83-8c8f-3ed7a4b056f7\") " pod="openshift-console/console-5f574b7957-c26kt" Jul 01 17:18:11.989126 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:11.989131 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ef840556-8d22-4c83-8c8f-3ed7a4b056f7-oauth-serving-cert\") pod \"console-5f574b7957-c26kt\" (UID: \"ef840556-8d22-4c83-8c8f-3ed7a4b056f7\") " pod="openshift-console/console-5f574b7957-c26kt" Jul 01 17:18:11.989346 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:11.989209 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ef840556-8d22-4c83-8c8f-3ed7a4b056f7-console-serving-cert\") pod \"console-5f574b7957-c26kt\" (UID: \"ef840556-8d22-4c83-8c8f-3ed7a4b056f7\") " pod="openshift-console/console-5f574b7957-c26kt" Jul 01 17:18:11.989346 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:11.989244 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ef840556-8d22-4c83-8c8f-3ed7a4b056f7-console-config\") pod \"console-5f574b7957-c26kt\" (UID: \"ef840556-8d22-4c83-8c8f-3ed7a4b056f7\") " pod="openshift-console/console-5f574b7957-c26kt" Jul 01 17:18:11.989346 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:11.989263 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef840556-8d22-4c83-8c8f-3ed7a4b056f7-trusted-ca-bundle\") pod \"console-5f574b7957-c26kt\" (UID: \"ef840556-8d22-4c83-8c8f-3ed7a4b056f7\") " pod="openshift-console/console-5f574b7957-c26kt" Jul 01 17:18:11.989346 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:11.989285 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcnbc\" (UniqueName: \"kubernetes.io/projected/ef840556-8d22-4c83-8c8f-3ed7a4b056f7-kube-api-access-dcnbc\") pod \"console-5f574b7957-c26kt\" (UID: \"ef840556-8d22-4c83-8c8f-3ed7a4b056f7\") " pod="openshift-console/console-5f574b7957-c26kt" Jul 01 17:18:11.989524 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:11.989377 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ef840556-8d22-4c83-8c8f-3ed7a4b056f7-service-ca\") pod \"console-5f574b7957-c26kt\" (UID: \"ef840556-8d22-4c83-8c8f-3ed7a4b056f7\") " pod="openshift-console/console-5f574b7957-c26kt" Jul 01 17:18:12.089774 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:12.089730 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ef840556-8d22-4c83-8c8f-3ed7a4b056f7-console-serving-cert\") pod \"console-5f574b7957-c26kt\" (UID: \"ef840556-8d22-4c83-8c8f-3ed7a4b056f7\") " pod="openshift-console/console-5f574b7957-c26kt" Jul 01 17:18:12.089774 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:12.089771 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ef840556-8d22-4c83-8c8f-3ed7a4b056f7-console-config\") pod \"console-5f574b7957-c26kt\" (UID: \"ef840556-8d22-4c83-8c8f-3ed7a4b056f7\") " pod="openshift-console/console-5f574b7957-c26kt" Jul 01 17:18:12.090038 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:12.089787 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef840556-8d22-4c83-8c8f-3ed7a4b056f7-trusted-ca-bundle\") pod \"console-5f574b7957-c26kt\" (UID: \"ef840556-8d22-4c83-8c8f-3ed7a4b056f7\") " pod="openshift-console/console-5f574b7957-c26kt" Jul 01 17:18:12.090038 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:12.089834 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcnbc\" (UniqueName: \"kubernetes.io/projected/ef840556-8d22-4c83-8c8f-3ed7a4b056f7-kube-api-access-dcnbc\") pod \"console-5f574b7957-c26kt\" (UID: \"ef840556-8d22-4c83-8c8f-3ed7a4b056f7\") " pod="openshift-console/console-5f574b7957-c26kt" Jul 01 17:18:12.090038 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:12.089888 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ef840556-8d22-4c83-8c8f-3ed7a4b056f7-service-ca\") pod \"console-5f574b7957-c26kt\" (UID: \"ef840556-8d22-4c83-8c8f-3ed7a4b056f7\") " pod="openshift-console/console-5f574b7957-c26kt" Jul 01 17:18:12.090038 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:12.089941 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ef840556-8d22-4c83-8c8f-3ed7a4b056f7-console-oauth-config\") pod \"console-5f574b7957-c26kt\" (UID: \"ef840556-8d22-4c83-8c8f-3ed7a4b056f7\") " pod="openshift-console/console-5f574b7957-c26kt" Jul 01 17:18:12.090038 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:12.089991 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ef840556-8d22-4c83-8c8f-3ed7a4b056f7-oauth-serving-cert\") pod \"console-5f574b7957-c26kt\" (UID: \"ef840556-8d22-4c83-8c8f-3ed7a4b056f7\") " pod="openshift-console/console-5f574b7957-c26kt" Jul 01 17:18:12.090719 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:12.090693 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ef840556-8d22-4c83-8c8f-3ed7a4b056f7-oauth-serving-cert\") pod \"console-5f574b7957-c26kt\" (UID: \"ef840556-8d22-4c83-8c8f-3ed7a4b056f7\") " pod="openshift-console/console-5f574b7957-c26kt" Jul 01 17:18:12.090834 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:12.090693 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ef840556-8d22-4c83-8c8f-3ed7a4b056f7-console-config\") pod \"console-5f574b7957-c26kt\" (UID: \"ef840556-8d22-4c83-8c8f-3ed7a4b056f7\") " pod="openshift-console/console-5f574b7957-c26kt" Jul 01 17:18:12.090834 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:12.090773 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef840556-8d22-4c83-8c8f-3ed7a4b056f7-trusted-ca-bundle\") pod \"console-5f574b7957-c26kt\" (UID: \"ef840556-8d22-4c83-8c8f-3ed7a4b056f7\") " pod="openshift-console/console-5f574b7957-c26kt" Jul 01 17:18:12.090929 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:12.090906 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ef840556-8d22-4c83-8c8f-3ed7a4b056f7-service-ca\") pod \"console-5f574b7957-c26kt\" (UID: \"ef840556-8d22-4c83-8c8f-3ed7a4b056f7\") " pod="openshift-console/console-5f574b7957-c26kt" Jul 01 17:18:12.092617 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:12.092598 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ef840556-8d22-4c83-8c8f-3ed7a4b056f7-console-serving-cert\") pod \"console-5f574b7957-c26kt\" (UID: \"ef840556-8d22-4c83-8c8f-3ed7a4b056f7\") " pod="openshift-console/console-5f574b7957-c26kt" Jul 01 17:18:12.092672 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:12.092628 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ef840556-8d22-4c83-8c8f-3ed7a4b056f7-console-oauth-config\") pod \"console-5f574b7957-c26kt\" (UID: \"ef840556-8d22-4c83-8c8f-3ed7a4b056f7\") " pod="openshift-console/console-5f574b7957-c26kt" Jul 01 17:18:12.098766 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:12.098739 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcnbc\" (UniqueName: \"kubernetes.io/projected/ef840556-8d22-4c83-8c8f-3ed7a4b056f7-kube-api-access-dcnbc\") pod \"console-5f574b7957-c26kt\" (UID: \"ef840556-8d22-4c83-8c8f-3ed7a4b056f7\") " pod="openshift-console/console-5f574b7957-c26kt" Jul 01 17:18:12.269663 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:12.269623 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f574b7957-c26kt" Jul 01 17:18:12.424027 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:12.424003 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f574b7957-c26kt"] Jul 01 17:18:12.425105 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:18:12.425073 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef840556_8d22_4c83_8c8f_3ed7a4b056f7.slice/crio-0c93f5d82ea01fe193a72c2f69e74f3432cecfeb3439f09e5496ad5e03d81ae8 WatchSource:0}: Error finding container 0c93f5d82ea01fe193a72c2f69e74f3432cecfeb3439f09e5496ad5e03d81ae8: Status 404 returned error can't find the container with id 0c93f5d82ea01fe193a72c2f69e74f3432cecfeb3439f09e5496ad5e03d81ae8 Jul 01 17:18:12.933146 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:12.933102 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f574b7957-c26kt" event={"ID":"ef840556-8d22-4c83-8c8f-3ed7a4b056f7","Type":"ContainerStarted","Data":"0c93f5d82ea01fe193a72c2f69e74f3432cecfeb3439f09e5496ad5e03d81ae8"} Jul 01 17:18:13.937612 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:13.937519 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f574b7957-c26kt" event={"ID":"ef840556-8d22-4c83-8c8f-3ed7a4b056f7","Type":"ContainerStarted","Data":"43591b3005b69773c46314ff719890413bc38078464f0da07b7adac950351c4c"} Jul 01 17:18:13.938942 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:13.938916 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5674d46676-b7vkh" event={"ID":"120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9","Type":"ContainerStarted","Data":"edef8fd9d841f1f5e7696d3f06b4c1209f5f73e52a7a88df41036cad2bbb4784"} Jul 01 17:18:13.975258 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:13.975201 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f574b7957-c26kt" podStartSLOduration=1.869969945 podStartE2EDuration="2.975181877s" totalImagesPullingTime="1.105211932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:18:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:18:13.972561739 +0000 UTC m=+124.004559017" watchObservedRunningTime="2026-07-01 17:18:13.975181877 +0000 UTC m=+124.007179138" Jul 01 17:18:14.002652 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:14.002594 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5674d46676-b7vkh" podStartSLOduration=1.5045022750000001 podStartE2EDuration="5.002576988s" totalImagesPullingTime="3.498074713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:18:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:18:14.000839805 +0000 UTC m=+124.032837090" watchObservedRunningTime="2026-07-01 17:18:14.002576988 +0000 UTC m=+124.034574248" Jul 01 17:18:19.892860 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:19.892819 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5674d46676-b7vkh" Jul 01 17:18:19.893310 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:19.892884 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5674d46676-b7vkh" Jul 01 17:18:19.898174 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:19.898150 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5674d46676-b7vkh" Jul 01 17:18:19.962543 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:19.962511 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5674d46676-b7vkh" Jul 01 17:18:20.254380 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:20.254350 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec5b1126-9d68-4911-ad3d-6f8369cf5a5d-metrics-certs\") pod \"network-metrics-daemon-wx5ff\" (UID: \"ec5b1126-9d68-4911-ad3d-6f8369cf5a5d\") " pod="openshift-multus/network-metrics-daemon-wx5ff" Jul 01 17:18:20.256959 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:20.256907 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec5b1126-9d68-4911-ad3d-6f8369cf5a5d-metrics-certs\") pod \"network-metrics-daemon-wx5ff\" (UID: \"ec5b1126-9d68-4911-ad3d-6f8369cf5a5d\") " pod="openshift-multus/network-metrics-daemon-wx5ff" Jul 01 17:18:20.540550 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:20.540463 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gs6qb\"" Jul 01 17:18:20.547962 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:20.547929 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wx5ff" Jul 01 17:18:20.687420 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:20.687389 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wx5ff"] Jul 01 17:18:20.962747 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:20.962646 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wx5ff" event={"ID":"ec5b1126-9d68-4911-ad3d-6f8369cf5a5d","Type":"ContainerStarted","Data":"c65e78400183af3964272500ebd0ce91c7b3773ce57a9c8e3bff5da9f1a7d347"} Jul 01 17:18:21.967841 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:21.967739 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wx5ff" event={"ID":"ec5b1126-9d68-4911-ad3d-6f8369cf5a5d","Type":"ContainerStarted","Data":"0e1b6ac61609f5323d72e915ee8201d7c8b931054ad8663aaf8e4f9a722e0b2d"} Jul 01 17:18:21.967841 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:21.967799 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wx5ff" event={"ID":"ec5b1126-9d68-4911-ad3d-6f8369cf5a5d","Type":"ContainerStarted","Data":"8163392e30ec358d6883dbe1d38e86b599763c3316d5c476135254f9e66874fd"} Jul 01 17:18:21.987254 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:21.987200 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wx5ff" podStartSLOduration=131.018657938 podStartE2EDuration="2m11.987181919s" totalImagesPullingTime="968.523981ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:16:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:18:21.98662772 +0000 UTC m=+132.018624993" watchObservedRunningTime="2026-07-01 17:18:21.987181919 +0000 UTC m=+132.019179212" Jul 01 17:18:22.269829 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:22.269789 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f574b7957-c26kt" Jul 01 17:18:22.270064 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:22.269858 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f574b7957-c26kt" Jul 01 17:18:22.274764 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:22.274737 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f574b7957-c26kt" Jul 01 17:18:22.975473 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:22.975440 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f574b7957-c26kt" Jul 01 17:18:23.028233 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.028202 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5674d46676-b7vkh"] Jul 01 17:18:23.288367 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.288325 2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5856f4f55b-m9442" podUID="e4c4eec4-7129-4d71-bebe-2a2c6093ea12" containerName="registry" containerID="cri-o://bc28165d2aecd54d14d3eacaf7c73016df9bb0ab09380abef03dde2fd5943473" gracePeriod=30 Jul 01 17:18:23.541211 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.541136 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5856f4f55b-m9442" Jul 01 17:18:23.580154 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.580124 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-registry-tls\") pod \"e4c4eec4-7129-4d71-bebe-2a2c6093ea12\" (UID: \"e4c4eec4-7129-4d71-bebe-2a2c6093ea12\") " Jul 01 17:18:23.580334 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.580194 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-bound-sa-token\") pod \"e4c4eec4-7129-4d71-bebe-2a2c6093ea12\" (UID: \"e4c4eec4-7129-4d71-bebe-2a2c6093ea12\") " Jul 01 17:18:23.580334 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.580228 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-trusted-ca\") pod \"e4c4eec4-7129-4d71-bebe-2a2c6093ea12\" (UID: \"e4c4eec4-7129-4d71-bebe-2a2c6093ea12\") " Jul 01 17:18:23.580334 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.580249 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-ca-trust-extracted\") pod \"e4c4eec4-7129-4d71-bebe-2a2c6093ea12\" (UID: \"e4c4eec4-7129-4d71-bebe-2a2c6093ea12\") " Jul 01 17:18:23.580334 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.580282 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-installation-pull-secrets\") pod \"e4c4eec4-7129-4d71-bebe-2a2c6093ea12\" (UID: \"e4c4eec4-7129-4d71-bebe-2a2c6093ea12\") " Jul 01 17:18:23.580334 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.580308 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-registry-certificates\") pod \"e4c4eec4-7129-4d71-bebe-2a2c6093ea12\" (UID: \"e4c4eec4-7129-4d71-bebe-2a2c6093ea12\") " Jul 01 17:18:23.580590 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.580349 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-image-registry-private-configuration\") pod \"e4c4eec4-7129-4d71-bebe-2a2c6093ea12\" (UID: \"e4c4eec4-7129-4d71-bebe-2a2c6093ea12\") " Jul 01 17:18:23.580590 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.580381 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wj7nl\" (UniqueName: \"kubernetes.io/projected/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-kube-api-access-wj7nl\") pod \"e4c4eec4-7129-4d71-bebe-2a2c6093ea12\" (UID: \"e4c4eec4-7129-4d71-bebe-2a2c6093ea12\") " Jul 01 17:18:23.580755 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.580703 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e4c4eec4-7129-4d71-bebe-2a2c6093ea12" (UID: "e4c4eec4-7129-4d71-bebe-2a2c6093ea12"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:18:23.580990 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.580931 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e4c4eec4-7129-4d71-bebe-2a2c6093ea12" (UID: "e4c4eec4-7129-4d71-bebe-2a2c6093ea12"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:18:23.586331 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.586281 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e4c4eec4-7129-4d71-bebe-2a2c6093ea12" (UID: "e4c4eec4-7129-4d71-bebe-2a2c6093ea12"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:18:23.586514 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.586349 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-kube-api-access-wj7nl" (OuterVolumeSpecName: "kube-api-access-wj7nl") pod "e4c4eec4-7129-4d71-bebe-2a2c6093ea12" (UID: "e4c4eec4-7129-4d71-bebe-2a2c6093ea12"). InnerVolumeSpecName "kube-api-access-wj7nl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:18:23.586514 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.586413 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e4c4eec4-7129-4d71-bebe-2a2c6093ea12" (UID: "e4c4eec4-7129-4d71-bebe-2a2c6093ea12"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:18:23.586667 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.586644 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e4c4eec4-7129-4d71-bebe-2a2c6093ea12" (UID: "e4c4eec4-7129-4d71-bebe-2a2c6093ea12"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:18:23.586851 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.586825 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e4c4eec4-7129-4d71-bebe-2a2c6093ea12" (UID: "e4c4eec4-7129-4d71-bebe-2a2c6093ea12"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:18:23.592927 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.592901 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e4c4eec4-7129-4d71-bebe-2a2c6093ea12" (UID: "e4c4eec4-7129-4d71-bebe-2a2c6093ea12"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 17:18:23.681770 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.681731 2547 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-image-registry-private-configuration\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:18:23.681770 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.681761 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wj7nl\" (UniqueName: \"kubernetes.io/projected/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-kube-api-access-wj7nl\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:18:23.681770 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.681772 2547 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-registry-tls\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:18:23.681770 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.681781 2547 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-bound-sa-token\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:18:23.682077 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.681789 2547 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-trusted-ca\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:18:23.682077 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.681796 2547 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-ca-trust-extracted\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:18:23.682077 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.681805 2547 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-installation-pull-secrets\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:18:23.682077 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.681813 2547 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e4c4eec4-7129-4d71-bebe-2a2c6093ea12-registry-certificates\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:18:23.736942 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.736897 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-lpsjz"] Jul 01 17:18:23.737279 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.737260 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4c4eec4-7129-4d71-bebe-2a2c6093ea12" containerName="registry" Jul 01 17:18:23.737367 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.737280 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4c4eec4-7129-4d71-bebe-2a2c6093ea12" containerName="registry" Jul 01 17:18:23.737367 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.737352 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4c4eec4-7129-4d71-bebe-2a2c6093ea12" containerName="registry" Jul 01 17:18:23.740865 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.740838 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-n9264"] Jul 01 17:18:23.741036 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.740980 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-lpsjz" Jul 01 17:18:23.743042 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.743019 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n9264" Jul 01 17:18:23.744646 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.744625 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 01 17:18:23.744779 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.744663 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-qkvsd\"" Jul 01 17:18:23.744779 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.744712 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 01 17:18:23.745992 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.745974 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 01 17:18:23.748987 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.748963 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-w728g\"" Jul 01 17:18:23.748987 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.748978 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 01 17:18:23.749185 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.748970 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 01 17:18:23.749185 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.749098 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 01 17:18:23.759354 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.759330 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-lpsjz"] Jul 01 17:18:23.782599 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.782566 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c182a41e-78e7-49c0-84f4-467f5744c85b-node-exporter-textfile\") pod \"node-exporter-n9264\" (UID: \"c182a41e-78e7-49c0-84f4-467f5744c85b\") " pod="openshift-monitoring/node-exporter-n9264" Jul 01 17:18:23.782768 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.782620 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c182a41e-78e7-49c0-84f4-467f5744c85b-node-exporter-tls\") pod \"node-exporter-n9264\" (UID: \"c182a41e-78e7-49c0-84f4-467f5744c85b\") " pod="openshift-monitoring/node-exporter-n9264" Jul 01 17:18:23.782768 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.782646 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bppp\" (UniqueName: \"kubernetes.io/projected/fc6ce87c-412a-4860-9d48-751f937fee97-kube-api-access-2bppp\") pod \"openshift-state-metrics-57f99c8b49-lpsjz\" (UID: \"fc6ce87c-412a-4860-9d48-751f937fee97\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-lpsjz" Jul 01 17:18:23.782768 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.782663 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c182a41e-78e7-49c0-84f4-467f5744c85b-node-exporter-wtmp\") pod \"node-exporter-n9264\" (UID: \"c182a41e-78e7-49c0-84f4-467f5744c85b\") " pod="openshift-monitoring/node-exporter-n9264" Jul 01 17:18:23.782768 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.782725 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2lx8\" (UniqueName: \"kubernetes.io/projected/c182a41e-78e7-49c0-84f4-467f5744c85b-kube-api-access-s2lx8\") pod \"node-exporter-n9264\" (UID: \"c182a41e-78e7-49c0-84f4-467f5744c85b\") " pod="openshift-monitoring/node-exporter-n9264" Jul 01 17:18:23.782768 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.782759 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc6ce87c-412a-4860-9d48-751f937fee97-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-lpsjz\" (UID: \"fc6ce87c-412a-4860-9d48-751f937fee97\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-lpsjz" Jul 01 17:18:23.782929 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.782782 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c182a41e-78e7-49c0-84f4-467f5744c85b-metrics-client-ca\") pod \"node-exporter-n9264\" (UID: \"c182a41e-78e7-49c0-84f4-467f5744c85b\") " pod="openshift-monitoring/node-exporter-n9264" Jul 01 17:18:23.782929 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.782812 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc6ce87c-412a-4860-9d48-751f937fee97-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-lpsjz\" (UID: \"fc6ce87c-412a-4860-9d48-751f937fee97\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-lpsjz" Jul 01 17:18:23.782929 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.782877 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c182a41e-78e7-49c0-84f4-467f5744c85b-sys\") pod \"node-exporter-n9264\" (UID: \"c182a41e-78e7-49c0-84f4-467f5744c85b\") " pod="openshift-monitoring/node-exporter-n9264" Jul 01 17:18:23.782929 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.782900 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c182a41e-78e7-49c0-84f4-467f5744c85b-root\") pod \"node-exporter-n9264\" (UID: \"c182a41e-78e7-49c0-84f4-467f5744c85b\") " pod="openshift-monitoring/node-exporter-n9264" Jul 01 17:18:23.782929 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.782921 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc6ce87c-412a-4860-9d48-751f937fee97-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-lpsjz\" (UID: \"fc6ce87c-412a-4860-9d48-751f937fee97\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-lpsjz" Jul 01 17:18:23.783091 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.782944 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c182a41e-78e7-49c0-84f4-467f5744c85b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n9264\" (UID: \"c182a41e-78e7-49c0-84f4-467f5744c85b\") " pod="openshift-monitoring/node-exporter-n9264" Jul 01 17:18:23.783091 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.782976 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c182a41e-78e7-49c0-84f4-467f5744c85b-node-exporter-accelerators-collector-config\") pod \"node-exporter-n9264\" (UID: \"c182a41e-78e7-49c0-84f4-467f5744c85b\") " pod="openshift-monitoring/node-exporter-n9264" Jul 01 17:18:23.883833 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.883740 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c182a41e-78e7-49c0-84f4-467f5744c85b-node-exporter-textfile\") pod \"node-exporter-n9264\" (UID: \"c182a41e-78e7-49c0-84f4-467f5744c85b\") " pod="openshift-monitoring/node-exporter-n9264" Jul 01 17:18:23.883833 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.883791 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c182a41e-78e7-49c0-84f4-467f5744c85b-node-exporter-tls\") pod \"node-exporter-n9264\" (UID: \"c182a41e-78e7-49c0-84f4-467f5744c85b\") " pod="openshift-monitoring/node-exporter-n9264" Jul 01 17:18:23.883833 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.883810 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bppp\" (UniqueName: \"kubernetes.io/projected/fc6ce87c-412a-4860-9d48-751f937fee97-kube-api-access-2bppp\") pod \"openshift-state-metrics-57f99c8b49-lpsjz\" (UID: \"fc6ce87c-412a-4860-9d48-751f937fee97\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-lpsjz" Jul 01 17:18:23.883833 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.883828 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c182a41e-78e7-49c0-84f4-467f5744c85b-node-exporter-wtmp\") pod \"node-exporter-n9264\" (UID: \"c182a41e-78e7-49c0-84f4-467f5744c85b\") " pod="openshift-monitoring/node-exporter-n9264" Jul 01 17:18:23.884188 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.883862 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2lx8\" (UniqueName: \"kubernetes.io/projected/c182a41e-78e7-49c0-84f4-467f5744c85b-kube-api-access-s2lx8\") pod \"node-exporter-n9264\" (UID: \"c182a41e-78e7-49c0-84f4-467f5744c85b\") " pod="openshift-monitoring/node-exporter-n9264" Jul 01 17:18:23.884188 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.883907 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc6ce87c-412a-4860-9d48-751f937fee97-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-lpsjz\" (UID: \"fc6ce87c-412a-4860-9d48-751f937fee97\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-lpsjz" Jul 01 17:18:23.884188 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.883934 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c182a41e-78e7-49c0-84f4-467f5744c85b-metrics-client-ca\") pod \"node-exporter-n9264\" (UID: \"c182a41e-78e7-49c0-84f4-467f5744c85b\") " pod="openshift-monitoring/node-exporter-n9264" Jul 01 17:18:23.884188 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.884001 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc6ce87c-412a-4860-9d48-751f937fee97-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-lpsjz\" (UID: \"fc6ce87c-412a-4860-9d48-751f937fee97\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-lpsjz" Jul 01 17:18:23.884188 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.884028 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c182a41e-78e7-49c0-84f4-467f5744c85b-node-exporter-wtmp\") pod \"node-exporter-n9264\" (UID: \"c182a41e-78e7-49c0-84f4-467f5744c85b\") " pod="openshift-monitoring/node-exporter-n9264" Jul 01 17:18:23.884188 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.884036 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c182a41e-78e7-49c0-84f4-467f5744c85b-sys\") pod \"node-exporter-n9264\" (UID: \"c182a41e-78e7-49c0-84f4-467f5744c85b\") " pod="openshift-monitoring/node-exporter-n9264" Jul 01 17:18:23.884188 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.884075 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c182a41e-78e7-49c0-84f4-467f5744c85b-sys\") pod \"node-exporter-n9264\" (UID: \"c182a41e-78e7-49c0-84f4-467f5744c85b\") " pod="openshift-monitoring/node-exporter-n9264" Jul 01 17:18:23.884188 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:18:23.883933 2547 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 01 17:18:23.884188 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.884110 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c182a41e-78e7-49c0-84f4-467f5744c85b-node-exporter-textfile\") pod \"node-exporter-n9264\" (UID: \"c182a41e-78e7-49c0-84f4-467f5744c85b\") " pod="openshift-monitoring/node-exporter-n9264" Jul 01 17:18:23.884188 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.884123 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c182a41e-78e7-49c0-84f4-467f5744c85b-root\") pod \"node-exporter-n9264\" (UID: \"c182a41e-78e7-49c0-84f4-467f5744c85b\") " pod="openshift-monitoring/node-exporter-n9264" Jul 01 17:18:23.884188 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:18:23.884165 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c182a41e-78e7-49c0-84f4-467f5744c85b-node-exporter-tls podName:c182a41e-78e7-49c0-84f4-467f5744c85b nodeName:}" failed. No retries permitted until 2026-07-01 17:18:24.384144989 +0000 UTC m=+134.416142229 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/c182a41e-78e7-49c0-84f4-467f5744c85b-node-exporter-tls") pod "node-exporter-n9264" (UID: "c182a41e-78e7-49c0-84f4-467f5744c85b") : secret "node-exporter-tls" not found Jul 01 17:18:23.884188 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.884091 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c182a41e-78e7-49c0-84f4-467f5744c85b-root\") pod \"node-exporter-n9264\" (UID: \"c182a41e-78e7-49c0-84f4-467f5744c85b\") " pod="openshift-monitoring/node-exporter-n9264" Jul 01 17:18:23.884676 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.884202 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc6ce87c-412a-4860-9d48-751f937fee97-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-lpsjz\" (UID: \"fc6ce87c-412a-4860-9d48-751f937fee97\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-lpsjz" Jul 01 17:18:23.884676 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.884235 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c182a41e-78e7-49c0-84f4-467f5744c85b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n9264\" (UID: \"c182a41e-78e7-49c0-84f4-467f5744c85b\") " pod="openshift-monitoring/node-exporter-n9264" Jul 01 17:18:23.884676 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.884260 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c182a41e-78e7-49c0-84f4-467f5744c85b-node-exporter-accelerators-collector-config\") pod \"node-exporter-n9264\" (UID: \"c182a41e-78e7-49c0-84f4-467f5744c85b\") " pod="openshift-monitoring/node-exporter-n9264" Jul 01 17:18:23.884676 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:18:23.884341 2547 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 01 17:18:23.884676 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:18:23.884431 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc6ce87c-412a-4860-9d48-751f937fee97-openshift-state-metrics-tls podName:fc6ce87c-412a-4860-9d48-751f937fee97 nodeName:}" failed. No retries permitted until 2026-07-01 17:18:24.384410738 +0000 UTC m=+134.416407976 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/fc6ce87c-412a-4860-9d48-751f937fee97-openshift-state-metrics-tls") pod "openshift-state-metrics-57f99c8b49-lpsjz" (UID: "fc6ce87c-412a-4860-9d48-751f937fee97") : secret "openshift-state-metrics-tls" not found Jul 01 17:18:23.884676 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.884590 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c182a41e-78e7-49c0-84f4-467f5744c85b-metrics-client-ca\") pod \"node-exporter-n9264\" (UID: \"c182a41e-78e7-49c0-84f4-467f5744c85b\") " pod="openshift-monitoring/node-exporter-n9264" Jul 01 17:18:23.884849 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.884725 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc6ce87c-412a-4860-9d48-751f937fee97-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-lpsjz\" (UID: \"fc6ce87c-412a-4860-9d48-751f937fee97\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-lpsjz" Jul 01 17:18:23.884974 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.884935 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c182a41e-78e7-49c0-84f4-467f5744c85b-node-exporter-accelerators-collector-config\") pod \"node-exporter-n9264\" (UID: \"c182a41e-78e7-49c0-84f4-467f5744c85b\") " pod="openshift-monitoring/node-exporter-n9264" Jul 01 17:18:23.886587 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.886569 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c182a41e-78e7-49c0-84f4-467f5744c85b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n9264\" (UID: \"c182a41e-78e7-49c0-84f4-467f5744c85b\") " pod="openshift-monitoring/node-exporter-n9264" Jul 01 17:18:23.886662 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.886593 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc6ce87c-412a-4860-9d48-751f937fee97-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-lpsjz\" (UID: \"fc6ce87c-412a-4860-9d48-751f937fee97\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-lpsjz" Jul 01 17:18:23.894529 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.894499 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bppp\" (UniqueName: \"kubernetes.io/projected/fc6ce87c-412a-4860-9d48-751f937fee97-kube-api-access-2bppp\") pod \"openshift-state-metrics-57f99c8b49-lpsjz\" (UID: \"fc6ce87c-412a-4860-9d48-751f937fee97\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-lpsjz" Jul 01 17:18:23.894659 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.894507 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2lx8\" (UniqueName: \"kubernetes.io/projected/c182a41e-78e7-49c0-84f4-467f5744c85b-kube-api-access-s2lx8\") pod \"node-exporter-n9264\" (UID: \"c182a41e-78e7-49c0-84f4-467f5744c85b\") " pod="openshift-monitoring/node-exporter-n9264" Jul 01 17:18:23.976404 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.976371 2547 generic.go:356] "Generic (PLEG): container finished" podID="e4c4eec4-7129-4d71-bebe-2a2c6093ea12" containerID="bc28165d2aecd54d14d3eacaf7c73016df9bb0ab09380abef03dde2fd5943473" exitCode=0 Jul 01 17:18:23.976871 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.976453 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5856f4f55b-m9442" Jul 01 17:18:23.976871 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.976465 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5856f4f55b-m9442" event={"ID":"e4c4eec4-7129-4d71-bebe-2a2c6093ea12","Type":"ContainerDied","Data":"bc28165d2aecd54d14d3eacaf7c73016df9bb0ab09380abef03dde2fd5943473"} Jul 01 17:18:23.976871 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.976519 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5856f4f55b-m9442" event={"ID":"e4c4eec4-7129-4d71-bebe-2a2c6093ea12","Type":"ContainerDied","Data":"940bbb96d8bd14487770c1c484cbf1c19173861a4edacd1940284822be056818"} Jul 01 17:18:23.976871 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.976558 2547 scope.go:117] "RemoveContainer" containerID="bc28165d2aecd54d14d3eacaf7c73016df9bb0ab09380abef03dde2fd5943473" Jul 01 17:18:23.985788 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.985767 2547 scope.go:117] "RemoveContainer" containerID="bc28165d2aecd54d14d3eacaf7c73016df9bb0ab09380abef03dde2fd5943473" Jul 01 17:18:23.986160 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:18:23.986139 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc28165d2aecd54d14d3eacaf7c73016df9bb0ab09380abef03dde2fd5943473\": container with ID starting with bc28165d2aecd54d14d3eacaf7c73016df9bb0ab09380abef03dde2fd5943473 not found: ID does not exist" containerID="bc28165d2aecd54d14d3eacaf7c73016df9bb0ab09380abef03dde2fd5943473" Jul 01 17:18:23.986206 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:23.986173 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc28165d2aecd54d14d3eacaf7c73016df9bb0ab09380abef03dde2fd5943473"} err="failed to get container status \"bc28165d2aecd54d14d3eacaf7c73016df9bb0ab09380abef03dde2fd5943473\": rpc error: code = NotFound desc = could not find container \"bc28165d2aecd54d14d3eacaf7c73016df9bb0ab09380abef03dde2fd5943473\": container with ID starting with bc28165d2aecd54d14d3eacaf7c73016df9bb0ab09380abef03dde2fd5943473 not found: ID does not exist" Jul 01 17:18:24.002902 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.002871 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5856f4f55b-m9442"] Jul 01 17:18:24.007316 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.007291 2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5856f4f55b-m9442"] Jul 01 17:18:24.389535 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.389492 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc6ce87c-412a-4860-9d48-751f937fee97-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-lpsjz\" (UID: \"fc6ce87c-412a-4860-9d48-751f937fee97\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-lpsjz" Jul 01 17:18:24.389706 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.389562 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c182a41e-78e7-49c0-84f4-467f5744c85b-node-exporter-tls\") pod \"node-exporter-n9264\" (UID: \"c182a41e-78e7-49c0-84f4-467f5744c85b\") " pod="openshift-monitoring/node-exporter-n9264" Jul 01 17:18:24.392098 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.392074 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c182a41e-78e7-49c0-84f4-467f5744c85b-node-exporter-tls\") pod \"node-exporter-n9264\" (UID: \"c182a41e-78e7-49c0-84f4-467f5744c85b\") " pod="openshift-monitoring/node-exporter-n9264" Jul 01 17:18:24.392236 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.392211 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc6ce87c-412a-4860-9d48-751f937fee97-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-lpsjz\" (UID: \"fc6ce87c-412a-4860-9d48-751f937fee97\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-lpsjz" Jul 01 17:18:24.423624 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.423592 2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4c4eec4-7129-4d71-bebe-2a2c6093ea12" path="/var/lib/kubelet/pods/e4c4eec4-7129-4d71-bebe-2a2c6093ea12/volumes" Jul 01 17:18:24.651838 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.651750 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-lpsjz" Jul 01 17:18:24.657497 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.657471 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n9264" Jul 01 17:18:24.673183 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:18:24.673153 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc182a41e_78e7_49c0_84f4_467f5744c85b.slice/crio-782348e882cfdf0e8522a7382c65fad8a963aeb3a5d34449b6d69fb46d12adee WatchSource:0}: Error finding container 782348e882cfdf0e8522a7382c65fad8a963aeb3a5d34449b6d69fb46d12adee: Status 404 returned error can't find the container with id 782348e882cfdf0e8522a7382c65fad8a963aeb3a5d34449b6d69fb46d12adee Jul 01 17:18:24.683357 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.683328 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 17:18:24.686548 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.686525 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:18:24.689974 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.689933 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 01 17:18:24.689974 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.689933 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 01 17:18:24.690337 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.690283 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 01 17:18:24.690337 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.690328 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 01 17:18:24.690648 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.690348 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-brst9\"" Jul 01 17:18:24.690648 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.690494 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 01 17:18:24.691701 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.691681 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 01 17:18:24.692329 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.692271 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 01 17:18:24.692329 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.692307 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 01 17:18:24.692543 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.692272 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 01 17:18:24.705768 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.705730 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 17:18:24.792891 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.792850 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2fa540db-1ef6-4507-a7ed-407fe58c6223-config-volume\") pod \"alertmanager-main-0\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:18:24.793066 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.792908 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2fa540db-1ef6-4507-a7ed-407fe58c6223-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:18:24.793066 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.793003 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2fa540db-1ef6-4507-a7ed-407fe58c6223-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:18:24.793066 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.793032 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2fa540db-1ef6-4507-a7ed-407fe58c6223-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:18:24.793066 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.793057 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2fa540db-1ef6-4507-a7ed-407fe58c6223-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:18:24.793255 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.793113 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2fa540db-1ef6-4507-a7ed-407fe58c6223-web-config\") pod \"alertmanager-main-0\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:18:24.793255 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.793145 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2fa540db-1ef6-4507-a7ed-407fe58c6223-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:18:24.793255 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.793174 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fa540db-1ef6-4507-a7ed-407fe58c6223-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:18:24.793255 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.793224 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2fa540db-1ef6-4507-a7ed-407fe58c6223-config-out\") pod \"alertmanager-main-0\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:18:24.793389 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.793276 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2fa540db-1ef6-4507-a7ed-407fe58c6223-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:18:24.793389 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.793299 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2fa540db-1ef6-4507-a7ed-407fe58c6223-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:18:24.793389 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.793314 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6874z\" (UniqueName: \"kubernetes.io/projected/2fa540db-1ef6-4507-a7ed-407fe58c6223-kube-api-access-6874z\") pod \"alertmanager-main-0\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:18:24.793389 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.793333 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fa540db-1ef6-4507-a7ed-407fe58c6223-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:18:24.803914 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.803884 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-lpsjz"] Jul 01 17:18:24.806717 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:18:24.806689 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc6ce87c_412a_4860_9d48_751f937fee97.slice/crio-a5bab7d7c11b99071fc7f57635eded9060938eb4e65da504126cfdef8da70369 WatchSource:0}: Error finding container a5bab7d7c11b99071fc7f57635eded9060938eb4e65da504126cfdef8da70369: Status 404 returned error can't find the container with id a5bab7d7c11b99071fc7f57635eded9060938eb4e65da504126cfdef8da70369 Jul 01 17:18:24.894706 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.894673 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fa540db-1ef6-4507-a7ed-407fe58c6223-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:18:24.894823 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.894725 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2fa540db-1ef6-4507-a7ed-407fe58c6223-config-out\") pod \"alertmanager-main-0\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:18:24.894823 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.894803 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2fa540db-1ef6-4507-a7ed-407fe58c6223-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:18:24.894960 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:18:24.894826 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2fa540db-1ef6-4507-a7ed-407fe58c6223-alertmanager-trusted-ca-bundle podName:2fa540db-1ef6-4507-a7ed-407fe58c6223 nodeName:}" failed. No retries permitted until 2026-07-01 17:18:25.394798182 +0000 UTC m=+135.426795423 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/2fa540db-1ef6-4507-a7ed-407fe58c6223-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "2fa540db-1ef6-4507-a7ed-407fe58c6223") : configmap references non-existent config key: ca-bundle.crt Jul 01 17:18:24.894960 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.894875 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2fa540db-1ef6-4507-a7ed-407fe58c6223-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:18:24.894960 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.894908 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6874z\" (UniqueName: \"kubernetes.io/projected/2fa540db-1ef6-4507-a7ed-407fe58c6223-kube-api-access-6874z\") pod \"alertmanager-main-0\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:18:24.894960 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.894937 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fa540db-1ef6-4507-a7ed-407fe58c6223-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:18:24.895162 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.894997 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2fa540db-1ef6-4507-a7ed-407fe58c6223-config-volume\") pod \"alertmanager-main-0\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:18:24.895162 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.895029 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2fa540db-1ef6-4507-a7ed-407fe58c6223-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:18:24.895162 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.895077 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2fa540db-1ef6-4507-a7ed-407fe58c6223-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:18:24.895162 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.895102 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2fa540db-1ef6-4507-a7ed-407fe58c6223-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:18:24.895162 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.895130 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2fa540db-1ef6-4507-a7ed-407fe58c6223-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:18:24.896582 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.895829 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fa540db-1ef6-4507-a7ed-407fe58c6223-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:18:24.896582 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.895882 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2fa540db-1ef6-4507-a7ed-407fe58c6223-web-config\") pod \"alertmanager-main-0\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:18:24.896582 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.895929 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2fa540db-1ef6-4507-a7ed-407fe58c6223-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:18:24.896582 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.896371 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2fa540db-1ef6-4507-a7ed-407fe58c6223-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:18:24.898154 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.898049 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2fa540db-1ef6-4507-a7ed-407fe58c6223-config-out\") pod \"alertmanager-main-0\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:18:24.898248 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.898210 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2fa540db-1ef6-4507-a7ed-407fe58c6223-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:18:24.898729 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.898678 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2fa540db-1ef6-4507-a7ed-407fe58c6223-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:18:24.899832 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.899795 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2fa540db-1ef6-4507-a7ed-407fe58c6223-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:18:24.899832 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.899811 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2fa540db-1ef6-4507-a7ed-407fe58c6223-web-config\") pod \"alertmanager-main-0\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:18:24.900686 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.900638 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2fa540db-1ef6-4507-a7ed-407fe58c6223-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:18:24.901081 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.901055 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2fa540db-1ef6-4507-a7ed-407fe58c6223-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:18:24.901739 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.901710 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2fa540db-1ef6-4507-a7ed-407fe58c6223-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:18:24.903360 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.903265 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2fa540db-1ef6-4507-a7ed-407fe58c6223-config-volume\") pod \"alertmanager-main-0\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:18:24.914764 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.914733 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6874z\" (UniqueName: \"kubernetes.io/projected/2fa540db-1ef6-4507-a7ed-407fe58c6223-kube-api-access-6874z\") pod \"alertmanager-main-0\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:18:24.985166 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.985111 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-lpsjz" event={"ID":"fc6ce87c-412a-4860-9d48-751f937fee97","Type":"ContainerStarted","Data":"2de2fc96e444ec655e896fe62b2ad47d164e1c7772c8de2f237d4de6946aa206"} Jul 01 17:18:24.986155 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.986130 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-lpsjz" event={"ID":"fc6ce87c-412a-4860-9d48-751f937fee97","Type":"ContainerStarted","Data":"df8f2d0854e8294c4daf40372f9bbd62730bb95fb5e77a73863b603c0fa7220d"} Jul 01 17:18:24.986312 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.986231 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-lpsjz" event={"ID":"fc6ce87c-412a-4860-9d48-751f937fee97","Type":"ContainerStarted","Data":"a5bab7d7c11b99071fc7f57635eded9060938eb4e65da504126cfdef8da70369"} Jul 01 17:18:24.986647 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:24.986610 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n9264" event={"ID":"c182a41e-78e7-49c0-84f4-467f5744c85b","Type":"ContainerStarted","Data":"782348e882cfdf0e8522a7382c65fad8a963aeb3a5d34449b6d69fb46d12adee"} Jul 01 17:18:25.401287 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:25.401225 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fa540db-1ef6-4507-a7ed-407fe58c6223-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:18:25.402223 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:25.402196 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fa540db-1ef6-4507-a7ed-407fe58c6223-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:18:25.598022 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:25.597985 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:18:25.712027 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:25.711997 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6b597b858-99q2h"] Jul 01 17:18:25.716453 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:25.716426 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6b597b858-99q2h" Jul 01 17:18:25.720010 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:25.719938 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-7kmob912vuidn\"" Jul 01 17:18:25.720219 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:25.720188 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 01 17:18:25.720219 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:25.720188 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 01 17:18:25.720347 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:25.720242 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 01 17:18:25.720347 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:25.720198 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 01 17:18:25.720347 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:25.720306 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 01 17:18:25.721662 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:25.721639 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-rbwsb\"" Jul 01 17:18:25.735511 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:25.735484 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6b597b858-99q2h"] Jul 01 17:18:25.770582 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:25.770546 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 17:18:25.775279 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:18:25.775240 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fa540db_1ef6_4507_a7ed_407fe58c6223.slice/crio-3ae78042dc3aea0db814390a82c4d18ddf88bb164b396605527f85e13c842d65 WatchSource:0}: Error finding container 3ae78042dc3aea0db814390a82c4d18ddf88bb164b396605527f85e13c842d65: Status 404 returned error can't find the container with id 3ae78042dc3aea0db814390a82c4d18ddf88bb164b396605527f85e13c842d65 Jul 01 17:18:25.804710 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:25.804676 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1e974bdf-7089-4519-8ce7-199d229cd216-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6b597b858-99q2h\" (UID: \"1e974bdf-7089-4519-8ce7-199d229cd216\") " pod="openshift-monitoring/thanos-querier-6b597b858-99q2h" Jul 01 17:18:25.804863 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:25.804719 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1e974bdf-7089-4519-8ce7-199d229cd216-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6b597b858-99q2h\" (UID: \"1e974bdf-7089-4519-8ce7-199d229cd216\") " pod="openshift-monitoring/thanos-querier-6b597b858-99q2h" Jul 01 17:18:25.804863 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:25.804761 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1e974bdf-7089-4519-8ce7-199d229cd216-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6b597b858-99q2h\" (UID: \"1e974bdf-7089-4519-8ce7-199d229cd216\") " pod="openshift-monitoring/thanos-querier-6b597b858-99q2h" Jul 01 17:18:25.804863 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:25.804784 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e974bdf-7089-4519-8ce7-199d229cd216-metrics-client-ca\") pod \"thanos-querier-6b597b858-99q2h\" (UID: \"1e974bdf-7089-4519-8ce7-199d229cd216\") " pod="openshift-monitoring/thanos-querier-6b597b858-99q2h" Jul 01 17:18:25.804863 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:25.804827 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fnpr\" (UniqueName: \"kubernetes.io/projected/1e974bdf-7089-4519-8ce7-199d229cd216-kube-api-access-5fnpr\") pod \"thanos-querier-6b597b858-99q2h\" (UID: \"1e974bdf-7089-4519-8ce7-199d229cd216\") " pod="openshift-monitoring/thanos-querier-6b597b858-99q2h" Jul 01 17:18:25.805097 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:25.804903 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1e974bdf-7089-4519-8ce7-199d229cd216-secret-thanos-querier-tls\") pod \"thanos-querier-6b597b858-99q2h\" (UID: \"1e974bdf-7089-4519-8ce7-199d229cd216\") " pod="openshift-monitoring/thanos-querier-6b597b858-99q2h" Jul 01 17:18:25.805097 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:25.804935 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1e974bdf-7089-4519-8ce7-199d229cd216-secret-grpc-tls\") pod \"thanos-querier-6b597b858-99q2h\" (UID: \"1e974bdf-7089-4519-8ce7-199d229cd216\") " pod="openshift-monitoring/thanos-querier-6b597b858-99q2h" Jul 01 17:18:25.805097 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:25.804981 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1e974bdf-7089-4519-8ce7-199d229cd216-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6b597b858-99q2h\" (UID: \"1e974bdf-7089-4519-8ce7-199d229cd216\") " pod="openshift-monitoring/thanos-querier-6b597b858-99q2h" Jul 01 17:18:25.906204 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:25.906151 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1e974bdf-7089-4519-8ce7-199d229cd216-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6b597b858-99q2h\" (UID: \"1e974bdf-7089-4519-8ce7-199d229cd216\") " pod="openshift-monitoring/thanos-querier-6b597b858-99q2h" Jul 01 17:18:25.906204 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:25.906214 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1e974bdf-7089-4519-8ce7-199d229cd216-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6b597b858-99q2h\" (UID: \"1e974bdf-7089-4519-8ce7-199d229cd216\") " pod="openshift-monitoring/thanos-querier-6b597b858-99q2h" Jul 01 17:18:25.906442 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:25.906247 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1e974bdf-7089-4519-8ce7-199d229cd216-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6b597b858-99q2h\" (UID: \"1e974bdf-7089-4519-8ce7-199d229cd216\") " pod="openshift-monitoring/thanos-querier-6b597b858-99q2h" Jul 01 17:18:25.906442 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:25.906272 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e974bdf-7089-4519-8ce7-199d229cd216-metrics-client-ca\") pod \"thanos-querier-6b597b858-99q2h\" (UID: \"1e974bdf-7089-4519-8ce7-199d229cd216\") " pod="openshift-monitoring/thanos-querier-6b597b858-99q2h" Jul 01 17:18:25.906442 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:25.906298 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fnpr\" (UniqueName: \"kubernetes.io/projected/1e974bdf-7089-4519-8ce7-199d229cd216-kube-api-access-5fnpr\") pod \"thanos-querier-6b597b858-99q2h\" (UID: \"1e974bdf-7089-4519-8ce7-199d229cd216\") " pod="openshift-monitoring/thanos-querier-6b597b858-99q2h" Jul 01 17:18:25.906442 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:25.906358 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1e974bdf-7089-4519-8ce7-199d229cd216-secret-thanos-querier-tls\") pod \"thanos-querier-6b597b858-99q2h\" (UID: \"1e974bdf-7089-4519-8ce7-199d229cd216\") " pod="openshift-monitoring/thanos-querier-6b597b858-99q2h" Jul 01 17:18:25.906442 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:25.906402 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1e974bdf-7089-4519-8ce7-199d229cd216-secret-grpc-tls\") pod \"thanos-querier-6b597b858-99q2h\" (UID: \"1e974bdf-7089-4519-8ce7-199d229cd216\") " pod="openshift-monitoring/thanos-querier-6b597b858-99q2h" Jul 01 17:18:25.906442 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:25.906439 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1e974bdf-7089-4519-8ce7-199d229cd216-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6b597b858-99q2h\" (UID: \"1e974bdf-7089-4519-8ce7-199d229cd216\") " pod="openshift-monitoring/thanos-querier-6b597b858-99q2h" Jul 01 17:18:25.907241 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:25.907160 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e974bdf-7089-4519-8ce7-199d229cd216-metrics-client-ca\") pod \"thanos-querier-6b597b858-99q2h\" (UID: \"1e974bdf-7089-4519-8ce7-199d229cd216\") " pod="openshift-monitoring/thanos-querier-6b597b858-99q2h" Jul 01 17:18:25.909176 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:25.909105 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1e974bdf-7089-4519-8ce7-199d229cd216-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6b597b858-99q2h\" (UID: \"1e974bdf-7089-4519-8ce7-199d229cd216\") " pod="openshift-monitoring/thanos-querier-6b597b858-99q2h" Jul 01 17:18:25.909422 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:25.909400 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1e974bdf-7089-4519-8ce7-199d229cd216-secret-grpc-tls\") pod \"thanos-querier-6b597b858-99q2h\" (UID: \"1e974bdf-7089-4519-8ce7-199d229cd216\") " pod="openshift-monitoring/thanos-querier-6b597b858-99q2h" Jul 01 17:18:25.909514 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:25.909491 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1e974bdf-7089-4519-8ce7-199d229cd216-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6b597b858-99q2h\" (UID: \"1e974bdf-7089-4519-8ce7-199d229cd216\") " pod="openshift-monitoring/thanos-querier-6b597b858-99q2h" Jul 01 17:18:25.909556 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:25.909491 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1e974bdf-7089-4519-8ce7-199d229cd216-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6b597b858-99q2h\" (UID: \"1e974bdf-7089-4519-8ce7-199d229cd216\") " pod="openshift-monitoring/thanos-querier-6b597b858-99q2h" Jul 01 17:18:25.909635 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:25.909615 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1e974bdf-7089-4519-8ce7-199d229cd216-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6b597b858-99q2h\" (UID: \"1e974bdf-7089-4519-8ce7-199d229cd216\") " pod="openshift-monitoring/thanos-querier-6b597b858-99q2h" Jul 01 17:18:25.909694 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:25.909678 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1e974bdf-7089-4519-8ce7-199d229cd216-secret-thanos-querier-tls\") pod \"thanos-querier-6b597b858-99q2h\" (UID: \"1e974bdf-7089-4519-8ce7-199d229cd216\") " pod="openshift-monitoring/thanos-querier-6b597b858-99q2h" Jul 01 17:18:25.916253 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:25.916219 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fnpr\" (UniqueName: \"kubernetes.io/projected/1e974bdf-7089-4519-8ce7-199d229cd216-kube-api-access-5fnpr\") pod \"thanos-querier-6b597b858-99q2h\" (UID: \"1e974bdf-7089-4519-8ce7-199d229cd216\") " pod="openshift-monitoring/thanos-querier-6b597b858-99q2h" Jul 01 17:18:25.991677 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:25.991636 2547 generic.go:356] "Generic (PLEG): container finished" podID="c182a41e-78e7-49c0-84f4-467f5744c85b" containerID="55c07a679b9c480153f70df02515c07d02c15c19376a6a79efd9eb2cab6ed822" exitCode=0 Jul 01 17:18:25.992158 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:25.991726 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n9264" event={"ID":"c182a41e-78e7-49c0-84f4-467f5744c85b","Type":"ContainerDied","Data":"55c07a679b9c480153f70df02515c07d02c15c19376a6a79efd9eb2cab6ed822"} Jul 01 17:18:25.993094 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:25.993069 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fa540db-1ef6-4507-a7ed-407fe58c6223","Type":"ContainerStarted","Data":"3ae78042dc3aea0db814390a82c4d18ddf88bb164b396605527f85e13c842d65"} Jul 01 17:18:26.033853 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:26.033808 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6b597b858-99q2h" Jul 01 17:18:26.188384 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:26.188360 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6b597b858-99q2h"] Jul 01 17:18:26.190528 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:18:26.190501 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e974bdf_7089_4519_8ce7_199d229cd216.slice/crio-1329c870cbadf1efbe4e9665384a2f6417fbe9d3db3c12dd3fe7578b0796bacb WatchSource:0}: Error finding container 1329c870cbadf1efbe4e9665384a2f6417fbe9d3db3c12dd3fe7578b0796bacb: Status 404 returned error can't find the container with id 1329c870cbadf1efbe4e9665384a2f6417fbe9d3db3c12dd3fe7578b0796bacb Jul 01 17:18:27.001539 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:27.001449 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b597b858-99q2h" event={"ID":"1e974bdf-7089-4519-8ce7-199d229cd216","Type":"ContainerStarted","Data":"1329c870cbadf1efbe4e9665384a2f6417fbe9d3db3c12dd3fe7578b0796bacb"} Jul 01 17:18:27.005459 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:27.005351 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n9264" event={"ID":"c182a41e-78e7-49c0-84f4-467f5744c85b","Type":"ContainerStarted","Data":"8ca15869acf9aa658bdd29e2dda7ecc3a9e31c8072c83ef5703abd0a0b9a69a8"} Jul 01 17:18:27.005459 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:27.005419 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n9264" event={"ID":"c182a41e-78e7-49c0-84f4-467f5744c85b","Type":"ContainerStarted","Data":"588bd2a67d700d1b967215a93b76ce218dfdfc304646f2ee13badd1184385902"} Jul 01 17:18:27.034077 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:27.034005 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-n9264" podStartSLOduration=2.98404747 podStartE2EDuration="4.033984066s" totalImagesPullingTime="973.663362ms" totalInitContainerRuntime="76.273234ms" isStatefulPod=true podCreationTimestamp="2026-07-01 17:18:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:18:27.032233972 +0000 UTC m=+137.064231266" watchObservedRunningTime="2026-07-01 17:18:27.033984066 +0000 UTC m=+137.065981334" Jul 01 17:18:28.010970 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.010911 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-lpsjz" event={"ID":"fc6ce87c-412a-4860-9d48-751f937fee97","Type":"ContainerStarted","Data":"38542eaf5f363f2493d068b7c5c6d2a1042d442fbfa7b3cde33d1c9b557f0df1"} Jul 01 17:18:28.012373 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.012346 2547 generic.go:356] "Generic (PLEG): container finished" podID="2fa540db-1ef6-4507-a7ed-407fe58c6223" containerID="21c32c767562a2d337bffb1cf85bb451599105bd34ac56fe5727c56a6272190d" exitCode=0 Jul 01 17:18:28.012496 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.012433 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fa540db-1ef6-4507-a7ed-407fe58c6223","Type":"ContainerDied","Data":"21c32c767562a2d337bffb1cf85bb451599105bd34ac56fe5727c56a6272190d"} Jul 01 17:18:28.033489 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.033430 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-lpsjz" podStartSLOduration=2.8769079140000002 podStartE2EDuration="5.033410787s" totalImagesPullingTime="2.156502873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:18:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:18:28.030668064 +0000 UTC m=+138.062665323" watchObservedRunningTime="2026-07-01 17:18:28.033410787 +0000 UTC m=+138.065408046" Jul 01 17:18:28.135146 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.135118 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-746496b7bc-7b74v"] Jul 01 17:18:28.138260 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.138238 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-746496b7bc-7b74v" Jul 01 17:18:28.141231 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.141209 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 01 17:18:28.141703 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.141681 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-4c2s6\"" Jul 01 17:18:28.141790 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.141711 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 01 17:18:28.142235 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.142217 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 01 17:18:28.142325 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.142264 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-487as8i6770qq\"" Jul 01 17:18:28.143353 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.143336 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 01 17:18:28.148935 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.148909 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-746496b7bc-7b74v"] Jul 01 17:18:28.226741 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.226714 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/150e565e-3831-4429-9c58-b4a6ee8fb621-client-ca-bundle\") pod \"metrics-server-746496b7bc-7b74v\" (UID: \"150e565e-3831-4429-9c58-b4a6ee8fb621\") " pod="openshift-monitoring/metrics-server-746496b7bc-7b74v" Jul 01 17:18:28.226881 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.226748 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/150e565e-3831-4429-9c58-b4a6ee8fb621-audit-log\") pod \"metrics-server-746496b7bc-7b74v\" (UID: \"150e565e-3831-4429-9c58-b4a6ee8fb621\") " pod="openshift-monitoring/metrics-server-746496b7bc-7b74v" Jul 01 17:18:28.226881 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.226800 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/150e565e-3831-4429-9c58-b4a6ee8fb621-secret-metrics-server-client-certs\") pod \"metrics-server-746496b7bc-7b74v\" (UID: \"150e565e-3831-4429-9c58-b4a6ee8fb621\") " pod="openshift-monitoring/metrics-server-746496b7bc-7b74v" Jul 01 17:18:28.226881 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.226827 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/150e565e-3831-4429-9c58-b4a6ee8fb621-secret-metrics-server-tls\") pod \"metrics-server-746496b7bc-7b74v\" (UID: \"150e565e-3831-4429-9c58-b4a6ee8fb621\") " pod="openshift-monitoring/metrics-server-746496b7bc-7b74v" Jul 01 17:18:28.226881 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.226845 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5h4c\" (UniqueName: \"kubernetes.io/projected/150e565e-3831-4429-9c58-b4a6ee8fb621-kube-api-access-g5h4c\") pod \"metrics-server-746496b7bc-7b74v\" (UID: \"150e565e-3831-4429-9c58-b4a6ee8fb621\") " pod="openshift-monitoring/metrics-server-746496b7bc-7b74v" Jul 01 17:18:28.227095 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.226923 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/150e565e-3831-4429-9c58-b4a6ee8fb621-metrics-server-audit-profiles\") pod \"metrics-server-746496b7bc-7b74v\" (UID: \"150e565e-3831-4429-9c58-b4a6ee8fb621\") " pod="openshift-monitoring/metrics-server-746496b7bc-7b74v" Jul 01 17:18:28.227095 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.226985 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/150e565e-3831-4429-9c58-b4a6ee8fb621-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-746496b7bc-7b74v\" (UID: \"150e565e-3831-4429-9c58-b4a6ee8fb621\") " pod="openshift-monitoring/metrics-server-746496b7bc-7b74v" Jul 01 17:18:28.328265 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.328227 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/150e565e-3831-4429-9c58-b4a6ee8fb621-client-ca-bundle\") pod \"metrics-server-746496b7bc-7b74v\" (UID: \"150e565e-3831-4429-9c58-b4a6ee8fb621\") " pod="openshift-monitoring/metrics-server-746496b7bc-7b74v" Jul 01 17:18:28.328461 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.328275 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/150e565e-3831-4429-9c58-b4a6ee8fb621-audit-log\") pod \"metrics-server-746496b7bc-7b74v\" (UID: \"150e565e-3831-4429-9c58-b4a6ee8fb621\") " pod="openshift-monitoring/metrics-server-746496b7bc-7b74v" Jul 01 17:18:28.328461 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.328306 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/150e565e-3831-4429-9c58-b4a6ee8fb621-secret-metrics-server-client-certs\") pod \"metrics-server-746496b7bc-7b74v\" (UID: \"150e565e-3831-4429-9c58-b4a6ee8fb621\") " pod="openshift-monitoring/metrics-server-746496b7bc-7b74v" Jul 01 17:18:28.328461 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.328325 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/150e565e-3831-4429-9c58-b4a6ee8fb621-secret-metrics-server-tls\") pod \"metrics-server-746496b7bc-7b74v\" (UID: \"150e565e-3831-4429-9c58-b4a6ee8fb621\") " pod="openshift-monitoring/metrics-server-746496b7bc-7b74v" Jul 01 17:18:28.328461 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.328344 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5h4c\" (UniqueName: \"kubernetes.io/projected/150e565e-3831-4429-9c58-b4a6ee8fb621-kube-api-access-g5h4c\") pod \"metrics-server-746496b7bc-7b74v\" (UID: \"150e565e-3831-4429-9c58-b4a6ee8fb621\") " pod="openshift-monitoring/metrics-server-746496b7bc-7b74v" Jul 01 17:18:28.328461 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.328425 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/150e565e-3831-4429-9c58-b4a6ee8fb621-metrics-server-audit-profiles\") pod \"metrics-server-746496b7bc-7b74v\" (UID: \"150e565e-3831-4429-9c58-b4a6ee8fb621\") " pod="openshift-monitoring/metrics-server-746496b7bc-7b74v" Jul 01 17:18:28.328750 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.328465 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/150e565e-3831-4429-9c58-b4a6ee8fb621-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-746496b7bc-7b74v\" (UID: \"150e565e-3831-4429-9c58-b4a6ee8fb621\") " pod="openshift-monitoring/metrics-server-746496b7bc-7b74v" Jul 01 17:18:28.328799 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.328772 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/150e565e-3831-4429-9c58-b4a6ee8fb621-audit-log\") pod \"metrics-server-746496b7bc-7b74v\" (UID: \"150e565e-3831-4429-9c58-b4a6ee8fb621\") " pod="openshift-monitoring/metrics-server-746496b7bc-7b74v" Jul 01 17:18:28.329467 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.329446 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/150e565e-3831-4429-9c58-b4a6ee8fb621-metrics-server-audit-profiles\") pod \"metrics-server-746496b7bc-7b74v\" (UID: \"150e565e-3831-4429-9c58-b4a6ee8fb621\") " pod="openshift-monitoring/metrics-server-746496b7bc-7b74v" Jul 01 17:18:28.329578 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.329485 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/150e565e-3831-4429-9c58-b4a6ee8fb621-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-746496b7bc-7b74v\" (UID: \"150e565e-3831-4429-9c58-b4a6ee8fb621\") " pod="openshift-monitoring/metrics-server-746496b7bc-7b74v" Jul 01 17:18:28.330939 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.330909 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/150e565e-3831-4429-9c58-b4a6ee8fb621-client-ca-bundle\") pod \"metrics-server-746496b7bc-7b74v\" (UID: \"150e565e-3831-4429-9c58-b4a6ee8fb621\") " pod="openshift-monitoring/metrics-server-746496b7bc-7b74v" Jul 01 17:18:28.331061 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.330993 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/150e565e-3831-4429-9c58-b4a6ee8fb621-secret-metrics-server-client-certs\") pod \"metrics-server-746496b7bc-7b74v\" (UID: \"150e565e-3831-4429-9c58-b4a6ee8fb621\") " pod="openshift-monitoring/metrics-server-746496b7bc-7b74v" Jul 01 17:18:28.331113 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.331064 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/150e565e-3831-4429-9c58-b4a6ee8fb621-secret-metrics-server-tls\") pod \"metrics-server-746496b7bc-7b74v\" (UID: \"150e565e-3831-4429-9c58-b4a6ee8fb621\") " pod="openshift-monitoring/metrics-server-746496b7bc-7b74v" Jul 01 17:18:28.338025 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.338004 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5h4c\" (UniqueName: \"kubernetes.io/projected/150e565e-3831-4429-9c58-b4a6ee8fb621-kube-api-access-g5h4c\") pod \"metrics-server-746496b7bc-7b74v\" (UID: \"150e565e-3831-4429-9c58-b4a6ee8fb621\") " pod="openshift-monitoring/metrics-server-746496b7bc-7b74v" Jul 01 17:18:28.449360 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.449315 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-746496b7bc-7b74v" Jul 01 17:18:28.571199 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.571162 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6785cb48b6-t98mr"] Jul 01 17:18:28.575594 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.575573 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6785cb48b6-t98mr" Jul 01 17:18:28.583986 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.583937 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6785cb48b6-t98mr"] Jul 01 17:18:28.587639 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.587609 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-746496b7bc-7b74v"] Jul 01 17:18:28.591400 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:18:28.591373 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod150e565e_3831_4429_9c58_b4a6ee8fb621.slice/crio-4eabba49b02e8aff8ba5c0168e2abe3de63d3e5ff247de306bce81dd6e3d5d10 WatchSource:0}: Error finding container 4eabba49b02e8aff8ba5c0168e2abe3de63d3e5ff247de306bce81dd6e3d5d10: Status 404 returned error can't find the container with id 4eabba49b02e8aff8ba5c0168e2abe3de63d3e5ff247de306bce81dd6e3d5d10 Jul 01 17:18:28.629904 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.629866 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zt52h\" (UniqueName: \"kubernetes.io/projected/257c3bab-439c-46c2-97ed-2eb7c9f81de4-kube-api-access-zt52h\") pod \"console-6785cb48b6-t98mr\" (UID: \"257c3bab-439c-46c2-97ed-2eb7c9f81de4\") " pod="openshift-console/console-6785cb48b6-t98mr" Jul 01 17:18:28.629904 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.629912 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/257c3bab-439c-46c2-97ed-2eb7c9f81de4-console-serving-cert\") pod \"console-6785cb48b6-t98mr\" (UID: \"257c3bab-439c-46c2-97ed-2eb7c9f81de4\") " pod="openshift-console/console-6785cb48b6-t98mr" Jul 01 17:18:28.630151 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.629930 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/257c3bab-439c-46c2-97ed-2eb7c9f81de4-trusted-ca-bundle\") pod \"console-6785cb48b6-t98mr\" (UID: \"257c3bab-439c-46c2-97ed-2eb7c9f81de4\") " pod="openshift-console/console-6785cb48b6-t98mr" Jul 01 17:18:28.630151 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.630068 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/257c3bab-439c-46c2-97ed-2eb7c9f81de4-service-ca\") pod \"console-6785cb48b6-t98mr\" (UID: \"257c3bab-439c-46c2-97ed-2eb7c9f81de4\") " pod="openshift-console/console-6785cb48b6-t98mr" Jul 01 17:18:28.630151 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.630098 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/257c3bab-439c-46c2-97ed-2eb7c9f81de4-console-oauth-config\") pod \"console-6785cb48b6-t98mr\" (UID: \"257c3bab-439c-46c2-97ed-2eb7c9f81de4\") " pod="openshift-console/console-6785cb48b6-t98mr" Jul 01 17:18:28.630151 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.630134 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/257c3bab-439c-46c2-97ed-2eb7c9f81de4-console-config\") pod \"console-6785cb48b6-t98mr\" (UID: \"257c3bab-439c-46c2-97ed-2eb7c9f81de4\") " pod="openshift-console/console-6785cb48b6-t98mr" Jul 01 17:18:28.630291 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.630174 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/257c3bab-439c-46c2-97ed-2eb7c9f81de4-oauth-serving-cert\") pod \"console-6785cb48b6-t98mr\" (UID: \"257c3bab-439c-46c2-97ed-2eb7c9f81de4\") " pod="openshift-console/console-6785cb48b6-t98mr" Jul 01 17:18:28.731207 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.731170 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/257c3bab-439c-46c2-97ed-2eb7c9f81de4-service-ca\") pod \"console-6785cb48b6-t98mr\" (UID: \"257c3bab-439c-46c2-97ed-2eb7c9f81de4\") " pod="openshift-console/console-6785cb48b6-t98mr" Jul 01 17:18:28.731207 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.731207 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/257c3bab-439c-46c2-97ed-2eb7c9f81de4-console-oauth-config\") pod \"console-6785cb48b6-t98mr\" (UID: \"257c3bab-439c-46c2-97ed-2eb7c9f81de4\") " pod="openshift-console/console-6785cb48b6-t98mr" Jul 01 17:18:28.731441 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.731254 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/257c3bab-439c-46c2-97ed-2eb7c9f81de4-console-config\") pod \"console-6785cb48b6-t98mr\" (UID: \"257c3bab-439c-46c2-97ed-2eb7c9f81de4\") " pod="openshift-console/console-6785cb48b6-t98mr" Jul 01 17:18:28.731441 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.731323 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/257c3bab-439c-46c2-97ed-2eb7c9f81de4-oauth-serving-cert\") pod \"console-6785cb48b6-t98mr\" (UID: \"257c3bab-439c-46c2-97ed-2eb7c9f81de4\") " pod="openshift-console/console-6785cb48b6-t98mr" Jul 01 17:18:28.731441 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.731353 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt52h\" (UniqueName: \"kubernetes.io/projected/257c3bab-439c-46c2-97ed-2eb7c9f81de4-kube-api-access-zt52h\") pod \"console-6785cb48b6-t98mr\" (UID: \"257c3bab-439c-46c2-97ed-2eb7c9f81de4\") " pod="openshift-console/console-6785cb48b6-t98mr" Jul 01 17:18:28.731441 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.731393 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/257c3bab-439c-46c2-97ed-2eb7c9f81de4-console-serving-cert\") pod \"console-6785cb48b6-t98mr\" (UID: \"257c3bab-439c-46c2-97ed-2eb7c9f81de4\") " pod="openshift-console/console-6785cb48b6-t98mr" Jul 01 17:18:28.731441 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.731415 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/257c3bab-439c-46c2-97ed-2eb7c9f81de4-trusted-ca-bundle\") pod \"console-6785cb48b6-t98mr\" (UID: \"257c3bab-439c-46c2-97ed-2eb7c9f81de4\") " pod="openshift-console/console-6785cb48b6-t98mr" Jul 01 17:18:28.732052 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.732024 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/257c3bab-439c-46c2-97ed-2eb7c9f81de4-service-ca\") pod \"console-6785cb48b6-t98mr\" (UID: \"257c3bab-439c-46c2-97ed-2eb7c9f81de4\") " pod="openshift-console/console-6785cb48b6-t98mr" Jul 01 17:18:28.732165 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.732098 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/257c3bab-439c-46c2-97ed-2eb7c9f81de4-oauth-serving-cert\") pod \"console-6785cb48b6-t98mr\" (UID: \"257c3bab-439c-46c2-97ed-2eb7c9f81de4\") " pod="openshift-console/console-6785cb48b6-t98mr" Jul 01 17:18:28.732165 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.732118 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/257c3bab-439c-46c2-97ed-2eb7c9f81de4-console-config\") pod \"console-6785cb48b6-t98mr\" (UID: \"257c3bab-439c-46c2-97ed-2eb7c9f81de4\") " pod="openshift-console/console-6785cb48b6-t98mr" Jul 01 17:18:28.732280 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.732264 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/257c3bab-439c-46c2-97ed-2eb7c9f81de4-trusted-ca-bundle\") pod \"console-6785cb48b6-t98mr\" (UID: \"257c3bab-439c-46c2-97ed-2eb7c9f81de4\") " pod="openshift-console/console-6785cb48b6-t98mr" Jul 01 17:18:28.734463 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.734444 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/257c3bab-439c-46c2-97ed-2eb7c9f81de4-console-serving-cert\") pod \"console-6785cb48b6-t98mr\" (UID: \"257c3bab-439c-46c2-97ed-2eb7c9f81de4\") " pod="openshift-console/console-6785cb48b6-t98mr" Jul 01 17:18:28.734521 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.734477 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/257c3bab-439c-46c2-97ed-2eb7c9f81de4-console-oauth-config\") pod \"console-6785cb48b6-t98mr\" (UID: \"257c3bab-439c-46c2-97ed-2eb7c9f81de4\") " pod="openshift-console/console-6785cb48b6-t98mr" Jul 01 17:18:28.741109 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.741089 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zt52h\" (UniqueName: \"kubernetes.io/projected/257c3bab-439c-46c2-97ed-2eb7c9f81de4-kube-api-access-zt52h\") pod \"console-6785cb48b6-t98mr\" (UID: \"257c3bab-439c-46c2-97ed-2eb7c9f81de4\") " pod="openshift-console/console-6785cb48b6-t98mr" Jul 01 17:18:28.885390 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:28.885295 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6785cb48b6-t98mr" Jul 01 17:18:29.020393 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:29.020351 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b597b858-99q2h" event={"ID":"1e974bdf-7089-4519-8ce7-199d229cd216","Type":"ContainerStarted","Data":"e538332103f84eaeda4592ef3a9cb4c8c753b25271e5baadcafcb40d8eb19d52"} Jul 01 17:18:29.020856 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:29.020433 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b597b858-99q2h" event={"ID":"1e974bdf-7089-4519-8ce7-199d229cd216","Type":"ContainerStarted","Data":"d38dc3c142b0aa9ed933fd6cfccdf061ba739344431bf83fcb4915a0e2b4ff28"} Jul 01 17:18:29.020856 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:29.020474 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b597b858-99q2h" event={"ID":"1e974bdf-7089-4519-8ce7-199d229cd216","Type":"ContainerStarted","Data":"c45837403a872f89c6c622b2fd04d72ca5f2b07187664a5eba0770fefedbe0e0"} Jul 01 17:18:29.021938 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:29.021904 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-746496b7bc-7b74v" event={"ID":"150e565e-3831-4429-9c58-b4a6ee8fb621","Type":"ContainerStarted","Data":"4eabba49b02e8aff8ba5c0168e2abe3de63d3e5ff247de306bce81dd6e3d5d10"} Jul 01 17:18:29.030827 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:29.030805 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6785cb48b6-t98mr"] Jul 01 17:18:29.033890 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:18:29.033865 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod257c3bab_439c_46c2_97ed_2eb7c9f81de4.slice/crio-26fa3649fc8e3117de2774a5486e9bda0b77ab4584b199dacc40b2bd7e8390aa WatchSource:0}: Error finding container 26fa3649fc8e3117de2774a5486e9bda0b77ab4584b199dacc40b2bd7e8390aa: Status 404 returned error can't find the container with id 26fa3649fc8e3117de2774a5486e9bda0b77ab4584b199dacc40b2bd7e8390aa Jul 01 17:18:30.029054 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:30.029013 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6785cb48b6-t98mr" event={"ID":"257c3bab-439c-46c2-97ed-2eb7c9f81de4","Type":"ContainerStarted","Data":"2246bd1d322db80abd800a8df8cd4f15c7b66c29a5988a4cb371512d901ecbcc"} Jul 01 17:18:30.029590 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:30.029078 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6785cb48b6-t98mr" event={"ID":"257c3bab-439c-46c2-97ed-2eb7c9f81de4","Type":"ContainerStarted","Data":"26fa3649fc8e3117de2774a5486e9bda0b77ab4584b199dacc40b2bd7e8390aa"} Jul 01 17:18:30.032886 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:30.032710 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b597b858-99q2h" event={"ID":"1e974bdf-7089-4519-8ce7-199d229cd216","Type":"ContainerStarted","Data":"59c6fdf4097ae9338ff06eb32b229a38393f50b6dc5a3065f6058fb68ece03cd"} Jul 01 17:18:30.032886 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:30.032788 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b597b858-99q2h" event={"ID":"1e974bdf-7089-4519-8ce7-199d229cd216","Type":"ContainerStarted","Data":"8ebef949c51d0d0360b7c303b80b962ae5357b502a6a6ccdcf6f474ca678868b"} Jul 01 17:18:30.032886 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:30.032834 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b597b858-99q2h" event={"ID":"1e974bdf-7089-4519-8ce7-199d229cd216","Type":"ContainerStarted","Data":"bc398ff2b30e3d8315227f965aa9ccdfe871ceeb39dd57760cd0251c6ca43781"} Jul 01 17:18:30.033179 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:30.032933 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6b597b858-99q2h" Jul 01 17:18:30.050650 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:30.050584 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6785cb48b6-t98mr" podStartSLOduration=2.050561667 podStartE2EDuration="2.050561667s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:18:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:18:30.048347022 +0000 UTC m=+140.080344306" watchObservedRunningTime="2026-07-01 17:18:30.050561667 +0000 UTC m=+140.082558928" Jul 01 17:18:30.076157 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:30.076103 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6b597b858-99q2h" podStartSLOduration=2.113792781 podStartE2EDuration="5.07606263s" totalImagesPullingTime="2.962269849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:18:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:18:30.074197346 +0000 UTC m=+140.106194654" watchObservedRunningTime="2026-07-01 17:18:30.07606263 +0000 UTC m=+140.108059891" Jul 01 17:18:31.039139 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:31.039110 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-746496b7bc-7b74v" event={"ID":"150e565e-3831-4429-9c58-b4a6ee8fb621","Type":"ContainerStarted","Data":"b247729a0423d6e56fa8c072ee61a5388b1bba4e344b373b320837f1ab4f3a1e"} Jul 01 17:18:31.041782 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:31.041756 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fa540db-1ef6-4507-a7ed-407fe58c6223","Type":"ContainerStarted","Data":"fcb9a2ac7d5361e039e321fe93534b9d3feee632b45e4978a0e47ed637509f67"} Jul 01 17:18:31.041888 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:31.041826 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fa540db-1ef6-4507-a7ed-407fe58c6223","Type":"ContainerStarted","Data":"997f0cabc58b1f9ce1f9cc053359e9458b19cffd81e63716606465e3622c6caf"} Jul 01 17:18:31.041888 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:31.041867 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fa540db-1ef6-4507-a7ed-407fe58c6223","Type":"ContainerStarted","Data":"f2e4acefc487d755d9f063def535777e83d9bb4a754013d49df52b90bad33eaa"} Jul 01 17:18:31.084320 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:31.084263 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-746496b7bc-7b74v" podStartSLOduration=1.538264976 podStartE2EDuration="3.084246492s" totalImagesPullingTime="1.545981516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:18:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:18:31.082807337 +0000 UTC m=+141.114804598" watchObservedRunningTime="2026-07-01 17:18:31.084246492 +0000 UTC m=+141.116243751" Jul 01 17:18:32.049128 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:32.049094 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fa540db-1ef6-4507-a7ed-407fe58c6223","Type":"ContainerStarted","Data":"1b965f0a6ba3ce16635783dc14f2ab047adb279c60c1e5726b996ad402320f92"} Jul 01 17:18:32.049508 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:32.049163 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fa540db-1ef6-4507-a7ed-407fe58c6223","Type":"ContainerStarted","Data":"ca4eb833eccbd7a3bdf6e70a5e10124399c3fc4ef940f8a47a7ed533fa39de6a"} Jul 01 17:18:32.049508 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:32.049190 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fa540db-1ef6-4507-a7ed-407fe58c6223","Type":"ContainerStarted","Data":"6c5b2f6a638c80469f3ad449a5344f1eaeb66b4d0bf4ef50ed06a4e3a3039329"} Jul 01 17:18:32.080549 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:32.080490 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.096415768 podStartE2EDuration="8.080471543s" totalImagesPullingTime="3.96313414s" totalInitContainerRuntime="20.921635ms" isStatefulPod=false podCreationTimestamp="2026-07-01 17:18:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:18:32.080252977 +0000 UTC m=+142.112250257" watchObservedRunningTime="2026-07-01 17:18:32.080471543 +0000 UTC m=+142.112468805" Jul 01 17:18:36.068966 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:36.068917 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6b597b858-99q2h" Jul 01 17:18:38.885485 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:38.885441 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6785cb48b6-t98mr" Jul 01 17:18:38.885991 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:38.885517 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6785cb48b6-t98mr" Jul 01 17:18:38.890450 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:38.890425 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6785cb48b6-t98mr" Jul 01 17:18:39.080465 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:39.080431 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6785cb48b6-t98mr" Jul 01 17:18:39.127316 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:39.127277 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f574b7957-c26kt"] Jul 01 17:18:48.054061 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:48.054018 2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5674d46676-b7vkh" podUID="120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9" containerName="console" containerID="cri-o://edef8fd9d841f1f5e7696d3f06b4c1209f5f73e52a7a88df41036cad2bbb4784" gracePeriod=15 Jul 01 17:18:48.298589 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:48.298558 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5674d46676-b7vkh" Jul 01 17:18:48.408008 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:48.407886 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9-service-ca\") pod \"120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9\" (UID: \"120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9\") " Jul 01 17:18:48.408008 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:48.407993 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9-console-oauth-config\") pod \"120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9\" (UID: \"120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9\") " Jul 01 17:18:48.408238 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:48.408015 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9-oauth-serving-cert\") pod \"120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9\" (UID: \"120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9\") " Jul 01 17:18:48.408238 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:48.408043 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9-console-serving-cert\") pod \"120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9\" (UID: \"120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9\") " Jul 01 17:18:48.408238 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:48.408074 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6fjl9\" (UniqueName: \"kubernetes.io/projected/120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9-kube-api-access-6fjl9\") pod \"120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9\" (UID: \"120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9\") " Jul 01 17:18:48.408238 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:48.408111 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9-console-config\") pod \"120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9\" (UID: \"120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9\") " Jul 01 17:18:48.408487 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:48.408458 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9-service-ca" (OuterVolumeSpecName: "service-ca") pod "120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9" (UID: "120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:18:48.408487 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:48.408477 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9" (UID: "120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:18:48.408665 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:48.408561 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9-console-config" (OuterVolumeSpecName: "console-config") pod "120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9" (UID: "120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:18:48.410536 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:48.410512 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9" (UID: "120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:18:48.410624 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:48.410587 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9-kube-api-access-6fjl9" (OuterVolumeSpecName: "kube-api-access-6fjl9") pod "120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9" (UID: "120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9"). InnerVolumeSpecName "kube-api-access-6fjl9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:18:48.410624 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:48.410607 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9" (UID: "120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:18:48.449601 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:48.449566 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-746496b7bc-7b74v" Jul 01 17:18:48.449729 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:48.449651 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-746496b7bc-7b74v" Jul 01 17:18:48.509271 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:48.509238 2547 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9-console-oauth-config\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:18:48.509271 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:48.509266 2547 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9-oauth-serving-cert\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:18:48.509271 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:48.509276 2547 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9-console-serving-cert\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:18:48.509498 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:48.509285 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6fjl9\" (UniqueName: \"kubernetes.io/projected/120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9-kube-api-access-6fjl9\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:18:48.509498 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:48.509296 2547 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9-console-config\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:18:48.509498 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:48.509305 2547 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9-service-ca\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:18:49.118930 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:49.118892 2547 generic.go:356] "Generic (PLEG): container finished" podID="120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9" containerID="edef8fd9d841f1f5e7696d3f06b4c1209f5f73e52a7a88df41036cad2bbb4784" exitCode=0 Jul 01 17:18:49.119413 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:49.118974 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5674d46676-b7vkh" Jul 01 17:18:49.119413 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:49.118975 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5674d46676-b7vkh" event={"ID":"120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9","Type":"ContainerDied","Data":"edef8fd9d841f1f5e7696d3f06b4c1209f5f73e52a7a88df41036cad2bbb4784"} Jul 01 17:18:49.119413 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:49.119029 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5674d46676-b7vkh" event={"ID":"120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9","Type":"ContainerDied","Data":"8cf5bcd4543178cf0f81f3ee131b69f5a54dc7c028ebb55796f1be28fb1d5d55"} Jul 01 17:18:49.119413 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:49.119050 2547 scope.go:117] "RemoveContainer" containerID="edef8fd9d841f1f5e7696d3f06b4c1209f5f73e52a7a88df41036cad2bbb4784" Jul 01 17:18:49.127867 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:49.127846 2547 scope.go:117] "RemoveContainer" containerID="edef8fd9d841f1f5e7696d3f06b4c1209f5f73e52a7a88df41036cad2bbb4784" Jul 01 17:18:49.128179 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:18:49.128158 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edef8fd9d841f1f5e7696d3f06b4c1209f5f73e52a7a88df41036cad2bbb4784\": container with ID starting with edef8fd9d841f1f5e7696d3f06b4c1209f5f73e52a7a88df41036cad2bbb4784 not found: ID does not exist" containerID="edef8fd9d841f1f5e7696d3f06b4c1209f5f73e52a7a88df41036cad2bbb4784" Jul 01 17:18:49.128240 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:49.128188 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edef8fd9d841f1f5e7696d3f06b4c1209f5f73e52a7a88df41036cad2bbb4784"} err="failed to get container status \"edef8fd9d841f1f5e7696d3f06b4c1209f5f73e52a7a88df41036cad2bbb4784\": rpc error: code = NotFound desc = could not find container \"edef8fd9d841f1f5e7696d3f06b4c1209f5f73e52a7a88df41036cad2bbb4784\": container with ID starting with edef8fd9d841f1f5e7696d3f06b4c1209f5f73e52a7a88df41036cad2bbb4784 not found: ID does not exist" Jul 01 17:18:49.138266 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:49.138239 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5674d46676-b7vkh"] Jul 01 17:18:49.141405 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:49.141383 2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5674d46676-b7vkh"] Jul 01 17:18:50.424886 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:18:50.424846 2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9" path="/var/lib/kubelet/pods/120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9/volumes" Jul 01 17:19:04.155538 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:04.155441 2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5f574b7957-c26kt" podUID="ef840556-8d22-4c83-8c8f-3ed7a4b056f7" containerName="console" containerID="cri-o://43591b3005b69773c46314ff719890413bc38078464f0da07b7adac950351c4c" gracePeriod=15 Jul 01 17:19:04.405634 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:04.405564 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f574b7957-c26kt" Jul 01 17:19:04.441283 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:04.441250 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ef840556-8d22-4c83-8c8f-3ed7a4b056f7-console-config\") pod \"ef840556-8d22-4c83-8c8f-3ed7a4b056f7\" (UID: \"ef840556-8d22-4c83-8c8f-3ed7a4b056f7\") " Jul 01 17:19:04.441481 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:04.441304 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ef840556-8d22-4c83-8c8f-3ed7a4b056f7-oauth-serving-cert\") pod \"ef840556-8d22-4c83-8c8f-3ed7a4b056f7\" (UID: \"ef840556-8d22-4c83-8c8f-3ed7a4b056f7\") " Jul 01 17:19:04.441481 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:04.441327 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dcnbc\" (UniqueName: \"kubernetes.io/projected/ef840556-8d22-4c83-8c8f-3ed7a4b056f7-kube-api-access-dcnbc\") pod \"ef840556-8d22-4c83-8c8f-3ed7a4b056f7\" (UID: \"ef840556-8d22-4c83-8c8f-3ed7a4b056f7\") " Jul 01 17:19:04.441481 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:04.441352 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ef840556-8d22-4c83-8c8f-3ed7a4b056f7-console-serving-cert\") pod \"ef840556-8d22-4c83-8c8f-3ed7a4b056f7\" (UID: \"ef840556-8d22-4c83-8c8f-3ed7a4b056f7\") " Jul 01 17:19:04.441606 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:04.441478 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef840556-8d22-4c83-8c8f-3ed7a4b056f7-trusted-ca-bundle\") pod \"ef840556-8d22-4c83-8c8f-3ed7a4b056f7\" (UID: \"ef840556-8d22-4c83-8c8f-3ed7a4b056f7\") " Jul 01 17:19:04.441792 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:04.441761 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef840556-8d22-4c83-8c8f-3ed7a4b056f7-console-config" (OuterVolumeSpecName: "console-config") pod "ef840556-8d22-4c83-8c8f-3ed7a4b056f7" (UID: "ef840556-8d22-4c83-8c8f-3ed7a4b056f7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:19:04.441940 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:04.441829 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef840556-8d22-4c83-8c8f-3ed7a4b056f7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ef840556-8d22-4c83-8c8f-3ed7a4b056f7" (UID: "ef840556-8d22-4c83-8c8f-3ed7a4b056f7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:19:04.441940 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:04.441922 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef840556-8d22-4c83-8c8f-3ed7a4b056f7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ef840556-8d22-4c83-8c8f-3ed7a4b056f7" (UID: "ef840556-8d22-4c83-8c8f-3ed7a4b056f7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:19:04.443859 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:04.443832 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef840556-8d22-4c83-8c8f-3ed7a4b056f7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ef840556-8d22-4c83-8c8f-3ed7a4b056f7" (UID: "ef840556-8d22-4c83-8c8f-3ed7a4b056f7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:19:04.443984 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:04.443920 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef840556-8d22-4c83-8c8f-3ed7a4b056f7-kube-api-access-dcnbc" (OuterVolumeSpecName: "kube-api-access-dcnbc") pod "ef840556-8d22-4c83-8c8f-3ed7a4b056f7" (UID: "ef840556-8d22-4c83-8c8f-3ed7a4b056f7"). InnerVolumeSpecName "kube-api-access-dcnbc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:19:04.542533 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:04.542475 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ef840556-8d22-4c83-8c8f-3ed7a4b056f7-console-oauth-config\") pod \"ef840556-8d22-4c83-8c8f-3ed7a4b056f7\" (UID: \"ef840556-8d22-4c83-8c8f-3ed7a4b056f7\") " Jul 01 17:19:04.542533 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:04.542539 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ef840556-8d22-4c83-8c8f-3ed7a4b056f7-service-ca\") pod \"ef840556-8d22-4c83-8c8f-3ed7a4b056f7\" (UID: \"ef840556-8d22-4c83-8c8f-3ed7a4b056f7\") " Jul 01 17:19:04.542753 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:04.542735 2547 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ef840556-8d22-4c83-8c8f-3ed7a4b056f7-console-config\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:19:04.542788 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:04.542753 2547 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ef840556-8d22-4c83-8c8f-3ed7a4b056f7-oauth-serving-cert\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:19:04.542788 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:04.542767 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dcnbc\" (UniqueName: \"kubernetes.io/projected/ef840556-8d22-4c83-8c8f-3ed7a4b056f7-kube-api-access-dcnbc\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:19:04.542788 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:04.542781 2547 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ef840556-8d22-4c83-8c8f-3ed7a4b056f7-console-serving-cert\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:19:04.542880 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:04.542794 2547 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef840556-8d22-4c83-8c8f-3ed7a4b056f7-trusted-ca-bundle\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:19:04.542880 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:04.542850 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef840556-8d22-4c83-8c8f-3ed7a4b056f7-service-ca" (OuterVolumeSpecName: "service-ca") pod "ef840556-8d22-4c83-8c8f-3ed7a4b056f7" (UID: "ef840556-8d22-4c83-8c8f-3ed7a4b056f7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:19:04.544900 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:04.544879 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef840556-8d22-4c83-8c8f-3ed7a4b056f7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ef840556-8d22-4c83-8c8f-3ed7a4b056f7" (UID: "ef840556-8d22-4c83-8c8f-3ed7a4b056f7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:19:04.644000 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:04.643942 2547 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ef840556-8d22-4c83-8c8f-3ed7a4b056f7-console-oauth-config\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:19:04.644000 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:04.643995 2547 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ef840556-8d22-4c83-8c8f-3ed7a4b056f7-service-ca\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:19:05.189015 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:05.188974 2547 generic.go:356] "Generic (PLEG): container finished" podID="ef840556-8d22-4c83-8c8f-3ed7a4b056f7" containerID="43591b3005b69773c46314ff719890413bc38078464f0da07b7adac950351c4c" exitCode=0 Jul 01 17:19:05.189404 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:05.189029 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f574b7957-c26kt" Jul 01 17:19:05.189404 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:05.189049 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f574b7957-c26kt" event={"ID":"ef840556-8d22-4c83-8c8f-3ed7a4b056f7","Type":"ContainerDied","Data":"43591b3005b69773c46314ff719890413bc38078464f0da07b7adac950351c4c"} Jul 01 17:19:05.189404 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:05.189142 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f574b7957-c26kt" event={"ID":"ef840556-8d22-4c83-8c8f-3ed7a4b056f7","Type":"ContainerDied","Data":"0c93f5d82ea01fe193a72c2f69e74f3432cecfeb3439f09e5496ad5e03d81ae8"} Jul 01 17:19:05.189404 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:05.189166 2547 scope.go:117] "RemoveContainer" containerID="43591b3005b69773c46314ff719890413bc38078464f0da07b7adac950351c4c" Jul 01 17:19:05.197939 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:05.197921 2547 scope.go:117] "RemoveContainer" containerID="43591b3005b69773c46314ff719890413bc38078464f0da07b7adac950351c4c" Jul 01 17:19:05.198276 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:19:05.198255 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43591b3005b69773c46314ff719890413bc38078464f0da07b7adac950351c4c\": container with ID starting with 43591b3005b69773c46314ff719890413bc38078464f0da07b7adac950351c4c not found: ID does not exist" containerID="43591b3005b69773c46314ff719890413bc38078464f0da07b7adac950351c4c" Jul 01 17:19:05.198346 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:05.198290 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43591b3005b69773c46314ff719890413bc38078464f0da07b7adac950351c4c"} err="failed to get container status \"43591b3005b69773c46314ff719890413bc38078464f0da07b7adac950351c4c\": rpc error: code = NotFound desc = could not find container \"43591b3005b69773c46314ff719890413bc38078464f0da07b7adac950351c4c\": container with ID starting with 43591b3005b69773c46314ff719890413bc38078464f0da07b7adac950351c4c not found: ID does not exist" Jul 01 17:19:05.210580 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:05.210546 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f574b7957-c26kt"] Jul 01 17:19:05.214214 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:05.214187 2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f574b7957-c26kt"] Jul 01 17:19:06.423851 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:06.423811 2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef840556-8d22-4c83-8c8f-3ed7a4b056f7" path="/var/lib/kubelet/pods/ef840556-8d22-4c83-8c8f-3ed7a4b056f7/volumes" Jul 01 17:19:08.457019 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:08.456933 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-746496b7bc-7b74v" Jul 01 17:19:08.462978 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:08.462916 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-746496b7bc-7b74v" Jul 01 17:19:43.904233 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:43.904193 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 17:19:43.904857 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:43.904549 2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2fa540db-1ef6-4507-a7ed-407fe58c6223" containerName="alertmanager" containerID="cri-o://f2e4acefc487d755d9f063def535777e83d9bb4a754013d49df52b90bad33eaa" gracePeriod=120 Jul 01 17:19:43.904857 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:43.904605 2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2fa540db-1ef6-4507-a7ed-407fe58c6223" containerName="kube-rbac-proxy-metric" containerID="cri-o://ca4eb833eccbd7a3bdf6e70a5e10124399c3fc4ef940f8a47a7ed533fa39de6a" gracePeriod=120 Jul 01 17:19:43.904857 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:43.904612 2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2fa540db-1ef6-4507-a7ed-407fe58c6223" containerName="kube-rbac-proxy-web" containerID="cri-o://fcb9a2ac7d5361e039e321fe93534b9d3feee632b45e4978a0e47ed637509f67" gracePeriod=120 Jul 01 17:19:43.905140 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:43.904842 2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2fa540db-1ef6-4507-a7ed-407fe58c6223" containerName="kube-rbac-proxy" containerID="cri-o://6c5b2f6a638c80469f3ad449a5344f1eaeb66b4d0bf4ef50ed06a4e3a3039329" gracePeriod=120 Jul 01 17:19:43.905578 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:43.905269 2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2fa540db-1ef6-4507-a7ed-407fe58c6223" containerName="config-reloader" containerID="cri-o://997f0cabc58b1f9ce1f9cc053359e9458b19cffd81e63716606465e3622c6caf" gracePeriod=120 Jul 01 17:19:43.905578 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:43.905376 2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2fa540db-1ef6-4507-a7ed-407fe58c6223" containerName="prom-label-proxy" containerID="cri-o://1b965f0a6ba3ce16635783dc14f2ab047adb279c60c1e5726b996ad402320f92" gracePeriod=120 Jul 01 17:19:44.350373 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:44.350326 2547 generic.go:356] "Generic (PLEG): container finished" podID="2fa540db-1ef6-4507-a7ed-407fe58c6223" containerID="1b965f0a6ba3ce16635783dc14f2ab047adb279c60c1e5726b996ad402320f92" exitCode=0 Jul 01 17:19:44.350373 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:44.350354 2547 generic.go:356] "Generic (PLEG): container finished" podID="2fa540db-1ef6-4507-a7ed-407fe58c6223" containerID="6c5b2f6a638c80469f3ad449a5344f1eaeb66b4d0bf4ef50ed06a4e3a3039329" exitCode=0 Jul 01 17:19:44.350373 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:44.350362 2547 generic.go:356] "Generic (PLEG): container finished" podID="2fa540db-1ef6-4507-a7ed-407fe58c6223" containerID="997f0cabc58b1f9ce1f9cc053359e9458b19cffd81e63716606465e3622c6caf" exitCode=0 Jul 01 17:19:44.350373 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:44.350370 2547 generic.go:356] "Generic (PLEG): container finished" podID="2fa540db-1ef6-4507-a7ed-407fe58c6223" containerID="f2e4acefc487d755d9f063def535777e83d9bb4a754013d49df52b90bad33eaa" exitCode=0 Jul 01 17:19:44.350653 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:44.350393 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fa540db-1ef6-4507-a7ed-407fe58c6223","Type":"ContainerDied","Data":"1b965f0a6ba3ce16635783dc14f2ab047adb279c60c1e5726b996ad402320f92"} Jul 01 17:19:44.350653 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:44.350493 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fa540db-1ef6-4507-a7ed-407fe58c6223","Type":"ContainerDied","Data":"6c5b2f6a638c80469f3ad449a5344f1eaeb66b4d0bf4ef50ed06a4e3a3039329"} Jul 01 17:19:44.350653 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:44.350519 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fa540db-1ef6-4507-a7ed-407fe58c6223","Type":"ContainerDied","Data":"997f0cabc58b1f9ce1f9cc053359e9458b19cffd81e63716606465e3622c6caf"} Jul 01 17:19:44.350653 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:44.350545 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fa540db-1ef6-4507-a7ed-407fe58c6223","Type":"ContainerDied","Data":"f2e4acefc487d755d9f063def535777e83d9bb4a754013d49df52b90bad33eaa"} Jul 01 17:19:45.178405 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.178377 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:19:45.315478 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.315439 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fa540db-1ef6-4507-a7ed-407fe58c6223-metrics-client-ca\") pod \"2fa540db-1ef6-4507-a7ed-407fe58c6223\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " Jul 01 17:19:45.315478 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.315482 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2fa540db-1ef6-4507-a7ed-407fe58c6223-web-config\") pod \"2fa540db-1ef6-4507-a7ed-407fe58c6223\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " Jul 01 17:19:45.315760 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.315504 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fa540db-1ef6-4507-a7ed-407fe58c6223-alertmanager-trusted-ca-bundle\") pod \"2fa540db-1ef6-4507-a7ed-407fe58c6223\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " Jul 01 17:19:45.315760 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.315532 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6874z\" (UniqueName: \"kubernetes.io/projected/2fa540db-1ef6-4507-a7ed-407fe58c6223-kube-api-access-6874z\") pod \"2fa540db-1ef6-4507-a7ed-407fe58c6223\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " Jul 01 17:19:45.315760 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.315551 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2fa540db-1ef6-4507-a7ed-407fe58c6223-secret-alertmanager-kube-rbac-proxy-web\") pod \"2fa540db-1ef6-4507-a7ed-407fe58c6223\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " Jul 01 17:19:45.315760 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.315572 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2fa540db-1ef6-4507-a7ed-407fe58c6223-cluster-tls-config\") pod \"2fa540db-1ef6-4507-a7ed-407fe58c6223\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " Jul 01 17:19:45.315760 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.315725 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2fa540db-1ef6-4507-a7ed-407fe58c6223-secret-alertmanager-kube-rbac-proxy\") pod \"2fa540db-1ef6-4507-a7ed-407fe58c6223\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " Jul 01 17:19:45.316053 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.315768 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2fa540db-1ef6-4507-a7ed-407fe58c6223-secret-alertmanager-main-tls\") pod \"2fa540db-1ef6-4507-a7ed-407fe58c6223\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " Jul 01 17:19:45.316053 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.315808 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2fa540db-1ef6-4507-a7ed-407fe58c6223-alertmanager-main-db\") pod \"2fa540db-1ef6-4507-a7ed-407fe58c6223\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " Jul 01 17:19:45.316053 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.315863 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2fa540db-1ef6-4507-a7ed-407fe58c6223-tls-assets\") pod \"2fa540db-1ef6-4507-a7ed-407fe58c6223\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " Jul 01 17:19:45.316053 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.315874 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fa540db-1ef6-4507-a7ed-407fe58c6223-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "2fa540db-1ef6-4507-a7ed-407fe58c6223" (UID: "2fa540db-1ef6-4507-a7ed-407fe58c6223"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:19:45.316053 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.315893 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2fa540db-1ef6-4507-a7ed-407fe58c6223-secret-alertmanager-kube-rbac-proxy-metric\") pod \"2fa540db-1ef6-4507-a7ed-407fe58c6223\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " Jul 01 17:19:45.316053 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.315925 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2fa540db-1ef6-4507-a7ed-407fe58c6223-config-volume\") pod \"2fa540db-1ef6-4507-a7ed-407fe58c6223\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " Jul 01 17:19:45.316053 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.315974 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2fa540db-1ef6-4507-a7ed-407fe58c6223-config-out\") pod \"2fa540db-1ef6-4507-a7ed-407fe58c6223\" (UID: \"2fa540db-1ef6-4507-a7ed-407fe58c6223\") " Jul 01 17:19:45.316053 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.315986 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fa540db-1ef6-4507-a7ed-407fe58c6223-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "2fa540db-1ef6-4507-a7ed-407fe58c6223" (UID: "2fa540db-1ef6-4507-a7ed-407fe58c6223"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:19:45.316446 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.316240 2547 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fa540db-1ef6-4507-a7ed-407fe58c6223-metrics-client-ca\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:19:45.316446 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.316260 2547 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fa540db-1ef6-4507-a7ed-407fe58c6223-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:19:45.316446 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.316255 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fa540db-1ef6-4507-a7ed-407fe58c6223-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "2fa540db-1ef6-4507-a7ed-407fe58c6223" (UID: "2fa540db-1ef6-4507-a7ed-407fe58c6223"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 17:19:45.318683 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.318642 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fa540db-1ef6-4507-a7ed-407fe58c6223-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "2fa540db-1ef6-4507-a7ed-407fe58c6223" (UID: "2fa540db-1ef6-4507-a7ed-407fe58c6223"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:19:45.318683 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.318643 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fa540db-1ef6-4507-a7ed-407fe58c6223-kube-api-access-6874z" (OuterVolumeSpecName: "kube-api-access-6874z") pod "2fa540db-1ef6-4507-a7ed-407fe58c6223" (UID: "2fa540db-1ef6-4507-a7ed-407fe58c6223"). InnerVolumeSpecName "kube-api-access-6874z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:19:45.319082 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.319023 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fa540db-1ef6-4507-a7ed-407fe58c6223-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "2fa540db-1ef6-4507-a7ed-407fe58c6223" (UID: "2fa540db-1ef6-4507-a7ed-407fe58c6223"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:19:45.319510 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.319470 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fa540db-1ef6-4507-a7ed-407fe58c6223-config-out" (OuterVolumeSpecName: "config-out") pod "2fa540db-1ef6-4507-a7ed-407fe58c6223" (UID: "2fa540db-1ef6-4507-a7ed-407fe58c6223"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 17:19:45.319699 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.319669 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fa540db-1ef6-4507-a7ed-407fe58c6223-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "2fa540db-1ef6-4507-a7ed-407fe58c6223" (UID: "2fa540db-1ef6-4507-a7ed-407fe58c6223"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:19:45.319777 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.319752 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fa540db-1ef6-4507-a7ed-407fe58c6223-config-volume" (OuterVolumeSpecName: "config-volume") pod "2fa540db-1ef6-4507-a7ed-407fe58c6223" (UID: "2fa540db-1ef6-4507-a7ed-407fe58c6223"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:19:45.320593 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.320569 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fa540db-1ef6-4507-a7ed-407fe58c6223-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "2fa540db-1ef6-4507-a7ed-407fe58c6223" (UID: "2fa540db-1ef6-4507-a7ed-407fe58c6223"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:19:45.320690 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.320654 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fa540db-1ef6-4507-a7ed-407fe58c6223-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "2fa540db-1ef6-4507-a7ed-407fe58c6223" (UID: "2fa540db-1ef6-4507-a7ed-407fe58c6223"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:19:45.324456 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.324431 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fa540db-1ef6-4507-a7ed-407fe58c6223-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "2fa540db-1ef6-4507-a7ed-407fe58c6223" (UID: "2fa540db-1ef6-4507-a7ed-407fe58c6223"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:19:45.331468 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.331440 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fa540db-1ef6-4507-a7ed-407fe58c6223-web-config" (OuterVolumeSpecName: "web-config") pod "2fa540db-1ef6-4507-a7ed-407fe58c6223" (UID: "2fa540db-1ef6-4507-a7ed-407fe58c6223"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:19:45.357117 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.357083 2547 generic.go:356] "Generic (PLEG): container finished" podID="2fa540db-1ef6-4507-a7ed-407fe58c6223" containerID="ca4eb833eccbd7a3bdf6e70a5e10124399c3fc4ef940f8a47a7ed533fa39de6a" exitCode=0 Jul 01 17:19:45.357117 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.357109 2547 generic.go:356] "Generic (PLEG): container finished" podID="2fa540db-1ef6-4507-a7ed-407fe58c6223" containerID="fcb9a2ac7d5361e039e321fe93534b9d3feee632b45e4978a0e47ed637509f67" exitCode=0 Jul 01 17:19:45.357314 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.357129 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fa540db-1ef6-4507-a7ed-407fe58c6223","Type":"ContainerDied","Data":"ca4eb833eccbd7a3bdf6e70a5e10124399c3fc4ef940f8a47a7ed533fa39de6a"} Jul 01 17:19:45.357314 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.357192 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fa540db-1ef6-4507-a7ed-407fe58c6223","Type":"ContainerDied","Data":"fcb9a2ac7d5361e039e321fe93534b9d3feee632b45e4978a0e47ed637509f67"} Jul 01 17:19:45.357314 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.357196 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:19:45.357314 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.357219 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fa540db-1ef6-4507-a7ed-407fe58c6223","Type":"ContainerDied","Data":"3ae78042dc3aea0db814390a82c4d18ddf88bb164b396605527f85e13c842d65"} Jul 01 17:19:45.357314 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.357252 2547 scope.go:117] "RemoveContainer" containerID="1b965f0a6ba3ce16635783dc14f2ab047adb279c60c1e5726b996ad402320f92" Jul 01 17:19:45.365709 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.365690 2547 scope.go:117] "RemoveContainer" containerID="ca4eb833eccbd7a3bdf6e70a5e10124399c3fc4ef940f8a47a7ed533fa39de6a" Jul 01 17:19:45.373374 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.373353 2547 scope.go:117] "RemoveContainer" containerID="6c5b2f6a638c80469f3ad449a5344f1eaeb66b4d0bf4ef50ed06a4e3a3039329" Jul 01 17:19:45.381394 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.381371 2547 scope.go:117] "RemoveContainer" containerID="fcb9a2ac7d5361e039e321fe93534b9d3feee632b45e4978a0e47ed637509f67" Jul 01 17:19:45.382350 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.382331 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 17:19:45.385864 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.385838 2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 17:19:45.389627 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.389609 2547 scope.go:117] "RemoveContainer" containerID="997f0cabc58b1f9ce1f9cc053359e9458b19cffd81e63716606465e3622c6caf" Jul 01 17:19:45.397852 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.397831 2547 scope.go:117] "RemoveContainer" containerID="f2e4acefc487d755d9f063def535777e83d9bb4a754013d49df52b90bad33eaa" Jul 01 17:19:45.406141 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.406118 2547 scope.go:117] "RemoveContainer" containerID="21c32c767562a2d337bffb1cf85bb451599105bd34ac56fe5727c56a6272190d" Jul 01 17:19:45.413707 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.413680 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 17:19:45.414076 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.414060 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fa540db-1ef6-4507-a7ed-407fe58c6223" containerName="alertmanager" Jul 01 17:19:45.414187 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.414081 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fa540db-1ef6-4507-a7ed-407fe58c6223" containerName="alertmanager" Jul 01 17:19:45.414187 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.414094 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fa540db-1ef6-4507-a7ed-407fe58c6223" containerName="prom-label-proxy" Jul 01 17:19:45.414187 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.414102 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fa540db-1ef6-4507-a7ed-407fe58c6223" containerName="prom-label-proxy" Jul 01 17:19:45.414187 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.414114 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fa540db-1ef6-4507-a7ed-407fe58c6223" containerName="init-config-reloader" Jul 01 17:19:45.414187 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.414123 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fa540db-1ef6-4507-a7ed-407fe58c6223" containerName="init-config-reloader" Jul 01 17:19:45.414187 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.414132 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fa540db-1ef6-4507-a7ed-407fe58c6223" containerName="kube-rbac-proxy-web" Jul 01 17:19:45.414187 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.414142 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fa540db-1ef6-4507-a7ed-407fe58c6223" containerName="kube-rbac-proxy-web" Jul 01 17:19:45.414187 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.414156 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9" containerName="console" Jul 01 17:19:45.414187 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.414165 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9" containerName="console" Jul 01 17:19:45.414187 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.414183 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef840556-8d22-4c83-8c8f-3ed7a4b056f7" containerName="console" Jul 01 17:19:45.414668 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.414194 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef840556-8d22-4c83-8c8f-3ed7a4b056f7" containerName="console" Jul 01 17:19:45.414668 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.414205 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fa540db-1ef6-4507-a7ed-407fe58c6223" containerName="kube-rbac-proxy-metric" Jul 01 17:19:45.414668 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.414214 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fa540db-1ef6-4507-a7ed-407fe58c6223" containerName="kube-rbac-proxy-metric" Jul 01 17:19:45.414668 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.414226 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fa540db-1ef6-4507-a7ed-407fe58c6223" containerName="kube-rbac-proxy" Jul 01 17:19:45.414668 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.414234 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fa540db-1ef6-4507-a7ed-407fe58c6223" containerName="kube-rbac-proxy" Jul 01 17:19:45.414668 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.414247 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fa540db-1ef6-4507-a7ed-407fe58c6223" containerName="config-reloader" Jul 01 17:19:45.414668 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.414255 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fa540db-1ef6-4507-a7ed-407fe58c6223" containerName="config-reloader" Jul 01 17:19:45.414668 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.414327 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fa540db-1ef6-4507-a7ed-407fe58c6223" containerName="prom-label-proxy" Jul 01 17:19:45.414668 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.414340 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef840556-8d22-4c83-8c8f-3ed7a4b056f7" containerName="console" Jul 01 17:19:45.414668 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.414349 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fa540db-1ef6-4507-a7ed-407fe58c6223" containerName="kube-rbac-proxy-web" Jul 01 17:19:45.414668 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.414358 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fa540db-1ef6-4507-a7ed-407fe58c6223" containerName="kube-rbac-proxy" Jul 01 17:19:45.414668 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.414368 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fa540db-1ef6-4507-a7ed-407fe58c6223" containerName="alertmanager" Jul 01 17:19:45.414668 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.414379 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="120d9dff-9034-4b6e-a2b7-fd69cc2eb5a9" containerName="console" Jul 01 17:19:45.414668 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.414388 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fa540db-1ef6-4507-a7ed-407fe58c6223" containerName="config-reloader" Jul 01 17:19:45.414668 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.414397 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fa540db-1ef6-4507-a7ed-407fe58c6223" containerName="kube-rbac-proxy-metric" Jul 01 17:19:45.414668 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.414549 2547 scope.go:117] "RemoveContainer" containerID="1b965f0a6ba3ce16635783dc14f2ab047adb279c60c1e5726b996ad402320f92" Jul 01 17:19:45.415455 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:19:45.414891 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b965f0a6ba3ce16635783dc14f2ab047adb279c60c1e5726b996ad402320f92\": container with ID starting with 1b965f0a6ba3ce16635783dc14f2ab047adb279c60c1e5726b996ad402320f92 not found: ID does not exist" containerID="1b965f0a6ba3ce16635783dc14f2ab047adb279c60c1e5726b996ad402320f92" Jul 01 17:19:45.415455 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.414915 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b965f0a6ba3ce16635783dc14f2ab047adb279c60c1e5726b996ad402320f92"} err="failed to get container status \"1b965f0a6ba3ce16635783dc14f2ab047adb279c60c1e5726b996ad402320f92\": rpc error: code = NotFound desc = could not find container \"1b965f0a6ba3ce16635783dc14f2ab047adb279c60c1e5726b996ad402320f92\": container with ID starting with 1b965f0a6ba3ce16635783dc14f2ab047adb279c60c1e5726b996ad402320f92 not found: ID does not exist" Jul 01 17:19:45.415455 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.414933 2547 scope.go:117] "RemoveContainer" containerID="ca4eb833eccbd7a3bdf6e70a5e10124399c3fc4ef940f8a47a7ed533fa39de6a" Jul 01 17:19:45.415455 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:19:45.415213 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca4eb833eccbd7a3bdf6e70a5e10124399c3fc4ef940f8a47a7ed533fa39de6a\": container with ID starting with ca4eb833eccbd7a3bdf6e70a5e10124399c3fc4ef940f8a47a7ed533fa39de6a not found: ID does not exist" containerID="ca4eb833eccbd7a3bdf6e70a5e10124399c3fc4ef940f8a47a7ed533fa39de6a" Jul 01 17:19:45.415455 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.415239 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca4eb833eccbd7a3bdf6e70a5e10124399c3fc4ef940f8a47a7ed533fa39de6a"} err="failed to get container status \"ca4eb833eccbd7a3bdf6e70a5e10124399c3fc4ef940f8a47a7ed533fa39de6a\": rpc error: code = NotFound desc = could not find container \"ca4eb833eccbd7a3bdf6e70a5e10124399c3fc4ef940f8a47a7ed533fa39de6a\": container with ID starting with ca4eb833eccbd7a3bdf6e70a5e10124399c3fc4ef940f8a47a7ed533fa39de6a not found: ID does not exist" Jul 01 17:19:45.415455 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.415255 2547 scope.go:117] "RemoveContainer" containerID="6c5b2f6a638c80469f3ad449a5344f1eaeb66b4d0bf4ef50ed06a4e3a3039329" Jul 01 17:19:45.415728 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:19:45.415453 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c5b2f6a638c80469f3ad449a5344f1eaeb66b4d0bf4ef50ed06a4e3a3039329\": container with ID starting with 6c5b2f6a638c80469f3ad449a5344f1eaeb66b4d0bf4ef50ed06a4e3a3039329 not found: ID does not exist" containerID="6c5b2f6a638c80469f3ad449a5344f1eaeb66b4d0bf4ef50ed06a4e3a3039329" Jul 01 17:19:45.415728 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.415475 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c5b2f6a638c80469f3ad449a5344f1eaeb66b4d0bf4ef50ed06a4e3a3039329"} err="failed to get container status \"6c5b2f6a638c80469f3ad449a5344f1eaeb66b4d0bf4ef50ed06a4e3a3039329\": rpc error: code = NotFound desc = could not find container \"6c5b2f6a638c80469f3ad449a5344f1eaeb66b4d0bf4ef50ed06a4e3a3039329\": container with ID starting with 6c5b2f6a638c80469f3ad449a5344f1eaeb66b4d0bf4ef50ed06a4e3a3039329 not found: ID does not exist" Jul 01 17:19:45.415728 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.415487 2547 scope.go:117] "RemoveContainer" containerID="fcb9a2ac7d5361e039e321fe93534b9d3feee632b45e4978a0e47ed637509f67" Jul 01 17:19:45.415728 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:19:45.415688 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fcb9a2ac7d5361e039e321fe93534b9d3feee632b45e4978a0e47ed637509f67\": container with ID starting with fcb9a2ac7d5361e039e321fe93534b9d3feee632b45e4978a0e47ed637509f67 not found: ID does not exist" containerID="fcb9a2ac7d5361e039e321fe93534b9d3feee632b45e4978a0e47ed637509f67" Jul 01 17:19:45.415728 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.415706 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcb9a2ac7d5361e039e321fe93534b9d3feee632b45e4978a0e47ed637509f67"} err="failed to get container status \"fcb9a2ac7d5361e039e321fe93534b9d3feee632b45e4978a0e47ed637509f67\": rpc error: code = NotFound desc = could not find container \"fcb9a2ac7d5361e039e321fe93534b9d3feee632b45e4978a0e47ed637509f67\": container with ID starting with fcb9a2ac7d5361e039e321fe93534b9d3feee632b45e4978a0e47ed637509f67 not found: ID does not exist" Jul 01 17:19:45.415728 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.415718 2547 scope.go:117] "RemoveContainer" containerID="997f0cabc58b1f9ce1f9cc053359e9458b19cffd81e63716606465e3622c6caf" Jul 01 17:19:45.416042 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:19:45.415930 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"997f0cabc58b1f9ce1f9cc053359e9458b19cffd81e63716606465e3622c6caf\": container with ID starting with 997f0cabc58b1f9ce1f9cc053359e9458b19cffd81e63716606465e3622c6caf not found: ID does not exist" containerID="997f0cabc58b1f9ce1f9cc053359e9458b19cffd81e63716606465e3622c6caf" Jul 01 17:19:45.416042 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.415972 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"997f0cabc58b1f9ce1f9cc053359e9458b19cffd81e63716606465e3622c6caf"} err="failed to get container status \"997f0cabc58b1f9ce1f9cc053359e9458b19cffd81e63716606465e3622c6caf\": rpc error: code = NotFound desc = could not find container \"997f0cabc58b1f9ce1f9cc053359e9458b19cffd81e63716606465e3622c6caf\": container with ID starting with 997f0cabc58b1f9ce1f9cc053359e9458b19cffd81e63716606465e3622c6caf not found: ID does not exist" Jul 01 17:19:45.416042 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.415990 2547 scope.go:117] "RemoveContainer" containerID="f2e4acefc487d755d9f063def535777e83d9bb4a754013d49df52b90bad33eaa" Jul 01 17:19:45.416231 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:19:45.416216 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2e4acefc487d755d9f063def535777e83d9bb4a754013d49df52b90bad33eaa\": container with ID starting with f2e4acefc487d755d9f063def535777e83d9bb4a754013d49df52b90bad33eaa not found: ID does not exist" containerID="f2e4acefc487d755d9f063def535777e83d9bb4a754013d49df52b90bad33eaa" Jul 01 17:19:45.416270 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.416234 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2e4acefc487d755d9f063def535777e83d9bb4a754013d49df52b90bad33eaa"} err="failed to get container status \"f2e4acefc487d755d9f063def535777e83d9bb4a754013d49df52b90bad33eaa\": rpc error: code = NotFound desc = could not find container \"f2e4acefc487d755d9f063def535777e83d9bb4a754013d49df52b90bad33eaa\": container with ID starting with f2e4acefc487d755d9f063def535777e83d9bb4a754013d49df52b90bad33eaa not found: ID does not exist" Jul 01 17:19:45.416270 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.416249 2547 scope.go:117] "RemoveContainer" containerID="21c32c767562a2d337bffb1cf85bb451599105bd34ac56fe5727c56a6272190d" Jul 01 17:19:45.416461 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:19:45.416444 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21c32c767562a2d337bffb1cf85bb451599105bd34ac56fe5727c56a6272190d\": container with ID starting with 21c32c767562a2d337bffb1cf85bb451599105bd34ac56fe5727c56a6272190d not found: ID does not exist" containerID="21c32c767562a2d337bffb1cf85bb451599105bd34ac56fe5727c56a6272190d" Jul 01 17:19:45.416497 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.416468 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21c32c767562a2d337bffb1cf85bb451599105bd34ac56fe5727c56a6272190d"} err="failed to get container status \"21c32c767562a2d337bffb1cf85bb451599105bd34ac56fe5727c56a6272190d\": rpc error: code = NotFound desc = could not find container \"21c32c767562a2d337bffb1cf85bb451599105bd34ac56fe5727c56a6272190d\": container with ID starting with 21c32c767562a2d337bffb1cf85bb451599105bd34ac56fe5727c56a6272190d not found: ID does not exist" Jul 01 17:19:45.416497 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.416484 2547 scope.go:117] "RemoveContainer" containerID="1b965f0a6ba3ce16635783dc14f2ab047adb279c60c1e5726b996ad402320f92" Jul 01 17:19:45.416611 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.416592 2547 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2fa540db-1ef6-4507-a7ed-407fe58c6223-web-config\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:19:45.416611 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.416612 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6874z\" (UniqueName: \"kubernetes.io/projected/2fa540db-1ef6-4507-a7ed-407fe58c6223-kube-api-access-6874z\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:19:45.416785 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.416629 2547 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2fa540db-1ef6-4507-a7ed-407fe58c6223-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:19:45.416785 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.416643 2547 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2fa540db-1ef6-4507-a7ed-407fe58c6223-cluster-tls-config\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:19:45.416785 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.416655 2547 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2fa540db-1ef6-4507-a7ed-407fe58c6223-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:19:45.416785 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.416668 2547 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2fa540db-1ef6-4507-a7ed-407fe58c6223-secret-alertmanager-main-tls\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:19:45.416785 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.416681 2547 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2fa540db-1ef6-4507-a7ed-407fe58c6223-alertmanager-main-db\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:19:45.416785 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.416681 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b965f0a6ba3ce16635783dc14f2ab047adb279c60c1e5726b996ad402320f92"} err="failed to get container status \"1b965f0a6ba3ce16635783dc14f2ab047adb279c60c1e5726b996ad402320f92\": rpc error: code = NotFound desc = could not find container \"1b965f0a6ba3ce16635783dc14f2ab047adb279c60c1e5726b996ad402320f92\": container with ID starting with 1b965f0a6ba3ce16635783dc14f2ab047adb279c60c1e5726b996ad402320f92 not found: ID does not exist" Jul 01 17:19:45.416785 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.416693 2547 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2fa540db-1ef6-4507-a7ed-407fe58c6223-tls-assets\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:19:45.416785 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.416697 2547 scope.go:117] "RemoveContainer" containerID="ca4eb833eccbd7a3bdf6e70a5e10124399c3fc4ef940f8a47a7ed533fa39de6a" Jul 01 17:19:45.416785 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.416707 2547 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2fa540db-1ef6-4507-a7ed-407fe58c6223-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:19:45.416785 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.416719 2547 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2fa540db-1ef6-4507-a7ed-407fe58c6223-config-volume\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:19:45.416785 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.416731 2547 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2fa540db-1ef6-4507-a7ed-407fe58c6223-config-out\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:19:45.417192 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.416909 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca4eb833eccbd7a3bdf6e70a5e10124399c3fc4ef940f8a47a7ed533fa39de6a"} err="failed to get container status \"ca4eb833eccbd7a3bdf6e70a5e10124399c3fc4ef940f8a47a7ed533fa39de6a\": rpc error: code = NotFound desc = could not find container \"ca4eb833eccbd7a3bdf6e70a5e10124399c3fc4ef940f8a47a7ed533fa39de6a\": container with ID starting with ca4eb833eccbd7a3bdf6e70a5e10124399c3fc4ef940f8a47a7ed533fa39de6a not found: ID does not exist" Jul 01 17:19:45.417192 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.416928 2547 scope.go:117] "RemoveContainer" containerID="6c5b2f6a638c80469f3ad449a5344f1eaeb66b4d0bf4ef50ed06a4e3a3039329" Jul 01 17:19:45.417263 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.417199 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c5b2f6a638c80469f3ad449a5344f1eaeb66b4d0bf4ef50ed06a4e3a3039329"} err="failed to get container status \"6c5b2f6a638c80469f3ad449a5344f1eaeb66b4d0bf4ef50ed06a4e3a3039329\": rpc error: code = NotFound desc = could not find container \"6c5b2f6a638c80469f3ad449a5344f1eaeb66b4d0bf4ef50ed06a4e3a3039329\": container with ID starting with 6c5b2f6a638c80469f3ad449a5344f1eaeb66b4d0bf4ef50ed06a4e3a3039329 not found: ID does not exist" Jul 01 17:19:45.417263 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.417213 2547 scope.go:117] "RemoveContainer" containerID="fcb9a2ac7d5361e039e321fe93534b9d3feee632b45e4978a0e47ed637509f67" Jul 01 17:19:45.417448 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.417431 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcb9a2ac7d5361e039e321fe93534b9d3feee632b45e4978a0e47ed637509f67"} err="failed to get container status \"fcb9a2ac7d5361e039e321fe93534b9d3feee632b45e4978a0e47ed637509f67\": rpc error: code = NotFound desc = could not find container \"fcb9a2ac7d5361e039e321fe93534b9d3feee632b45e4978a0e47ed637509f67\": container with ID starting with fcb9a2ac7d5361e039e321fe93534b9d3feee632b45e4978a0e47ed637509f67 not found: ID does not exist" Jul 01 17:19:45.417522 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.417450 2547 scope.go:117] "RemoveContainer" containerID="997f0cabc58b1f9ce1f9cc053359e9458b19cffd81e63716606465e3622c6caf" Jul 01 17:19:45.417687 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.417669 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"997f0cabc58b1f9ce1f9cc053359e9458b19cffd81e63716606465e3622c6caf"} err="failed to get container status \"997f0cabc58b1f9ce1f9cc053359e9458b19cffd81e63716606465e3622c6caf\": rpc error: code = NotFound desc = could not find container \"997f0cabc58b1f9ce1f9cc053359e9458b19cffd81e63716606465e3622c6caf\": container with ID starting with 997f0cabc58b1f9ce1f9cc053359e9458b19cffd81e63716606465e3622c6caf not found: ID does not exist" Jul 01 17:19:45.417736 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.417688 2547 scope.go:117] "RemoveContainer" containerID="f2e4acefc487d755d9f063def535777e83d9bb4a754013d49df52b90bad33eaa" Jul 01 17:19:45.417901 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.417884 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2e4acefc487d755d9f063def535777e83d9bb4a754013d49df52b90bad33eaa"} err="failed to get container status \"f2e4acefc487d755d9f063def535777e83d9bb4a754013d49df52b90bad33eaa\": rpc error: code = NotFound desc = could not find container \"f2e4acefc487d755d9f063def535777e83d9bb4a754013d49df52b90bad33eaa\": container with ID starting with f2e4acefc487d755d9f063def535777e83d9bb4a754013d49df52b90bad33eaa not found: ID does not exist" Jul 01 17:19:45.417967 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.417902 2547 scope.go:117] "RemoveContainer" containerID="21c32c767562a2d337bffb1cf85bb451599105bd34ac56fe5727c56a6272190d" Jul 01 17:19:45.418152 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.418135 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21c32c767562a2d337bffb1cf85bb451599105bd34ac56fe5727c56a6272190d"} err="failed to get container status \"21c32c767562a2d337bffb1cf85bb451599105bd34ac56fe5727c56a6272190d\": rpc error: code = NotFound desc = could not find container \"21c32c767562a2d337bffb1cf85bb451599105bd34ac56fe5727c56a6272190d\": container with ID starting with 21c32c767562a2d337bffb1cf85bb451599105bd34ac56fe5727c56a6272190d not found: ID does not exist" Jul 01 17:19:45.418964 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.418937 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:19:45.422605 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.422573 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 01 17:19:45.422845 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.422612 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 01 17:19:45.422845 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.422629 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 01 17:19:45.422845 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.422573 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 01 17:19:45.422845 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.422674 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 01 17:19:45.422845 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.422676 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 01 17:19:45.422845 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.422764 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-brst9\"" Jul 01 17:19:45.423234 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.423218 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 01 17:19:45.425147 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.425130 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 01 17:19:45.429282 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.429260 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 01 17:19:45.438936 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.438907 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 17:19:45.517698 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.517653 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5b911acd-37de-4d0a-b138-b09444356093-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5b911acd-37de-4d0a-b138-b09444356093\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:19:45.517890 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.517712 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5b911acd-37de-4d0a-b138-b09444356093-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5b911acd-37de-4d0a-b138-b09444356093\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:19:45.517890 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.517749 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5b911acd-37de-4d0a-b138-b09444356093-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5b911acd-37de-4d0a-b138-b09444356093\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:19:45.517890 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.517773 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5b911acd-37de-4d0a-b138-b09444356093-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5b911acd-37de-4d0a-b138-b09444356093\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:19:45.517890 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.517803 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc998\" (UniqueName: \"kubernetes.io/projected/5b911acd-37de-4d0a-b138-b09444356093-kube-api-access-cc998\") pod \"alertmanager-main-0\" (UID: \"5b911acd-37de-4d0a-b138-b09444356093\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:19:45.517890 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.517849 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5b911acd-37de-4d0a-b138-b09444356093-web-config\") pod \"alertmanager-main-0\" (UID: \"5b911acd-37de-4d0a-b138-b09444356093\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:19:45.517890 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.517873 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5b911acd-37de-4d0a-b138-b09444356093-config-out\") pod \"alertmanager-main-0\" (UID: \"5b911acd-37de-4d0a-b138-b09444356093\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:19:45.518104 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.517894 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5b911acd-37de-4d0a-b138-b09444356093-config-volume\") pod \"alertmanager-main-0\" (UID: \"5b911acd-37de-4d0a-b138-b09444356093\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:19:45.518104 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.517915 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b911acd-37de-4d0a-b138-b09444356093-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5b911acd-37de-4d0a-b138-b09444356093\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:19:45.518104 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.517990 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5b911acd-37de-4d0a-b138-b09444356093-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5b911acd-37de-4d0a-b138-b09444356093\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:19:45.518104 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.518019 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b911acd-37de-4d0a-b138-b09444356093-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5b911acd-37de-4d0a-b138-b09444356093\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:19:45.518104 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.518048 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5b911acd-37de-4d0a-b138-b09444356093-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5b911acd-37de-4d0a-b138-b09444356093\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:19:45.518104 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.518083 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5b911acd-37de-4d0a-b138-b09444356093-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5b911acd-37de-4d0a-b138-b09444356093\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:19:45.618883 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.618790 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5b911acd-37de-4d0a-b138-b09444356093-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5b911acd-37de-4d0a-b138-b09444356093\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:19:45.618883 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.618845 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5b911acd-37de-4d0a-b138-b09444356093-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5b911acd-37de-4d0a-b138-b09444356093\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:19:45.618883 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.618882 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5b911acd-37de-4d0a-b138-b09444356093-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5b911acd-37de-4d0a-b138-b09444356093\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:19:45.619796 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.618917 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5b911acd-37de-4d0a-b138-b09444356093-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5b911acd-37de-4d0a-b138-b09444356093\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:19:45.619796 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.618940 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5b911acd-37de-4d0a-b138-b09444356093-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5b911acd-37de-4d0a-b138-b09444356093\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:19:45.619796 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.618994 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5b911acd-37de-4d0a-b138-b09444356093-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5b911acd-37de-4d0a-b138-b09444356093\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:19:45.619796 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.619035 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc998\" (UniqueName: \"kubernetes.io/projected/5b911acd-37de-4d0a-b138-b09444356093-kube-api-access-cc998\") pod \"alertmanager-main-0\" (UID: \"5b911acd-37de-4d0a-b138-b09444356093\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:19:45.619796 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.619075 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5b911acd-37de-4d0a-b138-b09444356093-web-config\") pod \"alertmanager-main-0\" (UID: \"5b911acd-37de-4d0a-b138-b09444356093\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:19:45.619796 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.619102 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5b911acd-37de-4d0a-b138-b09444356093-config-out\") pod \"alertmanager-main-0\" (UID: \"5b911acd-37de-4d0a-b138-b09444356093\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:19:45.619796 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.619153 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5b911acd-37de-4d0a-b138-b09444356093-config-volume\") pod \"alertmanager-main-0\" (UID: \"5b911acd-37de-4d0a-b138-b09444356093\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:19:45.619796 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.619183 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b911acd-37de-4d0a-b138-b09444356093-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5b911acd-37de-4d0a-b138-b09444356093\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:19:45.619796 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.619211 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5b911acd-37de-4d0a-b138-b09444356093-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5b911acd-37de-4d0a-b138-b09444356093\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:19:45.619796 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.619234 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b911acd-37de-4d0a-b138-b09444356093-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5b911acd-37de-4d0a-b138-b09444356093\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:19:45.619796 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.619292 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5b911acd-37de-4d0a-b138-b09444356093-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5b911acd-37de-4d0a-b138-b09444356093\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:19:45.620380 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.620201 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b911acd-37de-4d0a-b138-b09444356093-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5b911acd-37de-4d0a-b138-b09444356093\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:19:45.620380 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.620220 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b911acd-37de-4d0a-b138-b09444356093-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5b911acd-37de-4d0a-b138-b09444356093\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:19:45.622592 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.622341 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5b911acd-37de-4d0a-b138-b09444356093-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5b911acd-37de-4d0a-b138-b09444356093\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:19:45.622592 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.622341 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5b911acd-37de-4d0a-b138-b09444356093-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5b911acd-37de-4d0a-b138-b09444356093\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:19:45.622592 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.622511 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5b911acd-37de-4d0a-b138-b09444356093-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5b911acd-37de-4d0a-b138-b09444356093\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:19:45.622592 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.622517 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5b911acd-37de-4d0a-b138-b09444356093-config-volume\") pod \"alertmanager-main-0\" (UID: \"5b911acd-37de-4d0a-b138-b09444356093\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:19:45.622592 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.622576 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5b911acd-37de-4d0a-b138-b09444356093-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5b911acd-37de-4d0a-b138-b09444356093\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:19:45.622592 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.622584 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5b911acd-37de-4d0a-b138-b09444356093-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5b911acd-37de-4d0a-b138-b09444356093\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:19:45.623006 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.622914 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5b911acd-37de-4d0a-b138-b09444356093-web-config\") pod \"alertmanager-main-0\" (UID: \"5b911acd-37de-4d0a-b138-b09444356093\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:19:45.623485 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.623469 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5b911acd-37de-4d0a-b138-b09444356093-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5b911acd-37de-4d0a-b138-b09444356093\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:19:45.624195 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.624175 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5b911acd-37de-4d0a-b138-b09444356093-config-out\") pod \"alertmanager-main-0\" (UID: \"5b911acd-37de-4d0a-b138-b09444356093\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:19:45.629848 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.629820 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc998\" (UniqueName: \"kubernetes.io/projected/5b911acd-37de-4d0a-b138-b09444356093-kube-api-access-cc998\") pod \"alertmanager-main-0\" (UID: \"5b911acd-37de-4d0a-b138-b09444356093\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:19:45.728939 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.728901 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:19:45.884509 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:45.884481 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 17:19:45.887331 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:19:45.887301 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b911acd_37de_4d0a_b138_b09444356093.slice/crio-a62a2a822089d99b5b31ac55270fcd100d6e7c9e671108fe21cda5382ab84602 WatchSource:0}: Error finding container a62a2a822089d99b5b31ac55270fcd100d6e7c9e671108fe21cda5382ab84602: Status 404 returned error can't find the container with id a62a2a822089d99b5b31ac55270fcd100d6e7c9e671108fe21cda5382ab84602 Jul 01 17:19:46.362416 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:46.362382 2547 generic.go:356] "Generic (PLEG): container finished" podID="5b911acd-37de-4d0a-b138-b09444356093" containerID="2c003881e2a4672590a571aee3d9edfd1d3dcab9d98e6ad7b3a02dc14c449cc2" exitCode=0 Jul 01 17:19:46.362869 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:46.362479 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b911acd-37de-4d0a-b138-b09444356093","Type":"ContainerDied","Data":"2c003881e2a4672590a571aee3d9edfd1d3dcab9d98e6ad7b3a02dc14c449cc2"} Jul 01 17:19:46.362869 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:46.362570 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b911acd-37de-4d0a-b138-b09444356093","Type":"ContainerStarted","Data":"a62a2a822089d99b5b31ac55270fcd100d6e7c9e671108fe21cda5382ab84602"} Jul 01 17:19:46.423686 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:46.423653 2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fa540db-1ef6-4507-a7ed-407fe58c6223" path="/var/lib/kubelet/pods/2fa540db-1ef6-4507-a7ed-407fe58c6223/volumes" Jul 01 17:19:47.370455 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:47.370419 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b911acd-37de-4d0a-b138-b09444356093","Type":"ContainerStarted","Data":"fc4d8da82e0329fd9f346d374ddf8c683b572c8ad09024aa355bbcda9e56674a"} Jul 01 17:19:47.370826 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:47.370490 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b911acd-37de-4d0a-b138-b09444356093","Type":"ContainerStarted","Data":"de2eaf1f6070d6bd334197af90c1b5c7143ec24ed9af3937302d1a5b417b36a4"} Jul 01 17:19:47.370826 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:47.370516 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b911acd-37de-4d0a-b138-b09444356093","Type":"ContainerStarted","Data":"4dbe6e18e4198c46a89d973816d3a7a6d45b07ed260556fe2f0b7c2dd84602da"} Jul 01 17:19:47.370826 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:47.370539 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b911acd-37de-4d0a-b138-b09444356093","Type":"ContainerStarted","Data":"3dc3a0c0eb8ec4a8275f4662a70b683bccf6f587d65304e4de1f08fa36b3fb52"} Jul 01 17:19:47.370826 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:47.370561 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b911acd-37de-4d0a-b138-b09444356093","Type":"ContainerStarted","Data":"d4290a7a3a9e77712a169fc2ca624bb4ff9236f8fd6c51fddcaeb32db10335c2"} Jul 01 17:19:47.370826 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:47.370584 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b911acd-37de-4d0a-b138-b09444356093","Type":"ContainerStarted","Data":"809b2aefeea6ec5098102781c639731c471cf56291129a27f97fe6ad07bb1a2f"} Jul 01 17:19:47.407715 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:47.407653 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.391317905 podStartE2EDuration="2.407633658s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.315753ms" isStatefulPod=false podCreationTimestamp="2026-07-01 17:19:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:19:47.404868217 +0000 UTC m=+217.436865477" watchObservedRunningTime="2026-07-01 17:19:47.407633658 +0000 UTC m=+217.439630917" Jul 01 17:19:47.967659 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:47.967620 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-ff7bff99-sfttn"] Jul 01 17:19:47.970366 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:47.970348 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-ff7bff99-sfttn" Jul 01 17:19:47.973565 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:47.973532 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 01 17:19:47.973565 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:47.973532 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 01 17:19:47.973782 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:47.973531 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 01 17:19:47.973782 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:47.973564 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 01 17:19:47.973982 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:47.973933 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-jzrs2\"" Jul 01 17:19:47.974229 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:47.974213 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 01 17:19:47.979655 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:47.979635 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 01 17:19:47.986767 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:47.986729 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-ff7bff99-sfttn"] Jul 01 17:19:48.141884 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:48.141846 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a69ab409-230d-4459-b983-21b5e26bd4db-metrics-client-ca\") pod \"telemeter-client-ff7bff99-sfttn\" (UID: \"a69ab409-230d-4459-b983-21b5e26bd4db\") " pod="openshift-monitoring/telemeter-client-ff7bff99-sfttn" Jul 01 17:19:48.141884 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:48.141889 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a69ab409-230d-4459-b983-21b5e26bd4db-telemeter-client-tls\") pod \"telemeter-client-ff7bff99-sfttn\" (UID: \"a69ab409-230d-4459-b983-21b5e26bd4db\") " pod="openshift-monitoring/telemeter-client-ff7bff99-sfttn" Jul 01 17:19:48.142188 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:48.141915 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a69ab409-230d-4459-b983-21b5e26bd4db-telemeter-trusted-ca-bundle\") pod \"telemeter-client-ff7bff99-sfttn\" (UID: \"a69ab409-230d-4459-b983-21b5e26bd4db\") " pod="openshift-monitoring/telemeter-client-ff7bff99-sfttn" Jul 01 17:19:48.142188 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:48.141939 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a69ab409-230d-4459-b983-21b5e26bd4db-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-ff7bff99-sfttn\" (UID: \"a69ab409-230d-4459-b983-21b5e26bd4db\") " pod="openshift-monitoring/telemeter-client-ff7bff99-sfttn" Jul 01 17:19:48.142188 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:48.142058 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhdzb\" (UniqueName: \"kubernetes.io/projected/a69ab409-230d-4459-b983-21b5e26bd4db-kube-api-access-bhdzb\") pod \"telemeter-client-ff7bff99-sfttn\" (UID: \"a69ab409-230d-4459-b983-21b5e26bd4db\") " pod="openshift-monitoring/telemeter-client-ff7bff99-sfttn" Jul 01 17:19:48.142188 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:48.142099 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a69ab409-230d-4459-b983-21b5e26bd4db-serving-certs-ca-bundle\") pod \"telemeter-client-ff7bff99-sfttn\" (UID: \"a69ab409-230d-4459-b983-21b5e26bd4db\") " pod="openshift-monitoring/telemeter-client-ff7bff99-sfttn" Jul 01 17:19:48.142188 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:48.142146 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a69ab409-230d-4459-b983-21b5e26bd4db-secret-telemeter-client\") pod \"telemeter-client-ff7bff99-sfttn\" (UID: \"a69ab409-230d-4459-b983-21b5e26bd4db\") " pod="openshift-monitoring/telemeter-client-ff7bff99-sfttn" Jul 01 17:19:48.142188 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:48.142174 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a69ab409-230d-4459-b983-21b5e26bd4db-federate-client-tls\") pod \"telemeter-client-ff7bff99-sfttn\" (UID: \"a69ab409-230d-4459-b983-21b5e26bd4db\") " pod="openshift-monitoring/telemeter-client-ff7bff99-sfttn" Jul 01 17:19:48.243304 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:48.243212 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a69ab409-230d-4459-b983-21b5e26bd4db-serving-certs-ca-bundle\") pod \"telemeter-client-ff7bff99-sfttn\" (UID: \"a69ab409-230d-4459-b983-21b5e26bd4db\") " pod="openshift-monitoring/telemeter-client-ff7bff99-sfttn" Jul 01 17:19:48.243304 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:48.243267 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a69ab409-230d-4459-b983-21b5e26bd4db-secret-telemeter-client\") pod \"telemeter-client-ff7bff99-sfttn\" (UID: \"a69ab409-230d-4459-b983-21b5e26bd4db\") " pod="openshift-monitoring/telemeter-client-ff7bff99-sfttn" Jul 01 17:19:48.243304 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:48.243298 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a69ab409-230d-4459-b983-21b5e26bd4db-federate-client-tls\") pod \"telemeter-client-ff7bff99-sfttn\" (UID: \"a69ab409-230d-4459-b983-21b5e26bd4db\") " pod="openshift-monitoring/telemeter-client-ff7bff99-sfttn" Jul 01 17:19:48.243581 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:48.243334 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a69ab409-230d-4459-b983-21b5e26bd4db-metrics-client-ca\") pod \"telemeter-client-ff7bff99-sfttn\" (UID: \"a69ab409-230d-4459-b983-21b5e26bd4db\") " pod="openshift-monitoring/telemeter-client-ff7bff99-sfttn" Jul 01 17:19:48.243581 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:48.243356 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a69ab409-230d-4459-b983-21b5e26bd4db-telemeter-client-tls\") pod \"telemeter-client-ff7bff99-sfttn\" (UID: \"a69ab409-230d-4459-b983-21b5e26bd4db\") " pod="openshift-monitoring/telemeter-client-ff7bff99-sfttn" Jul 01 17:19:48.243581 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:48.243378 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a69ab409-230d-4459-b983-21b5e26bd4db-telemeter-trusted-ca-bundle\") pod \"telemeter-client-ff7bff99-sfttn\" (UID: \"a69ab409-230d-4459-b983-21b5e26bd4db\") " pod="openshift-monitoring/telemeter-client-ff7bff99-sfttn" Jul 01 17:19:48.243581 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:48.243401 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a69ab409-230d-4459-b983-21b5e26bd4db-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-ff7bff99-sfttn\" (UID: \"a69ab409-230d-4459-b983-21b5e26bd4db\") " pod="openshift-monitoring/telemeter-client-ff7bff99-sfttn" Jul 01 17:19:48.243581 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:48.243439 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhdzb\" (UniqueName: \"kubernetes.io/projected/a69ab409-230d-4459-b983-21b5e26bd4db-kube-api-access-bhdzb\") pod \"telemeter-client-ff7bff99-sfttn\" (UID: \"a69ab409-230d-4459-b983-21b5e26bd4db\") " pod="openshift-monitoring/telemeter-client-ff7bff99-sfttn" Jul 01 17:19:48.244179 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:48.244115 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a69ab409-230d-4459-b983-21b5e26bd4db-metrics-client-ca\") pod \"telemeter-client-ff7bff99-sfttn\" (UID: \"a69ab409-230d-4459-b983-21b5e26bd4db\") " pod="openshift-monitoring/telemeter-client-ff7bff99-sfttn" Jul 01 17:19:48.244179 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:48.244115 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a69ab409-230d-4459-b983-21b5e26bd4db-serving-certs-ca-bundle\") pod \"telemeter-client-ff7bff99-sfttn\" (UID: \"a69ab409-230d-4459-b983-21b5e26bd4db\") " pod="openshift-monitoring/telemeter-client-ff7bff99-sfttn" Jul 01 17:19:48.244408 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:48.244345 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a69ab409-230d-4459-b983-21b5e26bd4db-telemeter-trusted-ca-bundle\") pod \"telemeter-client-ff7bff99-sfttn\" (UID: \"a69ab409-230d-4459-b983-21b5e26bd4db\") " pod="openshift-monitoring/telemeter-client-ff7bff99-sfttn" Jul 01 17:19:48.246174 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:48.246140 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a69ab409-230d-4459-b983-21b5e26bd4db-federate-client-tls\") pod \"telemeter-client-ff7bff99-sfttn\" (UID: \"a69ab409-230d-4459-b983-21b5e26bd4db\") " pod="openshift-monitoring/telemeter-client-ff7bff99-sfttn" Jul 01 17:19:48.246260 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:48.246151 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a69ab409-230d-4459-b983-21b5e26bd4db-secret-telemeter-client\") pod \"telemeter-client-ff7bff99-sfttn\" (UID: \"a69ab409-230d-4459-b983-21b5e26bd4db\") " pod="openshift-monitoring/telemeter-client-ff7bff99-sfttn" Jul 01 17:19:48.246260 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:48.246188 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a69ab409-230d-4459-b983-21b5e26bd4db-telemeter-client-tls\") pod \"telemeter-client-ff7bff99-sfttn\" (UID: \"a69ab409-230d-4459-b983-21b5e26bd4db\") " pod="openshift-monitoring/telemeter-client-ff7bff99-sfttn" Jul 01 17:19:48.246336 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:48.246277 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a69ab409-230d-4459-b983-21b5e26bd4db-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-ff7bff99-sfttn\" (UID: \"a69ab409-230d-4459-b983-21b5e26bd4db\") " pod="openshift-monitoring/telemeter-client-ff7bff99-sfttn" Jul 01 17:19:48.252389 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:48.252366 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhdzb\" (UniqueName: \"kubernetes.io/projected/a69ab409-230d-4459-b983-21b5e26bd4db-kube-api-access-bhdzb\") pod \"telemeter-client-ff7bff99-sfttn\" (UID: \"a69ab409-230d-4459-b983-21b5e26bd4db\") " pod="openshift-monitoring/telemeter-client-ff7bff99-sfttn" Jul 01 17:19:48.281427 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:48.281390 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-ff7bff99-sfttn" Jul 01 17:19:48.437249 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:48.437210 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-ff7bff99-sfttn"] Jul 01 17:19:49.382513 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:49.382471 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-ff7bff99-sfttn" event={"ID":"a69ab409-230d-4459-b983-21b5e26bd4db","Type":"ContainerStarted","Data":"c0643513fbc74e53c5a8872914afacf6ea68b7fb584d8e03469b49ddb248d1d9"} Jul 01 17:19:50.388604 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:50.388511 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-ff7bff99-sfttn" event={"ID":"a69ab409-230d-4459-b983-21b5e26bd4db","Type":"ContainerStarted","Data":"bd2e1f21540b5508939f887fd80186495fa6e8de1b5fbb73a331168b477e0a7c"} Jul 01 17:19:50.388604 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:50.388566 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-ff7bff99-sfttn" event={"ID":"a69ab409-230d-4459-b983-21b5e26bd4db","Type":"ContainerStarted","Data":"90994041d4250ad913464b640d739cdcaabee63add3f51c6a30222cdfd70e34b"} Jul 01 17:19:50.388604 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:50.388586 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-ff7bff99-sfttn" event={"ID":"a69ab409-230d-4459-b983-21b5e26bd4db","Type":"ContainerStarted","Data":"3ba53766c78a2d07a51ff00c41ba31adbb64a069e6ac8cc92b1e8e316109461e"} Jul 01 17:19:50.416474 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:50.416417 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-ff7bff99-sfttn" podStartSLOduration=1.729935601 podStartE2EDuration="3.41639944s" totalImagesPullingTime="1.686463839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:19:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:19:50.413752823 +0000 UTC m=+220.445750106" watchObservedRunningTime="2026-07-01 17:19:50.41639944 +0000 UTC m=+220.448396700" Jul 01 17:19:51.225401 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:51.225360 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-858988cddd-vdsp5"] Jul 01 17:19:51.228781 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:51.228761 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-858988cddd-vdsp5" Jul 01 17:19:51.244893 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:51.244862 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-858988cddd-vdsp5"] Jul 01 17:19:51.372033 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:51.371980 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d65c84f1-803c-46b2-86fc-984205295913-oauth-serving-cert\") pod \"console-858988cddd-vdsp5\" (UID: \"d65c84f1-803c-46b2-86fc-984205295913\") " pod="openshift-console/console-858988cddd-vdsp5" Jul 01 17:19:51.372033 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:51.372040 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz8c5\" (UniqueName: \"kubernetes.io/projected/d65c84f1-803c-46b2-86fc-984205295913-kube-api-access-mz8c5\") pod \"console-858988cddd-vdsp5\" (UID: \"d65c84f1-803c-46b2-86fc-984205295913\") " pod="openshift-console/console-858988cddd-vdsp5" Jul 01 17:19:51.372289 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:51.372094 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d65c84f1-803c-46b2-86fc-984205295913-console-oauth-config\") pod \"console-858988cddd-vdsp5\" (UID: \"d65c84f1-803c-46b2-86fc-984205295913\") " pod="openshift-console/console-858988cddd-vdsp5" Jul 01 17:19:51.372289 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:51.372110 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d65c84f1-803c-46b2-86fc-984205295913-trusted-ca-bundle\") pod \"console-858988cddd-vdsp5\" (UID: \"d65c84f1-803c-46b2-86fc-984205295913\") " pod="openshift-console/console-858988cddd-vdsp5" Jul 01 17:19:51.372289 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:51.372179 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d65c84f1-803c-46b2-86fc-984205295913-service-ca\") pod \"console-858988cddd-vdsp5\" (UID: \"d65c84f1-803c-46b2-86fc-984205295913\") " pod="openshift-console/console-858988cddd-vdsp5" Jul 01 17:19:51.372289 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:51.372203 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d65c84f1-803c-46b2-86fc-984205295913-console-config\") pod \"console-858988cddd-vdsp5\" (UID: \"d65c84f1-803c-46b2-86fc-984205295913\") " pod="openshift-console/console-858988cddd-vdsp5" Jul 01 17:19:51.372289 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:51.372236 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d65c84f1-803c-46b2-86fc-984205295913-console-serving-cert\") pod \"console-858988cddd-vdsp5\" (UID: \"d65c84f1-803c-46b2-86fc-984205295913\") " pod="openshift-console/console-858988cddd-vdsp5" Jul 01 17:19:51.473199 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:51.473164 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d65c84f1-803c-46b2-86fc-984205295913-service-ca\") pod \"console-858988cddd-vdsp5\" (UID: \"d65c84f1-803c-46b2-86fc-984205295913\") " pod="openshift-console/console-858988cddd-vdsp5" Jul 01 17:19:51.473199 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:51.473199 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d65c84f1-803c-46b2-86fc-984205295913-console-config\") pod \"console-858988cddd-vdsp5\" (UID: \"d65c84f1-803c-46b2-86fc-984205295913\") " pod="openshift-console/console-858988cddd-vdsp5" Jul 01 17:19:51.473724 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:51.473224 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d65c84f1-803c-46b2-86fc-984205295913-console-serving-cert\") pod \"console-858988cddd-vdsp5\" (UID: \"d65c84f1-803c-46b2-86fc-984205295913\") " pod="openshift-console/console-858988cddd-vdsp5" Jul 01 17:19:51.473724 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:51.473264 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d65c84f1-803c-46b2-86fc-984205295913-oauth-serving-cert\") pod \"console-858988cddd-vdsp5\" (UID: \"d65c84f1-803c-46b2-86fc-984205295913\") " pod="openshift-console/console-858988cddd-vdsp5" Jul 01 17:19:51.473724 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:51.473296 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mz8c5\" (UniqueName: \"kubernetes.io/projected/d65c84f1-803c-46b2-86fc-984205295913-kube-api-access-mz8c5\") pod \"console-858988cddd-vdsp5\" (UID: \"d65c84f1-803c-46b2-86fc-984205295913\") " pod="openshift-console/console-858988cddd-vdsp5" Jul 01 17:19:51.473724 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:51.473340 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d65c84f1-803c-46b2-86fc-984205295913-console-oauth-config\") pod \"console-858988cddd-vdsp5\" (UID: \"d65c84f1-803c-46b2-86fc-984205295913\") " pod="openshift-console/console-858988cddd-vdsp5" Jul 01 17:19:51.473724 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:51.473362 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d65c84f1-803c-46b2-86fc-984205295913-trusted-ca-bundle\") pod \"console-858988cddd-vdsp5\" (UID: \"d65c84f1-803c-46b2-86fc-984205295913\") " pod="openshift-console/console-858988cddd-vdsp5" Jul 01 17:19:51.474228 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:51.474061 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d65c84f1-803c-46b2-86fc-984205295913-service-ca\") pod \"console-858988cddd-vdsp5\" (UID: \"d65c84f1-803c-46b2-86fc-984205295913\") " pod="openshift-console/console-858988cddd-vdsp5" Jul 01 17:19:51.474228 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:51.474132 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d65c84f1-803c-46b2-86fc-984205295913-oauth-serving-cert\") pod \"console-858988cddd-vdsp5\" (UID: \"d65c84f1-803c-46b2-86fc-984205295913\") " pod="openshift-console/console-858988cddd-vdsp5" Jul 01 17:19:51.474228 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:51.474138 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d65c84f1-803c-46b2-86fc-984205295913-console-config\") pod \"console-858988cddd-vdsp5\" (UID: \"d65c84f1-803c-46b2-86fc-984205295913\") " pod="openshift-console/console-858988cddd-vdsp5" Jul 01 17:19:51.474228 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:51.474236 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d65c84f1-803c-46b2-86fc-984205295913-trusted-ca-bundle\") pod \"console-858988cddd-vdsp5\" (UID: \"d65c84f1-803c-46b2-86fc-984205295913\") " pod="openshift-console/console-858988cddd-vdsp5" Jul 01 17:19:51.476237 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:51.476181 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d65c84f1-803c-46b2-86fc-984205295913-console-serving-cert\") pod \"console-858988cddd-vdsp5\" (UID: \"d65c84f1-803c-46b2-86fc-984205295913\") " pod="openshift-console/console-858988cddd-vdsp5" Jul 01 17:19:51.476237 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:51.476180 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d65c84f1-803c-46b2-86fc-984205295913-console-oauth-config\") pod \"console-858988cddd-vdsp5\" (UID: \"d65c84f1-803c-46b2-86fc-984205295913\") " pod="openshift-console/console-858988cddd-vdsp5" Jul 01 17:19:51.488370 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:51.488343 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz8c5\" (UniqueName: \"kubernetes.io/projected/d65c84f1-803c-46b2-86fc-984205295913-kube-api-access-mz8c5\") pod \"console-858988cddd-vdsp5\" (UID: \"d65c84f1-803c-46b2-86fc-984205295913\") " pod="openshift-console/console-858988cddd-vdsp5" Jul 01 17:19:51.538298 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:51.538256 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-858988cddd-vdsp5" Jul 01 17:19:51.679710 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:51.679678 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-858988cddd-vdsp5"] Jul 01 17:19:51.683039 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:19:51.683007 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd65c84f1_803c_46b2_86fc_984205295913.slice/crio-c735cf154581cf825271d8538b74c746f066c9c465b7cc1dddd1b9f3f9dbec24 WatchSource:0}: Error finding container c735cf154581cf825271d8538b74c746f066c9c465b7cc1dddd1b9f3f9dbec24: Status 404 returned error can't find the container with id c735cf154581cf825271d8538b74c746f066c9c465b7cc1dddd1b9f3f9dbec24 Jul 01 17:19:52.398414 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:52.398376 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-858988cddd-vdsp5" event={"ID":"d65c84f1-803c-46b2-86fc-984205295913","Type":"ContainerStarted","Data":"ed138d49a983bf5ea8c42ec881be6af5bee717a07537adea13e7558427b52be9"} Jul 01 17:19:52.398602 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:52.398453 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-858988cddd-vdsp5" event={"ID":"d65c84f1-803c-46b2-86fc-984205295913","Type":"ContainerStarted","Data":"c735cf154581cf825271d8538b74c746f066c9c465b7cc1dddd1b9f3f9dbec24"} Jul 01 17:19:52.418844 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:19:52.418785 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-858988cddd-vdsp5" podStartSLOduration=1.418767717 podStartE2EDuration="1.418767717s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:19:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:19:52.416229846 +0000 UTC m=+222.448227141" watchObservedRunningTime="2026-07-01 17:19:52.418767717 +0000 UTC m=+222.450764976" Jul 01 17:20:01.538617 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:20:01.538558 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-858988cddd-vdsp5" Jul 01 17:20:01.539160 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:20:01.538653 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-858988cddd-vdsp5" Jul 01 17:20:01.543405 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:20:01.543381 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-858988cddd-vdsp5" Jul 01 17:20:02.444082 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:20:02.444047 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-858988cddd-vdsp5" Jul 01 17:20:02.490708 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:20:02.490673 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6785cb48b6-t98mr"] Jul 01 17:20:27.512702 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:20:27.512656 2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6785cb48b6-t98mr" podUID="257c3bab-439c-46c2-97ed-2eb7c9f81de4" containerName="console" containerID="cri-o://2246bd1d322db80abd800a8df8cd4f15c7b66c29a5988a4cb371512d901ecbcc" gracePeriod=15 Jul 01 17:20:27.762853 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:20:27.762790 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6785cb48b6-t98mr" Jul 01 17:20:27.902253 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:20:27.898780 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/257c3bab-439c-46c2-97ed-2eb7c9f81de4-trusted-ca-bundle\") pod \"257c3bab-439c-46c2-97ed-2eb7c9f81de4\" (UID: \"257c3bab-439c-46c2-97ed-2eb7c9f81de4\") " Jul 01 17:20:27.902253 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:20:27.898866 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/257c3bab-439c-46c2-97ed-2eb7c9f81de4-service-ca\") pod \"257c3bab-439c-46c2-97ed-2eb7c9f81de4\" (UID: \"257c3bab-439c-46c2-97ed-2eb7c9f81de4\") " Jul 01 17:20:27.902253 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:20:27.899023 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zt52h\" (UniqueName: \"kubernetes.io/projected/257c3bab-439c-46c2-97ed-2eb7c9f81de4-kube-api-access-zt52h\") pod \"257c3bab-439c-46c2-97ed-2eb7c9f81de4\" (UID: \"257c3bab-439c-46c2-97ed-2eb7c9f81de4\") " Jul 01 17:20:27.902253 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:20:27.899084 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/257c3bab-439c-46c2-97ed-2eb7c9f81de4-oauth-serving-cert\") pod \"257c3bab-439c-46c2-97ed-2eb7c9f81de4\" (UID: \"257c3bab-439c-46c2-97ed-2eb7c9f81de4\") " Jul 01 17:20:27.902253 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:20:27.899152 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/257c3bab-439c-46c2-97ed-2eb7c9f81de4-console-oauth-config\") pod \"257c3bab-439c-46c2-97ed-2eb7c9f81de4\" (UID: \"257c3bab-439c-46c2-97ed-2eb7c9f81de4\") " Jul 01 17:20:27.902253 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:20:27.899216 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/257c3bab-439c-46c2-97ed-2eb7c9f81de4-console-serving-cert\") pod \"257c3bab-439c-46c2-97ed-2eb7c9f81de4\" (UID: \"257c3bab-439c-46c2-97ed-2eb7c9f81de4\") " Jul 01 17:20:27.902253 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:20:27.899248 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/257c3bab-439c-46c2-97ed-2eb7c9f81de4-console-config\") pod \"257c3bab-439c-46c2-97ed-2eb7c9f81de4\" (UID: \"257c3bab-439c-46c2-97ed-2eb7c9f81de4\") " Jul 01 17:20:27.902253 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:20:27.899270 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/257c3bab-439c-46c2-97ed-2eb7c9f81de4-service-ca" (OuterVolumeSpecName: "service-ca") pod "257c3bab-439c-46c2-97ed-2eb7c9f81de4" (UID: "257c3bab-439c-46c2-97ed-2eb7c9f81de4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:20:27.902253 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:20:27.899318 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/257c3bab-439c-46c2-97ed-2eb7c9f81de4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "257c3bab-439c-46c2-97ed-2eb7c9f81de4" (UID: "257c3bab-439c-46c2-97ed-2eb7c9f81de4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:20:27.902253 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:20:27.899615 2547 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/257c3bab-439c-46c2-97ed-2eb7c9f81de4-trusted-ca-bundle\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:20:27.902253 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:20:27.899646 2547 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/257c3bab-439c-46c2-97ed-2eb7c9f81de4-service-ca\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:20:27.902253 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:20:27.899639 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/257c3bab-439c-46c2-97ed-2eb7c9f81de4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "257c3bab-439c-46c2-97ed-2eb7c9f81de4" (UID: "257c3bab-439c-46c2-97ed-2eb7c9f81de4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:20:27.902253 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:20:27.900022 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/257c3bab-439c-46c2-97ed-2eb7c9f81de4-console-config" (OuterVolumeSpecName: "console-config") pod "257c3bab-439c-46c2-97ed-2eb7c9f81de4" (UID: "257c3bab-439c-46c2-97ed-2eb7c9f81de4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:20:27.905900 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:20:27.905858 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/257c3bab-439c-46c2-97ed-2eb7c9f81de4-kube-api-access-zt52h" (OuterVolumeSpecName: "kube-api-access-zt52h") pod "257c3bab-439c-46c2-97ed-2eb7c9f81de4" (UID: "257c3bab-439c-46c2-97ed-2eb7c9f81de4"). InnerVolumeSpecName "kube-api-access-zt52h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:20:27.905900 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:20:27.905866 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/257c3bab-439c-46c2-97ed-2eb7c9f81de4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "257c3bab-439c-46c2-97ed-2eb7c9f81de4" (UID: "257c3bab-439c-46c2-97ed-2eb7c9f81de4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:20:27.905900 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:20:27.905887 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/257c3bab-439c-46c2-97ed-2eb7c9f81de4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "257c3bab-439c-46c2-97ed-2eb7c9f81de4" (UID: "257c3bab-439c-46c2-97ed-2eb7c9f81de4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:20:28.000114 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:20:28.000078 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zt52h\" (UniqueName: \"kubernetes.io/projected/257c3bab-439c-46c2-97ed-2eb7c9f81de4-kube-api-access-zt52h\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:20:28.000114 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:20:28.000109 2547 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/257c3bab-439c-46c2-97ed-2eb7c9f81de4-oauth-serving-cert\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:20:28.000114 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:20:28.000120 2547 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/257c3bab-439c-46c2-97ed-2eb7c9f81de4-console-oauth-config\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:20:28.000114 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:20:28.000131 2547 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/257c3bab-439c-46c2-97ed-2eb7c9f81de4-console-serving-cert\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:20:28.000401 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:20:28.000140 2547 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/257c3bab-439c-46c2-97ed-2eb7c9f81de4-console-config\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:20:28.553131 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:20:28.553094 2547 generic.go:356] "Generic (PLEG): container finished" podID="257c3bab-439c-46c2-97ed-2eb7c9f81de4" containerID="2246bd1d322db80abd800a8df8cd4f15c7b66c29a5988a4cb371512d901ecbcc" exitCode=0 Jul 01 17:20:28.553565 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:20:28.553143 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6785cb48b6-t98mr" event={"ID":"257c3bab-439c-46c2-97ed-2eb7c9f81de4","Type":"ContainerDied","Data":"2246bd1d322db80abd800a8df8cd4f15c7b66c29a5988a4cb371512d901ecbcc"} Jul 01 17:20:28.553565 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:20:28.553205 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6785cb48b6-t98mr" event={"ID":"257c3bab-439c-46c2-97ed-2eb7c9f81de4","Type":"ContainerDied","Data":"26fa3649fc8e3117de2774a5486e9bda0b77ab4584b199dacc40b2bd7e8390aa"} Jul 01 17:20:28.553565 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:20:28.553155 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6785cb48b6-t98mr" Jul 01 17:20:28.553565 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:20:28.553240 2547 scope.go:117] "RemoveContainer" containerID="2246bd1d322db80abd800a8df8cd4f15c7b66c29a5988a4cb371512d901ecbcc" Jul 01 17:20:28.564553 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:20:28.564490 2547 scope.go:117] "RemoveContainer" containerID="2246bd1d322db80abd800a8df8cd4f15c7b66c29a5988a4cb371512d901ecbcc" Jul 01 17:20:28.564995 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:20:28.564942 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2246bd1d322db80abd800a8df8cd4f15c7b66c29a5988a4cb371512d901ecbcc\": container with ID starting with 2246bd1d322db80abd800a8df8cd4f15c7b66c29a5988a4cb371512d901ecbcc not found: ID does not exist" containerID="2246bd1d322db80abd800a8df8cd4f15c7b66c29a5988a4cb371512d901ecbcc" Jul 01 17:20:28.565086 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:20:28.565006 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2246bd1d322db80abd800a8df8cd4f15c7b66c29a5988a4cb371512d901ecbcc"} err="failed to get container status \"2246bd1d322db80abd800a8df8cd4f15c7b66c29a5988a4cb371512d901ecbcc\": rpc error: code = NotFound desc = could not find container \"2246bd1d322db80abd800a8df8cd4f15c7b66c29a5988a4cb371512d901ecbcc\": container with ID starting with 2246bd1d322db80abd800a8df8cd4f15c7b66c29a5988a4cb371512d901ecbcc not found: ID does not exist" Jul 01 17:20:28.576280 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:20:28.576246 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6785cb48b6-t98mr"] Jul 01 17:20:28.580031 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:20:28.580007 2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6785cb48b6-t98mr"] Jul 01 17:20:30.423642 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:20:30.423607 2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="257c3bab-439c-46c2-97ed-2eb7c9f81de4" path="/var/lib/kubelet/pods/257c3bab-439c-46c2-97ed-2eb7c9f81de4/volumes" Jul 01 17:21:00.250285 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:00.250229 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c79dcb45b-2kw7r"] Jul 01 17:21:00.250755 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:00.250607 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="257c3bab-439c-46c2-97ed-2eb7c9f81de4" containerName="console" Jul 01 17:21:00.250755 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:00.250619 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="257c3bab-439c-46c2-97ed-2eb7c9f81de4" containerName="console" Jul 01 17:21:00.250755 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:00.250673 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="257c3bab-439c-46c2-97ed-2eb7c9f81de4" containerName="console" Jul 01 17:21:00.252786 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:00.252772 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c79dcb45b-2kw7r" Jul 01 17:21:00.257996 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:00.257944 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nt8hv\" (UniqueName: \"kubernetes.io/projected/27ef9fa8-e164-4a33-8993-1e62a2ac04c5-kube-api-access-nt8hv\") pod \"console-c79dcb45b-2kw7r\" (UID: \"27ef9fa8-e164-4a33-8993-1e62a2ac04c5\") " pod="openshift-console/console-c79dcb45b-2kw7r" Jul 01 17:21:00.258144 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:00.258019 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27ef9fa8-e164-4a33-8993-1e62a2ac04c5-trusted-ca-bundle\") pod \"console-c79dcb45b-2kw7r\" (UID: \"27ef9fa8-e164-4a33-8993-1e62a2ac04c5\") " pod="openshift-console/console-c79dcb45b-2kw7r" Jul 01 17:21:00.258144 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:00.258055 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27ef9fa8-e164-4a33-8993-1e62a2ac04c5-console-oauth-config\") pod \"console-c79dcb45b-2kw7r\" (UID: \"27ef9fa8-e164-4a33-8993-1e62a2ac04c5\") " pod="openshift-console/console-c79dcb45b-2kw7r" Jul 01 17:21:00.258144 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:00.258107 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27ef9fa8-e164-4a33-8993-1e62a2ac04c5-console-config\") pod \"console-c79dcb45b-2kw7r\" (UID: \"27ef9fa8-e164-4a33-8993-1e62a2ac04c5\") " pod="openshift-console/console-c79dcb45b-2kw7r" Jul 01 17:21:00.258144 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:00.258133 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27ef9fa8-e164-4a33-8993-1e62a2ac04c5-service-ca\") pod \"console-c79dcb45b-2kw7r\" (UID: \"27ef9fa8-e164-4a33-8993-1e62a2ac04c5\") " pod="openshift-console/console-c79dcb45b-2kw7r" Jul 01 17:21:00.258317 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:00.258190 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27ef9fa8-e164-4a33-8993-1e62a2ac04c5-console-serving-cert\") pod \"console-c79dcb45b-2kw7r\" (UID: \"27ef9fa8-e164-4a33-8993-1e62a2ac04c5\") " pod="openshift-console/console-c79dcb45b-2kw7r" Jul 01 17:21:00.258317 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:00.258221 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27ef9fa8-e164-4a33-8993-1e62a2ac04c5-oauth-serving-cert\") pod \"console-c79dcb45b-2kw7r\" (UID: \"27ef9fa8-e164-4a33-8993-1e62a2ac04c5\") " pod="openshift-console/console-c79dcb45b-2kw7r" Jul 01 17:21:00.264090 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:00.264068 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c79dcb45b-2kw7r"] Jul 01 17:21:00.359231 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:00.359195 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27ef9fa8-e164-4a33-8993-1e62a2ac04c5-console-serving-cert\") pod \"console-c79dcb45b-2kw7r\" (UID: \"27ef9fa8-e164-4a33-8993-1e62a2ac04c5\") " pod="openshift-console/console-c79dcb45b-2kw7r" Jul 01 17:21:00.359231 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:00.359227 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27ef9fa8-e164-4a33-8993-1e62a2ac04c5-oauth-serving-cert\") pod \"console-c79dcb45b-2kw7r\" (UID: \"27ef9fa8-e164-4a33-8993-1e62a2ac04c5\") " pod="openshift-console/console-c79dcb45b-2kw7r" Jul 01 17:21:00.359494 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:00.359258 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nt8hv\" (UniqueName: \"kubernetes.io/projected/27ef9fa8-e164-4a33-8993-1e62a2ac04c5-kube-api-access-nt8hv\") pod \"console-c79dcb45b-2kw7r\" (UID: \"27ef9fa8-e164-4a33-8993-1e62a2ac04c5\") " pod="openshift-console/console-c79dcb45b-2kw7r" Jul 01 17:21:00.359494 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:00.359284 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27ef9fa8-e164-4a33-8993-1e62a2ac04c5-trusted-ca-bundle\") pod \"console-c79dcb45b-2kw7r\" (UID: \"27ef9fa8-e164-4a33-8993-1e62a2ac04c5\") " pod="openshift-console/console-c79dcb45b-2kw7r" Jul 01 17:21:00.359494 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:00.359309 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27ef9fa8-e164-4a33-8993-1e62a2ac04c5-console-oauth-config\") pod \"console-c79dcb45b-2kw7r\" (UID: \"27ef9fa8-e164-4a33-8993-1e62a2ac04c5\") " pod="openshift-console/console-c79dcb45b-2kw7r" Jul 01 17:21:00.359494 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:00.359340 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27ef9fa8-e164-4a33-8993-1e62a2ac04c5-console-config\") pod \"console-c79dcb45b-2kw7r\" (UID: \"27ef9fa8-e164-4a33-8993-1e62a2ac04c5\") " pod="openshift-console/console-c79dcb45b-2kw7r" Jul 01 17:21:00.359494 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:00.359357 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27ef9fa8-e164-4a33-8993-1e62a2ac04c5-service-ca\") pod \"console-c79dcb45b-2kw7r\" (UID: \"27ef9fa8-e164-4a33-8993-1e62a2ac04c5\") " pod="openshift-console/console-c79dcb45b-2kw7r" Jul 01 17:21:00.360206 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:00.360175 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27ef9fa8-e164-4a33-8993-1e62a2ac04c5-console-config\") pod \"console-c79dcb45b-2kw7r\" (UID: \"27ef9fa8-e164-4a33-8993-1e62a2ac04c5\") " pod="openshift-console/console-c79dcb45b-2kw7r" Jul 01 17:21:00.360307 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:00.360193 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27ef9fa8-e164-4a33-8993-1e62a2ac04c5-service-ca\") pod \"console-c79dcb45b-2kw7r\" (UID: \"27ef9fa8-e164-4a33-8993-1e62a2ac04c5\") " pod="openshift-console/console-c79dcb45b-2kw7r" Jul 01 17:21:00.360307 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:00.360216 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27ef9fa8-e164-4a33-8993-1e62a2ac04c5-oauth-serving-cert\") pod \"console-c79dcb45b-2kw7r\" (UID: \"27ef9fa8-e164-4a33-8993-1e62a2ac04c5\") " pod="openshift-console/console-c79dcb45b-2kw7r" Jul 01 17:21:00.360409 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:00.360250 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27ef9fa8-e164-4a33-8993-1e62a2ac04c5-trusted-ca-bundle\") pod \"console-c79dcb45b-2kw7r\" (UID: \"27ef9fa8-e164-4a33-8993-1e62a2ac04c5\") " pod="openshift-console/console-c79dcb45b-2kw7r" Jul 01 17:21:00.361885 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:00.361861 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27ef9fa8-e164-4a33-8993-1e62a2ac04c5-console-oauth-config\") pod \"console-c79dcb45b-2kw7r\" (UID: \"27ef9fa8-e164-4a33-8993-1e62a2ac04c5\") " pod="openshift-console/console-c79dcb45b-2kw7r" Jul 01 17:21:00.362075 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:00.362057 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27ef9fa8-e164-4a33-8993-1e62a2ac04c5-console-serving-cert\") pod \"console-c79dcb45b-2kw7r\" (UID: \"27ef9fa8-e164-4a33-8993-1e62a2ac04c5\") " pod="openshift-console/console-c79dcb45b-2kw7r" Jul 01 17:21:00.367820 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:00.367793 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nt8hv\" (UniqueName: \"kubernetes.io/projected/27ef9fa8-e164-4a33-8993-1e62a2ac04c5-kube-api-access-nt8hv\") pod \"console-c79dcb45b-2kw7r\" (UID: \"27ef9fa8-e164-4a33-8993-1e62a2ac04c5\") " pod="openshift-console/console-c79dcb45b-2kw7r" Jul 01 17:21:00.561458 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:00.561370 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c79dcb45b-2kw7r" Jul 01 17:21:00.698213 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:00.698186 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c79dcb45b-2kw7r"] Jul 01 17:21:00.700833 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:21:00.700802 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27ef9fa8_e164_4a33_8993_1e62a2ac04c5.slice/crio-12ff0902db8420e54ccc54517d48ec195adbc5d8753f1f9b2bdb1456fbacce5e WatchSource:0}: Error finding container 12ff0902db8420e54ccc54517d48ec195adbc5d8753f1f9b2bdb1456fbacce5e: Status 404 returned error can't find the container with id 12ff0902db8420e54ccc54517d48ec195adbc5d8753f1f9b2bdb1456fbacce5e Jul 01 17:21:01.690056 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:01.690023 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c79dcb45b-2kw7r" event={"ID":"27ef9fa8-e164-4a33-8993-1e62a2ac04c5","Type":"ContainerStarted","Data":"490e09d35fda7ca64e8a7e658601602b75e2223369f9a45e8d5b66395f9f75aa"} Jul 01 17:21:01.690443 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:01.690074 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c79dcb45b-2kw7r" event={"ID":"27ef9fa8-e164-4a33-8993-1e62a2ac04c5","Type":"ContainerStarted","Data":"12ff0902db8420e54ccc54517d48ec195adbc5d8753f1f9b2bdb1456fbacce5e"} Jul 01 17:21:01.711647 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:01.711587 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c79dcb45b-2kw7r" podStartSLOduration=1.711571303 podStartE2EDuration="1.711571303s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:21:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:21:01.709548749 +0000 UTC m=+291.741546010" watchObservedRunningTime="2026-07-01 17:21:01.711571303 +0000 UTC m=+291.743568563" Jul 01 17:21:10.370064 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:10.370034 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qh49d_aa1fdd8a-5b35-4bac-9836-028a3292e25c/ovn-acl-logging/0.log" Jul 01 17:21:10.375332 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:10.375311 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qh49d_aa1fdd8a-5b35-4bac-9836-028a3292e25c/ovn-acl-logging/0.log" Jul 01 17:21:10.378390 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:10.378373 2547 kubelet.go:1648] "Image garbage collection succeeded" Jul 01 17:21:10.562265 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:10.562223 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c79dcb45b-2kw7r" Jul 01 17:21:10.563398 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:10.562282 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c79dcb45b-2kw7r" Jul 01 17:21:10.567105 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:10.567083 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c79dcb45b-2kw7r" Jul 01 17:21:10.734011 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:10.733915 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c79dcb45b-2kw7r" Jul 01 17:21:10.785735 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:10.785708 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-858988cddd-vdsp5"] Jul 01 17:21:35.806372 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:35.806307 2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-858988cddd-vdsp5" podUID="d65c84f1-803c-46b2-86fc-984205295913" containerName="console" containerID="cri-o://ed138d49a983bf5ea8c42ec881be6af5bee717a07537adea13e7558427b52be9" gracePeriod=15 Jul 01 17:21:36.047220 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:36.047198 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-858988cddd-vdsp5" Jul 01 17:21:36.131142 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:36.131079 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d65c84f1-803c-46b2-86fc-984205295913-oauth-serving-cert\") pod \"d65c84f1-803c-46b2-86fc-984205295913\" (UID: \"d65c84f1-803c-46b2-86fc-984205295913\") " Jul 01 17:21:36.131142 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:36.131115 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d65c84f1-803c-46b2-86fc-984205295913-service-ca\") pod \"d65c84f1-803c-46b2-86fc-984205295913\" (UID: \"d65c84f1-803c-46b2-86fc-984205295913\") " Jul 01 17:21:36.131316 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:36.131159 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d65c84f1-803c-46b2-86fc-984205295913-console-oauth-config\") pod \"d65c84f1-803c-46b2-86fc-984205295913\" (UID: \"d65c84f1-803c-46b2-86fc-984205295913\") " Jul 01 17:21:36.131316 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:36.131183 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d65c84f1-803c-46b2-86fc-984205295913-console-config\") pod \"d65c84f1-803c-46b2-86fc-984205295913\" (UID: \"d65c84f1-803c-46b2-86fc-984205295913\") " Jul 01 17:21:36.131316 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:36.131231 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d65c84f1-803c-46b2-86fc-984205295913-console-serving-cert\") pod \"d65c84f1-803c-46b2-86fc-984205295913\" (UID: \"d65c84f1-803c-46b2-86fc-984205295913\") " Jul 01 17:21:36.131509 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:36.131313 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mz8c5\" (UniqueName: \"kubernetes.io/projected/d65c84f1-803c-46b2-86fc-984205295913-kube-api-access-mz8c5\") pod \"d65c84f1-803c-46b2-86fc-984205295913\" (UID: \"d65c84f1-803c-46b2-86fc-984205295913\") " Jul 01 17:21:36.131509 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:36.131345 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d65c84f1-803c-46b2-86fc-984205295913-trusted-ca-bundle\") pod \"d65c84f1-803c-46b2-86fc-984205295913\" (UID: \"d65c84f1-803c-46b2-86fc-984205295913\") " Jul 01 17:21:36.131612 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:36.131506 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d65c84f1-803c-46b2-86fc-984205295913-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d65c84f1-803c-46b2-86fc-984205295913" (UID: "d65c84f1-803c-46b2-86fc-984205295913"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:21:36.131612 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:36.131543 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d65c84f1-803c-46b2-86fc-984205295913-console-config" (OuterVolumeSpecName: "console-config") pod "d65c84f1-803c-46b2-86fc-984205295913" (UID: "d65c84f1-803c-46b2-86fc-984205295913"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:21:36.131612 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:36.131564 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d65c84f1-803c-46b2-86fc-984205295913-service-ca" (OuterVolumeSpecName: "service-ca") pod "d65c84f1-803c-46b2-86fc-984205295913" (UID: "d65c84f1-803c-46b2-86fc-984205295913"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:21:36.131775 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:36.131610 2547 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d65c84f1-803c-46b2-86fc-984205295913-oauth-serving-cert\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:21:36.131887 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:36.131866 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d65c84f1-803c-46b2-86fc-984205295913-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d65c84f1-803c-46b2-86fc-984205295913" (UID: "d65c84f1-803c-46b2-86fc-984205295913"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:21:36.133338 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:36.133317 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d65c84f1-803c-46b2-86fc-984205295913-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d65c84f1-803c-46b2-86fc-984205295913" (UID: "d65c84f1-803c-46b2-86fc-984205295913"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:21:36.133894 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:36.133865 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d65c84f1-803c-46b2-86fc-984205295913-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d65c84f1-803c-46b2-86fc-984205295913" (UID: "d65c84f1-803c-46b2-86fc-984205295913"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:21:36.133991 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:36.133874 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d65c84f1-803c-46b2-86fc-984205295913-kube-api-access-mz8c5" (OuterVolumeSpecName: "kube-api-access-mz8c5") pod "d65c84f1-803c-46b2-86fc-984205295913" (UID: "d65c84f1-803c-46b2-86fc-984205295913"). InnerVolumeSpecName "kube-api-access-mz8c5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:21:36.232271 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:36.232238 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mz8c5\" (UniqueName: \"kubernetes.io/projected/d65c84f1-803c-46b2-86fc-984205295913-kube-api-access-mz8c5\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:21:36.232271 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:36.232269 2547 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d65c84f1-803c-46b2-86fc-984205295913-trusted-ca-bundle\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:21:36.232389 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:36.232280 2547 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d65c84f1-803c-46b2-86fc-984205295913-service-ca\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:21:36.232389 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:36.232290 2547 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d65c84f1-803c-46b2-86fc-984205295913-console-oauth-config\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:21:36.232389 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:36.232299 2547 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d65c84f1-803c-46b2-86fc-984205295913-console-config\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:21:36.232389 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:36.232307 2547 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d65c84f1-803c-46b2-86fc-984205295913-console-serving-cert\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:21:36.834592 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:36.834561 2547 generic.go:356] "Generic (PLEG): container finished" podID="d65c84f1-803c-46b2-86fc-984205295913" containerID="ed138d49a983bf5ea8c42ec881be6af5bee717a07537adea13e7558427b52be9" exitCode=0 Jul 01 17:21:36.834919 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:36.834598 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-858988cddd-vdsp5" Jul 01 17:21:36.834919 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:36.834647 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-858988cddd-vdsp5" event={"ID":"d65c84f1-803c-46b2-86fc-984205295913","Type":"ContainerDied","Data":"ed138d49a983bf5ea8c42ec881be6af5bee717a07537adea13e7558427b52be9"} Jul 01 17:21:36.834919 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:36.834696 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-858988cddd-vdsp5" event={"ID":"d65c84f1-803c-46b2-86fc-984205295913","Type":"ContainerDied","Data":"c735cf154581cf825271d8538b74c746f066c9c465b7cc1dddd1b9f3f9dbec24"} Jul 01 17:21:36.834919 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:36.834719 2547 scope.go:117] "RemoveContainer" containerID="ed138d49a983bf5ea8c42ec881be6af5bee717a07537adea13e7558427b52be9" Jul 01 17:21:36.842914 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:36.842899 2547 scope.go:117] "RemoveContainer" containerID="ed138d49a983bf5ea8c42ec881be6af5bee717a07537adea13e7558427b52be9" Jul 01 17:21:36.843232 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:21:36.843210 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed138d49a983bf5ea8c42ec881be6af5bee717a07537adea13e7558427b52be9\": container with ID starting with ed138d49a983bf5ea8c42ec881be6af5bee717a07537adea13e7558427b52be9 not found: ID does not exist" containerID="ed138d49a983bf5ea8c42ec881be6af5bee717a07537adea13e7558427b52be9" Jul 01 17:21:36.843305 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:36.843238 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed138d49a983bf5ea8c42ec881be6af5bee717a07537adea13e7558427b52be9"} err="failed to get container status \"ed138d49a983bf5ea8c42ec881be6af5bee717a07537adea13e7558427b52be9\": rpc error: code = NotFound desc = could not find container \"ed138d49a983bf5ea8c42ec881be6af5bee717a07537adea13e7558427b52be9\": container with ID starting with ed138d49a983bf5ea8c42ec881be6af5bee717a07537adea13e7558427b52be9 not found: ID does not exist" Jul 01 17:21:36.854261 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:36.854240 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-858988cddd-vdsp5"] Jul 01 17:21:36.857806 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:36.857787 2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-858988cddd-vdsp5"] Jul 01 17:21:38.423746 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:21:38.423708 2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d65c84f1-803c-46b2-86fc-984205295913" path="/var/lib/kubelet/pods/d65c84f1-803c-46b2-86fc-984205295913/volumes" Jul 01 17:22:30.723129 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:22:30.723096 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-9jpt8"] Jul 01 17:22:30.723533 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:22:30.723397 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d65c84f1-803c-46b2-86fc-984205295913" containerName="console" Jul 01 17:22:30.723533 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:22:30.723407 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="d65c84f1-803c-46b2-86fc-984205295913" containerName="console" Jul 01 17:22:30.723533 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:22:30.723473 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="d65c84f1-803c-46b2-86fc-984205295913" containerName="console" Jul 01 17:22:30.726983 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:22:30.726943 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-9jpt8" Jul 01 17:22:30.731644 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:22:30.731621 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Jul 01 17:22:30.731784 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:22:30.731650 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 01 17:22:30.731784 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:22:30.731700 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 01 17:22:30.733417 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:22:30.733398 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-f954g\"" Jul 01 17:22:30.733560 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:22:30.733405 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 01 17:22:30.739738 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:22:30.739712 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-9jpt8"] Jul 01 17:22:30.813937 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:22:30.813914 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/59ba47e8-4291-4964-a132-11752a0a7ec7-certificates\") pod \"keda-admission-5fbd5c4644-9jpt8\" (UID: \"59ba47e8-4291-4964-a132-11752a0a7ec7\") " pod="openshift-keda/keda-admission-5fbd5c4644-9jpt8" Jul 01 17:22:30.814050 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:22:30.814033 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ss79r\" (UniqueName: \"kubernetes.io/projected/59ba47e8-4291-4964-a132-11752a0a7ec7-kube-api-access-ss79r\") pod \"keda-admission-5fbd5c4644-9jpt8\" (UID: \"59ba47e8-4291-4964-a132-11752a0a7ec7\") " pod="openshift-keda/keda-admission-5fbd5c4644-9jpt8" Jul 01 17:22:30.914728 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:22:30.914704 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/59ba47e8-4291-4964-a132-11752a0a7ec7-certificates\") pod \"keda-admission-5fbd5c4644-9jpt8\" (UID: \"59ba47e8-4291-4964-a132-11752a0a7ec7\") " pod="openshift-keda/keda-admission-5fbd5c4644-9jpt8" Jul 01 17:22:30.914820 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:22:30.914758 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ss79r\" (UniqueName: \"kubernetes.io/projected/59ba47e8-4291-4964-a132-11752a0a7ec7-kube-api-access-ss79r\") pod \"keda-admission-5fbd5c4644-9jpt8\" (UID: \"59ba47e8-4291-4964-a132-11752a0a7ec7\") " pod="openshift-keda/keda-admission-5fbd5c4644-9jpt8" Jul 01 17:22:30.917244 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:22:30.917223 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/59ba47e8-4291-4964-a132-11752a0a7ec7-certificates\") pod \"keda-admission-5fbd5c4644-9jpt8\" (UID: \"59ba47e8-4291-4964-a132-11752a0a7ec7\") " pod="openshift-keda/keda-admission-5fbd5c4644-9jpt8" Jul 01 17:22:30.924045 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:22:30.924020 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ss79r\" (UniqueName: \"kubernetes.io/projected/59ba47e8-4291-4964-a132-11752a0a7ec7-kube-api-access-ss79r\") pod \"keda-admission-5fbd5c4644-9jpt8\" (UID: \"59ba47e8-4291-4964-a132-11752a0a7ec7\") " pod="openshift-keda/keda-admission-5fbd5c4644-9jpt8" Jul 01 17:22:31.038811 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:22:31.038794 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-9jpt8" Jul 01 17:22:31.171227 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:22:31.171200 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-9jpt8"] Jul 01 17:22:31.174356 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:22:31.174330 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59ba47e8_4291_4964_a132_11752a0a7ec7.slice/crio-2a46107aa15e99e242cae74fb5e7f8df7799ed2f491d8e96d1f8a8650bbf8529 WatchSource:0}: Error finding container 2a46107aa15e99e242cae74fb5e7f8df7799ed2f491d8e96d1f8a8650bbf8529: Status 404 returned error can't find the container with id 2a46107aa15e99e242cae74fb5e7f8df7799ed2f491d8e96d1f8a8650bbf8529 Jul 01 17:22:31.176013 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:22:31.175995 2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 17:22:32.057616 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:22:32.057574 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-9jpt8" event={"ID":"59ba47e8-4291-4964-a132-11752a0a7ec7","Type":"ContainerStarted","Data":"2a46107aa15e99e242cae74fb5e7f8df7799ed2f491d8e96d1f8a8650bbf8529"} Jul 01 17:22:36.076182 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:22:36.076146 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-9jpt8" event={"ID":"59ba47e8-4291-4964-a132-11752a0a7ec7","Type":"ContainerStarted","Data":"181766cda17b9733f13a3a3267ee6c1834b225ca5d2bc41bb5e4e31063fa8d4a"} Jul 01 17:22:36.076560 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:22:36.076227 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-5fbd5c4644-9jpt8" Jul 01 17:22:36.094278 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:22:36.094234 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-5fbd5c4644-9jpt8" podStartSLOduration=2.039899909 podStartE2EDuration="6.094219604s" totalImagesPullingTime="4.054319695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:22:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:22:36.094182958 +0000 UTC m=+386.126180223" watchObservedRunningTime="2026-07-01 17:22:36.094219604 +0000 UTC m=+386.126216864" Jul 01 17:22:57.082620 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:22:57.082586 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-5fbd5c4644-9jpt8" Jul 01 17:23:38.553227 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:23:38.553144 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-sdqp2"] Jul 01 17:23:38.556328 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:23:38.556306 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-67d95fdc48-sdqp2" Jul 01 17:23:38.561038 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:23:38.561021 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 01 17:23:38.561434 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:23:38.561417 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Jul 01 17:23:38.561886 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:23:38.561862 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-vqwj9\"" Jul 01 17:23:38.562006 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:23:38.561914 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 01 17:23:38.581770 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:23:38.581748 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-sdqp2"] Jul 01 17:23:38.588628 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:23:38.588612 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-x2dxg"] Jul 01 17:23:38.591481 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:23:38.591467 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-x2dxg" Jul 01 17:23:38.594352 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:23:38.594336 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 01 17:23:38.594487 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:23:38.594474 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-vgqfv\"" Jul 01 17:23:38.604933 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:23:38.604912 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-x2dxg"] Jul 01 17:23:38.700235 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:23:38.700212 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e769cca4-49d6-4360-8baf-65926b575fd8-cert\") pod \"llmisvc-controller-manager-67d95fdc48-sdqp2\" (UID: \"e769cca4-49d6-4360-8baf-65926b575fd8\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-sdqp2" Jul 01 17:23:38.700340 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:23:38.700244 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a22f29d4-08e9-48a4-a342-02a3ed8ffaae-data\") pod \"seaweedfs-64568bcd49-x2dxg\" (UID: \"a22f29d4-08e9-48a4-a342-02a3ed8ffaae\") " pod="kserve/seaweedfs-64568bcd49-x2dxg" Jul 01 17:23:38.700340 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:23:38.700272 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z545c\" (UniqueName: \"kubernetes.io/projected/e769cca4-49d6-4360-8baf-65926b575fd8-kube-api-access-z545c\") pod \"llmisvc-controller-manager-67d95fdc48-sdqp2\" (UID: \"e769cca4-49d6-4360-8baf-65926b575fd8\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-sdqp2" Jul 01 17:23:38.700448 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:23:38.700377 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvf8f\" (UniqueName: \"kubernetes.io/projected/a22f29d4-08e9-48a4-a342-02a3ed8ffaae-kube-api-access-hvf8f\") pod \"seaweedfs-64568bcd49-x2dxg\" (UID: \"a22f29d4-08e9-48a4-a342-02a3ed8ffaae\") " pod="kserve/seaweedfs-64568bcd49-x2dxg" Jul 01 17:23:38.801773 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:23:38.801743 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a22f29d4-08e9-48a4-a342-02a3ed8ffaae-data\") pod \"seaweedfs-64568bcd49-x2dxg\" (UID: \"a22f29d4-08e9-48a4-a342-02a3ed8ffaae\") " pod="kserve/seaweedfs-64568bcd49-x2dxg" Jul 01 17:23:38.801885 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:23:38.801798 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z545c\" (UniqueName: \"kubernetes.io/projected/e769cca4-49d6-4360-8baf-65926b575fd8-kube-api-access-z545c\") pod \"llmisvc-controller-manager-67d95fdc48-sdqp2\" (UID: \"e769cca4-49d6-4360-8baf-65926b575fd8\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-sdqp2" Jul 01 17:23:38.801885 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:23:38.801851 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvf8f\" (UniqueName: \"kubernetes.io/projected/a22f29d4-08e9-48a4-a342-02a3ed8ffaae-kube-api-access-hvf8f\") pod \"seaweedfs-64568bcd49-x2dxg\" (UID: \"a22f29d4-08e9-48a4-a342-02a3ed8ffaae\") " pod="kserve/seaweedfs-64568bcd49-x2dxg" Jul 01 17:23:38.802037 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:23:38.801912 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e769cca4-49d6-4360-8baf-65926b575fd8-cert\") pod \"llmisvc-controller-manager-67d95fdc48-sdqp2\" (UID: \"e769cca4-49d6-4360-8baf-65926b575fd8\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-sdqp2" Jul 01 17:23:38.802291 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:23:38.802261 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a22f29d4-08e9-48a4-a342-02a3ed8ffaae-data\") pod \"seaweedfs-64568bcd49-x2dxg\" (UID: \"a22f29d4-08e9-48a4-a342-02a3ed8ffaae\") " pod="kserve/seaweedfs-64568bcd49-x2dxg" Jul 01 17:23:38.804690 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:23:38.804629 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e769cca4-49d6-4360-8baf-65926b575fd8-cert\") pod \"llmisvc-controller-manager-67d95fdc48-sdqp2\" (UID: \"e769cca4-49d6-4360-8baf-65926b575fd8\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-sdqp2" Jul 01 17:23:38.812031 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:23:38.812006 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z545c\" (UniqueName: \"kubernetes.io/projected/e769cca4-49d6-4360-8baf-65926b575fd8-kube-api-access-z545c\") pod \"llmisvc-controller-manager-67d95fdc48-sdqp2\" (UID: \"e769cca4-49d6-4360-8baf-65926b575fd8\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-sdqp2" Jul 01 17:23:38.812122 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:23:38.812064 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvf8f\" (UniqueName: \"kubernetes.io/projected/a22f29d4-08e9-48a4-a342-02a3ed8ffaae-kube-api-access-hvf8f\") pod \"seaweedfs-64568bcd49-x2dxg\" (UID: \"a22f29d4-08e9-48a4-a342-02a3ed8ffaae\") " pod="kserve/seaweedfs-64568bcd49-x2dxg" Jul 01 17:23:38.867051 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:23:38.867020 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-67d95fdc48-sdqp2" Jul 01 17:23:38.899853 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:23:38.899833 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-x2dxg" Jul 01 17:23:39.009547 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:23:39.009521 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-sdqp2"] Jul 01 17:23:39.011540 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:23:39.011512 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode769cca4_49d6_4360_8baf_65926b575fd8.slice/crio-7d1a73a99cf790f35c655300ba2aa76e8f1af562ed709178f97e8d1f7fe9e185 WatchSource:0}: Error finding container 7d1a73a99cf790f35c655300ba2aa76e8f1af562ed709178f97e8d1f7fe9e185: Status 404 returned error can't find the container with id 7d1a73a99cf790f35c655300ba2aa76e8f1af562ed709178f97e8d1f7fe9e185 Jul 01 17:23:39.035294 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:23:39.035270 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-x2dxg"] Jul 01 17:23:39.036976 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:23:39.036935 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda22f29d4_08e9_48a4_a342_02a3ed8ffaae.slice/crio-8cef11b1b1274769ba45650ae1bc6d3f7045938bd217ee74d3c2e766f3c715d2 WatchSource:0}: Error finding container 8cef11b1b1274769ba45650ae1bc6d3f7045938bd217ee74d3c2e766f3c715d2: Status 404 returned error can't find the container with id 8cef11b1b1274769ba45650ae1bc6d3f7045938bd217ee74d3c2e766f3c715d2 Jul 01 17:23:39.344804 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:23:39.344774 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-sdqp2" event={"ID":"e769cca4-49d6-4360-8baf-65926b575fd8","Type":"ContainerStarted","Data":"7d1a73a99cf790f35c655300ba2aa76e8f1af562ed709178f97e8d1f7fe9e185"} Jul 01 17:23:39.345979 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:23:39.345935 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-x2dxg" event={"ID":"a22f29d4-08e9-48a4-a342-02a3ed8ffaae","Type":"ContainerStarted","Data":"8cef11b1b1274769ba45650ae1bc6d3f7045938bd217ee74d3c2e766f3c715d2"} Jul 01 17:23:41.356261 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:23:41.356194 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-sdqp2" event={"ID":"e769cca4-49d6-4360-8baf-65926b575fd8","Type":"ContainerStarted","Data":"61bde88b866ce06613c4c39896ae22a235fd8ce388c042e8524e00044826805e"} Jul 01 17:23:41.356572 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:23:41.356297 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-sdqp2" Jul 01 17:23:41.377446 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:23:41.377397 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-67d95fdc48-sdqp2" podStartSLOduration=1.3594568360000001 podStartE2EDuration="3.377383615s" totalImagesPullingTime="2.017926779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:23:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:23:41.37660978 +0000 UTC m=+451.408607040" watchObservedRunningTime="2026-07-01 17:23:41.377383615 +0000 UTC m=+451.409380874" Jul 01 17:23:43.366966 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:23:43.366912 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-x2dxg" event={"ID":"a22f29d4-08e9-48a4-a342-02a3ed8ffaae","Type":"ContainerStarted","Data":"8709f8b6a9fcd77c4b932f61d78e5165d798ca1afee11c4b9c877b9b9171dc58"} Jul 01 17:23:43.367398 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:23:43.367008 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-x2dxg" Jul 01 17:23:43.384903 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:23:43.384856 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-x2dxg" podStartSLOduration=1.638474064 podStartE2EDuration="5.384844578s" totalImagesPullingTime="3.746370514s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:23:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:23:43.384276191 +0000 UTC m=+453.416273472" watchObservedRunningTime="2026-07-01 17:23:43.384844578 +0000 UTC m=+453.416841837" Jul 01 17:23:49.373491 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:23:49.373465 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-x2dxg" Jul 01 17:24:12.363088 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:24:12.363057 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-sdqp2" Jul 01 17:24:13.848758 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:24:13.848717 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-848c499849-m6bdk"] Jul 01 17:24:13.855550 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:24:13.855530 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-848c499849-m6bdk" Jul 01 17:24:13.860218 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:24:13.860175 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-qr799\"" Jul 01 17:24:13.860218 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:24:13.860201 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" Jul 01 17:24:13.861925 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:24:13.861899 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-848c499849-m6bdk"] Jul 01 17:24:13.954130 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:24:13.954099 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee913519-3923-48fa-9475-ef5c5779c597-cert\") pod \"kserve-controller-manager-848c499849-m6bdk\" (UID: \"ee913519-3923-48fa-9475-ef5c5779c597\") " pod="kserve/kserve-controller-manager-848c499849-m6bdk" Jul 01 17:24:13.954241 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:24:13.954134 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kqh9\" (UniqueName: \"kubernetes.io/projected/ee913519-3923-48fa-9475-ef5c5779c597-kube-api-access-5kqh9\") pod \"kserve-controller-manager-848c499849-m6bdk\" (UID: \"ee913519-3923-48fa-9475-ef5c5779c597\") " pod="kserve/kserve-controller-manager-848c499849-m6bdk" Jul 01 17:24:14.055298 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:24:14.055271 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee913519-3923-48fa-9475-ef5c5779c597-cert\") pod \"kserve-controller-manager-848c499849-m6bdk\" (UID: \"ee913519-3923-48fa-9475-ef5c5779c597\") " pod="kserve/kserve-controller-manager-848c499849-m6bdk" Jul 01 17:24:14.055399 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:24:14.055311 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kqh9\" (UniqueName: \"kubernetes.io/projected/ee913519-3923-48fa-9475-ef5c5779c597-kube-api-access-5kqh9\") pod \"kserve-controller-manager-848c499849-m6bdk\" (UID: \"ee913519-3923-48fa-9475-ef5c5779c597\") " pod="kserve/kserve-controller-manager-848c499849-m6bdk" Jul 01 17:24:14.057939 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:24:14.057906 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee913519-3923-48fa-9475-ef5c5779c597-cert\") pod \"kserve-controller-manager-848c499849-m6bdk\" (UID: \"ee913519-3923-48fa-9475-ef5c5779c597\") " pod="kserve/kserve-controller-manager-848c499849-m6bdk" Jul 01 17:24:14.064637 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:24:14.064613 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kqh9\" (UniqueName: \"kubernetes.io/projected/ee913519-3923-48fa-9475-ef5c5779c597-kube-api-access-5kqh9\") pod \"kserve-controller-manager-848c499849-m6bdk\" (UID: \"ee913519-3923-48fa-9475-ef5c5779c597\") " pod="kserve/kserve-controller-manager-848c499849-m6bdk" Jul 01 17:24:14.167719 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:24:14.167660 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-848c499849-m6bdk" Jul 01 17:24:14.298530 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:24:14.298505 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-848c499849-m6bdk"] Jul 01 17:24:14.300262 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:24:14.300234 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee913519_3923_48fa_9475_ef5c5779c597.slice/crio-80f30342bf3954f0c80c2ace0becbe83709a5a666c20760ed1f942220277802b WatchSource:0}: Error finding container 80f30342bf3954f0c80c2ace0becbe83709a5a666c20760ed1f942220277802b: Status 404 returned error can't find the container with id 80f30342bf3954f0c80c2ace0becbe83709a5a666c20760ed1f942220277802b Jul 01 17:24:14.501997 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:24:14.501966 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-848c499849-m6bdk" event={"ID":"ee913519-3923-48fa-9475-ef5c5779c597","Type":"ContainerStarted","Data":"80f30342bf3954f0c80c2ace0becbe83709a5a666c20760ed1f942220277802b"} Jul 01 17:24:17.517708 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:24:17.517674 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-848c499849-m6bdk" event={"ID":"ee913519-3923-48fa-9475-ef5c5779c597","Type":"ContainerStarted","Data":"2b986d822e53c3175592aa1e08b66d717986025082a5b3701a95a5141b742d8f"} Jul 01 17:24:17.518179 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:24:17.517748 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-848c499849-m6bdk" Jul 01 17:24:17.537900 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:24:17.537854 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-848c499849-m6bdk" podStartSLOduration=2.008812039 podStartE2EDuration="4.537836074s" totalImagesPullingTime="2.529024035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:24:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:24:17.536321484 +0000 UTC m=+487.568318763" watchObservedRunningTime="2026-07-01 17:24:17.537836074 +0000 UTC m=+487.569833334" Jul 01 17:24:48.527220 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:24:48.527190 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-848c499849-m6bdk" Jul 01 17:24:51.652731 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:24:51.652702 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d4d787c6d-s7vr9"] Jul 01 17:24:51.657735 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:24:51.657713 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d4d787c6d-s7vr9" Jul 01 17:24:51.672814 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:24:51.672793 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d4d787c6d-s7vr9"] Jul 01 17:24:51.741523 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:24:51.741500 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b9fc45bc-6257-4dec-b66e-f6fa584898ca-console-config\") pod \"console-7d4d787c6d-s7vr9\" (UID: \"b9fc45bc-6257-4dec-b66e-f6fa584898ca\") " pod="openshift-console/console-7d4d787c6d-s7vr9" Jul 01 17:24:51.741626 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:24:51.741536 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b9fc45bc-6257-4dec-b66e-f6fa584898ca-service-ca\") pod \"console-7d4d787c6d-s7vr9\" (UID: \"b9fc45bc-6257-4dec-b66e-f6fa584898ca\") " pod="openshift-console/console-7d4d787c6d-s7vr9" Jul 01 17:24:51.741626 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:24:51.741558 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b9fc45bc-6257-4dec-b66e-f6fa584898ca-console-oauth-config\") pod \"console-7d4d787c6d-s7vr9\" (UID: \"b9fc45bc-6257-4dec-b66e-f6fa584898ca\") " pod="openshift-console/console-7d4d787c6d-s7vr9" Jul 01 17:24:51.741698 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:24:51.741636 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9fc45bc-6257-4dec-b66e-f6fa584898ca-trusted-ca-bundle\") pod \"console-7d4d787c6d-s7vr9\" (UID: \"b9fc45bc-6257-4dec-b66e-f6fa584898ca\") " pod="openshift-console/console-7d4d787c6d-s7vr9" Jul 01 17:24:51.741698 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:24:51.741655 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g287s\" (UniqueName: \"kubernetes.io/projected/b9fc45bc-6257-4dec-b66e-f6fa584898ca-kube-api-access-g287s\") pod \"console-7d4d787c6d-s7vr9\" (UID: \"b9fc45bc-6257-4dec-b66e-f6fa584898ca\") " pod="openshift-console/console-7d4d787c6d-s7vr9" Jul 01 17:24:51.741698 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:24:51.741678 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b9fc45bc-6257-4dec-b66e-f6fa584898ca-oauth-serving-cert\") pod \"console-7d4d787c6d-s7vr9\" (UID: \"b9fc45bc-6257-4dec-b66e-f6fa584898ca\") " pod="openshift-console/console-7d4d787c6d-s7vr9" Jul 01 17:24:51.741790 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:24:51.741727 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b9fc45bc-6257-4dec-b66e-f6fa584898ca-console-serving-cert\") pod \"console-7d4d787c6d-s7vr9\" (UID: \"b9fc45bc-6257-4dec-b66e-f6fa584898ca\") " pod="openshift-console/console-7d4d787c6d-s7vr9" Jul 01 17:24:51.842573 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:24:51.842551 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b9fc45bc-6257-4dec-b66e-f6fa584898ca-service-ca\") pod \"console-7d4d787c6d-s7vr9\" (UID: \"b9fc45bc-6257-4dec-b66e-f6fa584898ca\") " pod="openshift-console/console-7d4d787c6d-s7vr9" Jul 01 17:24:51.842667 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:24:51.842581 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b9fc45bc-6257-4dec-b66e-f6fa584898ca-console-oauth-config\") pod \"console-7d4d787c6d-s7vr9\" (UID: \"b9fc45bc-6257-4dec-b66e-f6fa584898ca\") " pod="openshift-console/console-7d4d787c6d-s7vr9" Jul 01 17:24:51.842667 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:24:51.842607 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9fc45bc-6257-4dec-b66e-f6fa584898ca-trusted-ca-bundle\") pod \"console-7d4d787c6d-s7vr9\" (UID: \"b9fc45bc-6257-4dec-b66e-f6fa584898ca\") " pod="openshift-console/console-7d4d787c6d-s7vr9" Jul 01 17:24:51.842752 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:24:51.842734 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g287s\" (UniqueName: \"kubernetes.io/projected/b9fc45bc-6257-4dec-b66e-f6fa584898ca-kube-api-access-g287s\") pod \"console-7d4d787c6d-s7vr9\" (UID: \"b9fc45bc-6257-4dec-b66e-f6fa584898ca\") " pod="openshift-console/console-7d4d787c6d-s7vr9" Jul 01 17:24:51.842793 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:24:51.842777 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b9fc45bc-6257-4dec-b66e-f6fa584898ca-oauth-serving-cert\") pod \"console-7d4d787c6d-s7vr9\" (UID: \"b9fc45bc-6257-4dec-b66e-f6fa584898ca\") " pod="openshift-console/console-7d4d787c6d-s7vr9" Jul 01 17:24:51.842840 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:24:51.842826 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b9fc45bc-6257-4dec-b66e-f6fa584898ca-console-serving-cert\") pod \"console-7d4d787c6d-s7vr9\" (UID: \"b9fc45bc-6257-4dec-b66e-f6fa584898ca\") " pod="openshift-console/console-7d4d787c6d-s7vr9" Jul 01 17:24:51.842886 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:24:51.842864 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b9fc45bc-6257-4dec-b66e-f6fa584898ca-console-config\") pod \"console-7d4d787c6d-s7vr9\" (UID: \"b9fc45bc-6257-4dec-b66e-f6fa584898ca\") " pod="openshift-console/console-7d4d787c6d-s7vr9" Jul 01 17:24:51.843424 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:24:51.843350 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b9fc45bc-6257-4dec-b66e-f6fa584898ca-service-ca\") pod \"console-7d4d787c6d-s7vr9\" (UID: \"b9fc45bc-6257-4dec-b66e-f6fa584898ca\") " pod="openshift-console/console-7d4d787c6d-s7vr9" Jul 01 17:24:51.843424 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:24:51.843430 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9fc45bc-6257-4dec-b66e-f6fa584898ca-trusted-ca-bundle\") pod \"console-7d4d787c6d-s7vr9\" (UID: \"b9fc45bc-6257-4dec-b66e-f6fa584898ca\") " pod="openshift-console/console-7d4d787c6d-s7vr9" Jul 01 17:24:51.843424 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:24:51.843464 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b9fc45bc-6257-4dec-b66e-f6fa584898ca-oauth-serving-cert\") pod \"console-7d4d787c6d-s7vr9\" (UID: \"b9fc45bc-6257-4dec-b66e-f6fa584898ca\") " pod="openshift-console/console-7d4d787c6d-s7vr9" Jul 01 17:24:51.843691 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:24:51.843507 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b9fc45bc-6257-4dec-b66e-f6fa584898ca-console-config\") pod \"console-7d4d787c6d-s7vr9\" (UID: \"b9fc45bc-6257-4dec-b66e-f6fa584898ca\") " pod="openshift-console/console-7d4d787c6d-s7vr9" Jul 01 17:24:51.845210 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:24:51.845186 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b9fc45bc-6257-4dec-b66e-f6fa584898ca-console-oauth-config\") pod \"console-7d4d787c6d-s7vr9\" (UID: \"b9fc45bc-6257-4dec-b66e-f6fa584898ca\") " pod="openshift-console/console-7d4d787c6d-s7vr9" Jul 01 17:24:51.845331 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:24:51.845313 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b9fc45bc-6257-4dec-b66e-f6fa584898ca-console-serving-cert\") pod \"console-7d4d787c6d-s7vr9\" (UID: \"b9fc45bc-6257-4dec-b66e-f6fa584898ca\") " pod="openshift-console/console-7d4d787c6d-s7vr9" Jul 01 17:24:51.855706 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:24:51.855685 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g287s\" (UniqueName: \"kubernetes.io/projected/b9fc45bc-6257-4dec-b66e-f6fa584898ca-kube-api-access-g287s\") pod \"console-7d4d787c6d-s7vr9\" (UID: \"b9fc45bc-6257-4dec-b66e-f6fa584898ca\") " pod="openshift-console/console-7d4d787c6d-s7vr9" Jul 01 17:24:51.966942 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:24:51.966889 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d4d787c6d-s7vr9" Jul 01 17:24:52.095190 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:24:52.095164 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d4d787c6d-s7vr9"] Jul 01 17:24:52.096654 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:24:52.096627 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9fc45bc_6257_4dec_b66e_f6fa584898ca.slice/crio-e42b0cdc55c3ff918317fbd26111f4ce2e6999ea3c63f56f0b0fa68d6423b1b2 WatchSource:0}: Error finding container e42b0cdc55c3ff918317fbd26111f4ce2e6999ea3c63f56f0b0fa68d6423b1b2: Status 404 returned error can't find the container with id e42b0cdc55c3ff918317fbd26111f4ce2e6999ea3c63f56f0b0fa68d6423b1b2 Jul 01 17:24:52.660890 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:24:52.660858 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d4d787c6d-s7vr9" event={"ID":"b9fc45bc-6257-4dec-b66e-f6fa584898ca","Type":"ContainerStarted","Data":"6e5d040745c0933d8607faa144e7ee3aa4e1e60c97076bc86192c746c7876015"} Jul 01 17:24:52.661289 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:24:52.660910 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d4d787c6d-s7vr9" event={"ID":"b9fc45bc-6257-4dec-b66e-f6fa584898ca","Type":"ContainerStarted","Data":"e42b0cdc55c3ff918317fbd26111f4ce2e6999ea3c63f56f0b0fa68d6423b1b2"} Jul 01 17:24:52.697191 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:24:52.697150 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d4d787c6d-s7vr9" podStartSLOduration=1.6971348640000001 podStartE2EDuration="1.697134864s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:24:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:24:52.69503762 +0000 UTC m=+522.727034898" watchObservedRunningTime="2026-07-01 17:24:52.697134864 +0000 UTC m=+522.729132188" Jul 01 17:25:01.967424 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:25:01.967347 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d4d787c6d-s7vr9" Jul 01 17:25:01.967424 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:25:01.967398 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d4d787c6d-s7vr9" Jul 01 17:25:01.977015 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:25:01.973660 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d4d787c6d-s7vr9" Jul 01 17:25:02.706203 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:25:02.706173 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d4d787c6d-s7vr9" Jul 01 17:25:02.760613 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:25:02.760586 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c79dcb45b-2kw7r"] Jul 01 17:25:27.781466 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:25:27.781398 2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-c79dcb45b-2kw7r" podUID="27ef9fa8-e164-4a33-8993-1e62a2ac04c5" containerName="console" containerID="cri-o://490e09d35fda7ca64e8a7e658601602b75e2223369f9a45e8d5b66395f9f75aa" gracePeriod=15 Jul 01 17:25:28.026568 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:25:28.026541 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c79dcb45b-2kw7r" Jul 01 17:25:28.139379 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:25:28.139323 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27ef9fa8-e164-4a33-8993-1e62a2ac04c5-trusted-ca-bundle\") pod \"27ef9fa8-e164-4a33-8993-1e62a2ac04c5\" (UID: \"27ef9fa8-e164-4a33-8993-1e62a2ac04c5\") " Jul 01 17:25:28.139379 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:25:28.139355 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27ef9fa8-e164-4a33-8993-1e62a2ac04c5-console-oauth-config\") pod \"27ef9fa8-e164-4a33-8993-1e62a2ac04c5\" (UID: \"27ef9fa8-e164-4a33-8993-1e62a2ac04c5\") " Jul 01 17:25:28.139379 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:25:28.139375 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nt8hv\" (UniqueName: \"kubernetes.io/projected/27ef9fa8-e164-4a33-8993-1e62a2ac04c5-kube-api-access-nt8hv\") pod \"27ef9fa8-e164-4a33-8993-1e62a2ac04c5\" (UID: \"27ef9fa8-e164-4a33-8993-1e62a2ac04c5\") " Jul 01 17:25:28.139607 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:25:28.139395 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27ef9fa8-e164-4a33-8993-1e62a2ac04c5-console-config\") pod \"27ef9fa8-e164-4a33-8993-1e62a2ac04c5\" (UID: \"27ef9fa8-e164-4a33-8993-1e62a2ac04c5\") " Jul 01 17:25:28.139607 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:25:28.139434 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27ef9fa8-e164-4a33-8993-1e62a2ac04c5-oauth-serving-cert\") pod \"27ef9fa8-e164-4a33-8993-1e62a2ac04c5\" (UID: \"27ef9fa8-e164-4a33-8993-1e62a2ac04c5\") " Jul 01 17:25:28.139607 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:25:28.139475 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27ef9fa8-e164-4a33-8993-1e62a2ac04c5-service-ca\") pod \"27ef9fa8-e164-4a33-8993-1e62a2ac04c5\" (UID: \"27ef9fa8-e164-4a33-8993-1e62a2ac04c5\") " Jul 01 17:25:28.139607 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:25:28.139523 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27ef9fa8-e164-4a33-8993-1e62a2ac04c5-console-serving-cert\") pod \"27ef9fa8-e164-4a33-8993-1e62a2ac04c5\" (UID: \"27ef9fa8-e164-4a33-8993-1e62a2ac04c5\") " Jul 01 17:25:28.139910 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:25:28.139865 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27ef9fa8-e164-4a33-8993-1e62a2ac04c5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "27ef9fa8-e164-4a33-8993-1e62a2ac04c5" (UID: "27ef9fa8-e164-4a33-8993-1e62a2ac04c5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:25:28.139910 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:25:28.139888 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27ef9fa8-e164-4a33-8993-1e62a2ac04c5-console-config" (OuterVolumeSpecName: "console-config") pod "27ef9fa8-e164-4a33-8993-1e62a2ac04c5" (UID: "27ef9fa8-e164-4a33-8993-1e62a2ac04c5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:25:28.140129 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:25:28.140044 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27ef9fa8-e164-4a33-8993-1e62a2ac04c5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "27ef9fa8-e164-4a33-8993-1e62a2ac04c5" (UID: "27ef9fa8-e164-4a33-8993-1e62a2ac04c5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:25:28.140129 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:25:28.140060 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27ef9fa8-e164-4a33-8993-1e62a2ac04c5-service-ca" (OuterVolumeSpecName: "service-ca") pod "27ef9fa8-e164-4a33-8993-1e62a2ac04c5" (UID: "27ef9fa8-e164-4a33-8993-1e62a2ac04c5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:25:28.141715 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:25:28.141687 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27ef9fa8-e164-4a33-8993-1e62a2ac04c5-kube-api-access-nt8hv" (OuterVolumeSpecName: "kube-api-access-nt8hv") pod "27ef9fa8-e164-4a33-8993-1e62a2ac04c5" (UID: "27ef9fa8-e164-4a33-8993-1e62a2ac04c5"). InnerVolumeSpecName "kube-api-access-nt8hv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:25:28.141816 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:25:28.141732 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27ef9fa8-e164-4a33-8993-1e62a2ac04c5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "27ef9fa8-e164-4a33-8993-1e62a2ac04c5" (UID: "27ef9fa8-e164-4a33-8993-1e62a2ac04c5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:25:28.141816 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:25:28.141765 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27ef9fa8-e164-4a33-8993-1e62a2ac04c5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "27ef9fa8-e164-4a33-8993-1e62a2ac04c5" (UID: "27ef9fa8-e164-4a33-8993-1e62a2ac04c5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:25:28.240879 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:25:28.240857 2547 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27ef9fa8-e164-4a33-8993-1e62a2ac04c5-console-serving-cert\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:25:28.240879 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:25:28.240876 2547 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27ef9fa8-e164-4a33-8993-1e62a2ac04c5-trusted-ca-bundle\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:25:28.241033 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:25:28.240886 2547 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27ef9fa8-e164-4a33-8993-1e62a2ac04c5-console-oauth-config\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:25:28.241033 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:25:28.240895 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nt8hv\" (UniqueName: \"kubernetes.io/projected/27ef9fa8-e164-4a33-8993-1e62a2ac04c5-kube-api-access-nt8hv\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:25:28.241033 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:25:28.240904 2547 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27ef9fa8-e164-4a33-8993-1e62a2ac04c5-console-config\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:25:28.241033 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:25:28.240912 2547 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27ef9fa8-e164-4a33-8993-1e62a2ac04c5-oauth-serving-cert\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:25:28.241033 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:25:28.240920 2547 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27ef9fa8-e164-4a33-8993-1e62a2ac04c5-service-ca\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:25:28.812231 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:25:28.812196 2547 generic.go:356] "Generic (PLEG): container finished" podID="27ef9fa8-e164-4a33-8993-1e62a2ac04c5" containerID="490e09d35fda7ca64e8a7e658601602b75e2223369f9a45e8d5b66395f9f75aa" exitCode=0 Jul 01 17:25:28.812663 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:25:28.812245 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c79dcb45b-2kw7r" Jul 01 17:25:28.812663 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:25:28.812256 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c79dcb45b-2kw7r" event={"ID":"27ef9fa8-e164-4a33-8993-1e62a2ac04c5","Type":"ContainerDied","Data":"490e09d35fda7ca64e8a7e658601602b75e2223369f9a45e8d5b66395f9f75aa"} Jul 01 17:25:28.812663 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:25:28.812297 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c79dcb45b-2kw7r" event={"ID":"27ef9fa8-e164-4a33-8993-1e62a2ac04c5","Type":"ContainerDied","Data":"12ff0902db8420e54ccc54517d48ec195adbc5d8753f1f9b2bdb1456fbacce5e"} Jul 01 17:25:28.812663 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:25:28.812316 2547 scope.go:117] "RemoveContainer" containerID="490e09d35fda7ca64e8a7e658601602b75e2223369f9a45e8d5b66395f9f75aa" Jul 01 17:25:28.820701 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:25:28.820685 2547 scope.go:117] "RemoveContainer" containerID="490e09d35fda7ca64e8a7e658601602b75e2223369f9a45e8d5b66395f9f75aa" Jul 01 17:25:28.821010 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:25:28.820987 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"490e09d35fda7ca64e8a7e658601602b75e2223369f9a45e8d5b66395f9f75aa\": container with ID starting with 490e09d35fda7ca64e8a7e658601602b75e2223369f9a45e8d5b66395f9f75aa not found: ID does not exist" containerID="490e09d35fda7ca64e8a7e658601602b75e2223369f9a45e8d5b66395f9f75aa" Jul 01 17:25:28.821068 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:25:28.821020 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"490e09d35fda7ca64e8a7e658601602b75e2223369f9a45e8d5b66395f9f75aa"} err="failed to get container status \"490e09d35fda7ca64e8a7e658601602b75e2223369f9a45e8d5b66395f9f75aa\": rpc error: code = NotFound desc = could not find container \"490e09d35fda7ca64e8a7e658601602b75e2223369f9a45e8d5b66395f9f75aa\": container with ID starting with 490e09d35fda7ca64e8a7e658601602b75e2223369f9a45e8d5b66395f9f75aa not found: ID does not exist" Jul 01 17:25:28.830735 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:25:28.830714 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c79dcb45b-2kw7r"] Jul 01 17:25:28.837488 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:25:28.837461 2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c79dcb45b-2kw7r"] Jul 01 17:25:30.423871 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:25:30.423838 2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27ef9fa8-e164-4a33-8993-1e62a2ac04c5" path="/var/lib/kubelet/pods/27ef9fa8-e164-4a33-8993-1e62a2ac04c5/volumes" Jul 01 17:26:10.401360 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:26:10.401330 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qh49d_aa1fdd8a-5b35-4bac-9836-028a3292e25c/ovn-acl-logging/0.log" Jul 01 17:26:10.403458 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:26:10.403432 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qh49d_aa1fdd8a-5b35-4bac-9836-028a3292e25c/ovn-acl-logging/0.log" Jul 01 17:30:22.927976 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:30:22.927924 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-99462-5d8d7b948b-5tkjb"] Jul 01 17:30:22.928474 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:30:22.928305 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27ef9fa8-e164-4a33-8993-1e62a2ac04c5" containerName="console" Jul 01 17:30:22.928474 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:30:22.928318 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="27ef9fa8-e164-4a33-8993-1e62a2ac04c5" containerName="console" Jul 01 17:30:22.928474 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:30:22.928384 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="27ef9fa8-e164-4a33-8993-1e62a2ac04c5" containerName="console" Jul 01 17:30:22.931247 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:30:22.931232 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-99462-5d8d7b948b-5tkjb" Jul 01 17:30:22.934429 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:30:22.934401 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-99462-serving-cert\"" Jul 01 17:30:22.934577 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:30:22.934432 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-99462-kube-rbac-proxy-sar-config\"" Jul 01 17:30:22.934725 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:30:22.934709 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-xldfq\"" Jul 01 17:30:22.934777 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:30:22.934712 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 01 17:30:22.941783 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:30:22.941758 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-99462-5d8d7b948b-5tkjb"] Jul 01 17:30:22.992891 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:30:22.992856 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8216ad57-ba35-4cc1-abc3-b876da3b4a58-proxy-tls\") pod \"model-chainer-raw-99462-5d8d7b948b-5tkjb\" (UID: \"8216ad57-ba35-4cc1-abc3-b876da3b4a58\") " pod="kserve-ci-e2e-test/model-chainer-raw-99462-5d8d7b948b-5tkjb" Jul 01 17:30:22.993055 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:30:22.992925 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8216ad57-ba35-4cc1-abc3-b876da3b4a58-openshift-service-ca-bundle\") pod \"model-chainer-raw-99462-5d8d7b948b-5tkjb\" (UID: \"8216ad57-ba35-4cc1-abc3-b876da3b4a58\") " pod="kserve-ci-e2e-test/model-chainer-raw-99462-5d8d7b948b-5tkjb" Jul 01 17:30:23.093915 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:30:23.093880 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8216ad57-ba35-4cc1-abc3-b876da3b4a58-openshift-service-ca-bundle\") pod \"model-chainer-raw-99462-5d8d7b948b-5tkjb\" (UID: \"8216ad57-ba35-4cc1-abc3-b876da3b4a58\") " pod="kserve-ci-e2e-test/model-chainer-raw-99462-5d8d7b948b-5tkjb" Jul 01 17:30:23.094108 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:30:23.093930 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8216ad57-ba35-4cc1-abc3-b876da3b4a58-proxy-tls\") pod \"model-chainer-raw-99462-5d8d7b948b-5tkjb\" (UID: \"8216ad57-ba35-4cc1-abc3-b876da3b4a58\") " pod="kserve-ci-e2e-test/model-chainer-raw-99462-5d8d7b948b-5tkjb" Jul 01 17:30:23.094108 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:30:23.094073 2547 secret.go:189] Couldn't get secret kserve-ci-e2e-test/model-chainer-raw-99462-serving-cert: secret "model-chainer-raw-99462-serving-cert" not found Jul 01 17:30:23.094180 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:30:23.094143 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8216ad57-ba35-4cc1-abc3-b876da3b4a58-proxy-tls podName:8216ad57-ba35-4cc1-abc3-b876da3b4a58 nodeName:}" failed. No retries permitted until 2026-07-01 17:30:23.59412002 +0000 UTC m=+853.626117259 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/8216ad57-ba35-4cc1-abc3-b876da3b4a58-proxy-tls") pod "model-chainer-raw-99462-5d8d7b948b-5tkjb" (UID: "8216ad57-ba35-4cc1-abc3-b876da3b4a58") : secret "model-chainer-raw-99462-serving-cert" not found Jul 01 17:30:23.094582 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:30:23.094562 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8216ad57-ba35-4cc1-abc3-b876da3b4a58-openshift-service-ca-bundle\") pod \"model-chainer-raw-99462-5d8d7b948b-5tkjb\" (UID: \"8216ad57-ba35-4cc1-abc3-b876da3b4a58\") " pod="kserve-ci-e2e-test/model-chainer-raw-99462-5d8d7b948b-5tkjb" Jul 01 17:30:23.599067 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:30:23.599032 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8216ad57-ba35-4cc1-abc3-b876da3b4a58-proxy-tls\") pod \"model-chainer-raw-99462-5d8d7b948b-5tkjb\" (UID: \"8216ad57-ba35-4cc1-abc3-b876da3b4a58\") " pod="kserve-ci-e2e-test/model-chainer-raw-99462-5d8d7b948b-5tkjb" Jul 01 17:30:23.601845 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:30:23.601815 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8216ad57-ba35-4cc1-abc3-b876da3b4a58-proxy-tls\") pod \"model-chainer-raw-99462-5d8d7b948b-5tkjb\" (UID: \"8216ad57-ba35-4cc1-abc3-b876da3b4a58\") " pod="kserve-ci-e2e-test/model-chainer-raw-99462-5d8d7b948b-5tkjb" Jul 01 17:30:23.843045 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:30:23.843002 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-99462-5d8d7b948b-5tkjb" Jul 01 17:30:23.976790 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:30:23.976764 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-99462-5d8d7b948b-5tkjb"] Jul 01 17:30:23.979499 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:30:23.979467 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8216ad57_ba35_4cc1_abc3_b876da3b4a58.slice/crio-d309a7c70452a232448d2258889cd8f7cdb075c143b1b40f82edcc57d0f76c7b WatchSource:0}: Error finding container d309a7c70452a232448d2258889cd8f7cdb075c143b1b40f82edcc57d0f76c7b: Status 404 returned error can't find the container with id d309a7c70452a232448d2258889cd8f7cdb075c143b1b40f82edcc57d0f76c7b Jul 01 17:30:23.981918 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:30:23.981901 2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 17:30:24.014709 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:30:24.014679 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-99462-5d8d7b948b-5tkjb" event={"ID":"8216ad57-ba35-4cc1-abc3-b876da3b4a58","Type":"ContainerStarted","Data":"d309a7c70452a232448d2258889cd8f7cdb075c143b1b40f82edcc57d0f76c7b"} Jul 01 17:30:27.029196 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:30:27.029153 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-99462-5d8d7b948b-5tkjb" event={"ID":"8216ad57-ba35-4cc1-abc3-b876da3b4a58","Type":"ContainerStarted","Data":"21730bbe37516a1c39bcffffa19d2832c54e821276465b7447e204234be7ad32"} Jul 01 17:30:27.029578 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:30:27.029290 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-99462-5d8d7b948b-5tkjb" Jul 01 17:30:27.048154 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:30:27.048106 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-99462-5d8d7b948b-5tkjb" podStartSLOduration=2.328465941 podStartE2EDuration="5.048090911s" totalImagesPullingTime="2.71962497s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:30:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:30:27.04645107 +0000 UTC m=+857.078448331" watchObservedRunningTime="2026-07-01 17:30:27.048090911 +0000 UTC m=+857.080088170" Jul 01 17:30:32.982373 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:30:32.982344 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-99462-5d8d7b948b-5tkjb"] Jul 01 17:30:32.983082 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:30:32.982539 2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-99462-5d8d7b948b-5tkjb" podUID="8216ad57-ba35-4cc1-abc3-b876da3b4a58" containerName="model-chainer-raw-99462" containerID="cri-o://21730bbe37516a1c39bcffffa19d2832c54e821276465b7447e204234be7ad32" gracePeriod=30 Jul 01 17:30:32.988735 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:30:32.988700 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-99462-5d8d7b948b-5tkjb" podUID="8216ad57-ba35-4cc1-abc3-b876da3b4a58" containerName="model-chainer-raw-99462" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 17:30:37.986617 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:30:37.986576 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-99462-5d8d7b948b-5tkjb" podUID="8216ad57-ba35-4cc1-abc3-b876da3b4a58" containerName="model-chainer-raw-99462" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 17:30:42.987399 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:30:42.987363 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-99462-5d8d7b948b-5tkjb" podUID="8216ad57-ba35-4cc1-abc3-b876da3b4a58" containerName="model-chainer-raw-99462" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 17:30:47.986867 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:30:47.986828 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-99462-5d8d7b948b-5tkjb" podUID="8216ad57-ba35-4cc1-abc3-b876da3b4a58" containerName="model-chainer-raw-99462" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 17:30:52.986776 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:30:52.986732 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-99462-5d8d7b948b-5tkjb" podUID="8216ad57-ba35-4cc1-abc3-b876da3b4a58" containerName="model-chainer-raw-99462" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 17:30:57.986785 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:30:57.986742 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-99462-5d8d7b948b-5tkjb" podUID="8216ad57-ba35-4cc1-abc3-b876da3b4a58" containerName="model-chainer-raw-99462" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 17:31:02.986649 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:31:02.986557 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-99462-5d8d7b948b-5tkjb" podUID="8216ad57-ba35-4cc1-abc3-b876da3b4a58" containerName="model-chainer-raw-99462" probeResult="failure" output="Get \"https://10.133.0.31:8080/readyz\": dial tcp 10.133.0.31:8080: connect: connection refused" Jul 01 17:31:03.178887 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:31:03.178848 2547 generic.go:356] "Generic (PLEG): container finished" podID="8216ad57-ba35-4cc1-abc3-b876da3b4a58" containerID="21730bbe37516a1c39bcffffa19d2832c54e821276465b7447e204234be7ad32" exitCode=0 Jul 01 17:31:03.179089 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:31:03.178922 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-99462-5d8d7b948b-5tkjb" event={"ID":"8216ad57-ba35-4cc1-abc3-b876da3b4a58","Type":"ContainerDied","Data":"21730bbe37516a1c39bcffffa19d2832c54e821276465b7447e204234be7ad32"} Jul 01 17:31:03.637313 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:31:03.637288 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-99462-5d8d7b948b-5tkjb" Jul 01 17:31:03.728040 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:31:03.728001 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8216ad57-ba35-4cc1-abc3-b876da3b4a58-proxy-tls\") pod \"8216ad57-ba35-4cc1-abc3-b876da3b4a58\" (UID: \"8216ad57-ba35-4cc1-abc3-b876da3b4a58\") " Jul 01 17:31:03.728213 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:31:03.728069 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8216ad57-ba35-4cc1-abc3-b876da3b4a58-openshift-service-ca-bundle\") pod \"8216ad57-ba35-4cc1-abc3-b876da3b4a58\" (UID: \"8216ad57-ba35-4cc1-abc3-b876da3b4a58\") " Jul 01 17:31:03.728450 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:31:03.728426 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8216ad57-ba35-4cc1-abc3-b876da3b4a58-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "8216ad57-ba35-4cc1-abc3-b876da3b4a58" (UID: "8216ad57-ba35-4cc1-abc3-b876da3b4a58"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:31:03.730443 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:31:03.730422 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8216ad57-ba35-4cc1-abc3-b876da3b4a58-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "8216ad57-ba35-4cc1-abc3-b876da3b4a58" (UID: "8216ad57-ba35-4cc1-abc3-b876da3b4a58"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:31:03.829351 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:31:03.829236 2547 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8216ad57-ba35-4cc1-abc3-b876da3b4a58-proxy-tls\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:31:03.829351 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:31:03.829283 2547 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8216ad57-ba35-4cc1-abc3-b876da3b4a58-openshift-service-ca-bundle\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:31:04.184256 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:31:04.184162 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-99462-5d8d7b948b-5tkjb" event={"ID":"8216ad57-ba35-4cc1-abc3-b876da3b4a58","Type":"ContainerDied","Data":"d309a7c70452a232448d2258889cd8f7cdb075c143b1b40f82edcc57d0f76c7b"} Jul 01 17:31:04.184256 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:31:04.184233 2547 scope.go:117] "RemoveContainer" containerID="21730bbe37516a1c39bcffffa19d2832c54e821276465b7447e204234be7ad32" Jul 01 17:31:04.184743 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:31:04.184174 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-99462-5d8d7b948b-5tkjb" Jul 01 17:31:04.205766 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:31:04.205738 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-99462-5d8d7b948b-5tkjb"] Jul 01 17:31:04.209555 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:31:04.209528 2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-99462-5d8d7b948b-5tkjb"] Jul 01 17:31:04.424488 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:31:04.424454 2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8216ad57-ba35-4cc1-abc3-b876da3b4a58" path="/var/lib/kubelet/pods/8216ad57-ba35-4cc1-abc3-b876da3b4a58/volumes" Jul 01 17:31:10.430963 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:31:10.430920 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qh49d_aa1fdd8a-5b35-4bac-9836-028a3292e25c/ovn-acl-logging/0.log" Jul 01 17:31:10.431421 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:31:10.431057 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qh49d_aa1fdd8a-5b35-4bac-9836-028a3292e25c/ovn-acl-logging/0.log" Jul 01 17:32:13.232492 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:32:13.232432 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-bca43-78b94bd9f9-q8zjz"] Jul 01 17:32:13.235166 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:32:13.232849 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8216ad57-ba35-4cc1-abc3-b876da3b4a58" containerName="model-chainer-raw-99462" Jul 01 17:32:13.235166 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:32:13.232864 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="8216ad57-ba35-4cc1-abc3-b876da3b4a58" containerName="model-chainer-raw-99462" Jul 01 17:32:13.235166 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:32:13.232978 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="8216ad57-ba35-4cc1-abc3-b876da3b4a58" containerName="model-chainer-raw-99462" Jul 01 17:32:13.236070 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:32:13.236048 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bca43-78b94bd9f9-q8zjz" Jul 01 17:32:13.240787 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:32:13.240762 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 01 17:32:13.241002 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:32:13.240980 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-xldfq\"" Jul 01 17:32:13.241668 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:32:13.241651 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-bca43-serving-cert\"" Jul 01 17:32:13.241725 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:32:13.241663 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-bca43-kube-rbac-proxy-sar-config\"" Jul 01 17:32:13.251796 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:32:13.251769 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-bca43-78b94bd9f9-q8zjz"] Jul 01 17:32:13.331982 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:32:13.331927 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a33434f7-dea3-4d86-9a79-78a5cf40b39a-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-bca43-78b94bd9f9-q8zjz\" (UID: \"a33434f7-dea3-4d86-9a79-78a5cf40b39a\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bca43-78b94bd9f9-q8zjz" Jul 01 17:32:13.332160 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:32:13.332088 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a33434f7-dea3-4d86-9a79-78a5cf40b39a-proxy-tls\") pod \"model-chainer-raw-hpa-bca43-78b94bd9f9-q8zjz\" (UID: \"a33434f7-dea3-4d86-9a79-78a5cf40b39a\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bca43-78b94bd9f9-q8zjz" Jul 01 17:32:13.433116 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:32:13.433077 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a33434f7-dea3-4d86-9a79-78a5cf40b39a-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-bca43-78b94bd9f9-q8zjz\" (UID: \"a33434f7-dea3-4d86-9a79-78a5cf40b39a\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bca43-78b94bd9f9-q8zjz" Jul 01 17:32:13.433318 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:32:13.433157 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a33434f7-dea3-4d86-9a79-78a5cf40b39a-proxy-tls\") pod \"model-chainer-raw-hpa-bca43-78b94bd9f9-q8zjz\" (UID: \"a33434f7-dea3-4d86-9a79-78a5cf40b39a\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bca43-78b94bd9f9-q8zjz" Jul 01 17:32:13.433751 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:32:13.433719 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a33434f7-dea3-4d86-9a79-78a5cf40b39a-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-bca43-78b94bd9f9-q8zjz\" (UID: \"a33434f7-dea3-4d86-9a79-78a5cf40b39a\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bca43-78b94bd9f9-q8zjz" Jul 01 17:32:13.435815 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:32:13.435793 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a33434f7-dea3-4d86-9a79-78a5cf40b39a-proxy-tls\") pod \"model-chainer-raw-hpa-bca43-78b94bd9f9-q8zjz\" (UID: \"a33434f7-dea3-4d86-9a79-78a5cf40b39a\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bca43-78b94bd9f9-q8zjz" Jul 01 17:32:13.547535 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:32:13.547493 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bca43-78b94bd9f9-q8zjz" Jul 01 17:32:13.687531 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:32:13.687500 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-bca43-78b94bd9f9-q8zjz"] Jul 01 17:32:13.690344 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:32:13.690308 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda33434f7_dea3_4d86_9a79_78a5cf40b39a.slice/crio-a3bf9bbb17aaa9c30634f64094fb350014b0c6a008a082eda8d494f5d8c18a04 WatchSource:0}: Error finding container a3bf9bbb17aaa9c30634f64094fb350014b0c6a008a082eda8d494f5d8c18a04: Status 404 returned error can't find the container with id a3bf9bbb17aaa9c30634f64094fb350014b0c6a008a082eda8d494f5d8c18a04 Jul 01 17:32:14.475411 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:32:14.475364 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bca43-78b94bd9f9-q8zjz" event={"ID":"a33434f7-dea3-4d86-9a79-78a5cf40b39a","Type":"ContainerStarted","Data":"55295d48d7259566041ba8cf408e851f6d7757eb6a60497632c11364098d9f84"} Jul 01 17:32:14.475825 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:32:14.475434 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bca43-78b94bd9f9-q8zjz" event={"ID":"a33434f7-dea3-4d86-9a79-78a5cf40b39a","Type":"ContainerStarted","Data":"a3bf9bbb17aaa9c30634f64094fb350014b0c6a008a082eda8d494f5d8c18a04"} Jul 01 17:32:14.475825 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:32:14.475502 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bca43-78b94bd9f9-q8zjz" Jul 01 17:32:14.493519 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:32:14.493462 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bca43-78b94bd9f9-q8zjz" podStartSLOduration=1.493445203 podStartE2EDuration="1.493445203s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:32:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:32:14.492317646 +0000 UTC m=+964.524314919" watchObservedRunningTime="2026-07-01 17:32:14.493445203 +0000 UTC m=+964.525442463" Jul 01 17:32:20.486008 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:32:20.485975 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bca43-78b94bd9f9-q8zjz" Jul 01 17:32:23.312253 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:32:23.312218 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-bca43-78b94bd9f9-q8zjz"] Jul 01 17:32:23.312787 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:32:23.312444 2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bca43-78b94bd9f9-q8zjz" podUID="a33434f7-dea3-4d86-9a79-78a5cf40b39a" containerName="model-chainer-raw-hpa-bca43" containerID="cri-o://55295d48d7259566041ba8cf408e851f6d7757eb6a60497632c11364098d9f84" gracePeriod=30 Jul 01 17:32:25.483719 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:32:25.483679 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bca43-78b94bd9f9-q8zjz" podUID="a33434f7-dea3-4d86-9a79-78a5cf40b39a" containerName="model-chainer-raw-hpa-bca43" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 17:32:30.484706 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:32:30.484658 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bca43-78b94bd9f9-q8zjz" podUID="a33434f7-dea3-4d86-9a79-78a5cf40b39a" containerName="model-chainer-raw-hpa-bca43" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 17:32:35.485423 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:32:35.485377 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bca43-78b94bd9f9-q8zjz" podUID="a33434f7-dea3-4d86-9a79-78a5cf40b39a" containerName="model-chainer-raw-hpa-bca43" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 17:32:35.485845 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:32:35.485486 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bca43-78b94bd9f9-q8zjz" Jul 01 17:32:40.484306 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:32:40.484261 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bca43-78b94bd9f9-q8zjz" podUID="a33434f7-dea3-4d86-9a79-78a5cf40b39a" containerName="model-chainer-raw-hpa-bca43" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 17:32:45.483433 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:32:45.483388 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bca43-78b94bd9f9-q8zjz" podUID="a33434f7-dea3-4d86-9a79-78a5cf40b39a" containerName="model-chainer-raw-hpa-bca43" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 17:32:50.483905 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:32:50.483862 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bca43-78b94bd9f9-q8zjz" podUID="a33434f7-dea3-4d86-9a79-78a5cf40b39a" containerName="model-chainer-raw-hpa-bca43" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 17:32:53.467227 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:32:53.467197 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bca43-78b94bd9f9-q8zjz" Jul 01 17:32:53.588811 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:32:53.588721 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a33434f7-dea3-4d86-9a79-78a5cf40b39a-openshift-service-ca-bundle\") pod \"a33434f7-dea3-4d86-9a79-78a5cf40b39a\" (UID: \"a33434f7-dea3-4d86-9a79-78a5cf40b39a\") " Jul 01 17:32:53.588811 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:32:53.588785 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a33434f7-dea3-4d86-9a79-78a5cf40b39a-proxy-tls\") pod \"a33434f7-dea3-4d86-9a79-78a5cf40b39a\" (UID: \"a33434f7-dea3-4d86-9a79-78a5cf40b39a\") " Jul 01 17:32:53.589172 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:32:53.589150 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a33434f7-dea3-4d86-9a79-78a5cf40b39a-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "a33434f7-dea3-4d86-9a79-78a5cf40b39a" (UID: "a33434f7-dea3-4d86-9a79-78a5cf40b39a"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:32:53.591020 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:32:53.590999 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a33434f7-dea3-4d86-9a79-78a5cf40b39a-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "a33434f7-dea3-4d86-9a79-78a5cf40b39a" (UID: "a33434f7-dea3-4d86-9a79-78a5cf40b39a"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:32:53.639395 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:32:53.639358 2547 generic.go:356] "Generic (PLEG): container finished" podID="a33434f7-dea3-4d86-9a79-78a5cf40b39a" containerID="55295d48d7259566041ba8cf408e851f6d7757eb6a60497632c11364098d9f84" exitCode=0 Jul 01 17:32:53.639559 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:32:53.639412 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bca43-78b94bd9f9-q8zjz" Jul 01 17:32:53.639559 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:32:53.639444 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bca43-78b94bd9f9-q8zjz" event={"ID":"a33434f7-dea3-4d86-9a79-78a5cf40b39a","Type":"ContainerDied","Data":"55295d48d7259566041ba8cf408e851f6d7757eb6a60497632c11364098d9f84"} Jul 01 17:32:53.639559 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:32:53.639498 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bca43-78b94bd9f9-q8zjz" event={"ID":"a33434f7-dea3-4d86-9a79-78a5cf40b39a","Type":"ContainerDied","Data":"a3bf9bbb17aaa9c30634f64094fb350014b0c6a008a082eda8d494f5d8c18a04"} Jul 01 17:32:53.639559 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:32:53.639520 2547 scope.go:117] "RemoveContainer" containerID="55295d48d7259566041ba8cf408e851f6d7757eb6a60497632c11364098d9f84" Jul 01 17:32:53.648519 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:32:53.648504 2547 scope.go:117] "RemoveContainer" containerID="55295d48d7259566041ba8cf408e851f6d7757eb6a60497632c11364098d9f84" Jul 01 17:32:53.648924 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:32:53.648906 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55295d48d7259566041ba8cf408e851f6d7757eb6a60497632c11364098d9f84\": container with ID starting with 55295d48d7259566041ba8cf408e851f6d7757eb6a60497632c11364098d9f84 not found: ID does not exist" containerID="55295d48d7259566041ba8cf408e851f6d7757eb6a60497632c11364098d9f84" Jul 01 17:32:53.649097 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:32:53.648937 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55295d48d7259566041ba8cf408e851f6d7757eb6a60497632c11364098d9f84"} err="failed to get container status \"55295d48d7259566041ba8cf408e851f6d7757eb6a60497632c11364098d9f84\": rpc error: code = NotFound desc = could not find container \"55295d48d7259566041ba8cf408e851f6d7757eb6a60497632c11364098d9f84\": container with ID starting with 55295d48d7259566041ba8cf408e851f6d7757eb6a60497632c11364098d9f84 not found: ID does not exist" Jul 01 17:32:53.665448 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:32:53.665421 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-bca43-78b94bd9f9-q8zjz"] Jul 01 17:32:53.669299 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:32:53.669276 2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-bca43-78b94bd9f9-q8zjz"] Jul 01 17:32:53.690010 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:32:53.689988 2547 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a33434f7-dea3-4d86-9a79-78a5cf40b39a-openshift-service-ca-bundle\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:32:53.690102 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:32:53.690013 2547 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a33434f7-dea3-4d86-9a79-78a5cf40b39a-proxy-tls\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:32:54.423667 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:32:54.423628 2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a33434f7-dea3-4d86-9a79-78a5cf40b39a" path="/var/lib/kubelet/pods/a33434f7-dea3-4d86-9a79-78a5cf40b39a/volumes" Jul 01 17:36:10.457244 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:36:10.457215 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qh49d_aa1fdd8a-5b35-4bac-9836-028a3292e25c/ovn-acl-logging/0.log" Jul 01 17:36:10.458154 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:36:10.458137 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qh49d_aa1fdd8a-5b35-4bac-9836-028a3292e25c/ovn-acl-logging/0.log" Jul 01 17:41:10.482178 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:41:10.482145 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qh49d_aa1fdd8a-5b35-4bac-9836-028a3292e25c/ovn-acl-logging/0.log" Jul 01 17:41:10.484479 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:41:10.484452 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qh49d_aa1fdd8a-5b35-4bac-9836-028a3292e25c/ovn-acl-logging/0.log" Jul 01 17:42:24.446002 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:42:24.445962 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rhlts/must-gather-k7pqf"] Jul 01 17:42:24.446589 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:42:24.446468 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a33434f7-dea3-4d86-9a79-78a5cf40b39a" containerName="model-chainer-raw-hpa-bca43" Jul 01 17:42:24.446589 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:42:24.446488 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="a33434f7-dea3-4d86-9a79-78a5cf40b39a" containerName="model-chainer-raw-hpa-bca43" Jul 01 17:42:24.446589 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:42:24.446571 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="a33434f7-dea3-4d86-9a79-78a5cf40b39a" containerName="model-chainer-raw-hpa-bca43" Jul 01 17:42:24.449652 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:42:24.449631 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rhlts/must-gather-k7pqf" Jul 01 17:42:24.452533 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:42:24.452514 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rhlts\"/\"openshift-service-ca.crt\"" Jul 01 17:42:24.453852 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:42:24.453838 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rhlts\"/\"default-dockercfg-m6z29\"" Jul 01 17:42:24.453852 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:42:24.453844 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rhlts\"/\"kube-root-ca.crt\"" Jul 01 17:42:24.457850 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:42:24.457829 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rhlts/must-gather-k7pqf"] Jul 01 17:42:24.519666 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:42:24.519628 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxk5c\" (UniqueName: \"kubernetes.io/projected/9f20b4c8-892b-4a87-b039-dd4b0e36d35e-kube-api-access-wxk5c\") pod \"must-gather-k7pqf\" (UID: \"9f20b4c8-892b-4a87-b039-dd4b0e36d35e\") " pod="openshift-must-gather-rhlts/must-gather-k7pqf" Jul 01 17:42:24.519875 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:42:24.519683 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9f20b4c8-892b-4a87-b039-dd4b0e36d35e-must-gather-output\") pod \"must-gather-k7pqf\" (UID: \"9f20b4c8-892b-4a87-b039-dd4b0e36d35e\") " pod="openshift-must-gather-rhlts/must-gather-k7pqf" Jul 01 17:42:24.621133 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:42:24.621103 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxk5c\" (UniqueName: \"kubernetes.io/projected/9f20b4c8-892b-4a87-b039-dd4b0e36d35e-kube-api-access-wxk5c\") pod \"must-gather-k7pqf\" (UID: \"9f20b4c8-892b-4a87-b039-dd4b0e36d35e\") " pod="openshift-must-gather-rhlts/must-gather-k7pqf" Jul 01 17:42:24.621263 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:42:24.621149 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9f20b4c8-892b-4a87-b039-dd4b0e36d35e-must-gather-output\") pod \"must-gather-k7pqf\" (UID: \"9f20b4c8-892b-4a87-b039-dd4b0e36d35e\") " pod="openshift-must-gather-rhlts/must-gather-k7pqf" Jul 01 17:42:24.621436 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:42:24.621420 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9f20b4c8-892b-4a87-b039-dd4b0e36d35e-must-gather-output\") pod \"must-gather-k7pqf\" (UID: \"9f20b4c8-892b-4a87-b039-dd4b0e36d35e\") " pod="openshift-must-gather-rhlts/must-gather-k7pqf" Jul 01 17:42:24.630256 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:42:24.630232 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxk5c\" (UniqueName: \"kubernetes.io/projected/9f20b4c8-892b-4a87-b039-dd4b0e36d35e-kube-api-access-wxk5c\") pod \"must-gather-k7pqf\" (UID: \"9f20b4c8-892b-4a87-b039-dd4b0e36d35e\") " pod="openshift-must-gather-rhlts/must-gather-k7pqf" Jul 01 17:42:24.758994 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:42:24.758970 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rhlts/must-gather-k7pqf" Jul 01 17:42:24.890309 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:42:24.890251 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rhlts/must-gather-k7pqf"] Jul 01 17:42:24.892567 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:42:24.892539 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f20b4c8_892b_4a87_b039_dd4b0e36d35e.slice/crio-ac4570ab618a09f896406ee47d17fe1d2220c5dca6038270b0a902ab3f2fd7bb WatchSource:0}: Error finding container ac4570ab618a09f896406ee47d17fe1d2220c5dca6038270b0a902ab3f2fd7bb: Status 404 returned error can't find the container with id ac4570ab618a09f896406ee47d17fe1d2220c5dca6038270b0a902ab3f2fd7bb Jul 01 17:42:24.894446 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:42:24.894431 2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 17:42:24.970066 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:42:24.970029 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rhlts/must-gather-k7pqf" event={"ID":"9f20b4c8-892b-4a87-b039-dd4b0e36d35e","Type":"ContainerStarted","Data":"ac4570ab618a09f896406ee47d17fe1d2220c5dca6038270b0a902ab3f2fd7bb"} Jul 01 17:42:32.012729 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:42:32.012688 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rhlts/must-gather-k7pqf" event={"ID":"9f20b4c8-892b-4a87-b039-dd4b0e36d35e","Type":"ContainerStarted","Data":"7ef310a8dc61e12bc16b1279e7ea66c19604a2b612ce6b43d7b62359320bab7b"} Jul 01 17:42:32.012729 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:42:32.012734 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rhlts/must-gather-k7pqf" event={"ID":"9f20b4c8-892b-4a87-b039-dd4b0e36d35e","Type":"ContainerStarted","Data":"33c3d33c6867ef9222ec1ccc9ac03a82c5679c64922aa6a61c5d7bdec9e136ed"} Jul 01 17:42:32.031569 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:42:32.031515 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rhlts/must-gather-k7pqf" podStartSLOduration=1.789311648 podStartE2EDuration="8.031498955s" totalImagesPullingTime="6.242187307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:42:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:42:32.029722621 +0000 UTC m=+1582.061719882" watchObservedRunningTime="2026-07-01 17:42:32.031498955 +0000 UTC m=+1582.063496215" Jul 01 17:42:53.112495 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:42:53.112458 2547 generic.go:356] "Generic (PLEG): container finished" podID="9f20b4c8-892b-4a87-b039-dd4b0e36d35e" containerID="33c3d33c6867ef9222ec1ccc9ac03a82c5679c64922aa6a61c5d7bdec9e136ed" exitCode=0 Jul 01 17:42:53.112893 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:42:53.112537 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rhlts/must-gather-k7pqf" event={"ID":"9f20b4c8-892b-4a87-b039-dd4b0e36d35e","Type":"ContainerDied","Data":"33c3d33c6867ef9222ec1ccc9ac03a82c5679c64922aa6a61c5d7bdec9e136ed"} Jul 01 17:42:53.112893 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:42:53.112869 2547 scope.go:117] "RemoveContainer" containerID="33c3d33c6867ef9222ec1ccc9ac03a82c5679c64922aa6a61c5d7bdec9e136ed" Jul 01 17:42:53.146464 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:42:53.146408 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-rhlts_must-gather-k7pqf_9f20b4c8-892b-4a87-b039-dd4b0e36d35e/gather/0.log" Jul 01 17:42:57.576320 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:42:57.576272 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8h2fn_32557f5d-39c9-49c0-bc63-3a9666e0ba57/global-pull-secret-syncer/0.log" Jul 01 17:42:57.755742 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:42:57.755712 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dd5mp_627d8da6-a395-4d8c-87f1-075a1402e2dc/konnectivity-agent/0.log" Jul 01 17:42:57.834039 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:42:57.833944 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-141.ec2.internal_a7186fa112b18e5dc69ae2ad2e5c6386/haproxy/0.log" Jul 01 17:42:58.572603 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:42:58.572571 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-rhlts/must-gather-k7pqf"] Jul 01 17:42:58.572784 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:42:58.572764 2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-must-gather-rhlts/must-gather-k7pqf" podUID="9f20b4c8-892b-4a87-b039-dd4b0e36d35e" containerName="copy" containerID="cri-o://7ef310a8dc61e12bc16b1279e7ea66c19604a2b612ce6b43d7b62359320bab7b" gracePeriod=2 Jul 01 17:42:58.575528 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:42:58.575484 2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-k7pqf\" is forbidden: User \"system:node:ip-10-0-137-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-rhlts\": no relationship found between node 'ip-10-0-137-141.ec2.internal' and this object" podUID="9f20b4c8-892b-4a87-b039-dd4b0e36d35e" pod="openshift-must-gather-rhlts/must-gather-k7pqf" Jul 01 17:42:58.576156 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:42:58.576131 2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-rhlts/must-gather-k7pqf"] Jul 01 17:42:58.812291 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:42:58.812266 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-rhlts_must-gather-k7pqf_9f20b4c8-892b-4a87-b039-dd4b0e36d35e/copy/0.log" Jul 01 17:42:58.813876 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:42:58.813856 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rhlts/must-gather-k7pqf" Jul 01 17:42:58.816406 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:42:58.816381 2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-k7pqf\" is forbidden: User \"system:node:ip-10-0-137-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-rhlts\": no relationship found between node 'ip-10-0-137-141.ec2.internal' and this object" podUID="9f20b4c8-892b-4a87-b039-dd4b0e36d35e" pod="openshift-must-gather-rhlts/must-gather-k7pqf" Jul 01 17:42:58.931842 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:42:58.931756 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9f20b4c8-892b-4a87-b039-dd4b0e36d35e-must-gather-output\") pod \"9f20b4c8-892b-4a87-b039-dd4b0e36d35e\" (UID: \"9f20b4c8-892b-4a87-b039-dd4b0e36d35e\") " Jul 01 17:42:58.931842 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:42:58.931813 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxk5c\" (UniqueName: \"kubernetes.io/projected/9f20b4c8-892b-4a87-b039-dd4b0e36d35e-kube-api-access-wxk5c\") pod \"9f20b4c8-892b-4a87-b039-dd4b0e36d35e\" (UID: \"9f20b4c8-892b-4a87-b039-dd4b0e36d35e\") " Jul 01 17:42:58.933148 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:42:58.933122 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f20b4c8-892b-4a87-b039-dd4b0e36d35e-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "9f20b4c8-892b-4a87-b039-dd4b0e36d35e" (UID: "9f20b4c8-892b-4a87-b039-dd4b0e36d35e"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 17:42:58.934141 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:42:58.934118 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f20b4c8-892b-4a87-b039-dd4b0e36d35e-kube-api-access-wxk5c" (OuterVolumeSpecName: "kube-api-access-wxk5c") pod "9f20b4c8-892b-4a87-b039-dd4b0e36d35e" (UID: "9f20b4c8-892b-4a87-b039-dd4b0e36d35e"). InnerVolumeSpecName "kube-api-access-wxk5c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:42:59.032768 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:42:59.032731 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxk5c\" (UniqueName: \"kubernetes.io/projected/9f20b4c8-892b-4a87-b039-dd4b0e36d35e-kube-api-access-wxk5c\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:42:59.032768 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:42:59.032763 2547 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9f20b4c8-892b-4a87-b039-dd4b0e36d35e-must-gather-output\") on node \"ip-10-0-137-141.ec2.internal\" DevicePath \"\"" Jul 01 17:42:59.137816 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:42:59.137792 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-rhlts_must-gather-k7pqf_9f20b4c8-892b-4a87-b039-dd4b0e36d35e/copy/0.log" Jul 01 17:42:59.138193 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:42:59.138173 2547 generic.go:356] "Generic (PLEG): container finished" podID="9f20b4c8-892b-4a87-b039-dd4b0e36d35e" containerID="7ef310a8dc61e12bc16b1279e7ea66c19604a2b612ce6b43d7b62359320bab7b" exitCode=143 Jul 01 17:42:59.138293 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:42:59.138219 2547 scope.go:117] "RemoveContainer" containerID="7ef310a8dc61e12bc16b1279e7ea66c19604a2b612ce6b43d7b62359320bab7b" Jul 01 17:42:59.138293 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:42:59.138227 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rhlts/must-gather-k7pqf" Jul 01 17:42:59.141010 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:42:59.140983 2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-k7pqf\" is forbidden: User \"system:node:ip-10-0-137-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-rhlts\": no relationship found between node 'ip-10-0-137-141.ec2.internal' and this object" podUID="9f20b4c8-892b-4a87-b039-dd4b0e36d35e" pod="openshift-must-gather-rhlts/must-gather-k7pqf" Jul 01 17:42:59.146804 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:42:59.146787 2547 scope.go:117] "RemoveContainer" containerID="33c3d33c6867ef9222ec1ccc9ac03a82c5679c64922aa6a61c5d7bdec9e136ed" Jul 01 17:42:59.148540 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:42:59.148518 2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-k7pqf\" is forbidden: User \"system:node:ip-10-0-137-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-rhlts\": no relationship found between node 'ip-10-0-137-141.ec2.internal' and this object" podUID="9f20b4c8-892b-4a87-b039-dd4b0e36d35e" pod="openshift-must-gather-rhlts/must-gather-k7pqf" Jul 01 17:42:59.158057 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:42:59.158037 2547 scope.go:117] "RemoveContainer" containerID="7ef310a8dc61e12bc16b1279e7ea66c19604a2b612ce6b43d7b62359320bab7b" Jul 01 17:42:59.158314 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:42:59.158292 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ef310a8dc61e12bc16b1279e7ea66c19604a2b612ce6b43d7b62359320bab7b\": container with ID starting with 7ef310a8dc61e12bc16b1279e7ea66c19604a2b612ce6b43d7b62359320bab7b not found: ID does not exist" containerID="7ef310a8dc61e12bc16b1279e7ea66c19604a2b612ce6b43d7b62359320bab7b" Jul 01 17:42:59.158363 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:42:59.158323 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ef310a8dc61e12bc16b1279e7ea66c19604a2b612ce6b43d7b62359320bab7b"} err="failed to get container status \"7ef310a8dc61e12bc16b1279e7ea66c19604a2b612ce6b43d7b62359320bab7b\": rpc error: code = NotFound desc = could not find container \"7ef310a8dc61e12bc16b1279e7ea66c19604a2b612ce6b43d7b62359320bab7b\": container with ID starting with 7ef310a8dc61e12bc16b1279e7ea66c19604a2b612ce6b43d7b62359320bab7b not found: ID does not exist" Jul 01 17:42:59.158363 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:42:59.158342 2547 scope.go:117] "RemoveContainer" containerID="33c3d33c6867ef9222ec1ccc9ac03a82c5679c64922aa6a61c5d7bdec9e136ed" Jul 01 17:42:59.158594 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:42:59.158575 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33c3d33c6867ef9222ec1ccc9ac03a82c5679c64922aa6a61c5d7bdec9e136ed\": container with ID starting with 33c3d33c6867ef9222ec1ccc9ac03a82c5679c64922aa6a61c5d7bdec9e136ed not found: ID does not exist" containerID="33c3d33c6867ef9222ec1ccc9ac03a82c5679c64922aa6a61c5d7bdec9e136ed" Jul 01 17:42:59.158651 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:42:59.158600 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33c3d33c6867ef9222ec1ccc9ac03a82c5679c64922aa6a61c5d7bdec9e136ed"} err="failed to get container status \"33c3d33c6867ef9222ec1ccc9ac03a82c5679c64922aa6a61c5d7bdec9e136ed\": rpc error: code = NotFound desc = could not find container \"33c3d33c6867ef9222ec1ccc9ac03a82c5679c64922aa6a61c5d7bdec9e136ed\": container with ID starting with 33c3d33c6867ef9222ec1ccc9ac03a82c5679c64922aa6a61c5d7bdec9e136ed not found: ID does not exist" Jul 01 17:43:00.423283 ip-10-0-137-141 kubenswrapper[2547]: E0701 17:43:00.423238 2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-k7pqf\" is forbidden: User \"system:node:ip-10-0-137-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-rhlts\": no relationship found between node 'ip-10-0-137-141.ec2.internal' and this object" podUID="9f20b4c8-892b-4a87-b039-dd4b0e36d35e" pod="openshift-must-gather-rhlts/must-gather-k7pqf" Jul 01 17:43:00.424244 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:00.424222 2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f20b4c8-892b-4a87-b039-dd4b0e36d35e" path="/var/lib/kubelet/pods/9f20b4c8-892b-4a87-b039-dd4b0e36d35e/volumes" Jul 01 17:43:02.278904 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:02.278876 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5b911acd-37de-4d0a-b138-b09444356093/alertmanager/0.log" Jul 01 17:43:02.312154 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:02.312124 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5b911acd-37de-4d0a-b138-b09444356093/config-reloader/0.log" Jul 01 17:43:02.376870 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:02.376841 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5b911acd-37de-4d0a-b138-b09444356093/kube-rbac-proxy-web/0.log" Jul 01 17:43:02.441315 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:02.441288 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5b911acd-37de-4d0a-b138-b09444356093/kube-rbac-proxy/0.log" Jul 01 17:43:02.476602 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:02.476569 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5b911acd-37de-4d0a-b138-b09444356093/kube-rbac-proxy-metric/0.log" Jul 01 17:43:02.511024 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:02.511004 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5b911acd-37de-4d0a-b138-b09444356093/prom-label-proxy/0.log" Jul 01 17:43:02.544441 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:02.544368 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5b911acd-37de-4d0a-b138-b09444356093/init-config-reloader/0.log" Jul 01 17:43:02.586575 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:02.586547 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-999px_ddb7b80a-d562-4021-ada0-8299226092cb/cluster-monitoring-operator/0.log" Jul 01 17:43:02.705739 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:02.705714 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-746496b7bc-7b74v_150e565e-3831-4429-9c58-b4a6ee8fb621/metrics-server/0.log" Jul 01 17:43:02.875273 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:02.875208 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n9264_c182a41e-78e7-49c0-84f4-467f5744c85b/node-exporter/0.log" Jul 01 17:43:02.907811 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:02.907785 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n9264_c182a41e-78e7-49c0-84f4-467f5744c85b/kube-rbac-proxy/0.log" Jul 01 17:43:02.942451 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:02.942432 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n9264_c182a41e-78e7-49c0-84f4-467f5744c85b/init-textfile/0.log" Jul 01 17:43:03.058220 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:03.058191 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-lpsjz_fc6ce87c-412a-4860-9d48-751f937fee97/kube-rbac-proxy-main/0.log" Jul 01 17:43:03.094571 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:03.094540 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-lpsjz_fc6ce87c-412a-4860-9d48-751f937fee97/kube-rbac-proxy-self/0.log" Jul 01 17:43:03.124937 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:03.124910 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-lpsjz_fc6ce87c-412a-4860-9d48-751f937fee97/openshift-state-metrics/0.log" Jul 01 17:43:03.491742 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:03.491711 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7ddc8784d4-sf4vn_c34bc306-c8ac-4df6-ba96-5ccb5e843556/prometheus-operator-admission-webhook/0.log" Jul 01 17:43:03.539726 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:03.539700 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-ff7bff99-sfttn_a69ab409-230d-4459-b983-21b5e26bd4db/telemeter-client/0.log" Jul 01 17:43:03.576854 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:03.576832 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-ff7bff99-sfttn_a69ab409-230d-4459-b983-21b5e26bd4db/reload/0.log" Jul 01 17:43:03.607973 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:03.607930 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-ff7bff99-sfttn_a69ab409-230d-4459-b983-21b5e26bd4db/kube-rbac-proxy/0.log" Jul 01 17:43:03.658053 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:03.658024 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b597b858-99q2h_1e974bdf-7089-4519-8ce7-199d229cd216/thanos-query/0.log" Jul 01 17:43:03.691759 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:03.691724 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b597b858-99q2h_1e974bdf-7089-4519-8ce7-199d229cd216/kube-rbac-proxy-web/0.log" Jul 01 17:43:03.719351 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:03.719327 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b597b858-99q2h_1e974bdf-7089-4519-8ce7-199d229cd216/kube-rbac-proxy/0.log" Jul 01 17:43:03.744525 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:03.744454 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b597b858-99q2h_1e974bdf-7089-4519-8ce7-199d229cd216/prom-label-proxy/0.log" Jul 01 17:43:03.772538 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:03.772517 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b597b858-99q2h_1e974bdf-7089-4519-8ce7-199d229cd216/kube-rbac-proxy-rules/0.log" Jul 01 17:43:03.804959 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:03.804935 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b597b858-99q2h_1e974bdf-7089-4519-8ce7-199d229cd216/kube-rbac-proxy-metrics/0.log" Jul 01 17:43:04.962879 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:04.962845 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cdb5968b9-l47gf_9de0f437-edda-4798-bbb3-61a7420a859e/networking-console-plugin/0.log" Jul 01 17:43:05.885768 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:05.885739 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7d4d787c6d-s7vr9_b9fc45bc-6257-4dec-b66e-f6fa584898ca/console/0.log" Jul 01 17:43:06.099663 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:06.099636 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mf9xf/perf-node-gather-daemonset-88x7j"] Jul 01 17:43:06.100089 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:06.099989 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f20b4c8-892b-4a87-b039-dd4b0e36d35e" containerName="copy" Jul 01 17:43:06.100089 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:06.100004 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f20b4c8-892b-4a87-b039-dd4b0e36d35e" containerName="copy" Jul 01 17:43:06.100089 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:06.100038 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f20b4c8-892b-4a87-b039-dd4b0e36d35e" containerName="gather" Jul 01 17:43:06.100089 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:06.100044 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f20b4c8-892b-4a87-b039-dd4b0e36d35e" containerName="gather" Jul 01 17:43:06.100223 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:06.100104 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f20b4c8-892b-4a87-b039-dd4b0e36d35e" containerName="copy" Jul 01 17:43:06.100223 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:06.100116 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f20b4c8-892b-4a87-b039-dd4b0e36d35e" containerName="gather" Jul 01 17:43:06.103771 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:06.103753 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mf9xf/perf-node-gather-daemonset-88x7j" Jul 01 17:43:06.106673 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:06.106653 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mf9xf\"/\"default-dockercfg-vm2np\"" Jul 01 17:43:06.106782 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:06.106714 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mf9xf\"/\"kube-root-ca.crt\"" Jul 01 17:43:06.108050 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:06.108031 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mf9xf\"/\"openshift-service-ca.crt\"" Jul 01 17:43:06.114629 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:06.114609 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mf9xf/perf-node-gather-daemonset-88x7j"] Jul 01 17:43:06.187659 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:06.187573 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8335640d-b2f1-4bb4-9ebd-fbfc1f48efc7-proc\") pod \"perf-node-gather-daemonset-88x7j\" (UID: \"8335640d-b2f1-4bb4-9ebd-fbfc1f48efc7\") " pod="openshift-must-gather-mf9xf/perf-node-gather-daemonset-88x7j" Jul 01 17:43:06.187659 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:06.187617 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8335640d-b2f1-4bb4-9ebd-fbfc1f48efc7-sys\") pod \"perf-node-gather-daemonset-88x7j\" (UID: \"8335640d-b2f1-4bb4-9ebd-fbfc1f48efc7\") " pod="openshift-must-gather-mf9xf/perf-node-gather-daemonset-88x7j" Jul 01 17:43:06.187887 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:06.187673 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8335640d-b2f1-4bb4-9ebd-fbfc1f48efc7-podres\") pod \"perf-node-gather-daemonset-88x7j\" (UID: \"8335640d-b2f1-4bb4-9ebd-fbfc1f48efc7\") " pod="openshift-must-gather-mf9xf/perf-node-gather-daemonset-88x7j" Jul 01 17:43:06.187887 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:06.187698 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvpqk\" (UniqueName: \"kubernetes.io/projected/8335640d-b2f1-4bb4-9ebd-fbfc1f48efc7-kube-api-access-mvpqk\") pod \"perf-node-gather-daemonset-88x7j\" (UID: \"8335640d-b2f1-4bb4-9ebd-fbfc1f48efc7\") " pod="openshift-must-gather-mf9xf/perf-node-gather-daemonset-88x7j" Jul 01 17:43:06.187887 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:06.187727 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8335640d-b2f1-4bb4-9ebd-fbfc1f48efc7-lib-modules\") pod \"perf-node-gather-daemonset-88x7j\" (UID: \"8335640d-b2f1-4bb4-9ebd-fbfc1f48efc7\") " pod="openshift-must-gather-mf9xf/perf-node-gather-daemonset-88x7j" Jul 01 17:43:06.289164 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:06.289129 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8335640d-b2f1-4bb4-9ebd-fbfc1f48efc7-sys\") pod \"perf-node-gather-daemonset-88x7j\" (UID: \"8335640d-b2f1-4bb4-9ebd-fbfc1f48efc7\") " pod="openshift-must-gather-mf9xf/perf-node-gather-daemonset-88x7j" Jul 01 17:43:06.289164 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:06.289168 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8335640d-b2f1-4bb4-9ebd-fbfc1f48efc7-podres\") pod \"perf-node-gather-daemonset-88x7j\" (UID: \"8335640d-b2f1-4bb4-9ebd-fbfc1f48efc7\") " pod="openshift-must-gather-mf9xf/perf-node-gather-daemonset-88x7j" Jul 01 17:43:06.289359 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:06.289187 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvpqk\" (UniqueName: \"kubernetes.io/projected/8335640d-b2f1-4bb4-9ebd-fbfc1f48efc7-kube-api-access-mvpqk\") pod \"perf-node-gather-daemonset-88x7j\" (UID: \"8335640d-b2f1-4bb4-9ebd-fbfc1f48efc7\") " pod="openshift-must-gather-mf9xf/perf-node-gather-daemonset-88x7j" Jul 01 17:43:06.289359 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:06.289216 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8335640d-b2f1-4bb4-9ebd-fbfc1f48efc7-lib-modules\") pod \"perf-node-gather-daemonset-88x7j\" (UID: \"8335640d-b2f1-4bb4-9ebd-fbfc1f48efc7\") " pod="openshift-must-gather-mf9xf/perf-node-gather-daemonset-88x7j" Jul 01 17:43:06.289359 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:06.289259 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8335640d-b2f1-4bb4-9ebd-fbfc1f48efc7-sys\") pod \"perf-node-gather-daemonset-88x7j\" (UID: \"8335640d-b2f1-4bb4-9ebd-fbfc1f48efc7\") " pod="openshift-must-gather-mf9xf/perf-node-gather-daemonset-88x7j" Jul 01 17:43:06.289359 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:06.289304 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8335640d-b2f1-4bb4-9ebd-fbfc1f48efc7-podres\") pod \"perf-node-gather-daemonset-88x7j\" (UID: \"8335640d-b2f1-4bb4-9ebd-fbfc1f48efc7\") " pod="openshift-must-gather-mf9xf/perf-node-gather-daemonset-88x7j" Jul 01 17:43:06.289359 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:06.289314 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8335640d-b2f1-4bb4-9ebd-fbfc1f48efc7-proc\") pod \"perf-node-gather-daemonset-88x7j\" (UID: \"8335640d-b2f1-4bb4-9ebd-fbfc1f48efc7\") " pod="openshift-must-gather-mf9xf/perf-node-gather-daemonset-88x7j" Jul 01 17:43:06.289359 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:06.289352 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8335640d-b2f1-4bb4-9ebd-fbfc1f48efc7-proc\") pod \"perf-node-gather-daemonset-88x7j\" (UID: \"8335640d-b2f1-4bb4-9ebd-fbfc1f48efc7\") " pod="openshift-must-gather-mf9xf/perf-node-gather-daemonset-88x7j" Jul 01 17:43:06.289543 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:06.289375 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8335640d-b2f1-4bb4-9ebd-fbfc1f48efc7-lib-modules\") pod \"perf-node-gather-daemonset-88x7j\" (UID: \"8335640d-b2f1-4bb4-9ebd-fbfc1f48efc7\") " pod="openshift-must-gather-mf9xf/perf-node-gather-daemonset-88x7j" Jul 01 17:43:06.298387 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:06.298363 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvpqk\" (UniqueName: \"kubernetes.io/projected/8335640d-b2f1-4bb4-9ebd-fbfc1f48efc7-kube-api-access-mvpqk\") pod \"perf-node-gather-daemonset-88x7j\" (UID: \"8335640d-b2f1-4bb4-9ebd-fbfc1f48efc7\") " pod="openshift-must-gather-mf9xf/perf-node-gather-daemonset-88x7j" Jul 01 17:43:06.413808 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:06.413771 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mf9xf/perf-node-gather-daemonset-88x7j" Jul 01 17:43:06.545840 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:06.545817 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mf9xf/perf-node-gather-daemonset-88x7j"] Jul 01 17:43:06.548224 ip-10-0-137-141 kubenswrapper[2547]: W0701 17:43:06.548198 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8335640d_b2f1_4bb4_9ebd_fbfc1f48efc7.slice/crio-247788ab01a62c9f45e011a8abbf3afd32e36a559e5bf28039d74867f36b60e2 WatchSource:0}: Error finding container 247788ab01a62c9f45e011a8abbf3afd32e36a559e5bf28039d74867f36b60e2: Status 404 returned error can't find the container with id 247788ab01a62c9f45e011a8abbf3afd32e36a559e5bf28039d74867f36b60e2 Jul 01 17:43:07.172507 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:07.172474 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mf9xf/perf-node-gather-daemonset-88x7j" event={"ID":"8335640d-b2f1-4bb4-9ebd-fbfc1f48efc7","Type":"ContainerStarted","Data":"0496848866a60c202708010bb8a02d65f3e42deab54da6b3101b46eb99719b8a"} Jul 01 17:43:07.172918 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:07.172522 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mf9xf/perf-node-gather-daemonset-88x7j" event={"ID":"8335640d-b2f1-4bb4-9ebd-fbfc1f48efc7","Type":"ContainerStarted","Data":"247788ab01a62c9f45e011a8abbf3afd32e36a559e5bf28039d74867f36b60e2"} Jul 01 17:43:07.172918 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:07.172611 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mf9xf/perf-node-gather-daemonset-88x7j" Jul 01 17:43:07.189669 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:07.189446 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mf9xf/perf-node-gather-daemonset-88x7j" podStartSLOduration=1.189429641 podStartE2EDuration="1.189429641s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:43:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:43:07.189151215 +0000 UTC m=+1617.221148496" watchObservedRunningTime="2026-07-01 17:43:07.189429641 +0000 UTC m=+1617.221426916" Jul 01 17:43:07.547400 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:07.547370 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s5qpl_374e3f60-2885-4bf0-848a-10a1a3c0003a/dns/0.log" Jul 01 17:43:07.574685 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:07.574663 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s5qpl_374e3f60-2885-4bf0-848a-10a1a3c0003a/kube-rbac-proxy/0.log" Jul 01 17:43:07.652108 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:07.652077 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-s96pk_b04b8848-2a26-42ab-adf6-46a857cbd6f2/dns-node-resolver/0.log" Jul 01 17:43:08.204060 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:08.204027 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9ksbn_c87a9aa8-cd15-41a5-9879-d6c448cc62eb/node-ca/0.log" Jul 01 17:43:09.485104 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:09.485067 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tczxv_01ad38f7-44ce-4388-9906-431090926394/serve-healthcheck-canary/0.log" Jul 01 17:43:10.016742 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:10.016718 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pbnbg_9b3d3b2b-3e29-406c-a0a7-fb990537bab4/kube-rbac-proxy/0.log" Jul 01 17:43:10.041189 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:10.041165 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pbnbg_9b3d3b2b-3e29-406c-a0a7-fb990537bab4/exporter/0.log" Jul 01 17:43:10.067154 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:10.067125 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pbnbg_9b3d3b2b-3e29-406c-a0a7-fb990537bab4/extractor/0.log" Jul 01 17:43:12.178987 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:12.178937 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-848c499849-m6bdk_ee913519-3923-48fa-9475-ef5c5779c597/manager/0.log" Jul 01 17:43:12.202397 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:12.202373 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-67d95fdc48-sdqp2_e769cca4-49d6-4360-8baf-65926b575fd8/manager/0.log" Jul 01 17:43:12.406375 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:12.406341 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-x2dxg_a22f29d4-08e9-48a4-a342-02a3ed8ffaae/seaweedfs/0.log" Jul 01 17:43:13.186519 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:13.186487 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mf9xf/perf-node-gather-daemonset-88x7j" Jul 01 17:43:18.071082 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:18.071053 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fw624_1cb2e486-78b2-4b87-9cc5-6286495cbc2b/kube-multus-additional-cni-plugins/0.log" Jul 01 17:43:18.096629 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:18.096603 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fw624_1cb2e486-78b2-4b87-9cc5-6286495cbc2b/egress-router-binary-copy/0.log" Jul 01 17:43:18.122456 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:18.122429 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fw624_1cb2e486-78b2-4b87-9cc5-6286495cbc2b/cni-plugins/0.log" Jul 01 17:43:18.149571 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:18.149549 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fw624_1cb2e486-78b2-4b87-9cc5-6286495cbc2b/bond-cni-plugin/0.log" Jul 01 17:43:18.177580 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:18.177556 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fw624_1cb2e486-78b2-4b87-9cc5-6286495cbc2b/routeoverride-cni/0.log" Jul 01 17:43:18.203389 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:18.203365 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fw624_1cb2e486-78b2-4b87-9cc5-6286495cbc2b/whereabouts-cni-bincopy/0.log" Jul 01 17:43:18.228387 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:18.228362 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fw624_1cb2e486-78b2-4b87-9cc5-6286495cbc2b/whereabouts-cni/0.log" Jul 01 17:43:18.613484 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:18.613456 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-bvz2x_fd657e38-8571-4b17-90b6-952c0e06ddbe/kube-multus/0.log" Jul 01 17:43:18.762514 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:18.762485 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wx5ff_ec5b1126-9d68-4911-ad3d-6f8369cf5a5d/network-metrics-daemon/0.log" Jul 01 17:43:18.791542 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:18.791511 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wx5ff_ec5b1126-9d68-4911-ad3d-6f8369cf5a5d/kube-rbac-proxy/0.log" Jul 01 17:43:19.836306 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:19.836274 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qh49d_aa1fdd8a-5b35-4bac-9836-028a3292e25c/ovn-controller/0.log" Jul 01 17:43:19.859682 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:19.859658 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qh49d_aa1fdd8a-5b35-4bac-9836-028a3292e25c/ovn-acl-logging/1.log" Jul 01 17:43:19.859682 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:19.859665 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qh49d_aa1fdd8a-5b35-4bac-9836-028a3292e25c/ovn-acl-logging/0.log" Jul 01 17:43:19.882935 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:19.882909 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qh49d_aa1fdd8a-5b35-4bac-9836-028a3292e25c/kube-rbac-proxy-node/0.log" Jul 01 17:43:19.908385 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:19.908357 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qh49d_aa1fdd8a-5b35-4bac-9836-028a3292e25c/kube-rbac-proxy-ovn-metrics/0.log" Jul 01 17:43:19.934487 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:19.934459 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qh49d_aa1fdd8a-5b35-4bac-9836-028a3292e25c/northd/0.log" Jul 01 17:43:19.959935 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:19.959911 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qh49d_aa1fdd8a-5b35-4bac-9836-028a3292e25c/nbdb/0.log" Jul 01 17:43:19.985074 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:19.985050 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qh49d_aa1fdd8a-5b35-4bac-9836-028a3292e25c/sbdb/0.log" Jul 01 17:43:20.029708 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:20.029680 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qh49d_aa1fdd8a-5b35-4bac-9836-028a3292e25c/ovnkube-controller/0.log" Jul 01 17:43:21.307552 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:21.307524 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-9zsrw_cecb7d35-1004-44b8-8eef-ca0efbf803cb/network-check-target-container/0.log" Jul 01 17:43:22.364866 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:22.364838 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-dgtqc_bef5840a-0d6b-45ed-8bcc-39df0049715f/iptables-alerter/0.log" Jul 01 17:43:23.327063 ip-10-0-137-141 kubenswrapper[2547]: I0701 17:43:23.327033 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-k6fj4_2b616970-957c-43eb-8efd-98cfa7957cf9/tuned/0.log"