Jul 02 12:38:36.434053 ip-10-0-140-7 systemd[1]: Starting Kubernetes Kubelet... Jul 02 12:38:36.865283 ip-10-0-140-7 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 12:38:36.865283 ip-10-0-140-7 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 02 12:38:36.865283 ip-10-0-140-7 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 12:38:36.865283 ip-10-0-140-7 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 02 12:38:36.865283 ip-10-0-140-7 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 12:38:36.865283 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.859724 2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 02 12:38:36.870061 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868255 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 12:38:36.870061 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868273 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 12:38:36.870061 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868279 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 12:38:36.870061 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868284 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 12:38:36.870061 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868292 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 12:38:36.870061 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868297 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 12:38:36.870061 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868302 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 12:38:36.870061 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868306 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 12:38:36.870061 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868311 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 12:38:36.870061 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868315 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 12:38:36.870061 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868320 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 12:38:36.870061 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868323 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 12:38:36.870061 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868327 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 12:38:36.870061 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868331 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 12:38:36.870061 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868334 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 12:38:36.870061 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868340 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 12:38:36.870061 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868345 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 12:38:36.870061 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868349 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 02 12:38:36.870061 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868353 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 12:38:36.870721 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868357 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 12:38:36.870721 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868362 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 12:38:36.870721 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868366 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 12:38:36.870721 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868370 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 12:38:36.870721 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868374 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 12:38:36.870721 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868378 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 12:38:36.870721 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868382 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 12:38:36.870721 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868386 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 12:38:36.870721 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868390 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 12:38:36.870721 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868394 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 12:38:36.870721 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868397 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 12:38:36.870721 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868401 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 12:38:36.870721 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868405 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 12:38:36.870721 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868410 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 12:38:36.870721 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868414 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 12:38:36.870721 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868417 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 12:38:36.870721 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868422 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 12:38:36.870721 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868426 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 12:38:36.870721 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868430 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 12:38:36.870721 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868434 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 12:38:36.871260 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868439 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 12:38:36.871260 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868442 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 12:38:36.871260 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868446 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 12:38:36.871260 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868451 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 12:38:36.871260 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868454 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 12:38:36.871260 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868458 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 12:38:36.871260 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868461 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 12:38:36.871260 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868465 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 12:38:36.871260 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868468 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 12:38:36.871260 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868473 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 12:38:36.871260 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868478 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 12:38:36.871260 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868482 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 12:38:36.871260 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868485 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 12:38:36.871260 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868490 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 12:38:36.871260 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868494 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 12:38:36.871260 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868497 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 12:38:36.871260 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868501 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 12:38:36.871260 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868506 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 12:38:36.871260 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868510 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 12:38:36.871260 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868514 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 12:38:36.871844 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868518 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 12:38:36.871844 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868521 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 12:38:36.871844 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868525 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 12:38:36.871844 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868529 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 12:38:36.871844 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868533 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 12:38:36.871844 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868537 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 12:38:36.871844 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868542 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 12:38:36.871844 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868546 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 12:38:36.871844 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868550 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 12:38:36.871844 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868553 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 12:38:36.871844 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868557 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 12:38:36.871844 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868561 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 12:38:36.871844 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868565 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 12:38:36.871844 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868569 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 12:38:36.871844 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868573 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 12:38:36.871844 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868577 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 12:38:36.871844 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868580 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 12:38:36.871844 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868584 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 12:38:36.871844 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868588 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 12:38:36.872809 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868592 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 12:38:36.872809 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868595 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 12:38:36.872809 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868600 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 12:38:36.872809 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868603 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 12:38:36.872809 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868607 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 12:38:36.872809 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868611 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 12:38:36.872809 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868616 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 12:38:36.872809 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868620 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 12:38:36.872809 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868624 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 12:38:36.872809 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868627 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 12:38:36.872809 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868631 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 12:38:36.872809 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868635 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 12:38:36.872809 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868638 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 12:38:36.872809 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868642 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 12:38:36.872809 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868645 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 12:38:36.872809 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868649 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 12:38:36.872809 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868653 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 12:38:36.872809 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868658 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 12:38:36.872809 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868661 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 12:38:36.872809 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868665 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 12:38:37.040847 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.868669 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 12:38:37.040847 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.871947 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 12:38:37.040847 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.871957 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 12:38:37.040847 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.871960 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 12:38:37.040847 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.871963 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 12:38:37.040847 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.871967 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 12:38:37.040847 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.871970 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 12:38:37.040847 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.871973 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 12:38:37.040847 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.871976 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 12:38:37.040847 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.871979 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 12:38:37.040847 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.871981 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 12:38:37.040847 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.871984 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 02 12:38:37.040847 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.871987 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 12:38:37.040847 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.871990 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 12:38:37.040847 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.871993 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 12:38:37.040847 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.871996 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 12:38:37.040847 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.871998 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 12:38:37.040847 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872001 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 12:38:37.040847 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872004 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 12:38:36.935929 ip-10-0-140-7 systemd[1]: Started Kubernetes Kubelet. Jul 02 12:38:37.055402 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872007 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 12:38:37.055402 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872010 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 12:38:37.055402 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872013 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 12:38:37.055402 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872016 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 12:38:37.055402 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872019 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 12:38:37.055402 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872022 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 12:38:37.055402 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872024 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 12:38:37.055402 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872027 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 12:38:37.055402 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872030 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 12:38:37.055402 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872032 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 12:38:37.055402 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872035 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 12:38:37.055402 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872037 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 12:38:37.055402 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872040 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 12:38:37.055402 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872043 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 12:38:37.055402 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872045 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 12:38:37.055402 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872048 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 12:38:37.055402 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872050 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 12:38:37.055402 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872053 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 12:38:37.055402 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872056 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 12:38:37.055402 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872059 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 12:38:37.058170 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872062 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 12:38:37.058170 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872064 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 12:38:37.058170 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872067 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 12:38:37.058170 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872069 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 12:38:37.058170 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872072 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 12:38:37.058170 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872074 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 12:38:37.058170 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872077 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 12:38:37.058170 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872080 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 12:38:37.058170 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872082 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 12:38:37.058170 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872085 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 12:38:37.058170 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872087 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 12:38:37.058170 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872091 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 12:38:37.058170 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872094 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 12:38:37.058170 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872096 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 12:38:37.058170 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872099 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 12:38:37.058170 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872101 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 12:38:37.058170 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872104 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 12:38:37.058170 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872107 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 12:38:37.058170 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872109 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 12:38:37.058170 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872112 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 12:38:37.059229 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872114 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 12:38:37.059229 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872118 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 12:38:37.059229 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872122 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 12:38:37.059229 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872124 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 12:38:37.059229 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872127 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 12:38:37.059229 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872130 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 12:38:37.059229 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872133 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 12:38:37.059229 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872135 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 12:38:37.059229 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872138 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 12:38:37.059229 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872141 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 12:38:37.059229 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872144 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 12:38:37.059229 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872146 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 12:38:37.059229 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872149 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 12:38:37.059229 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872152 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 12:38:37.059229 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872154 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 12:38:37.059229 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872157 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 12:38:37.059229 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872160 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 12:38:37.059229 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872163 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 12:38:37.059229 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872166 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 12:38:37.060324 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872168 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 12:38:37.060324 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872171 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 12:38:37.060324 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872174 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 12:38:37.060324 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872176 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 12:38:37.060324 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872179 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 12:38:37.060324 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872181 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 12:38:37.060324 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872184 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 12:38:37.060324 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872187 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 12:38:37.060324 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872189 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 12:38:37.060324 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872191 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 12:38:37.060324 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872194 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 12:38:37.060324 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872196 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 12:38:37.060324 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872200 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 12:38:37.060324 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872203 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 12:38:37.060324 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872205 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 12:38:37.060324 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872207 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 12:38:37.060324 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872210 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 12:38:37.060324 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872213 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 12:38:37.060324 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872217 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 12:38:37.060324 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872220 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 12:38:37.062427 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872223 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 12:38:37.062427 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872227 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 12:38:37.062427 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872678 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 12:38:37.062427 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872683 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 12:38:37.062427 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872687 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 12:38:37.062427 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872690 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 12:38:37.062427 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872694 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 12:38:37.062427 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872697 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 12:38:37.062427 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872700 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 12:38:37.062427 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872703 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 12:38:37.062427 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872706 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 12:38:37.062427 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872709 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 12:38:37.062427 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872712 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 12:38:37.062427 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872714 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 12:38:37.062427 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872717 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 12:38:37.062427 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872721 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 12:38:37.062427 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872723 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 12:38:37.062427 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872726 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 12:38:37.062427 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872729 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 12:38:37.062427 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872745 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 12:38:37.063523 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872748 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 12:38:37.063523 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872751 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 12:38:37.063523 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872754 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 12:38:37.063523 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872757 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 12:38:37.063523 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872760 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 12:38:37.063523 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872763 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 12:38:37.063523 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872765 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 12:38:37.063523 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872768 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 12:38:37.063523 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872770 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 12:38:37.063523 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872773 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 12:38:37.063523 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872775 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 12:38:37.063523 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872778 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 12:38:37.063523 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872781 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 12:38:37.063523 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872784 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 12:38:37.063523 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872787 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 12:38:37.063523 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872789 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 12:38:37.063523 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872792 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 12:38:37.063523 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872794 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 12:38:37.063523 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872797 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 12:38:37.065231 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872810 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 12:38:37.065231 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872814 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 12:38:37.065231 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872816 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 12:38:37.065231 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872819 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 12:38:37.065231 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872822 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 12:38:37.065231 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872825 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 12:38:37.065231 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872827 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 12:38:37.065231 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872830 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 12:38:37.065231 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872832 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 12:38:37.065231 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872835 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 12:38:37.065231 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872837 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 12:38:37.065231 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872840 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 12:38:37.065231 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872843 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 12:38:37.065231 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872846 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 12:38:37.065231 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872849 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 12:38:37.065231 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872852 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 12:38:37.065231 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872854 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 12:38:37.065231 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872857 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 12:38:37.065231 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872861 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 12:38:37.065231 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872863 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 12:38:37.066285 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872866 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 12:38:37.066285 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872868 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 12:38:37.066285 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872871 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 12:38:37.066285 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872873 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 02 12:38:37.066285 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872877 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 12:38:37.066285 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872880 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 12:38:37.066285 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872883 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 12:38:37.066285 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872886 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 12:38:37.066285 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872888 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 12:38:37.066285 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872891 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 12:38:37.066285 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872894 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 12:38:37.066285 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872897 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 12:38:37.066285 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872899 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 12:38:37.066285 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872902 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 12:38:37.066285 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872905 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 12:38:37.066285 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872909 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 12:38:37.066285 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872912 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 12:38:37.066285 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872915 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 12:38:37.066285 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872918 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 12:38:37.067796 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872920 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 12:38:37.067796 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872924 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 12:38:37.067796 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872927 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 12:38:37.067796 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872930 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 12:38:37.067796 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872933 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 12:38:37.067796 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872936 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 12:38:37.067796 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872939 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 12:38:37.067796 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872942 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 12:38:37.067796 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872945 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 12:38:37.067796 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872947 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 12:38:37.067796 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872950 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 12:38:37.067796 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872954 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 12:38:37.067796 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872956 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 12:38:37.067796 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872959 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 12:38:37.067796 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872962 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 12:38:37.067796 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872965 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 12:38:37.067796 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872967 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 12:38:37.067796 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872970 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 12:38:37.067796 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872973 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 12:38:37.069071 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872975 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 12:38:37.069071 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872977 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 12:38:37.069071 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872980 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 12:38:37.069071 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.872983 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 12:38:37.069071 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873062 2582 flags.go:64] FLAG: --address="0.0.0.0" Jul 02 12:38:37.069071 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873072 2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 02 12:38:37.069071 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873080 2582 flags.go:64] FLAG: --anonymous-auth="true" Jul 02 12:38:37.069071 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873084 2582 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 02 12:38:37.069071 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873089 2582 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 02 12:38:37.069071 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873093 2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 02 12:38:37.069071 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873097 2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 02 12:38:37.069071 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873102 2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 02 12:38:37.069071 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873105 2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 02 12:38:37.069071 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873108 2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 02 12:38:37.069071 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873111 2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 02 12:38:37.069071 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873115 2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 02 12:38:37.069071 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873118 2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 02 12:38:37.069071 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873121 2582 flags.go:64] FLAG: --cgroup-root="" Jul 02 12:38:37.069071 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873124 2582 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 02 12:38:37.069071 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873127 2582 flags.go:64] FLAG: --client-ca-file="" Jul 02 12:38:37.069071 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873130 2582 flags.go:64] FLAG: --cloud-provider="external" Jul 02 12:38:37.069071 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873133 2582 flags.go:64] FLAG: --cluster-dns="[]" Jul 02 12:38:37.069071 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873138 2582 flags.go:64] FLAG: --cluster-domain="" Jul 02 12:38:37.070147 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873141 2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 02 12:38:37.070147 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873144 2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 02 12:38:37.070147 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873147 2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 02 12:38:37.070147 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873150 2582 flags.go:64] FLAG: --container-log-max-files="5" Jul 02 12:38:37.070147 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873154 2582 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 02 12:38:37.070147 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873157 2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 02 12:38:37.070147 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873160 2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 02 12:38:37.070147 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873164 2582 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 02 12:38:37.070147 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873167 2582 flags.go:64] FLAG: --contention-profiling="false" Jul 02 12:38:37.070147 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873170 2582 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 02 12:38:37.070147 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873173 2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 02 12:38:37.070147 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873176 2582 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 02 12:38:37.070147 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873179 2582 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 02 12:38:37.070147 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873183 2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 02 12:38:37.070147 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873188 2582 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 02 12:38:37.070147 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873191 2582 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 02 12:38:37.070147 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873194 2582 flags.go:64] FLAG: --enable-load-reader="false" Jul 02 12:38:37.070147 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873197 2582 flags.go:64] FLAG: --enable-server="true" Jul 02 12:38:37.070147 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873200 2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 02 12:38:37.070147 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873204 2582 flags.go:64] FLAG: --event-burst="100" Jul 02 12:38:37.070147 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873207 2582 flags.go:64] FLAG: --event-qps="50" Jul 02 12:38:37.070147 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873210 2582 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 02 12:38:37.070147 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873213 2582 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 02 12:38:37.070147 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873216 2582 flags.go:64] FLAG: --eviction-hard="" Jul 02 12:38:37.071232 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873220 2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 02 12:38:37.071232 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873223 2582 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 02 12:38:37.071232 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873226 2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 02 12:38:37.071232 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873229 2582 flags.go:64] FLAG: --eviction-soft="" Jul 02 12:38:37.071232 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873232 2582 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 02 12:38:37.071232 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873235 2582 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 02 12:38:37.071232 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873238 2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 02 12:38:37.071232 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873241 2582 flags.go:64] FLAG: --experimental-mounter-path="" Jul 02 12:38:37.071232 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873243 2582 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 02 12:38:37.071232 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873246 2582 flags.go:64] FLAG: --fail-swap-on="true" Jul 02 12:38:37.071232 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873249 2582 flags.go:64] FLAG: --feature-gates="" Jul 02 12:38:37.071232 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873253 2582 flags.go:64] FLAG: --file-check-frequency="20s" Jul 02 12:38:37.071232 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873256 2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 02 12:38:37.071232 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873259 2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 02 12:38:37.071232 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873262 2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 02 12:38:37.071232 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873266 2582 flags.go:64] FLAG: --healthz-port="10248" Jul 02 12:38:37.071232 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873268 2582 flags.go:64] FLAG: --help="false" Jul 02 12:38:37.071232 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873287 2582 flags.go:64] FLAG: --hostname-override="ip-10-0-140-7.ec2.internal" Jul 02 12:38:37.071232 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873291 2582 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 02 12:38:37.071232 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873294 2582 flags.go:64] FLAG: --http-check-frequency="20s" Jul 02 12:38:37.071232 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873297 2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 02 12:38:37.071232 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873301 2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 02 12:38:37.071232 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873306 2582 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 02 12:38:37.072255 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873309 2582 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 02 12:38:37.072255 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873312 2582 flags.go:64] FLAG: --image-service-endpoint="" Jul 02 12:38:37.072255 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873316 2582 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 02 12:38:37.072255 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873319 2582 flags.go:64] FLAG: --kube-api-burst="100" Jul 02 12:38:37.072255 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873322 2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 02 12:38:37.072255 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873326 2582 flags.go:64] FLAG: --kube-api-qps="50" Jul 02 12:38:37.072255 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873329 2582 flags.go:64] FLAG: --kube-reserved="" Jul 02 12:38:37.072255 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873332 2582 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 02 12:38:37.072255 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873336 2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 02 12:38:37.072255 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873338 2582 flags.go:64] FLAG: --kubelet-cgroups="" Jul 02 12:38:37.072255 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873341 2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 02 12:38:37.072255 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873344 2582 flags.go:64] FLAG: --lock-file="" Jul 02 12:38:37.072255 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873347 2582 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 02 12:38:37.072255 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873351 2582 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 02 12:38:37.072255 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873353 2582 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 02 12:38:37.072255 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873359 2582 flags.go:64] FLAG: --log-json-split-stream="false" Jul 02 12:38:37.072255 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873361 2582 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 02 12:38:37.072255 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873364 2582 flags.go:64] FLAG: --log-text-split-stream="false" Jul 02 12:38:37.072255 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873367 2582 flags.go:64] FLAG: --logging-format="text" Jul 02 12:38:37.072255 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873370 2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 02 12:38:37.072255 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873373 2582 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 02 12:38:37.072255 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873376 2582 flags.go:64] FLAG: --manifest-url="" Jul 02 12:38:37.072255 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873379 2582 flags.go:64] FLAG: --manifest-url-header="" Jul 02 12:38:37.072255 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873383 2582 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 02 12:38:37.072255 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873386 2582 flags.go:64] FLAG: --max-open-files="1000000" Jul 02 12:38:37.073356 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873390 2582 flags.go:64] FLAG: --max-pods="110" Jul 02 12:38:37.073356 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873395 2582 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 02 12:38:37.073356 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873398 2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 02 12:38:37.073356 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873401 2582 flags.go:64] FLAG: --memory-manager-policy="None" Jul 02 12:38:37.073356 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873404 2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 02 12:38:37.073356 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873407 2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 02 12:38:37.073356 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873411 2582 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 02 12:38:37.073356 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873414 2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 02 12:38:37.073356 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873421 2582 flags.go:64] FLAG: --node-status-max-images="50" Jul 02 12:38:37.073356 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873424 2582 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 02 12:38:37.073356 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873427 2582 flags.go:64] FLAG: --oom-score-adj="-999" Jul 02 12:38:37.073356 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873431 2582 flags.go:64] FLAG: --pod-cidr="" Jul 02 12:38:37.073356 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873434 2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 02 12:38:37.073356 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873440 2582 flags.go:64] FLAG: --pod-manifest-path="" Jul 02 12:38:37.073356 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873443 2582 flags.go:64] FLAG: --pod-max-pids="-1" Jul 02 12:38:37.073356 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873446 2582 flags.go:64] FLAG: --pods-per-core="0" Jul 02 12:38:37.073356 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873449 2582 flags.go:64] FLAG: --port="10250" Jul 02 12:38:37.073356 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873452 2582 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 02 12:38:37.073356 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873455 2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f42d4941700208b0" Jul 02 12:38:37.073356 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873458 2582 flags.go:64] FLAG: --qos-reserved="" Jul 02 12:38:37.073356 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873461 2582 flags.go:64] FLAG: --read-only-port="10255" Jul 02 12:38:37.073356 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873464 2582 flags.go:64] FLAG: --register-node="true" Jul 02 12:38:37.073356 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873467 2582 flags.go:64] FLAG: --register-with-taints="" Jul 02 12:38:37.073356 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873471 2582 flags.go:64] FLAG: --registry-burst="10" Jul 02 12:38:37.074465 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873473 2582 flags.go:64] FLAG: --registry-qps="5" Jul 02 12:38:37.074465 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873476 2582 flags.go:64] FLAG: --reserved-cpus="" Jul 02 12:38:37.074465 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873479 2582 flags.go:64] FLAG: --reserved-memory="" Jul 02 12:38:37.074465 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873482 2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 02 12:38:37.074465 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873486 2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 02 12:38:37.074465 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873489 2582 flags.go:64] FLAG: --rotate-certificates="false" Jul 02 12:38:37.074465 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873492 2582 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 02 12:38:37.074465 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873494 2582 flags.go:64] FLAG: --runonce="false" Jul 02 12:38:37.074465 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873497 2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 02 12:38:37.074465 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873500 2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 02 12:38:37.074465 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873504 2582 flags.go:64] FLAG: --seccomp-default="false" Jul 02 12:38:37.074465 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873508 2582 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 02 12:38:37.074465 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873511 2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 02 12:38:37.074465 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873514 2582 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 02 12:38:37.074465 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873519 2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 02 12:38:37.074465 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873522 2582 flags.go:64] FLAG: --storage-driver-password="root" Jul 02 12:38:37.074465 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873525 2582 flags.go:64] FLAG: --storage-driver-secure="false" Jul 02 12:38:37.074465 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873528 2582 flags.go:64] FLAG: --storage-driver-table="stats" Jul 02 12:38:37.074465 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873531 2582 flags.go:64] FLAG: --storage-driver-user="root" Jul 02 12:38:37.074465 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873534 2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 02 12:38:37.074465 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873537 2582 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 02 12:38:37.074465 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873540 2582 flags.go:64] FLAG: --system-cgroups="" Jul 02 12:38:37.074465 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873543 2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 02 12:38:37.074465 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873549 2582 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 02 12:38:37.074465 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873551 2582 flags.go:64] FLAG: --tls-cert-file="" Jul 02 12:38:37.075553 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873555 2582 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 02 12:38:37.075553 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873558 2582 flags.go:64] FLAG: --tls-min-version="" Jul 02 12:38:37.075553 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873561 2582 flags.go:64] FLAG: --tls-private-key-file="" Jul 02 12:38:37.075553 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873563 2582 flags.go:64] FLAG: --topology-manager-policy="none" Jul 02 12:38:37.075553 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873566 2582 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 02 12:38:37.075553 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873569 2582 flags.go:64] FLAG: --topology-manager-scope="container" Jul 02 12:38:37.075553 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873572 2582 flags.go:64] FLAG: --v="2" Jul 02 12:38:37.075553 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873576 2582 flags.go:64] FLAG: --version="false" Jul 02 12:38:37.075553 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873580 2582 flags.go:64] FLAG: --vmodule="" Jul 02 12:38:37.075553 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873583 2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 02 12:38:37.075553 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.873587 2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 02 12:38:37.075553 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873756 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 12:38:37.075553 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873761 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 12:38:37.075553 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873764 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 12:38:37.075553 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873767 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 12:38:37.075553 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873771 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 12:38:37.075553 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873774 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 12:38:37.075553 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873780 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 12:38:37.075553 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873783 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 12:38:37.075553 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873786 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 12:38:37.075553 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873788 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 12:38:37.075553 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873792 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 12:38:37.075553 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873795 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 12:38:37.076639 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873798 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 12:38:37.076639 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873800 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 12:38:37.076639 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873803 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 12:38:37.076639 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873806 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 12:38:37.076639 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873808 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 12:38:37.076639 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873812 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 12:38:37.076639 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873815 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 12:38:37.076639 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873818 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 12:38:37.076639 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873820 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 12:38:37.076639 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873823 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 12:38:37.076639 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873826 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 12:38:37.076639 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873829 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 12:38:37.076639 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873831 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 12:38:37.076639 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873834 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 12:38:37.076639 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873836 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 12:38:37.076639 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873839 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 12:38:37.076639 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873842 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 12:38:37.076639 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873844 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 12:38:37.076639 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873847 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 12:38:37.077500 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873849 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 12:38:37.077500 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873852 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 12:38:37.077500 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873856 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 12:38:37.077500 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873860 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 12:38:37.077500 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873862 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 12:38:37.077500 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873865 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 12:38:37.077500 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873868 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 12:38:37.077500 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873872 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 12:38:37.077500 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873874 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 12:38:37.077500 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873877 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 12:38:37.077500 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873879 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 02 12:38:37.077500 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873884 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 12:38:37.077500 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873887 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 12:38:37.077500 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873890 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 12:38:37.077500 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873892 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 12:38:37.077500 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873895 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 12:38:37.077500 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873897 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 12:38:37.077500 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873900 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 12:38:37.077500 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873902 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 12:38:37.078363 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873905 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 12:38:37.078363 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873908 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 12:38:37.078363 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873911 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 12:38:37.078363 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873913 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 12:38:37.078363 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873916 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 12:38:37.078363 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873918 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 12:38:37.078363 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873921 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 12:38:37.078363 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873923 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 12:38:37.078363 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873926 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 12:38:37.078363 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873929 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 12:38:37.078363 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873931 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 12:38:37.078363 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873934 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 12:38:37.078363 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873936 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 12:38:37.078363 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873939 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 12:38:37.078363 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873941 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 12:38:37.078363 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873943 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 12:38:37.078363 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873946 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 12:38:37.078363 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873949 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 12:38:37.078363 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873953 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 12:38:37.079203 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873956 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 12:38:37.079203 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873960 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 12:38:37.079203 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873963 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 12:38:37.079203 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873966 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 12:38:37.079203 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873969 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 12:38:37.079203 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873973 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 12:38:37.079203 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873976 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 12:38:37.079203 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873978 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 12:38:37.079203 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873981 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 12:38:37.079203 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873984 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 12:38:37.079203 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873986 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 12:38:37.079203 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873989 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 12:38:37.079203 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873992 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 12:38:37.079203 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873995 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 12:38:37.079203 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.873997 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 12:38:37.079203 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.874001 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 12:38:37.079203 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.874003 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 12:38:37.079203 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.874006 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 12:38:37.079203 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.874008 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 12:38:37.079203 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.874011 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 12:38:37.080701 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.874014 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 12:38:37.080701 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.874016 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 12:38:37.080701 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.874020 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 12:38:37.080701 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.874023 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 12:38:37.080701 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.874026 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 12:38:37.080701 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.874029 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 12:38:37.080701 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.874031 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 12:38:37.080701 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.874034 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 12:38:37.080701 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.874036 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 12:38:37.080701 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.874039 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 12:38:37.080701 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.874044 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 12:38:37.080701 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.881138 2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 02 12:38:37.080701 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.881155 2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 02 12:38:37.080701 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.881174 2582 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 02 12:38:37.081352 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.881180 2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 02 12:38:37.081352 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881237 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 12:38:37.081352 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881243 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 12:38:37.081352 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881247 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 12:38:37.081352 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881249 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 12:38:37.081352 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881253 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 12:38:37.081352 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881256 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 12:38:37.081352 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881259 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 12:38:37.081352 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881262 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 12:38:37.081352 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881265 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 12:38:37.081352 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881268 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 12:38:37.081352 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881270 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 12:38:37.081352 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881273 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 12:38:37.081352 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881276 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 12:38:37.081352 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881278 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 12:38:37.081352 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881281 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 12:38:37.081352 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881285 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 12:38:37.081352 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881288 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 12:38:37.081352 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881291 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 12:38:37.083266 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881294 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 12:38:37.083266 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881296 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 12:38:37.083266 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881299 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 12:38:37.083266 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881302 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 12:38:37.083266 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881304 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 12:38:37.083266 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881307 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 12:38:37.083266 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881310 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 12:38:37.083266 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881313 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 12:38:37.083266 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881315 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 12:38:37.083266 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881318 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 12:38:37.083266 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881321 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 12:38:37.083266 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881333 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 12:38:37.083266 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881336 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 12:38:37.083266 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881338 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 12:38:37.083266 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881341 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 12:38:37.083266 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881344 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 12:38:37.083266 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881347 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 12:38:37.083266 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881349 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 12:38:37.083266 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881352 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 12:38:37.083266 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881354 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 12:38:37.084130 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881357 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 12:38:37.084130 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881360 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 12:38:37.084130 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881362 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 12:38:37.084130 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881365 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 12:38:37.084130 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881367 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 12:38:37.084130 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881370 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 12:38:37.084130 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881372 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 12:38:37.084130 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881375 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 12:38:37.084130 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881378 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 12:38:37.084130 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881381 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 12:38:37.084130 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881385 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 12:38:37.084130 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881388 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 12:38:37.084130 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881391 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 12:38:37.084130 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881394 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 12:38:37.084130 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881397 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 12:38:37.084130 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881401 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 12:38:37.084130 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881404 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 12:38:37.084130 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881410 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 12:38:37.084130 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881413 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 12:38:37.085427 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881416 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 12:38:37.085427 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881419 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 12:38:37.085427 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881422 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 12:38:37.085427 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881424 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 12:38:37.085427 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881427 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 12:38:37.085427 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881430 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 12:38:37.085427 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881432 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 12:38:37.085427 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881435 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 12:38:37.085427 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881439 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 12:38:37.085427 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881442 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 12:38:37.085427 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881445 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 12:38:37.085427 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881447 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 12:38:37.085427 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881450 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 12:38:37.085427 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881452 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 12:38:37.085427 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881455 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 12:38:37.085427 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881457 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 12:38:37.085427 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881460 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 12:38:37.085427 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881462 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 12:38:37.085427 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881465 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 12:38:37.085427 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881468 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 12:38:37.086300 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881470 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 12:38:37.086300 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881473 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 12:38:37.086300 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881475 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 12:38:37.086300 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881478 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 12:38:37.086300 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881480 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 12:38:37.086300 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881483 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 12:38:37.086300 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881485 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 12:38:37.086300 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881488 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 12:38:37.086300 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881490 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 12:38:37.086300 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881493 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 12:38:37.086300 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881497 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 12:38:37.086300 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881499 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 12:38:37.086300 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881502 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 12:38:37.086300 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881505 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 12:38:37.086300 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881507 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 12:38:37.086300 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881510 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 12:38:37.086300 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881513 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 02 12:38:37.086300 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881515 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 12:38:37.086300 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881521 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 12:38:37.086300 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881523 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 12:38:37.087178 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881528 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 12:38:37.087178 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881530 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 12:38:37.087178 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.881535 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 12:38:37.087178 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881648 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 12:38:37.087178 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881652 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 12:38:37.087178 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881656 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 12:38:37.087178 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881660 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 12:38:37.087178 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881663 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 12:38:37.087178 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881666 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 12:38:37.087178 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881669 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 12:38:37.087178 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881671 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 12:38:37.087178 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881674 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 12:38:37.087178 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881676 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 12:38:37.087178 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881679 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 12:38:37.087178 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881682 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 12:38:37.087837 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881684 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 12:38:37.087837 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881687 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 12:38:37.087837 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881689 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 12:38:37.087837 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881692 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 12:38:37.087837 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881695 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 12:38:37.087837 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881698 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 12:38:37.087837 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881700 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 12:38:37.087837 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881703 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 12:38:37.087837 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881706 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 12:38:37.087837 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881709 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 12:38:37.087837 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881712 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 12:38:37.087837 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881714 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 12:38:37.087837 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881717 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 12:38:37.087837 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881719 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 12:38:37.087837 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881722 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 12:38:37.087837 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881724 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 12:38:37.087837 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881728 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 12:38:37.087837 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881750 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 12:38:37.087837 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881753 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 12:38:37.087837 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881756 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 12:38:37.088690 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881759 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 12:38:37.088690 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881761 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 12:38:37.088690 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881764 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 12:38:37.088690 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881767 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 12:38:37.088690 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881769 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 12:38:37.088690 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881772 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 12:38:37.088690 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881774 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 12:38:37.088690 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881777 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 12:38:37.088690 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881779 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 12:38:37.088690 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881781 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 12:38:37.088690 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881784 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 12:38:37.088690 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881786 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 12:38:37.088690 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881789 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 12:38:37.088690 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881792 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 12:38:37.088690 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881794 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 12:38:37.088690 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881797 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 12:38:37.088690 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881799 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 12:38:37.088690 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881802 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 12:38:37.088690 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881804 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 12:38:37.088690 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881807 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 12:38:37.090410 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881811 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 12:38:37.090410 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881814 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 12:38:37.090410 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881816 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 12:38:37.090410 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881819 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 12:38:37.090410 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881821 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 12:38:37.090410 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881824 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 12:38:37.090410 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881827 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 12:38:37.090410 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881831 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 12:38:37.090410 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881835 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 12:38:37.090410 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881840 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 12:38:37.090410 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881844 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 12:38:37.090410 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881847 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 12:38:37.090410 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881850 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 12:38:37.090410 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881853 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 12:38:37.090410 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881855 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 12:38:37.090410 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881858 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 12:38:37.090410 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881860 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 12:38:37.090410 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881863 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 12:38:37.090410 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881865 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 12:38:37.091284 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881868 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 12:38:37.091284 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881870 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 12:38:37.091284 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881873 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 12:38:37.091284 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881875 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 12:38:37.091284 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881878 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 12:38:37.091284 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881880 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 12:38:37.091284 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881883 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 12:38:37.091284 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881885 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 02 12:38:37.091284 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881888 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 12:38:37.091284 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881890 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 12:38:37.091284 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881893 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 12:38:37.091284 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881895 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 12:38:37.091284 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881898 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 12:38:37.091284 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881903 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 12:38:37.091284 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881905 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 12:38:37.091284 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881907 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 12:38:37.091284 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881910 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 12:38:37.091284 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881912 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 12:38:37.091284 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881915 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 12:38:37.092159 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881917 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 12:38:37.092159 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881920 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 12:38:37.092159 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881922 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 12:38:37.092159 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881926 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 12:38:37.092159 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881929 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 12:38:37.092159 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881931 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 12:38:37.092159 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881934 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 12:38:37.092159 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881936 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 12:38:37.092159 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:36.881938 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 12:38:37.092159 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.881944 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 12:38:37.092159 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.882072 2582 server.go:962] "Client rotation is on, will bootstrap in background" Jul 02 12:38:37.092159 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.884878 2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 02 12:38:37.092159 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.886334 2582 server.go:1019] "Starting client certificate rotation" Jul 02 12:38:37.092159 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.886433 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 12:38:37.092813 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.886472 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 12:38:37.092813 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.889070 2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 12:38:37.092813 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.890280 2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 12:38:37.092813 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.903316 2582 log.go:25] "Validated CRI v1 runtime API" Jul 02 12:38:37.092813 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.905562 2582 log.go:25] "Validated CRI v1 image API" Jul 02 12:38:37.092813 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.906420 2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 02 12:38:37.092813 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.909174 2582 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8284908c-4f2e-46d2-8a5e-c7fa965e2b6b:/dev/nvme0n1p3 91cad587-67be-4ad3-88ef-f3284638de3e:/dev/nvme0n1p4] Jul 02 12:38:37.092813 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.909189 2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 02 12:38:37.260172 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.914196 2582 manager.go:216] Machine: {Timestamp:2026-07-02 12:38:36.912816162 +0000 UTC m=+0.356997770 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098513 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec276a0278e93208b7248c50d0b324e8 SystemUUID:ec276a02-78e9-3208-b724-8c50d0b324e8 BootID:4ca6158d-afc4-426c-90b3-eee5eacb78e2 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:48:ba:c3:93:1d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:48:ba:c3:93:1d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ce:d2:8f:0d:b4:e5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 02 12:38:37.260172 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.914296 2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 02 12:38:37.260172 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.914374 2582 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 02 12:38:37.260172 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.915330 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 12:38:37.260172 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.917674 2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 02 12:38:37.260172 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.917701 2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-7.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 02 12:38:37.260172 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.918825 2582 topology_manager.go:138] "Creating topology manager with none policy" Jul 02 12:38:37.260172 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.918839 2582 container_manager_linux.go:309] "Creating device plugin manager" Jul 02 12:38:37.260172 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.918847 2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 12:38:37.260172 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.919603 2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 12:38:37.260172 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.920520 2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 02 12:38:37.260172 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.923999 2582 state_mem.go:36] "Initialized new in-memory state store" Jul 02 12:38:37.260172 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.924111 2582 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 02 12:38:37.260172 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.924139 2582 kubelet.go:486] "Attempting to sync node with API server" Jul 02 12:38:37.260172 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.925016 2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 02 12:38:37.260172 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.925043 2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 02 12:38:37.260172 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.925056 2582 kubelet.go:398] "Adding apiserver pod source" Jul 02 12:38:37.261774 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.925067 2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 02 12:38:37.261774 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.925463 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 12:38:37.261774 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.925481 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 12:38:37.261774 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.927424 2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 02 12:38:37.261774 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.928951 2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 02 12:38:37.261774 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.928985 2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 02 12:38:37.261774 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.929947 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 02 12:38:37.261774 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.929972 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 02 12:38:37.261774 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.929984 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 02 12:38:37.261774 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.929997 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 02 12:38:37.261774 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.930014 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 02 12:38:37.261774 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.930025 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 02 12:38:37.261774 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.930044 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 02 12:38:37.261774 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.930055 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 02 12:38:37.261774 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.930068 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 02 12:38:37.261774 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.930079 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 02 12:38:37.261774 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.930094 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 02 12:38:37.261774 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.930103 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 02 12:38:37.261774 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.931126 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 02 12:38:37.261774 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.931308 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 02 12:38:37.261774 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.934965 2582 server.go:1268] "Started kubelet" Jul 02 12:38:37.261774 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.935052 2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 02 12:38:37.261774 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.935094 2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 02 12:38:37.261774 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.935128 2582 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 02 12:38:37.261774 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.936214 2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 02 12:38:37.261774 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.936272 2582 server.go:310] "Adding debug handlers to kubelet server" Jul 02 12:38:37.261774 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.936719 2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-7.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 02 12:38:37.261774 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:36.936762 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 02 12:38:37.261774 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:36.936902 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-7.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 02 12:38:37.261774 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:36.941211 2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 02 12:38:37.261774 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:36.940515 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-7.ec2.internal.18be7956f8e0d8a2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-7.ec2.internal,UID:ip-10-0-140-7.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-7.ec2.internal,},FirstTimestamp:2026-07-02 12:38:36.934928546 +0000 UTC m=+0.379110154,LastTimestamp:2026-07-02 12:38:36.934928546 +0000 UTC m=+0.379110154,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-7.ec2.internal,}" Jul 02 12:38:37.261774 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.945907 2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 02 12:38:37.261774 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.945925 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 02 12:38:37.261774 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:36.946006 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-7.ec2.internal\" not found" Jul 02 12:38:37.261774 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.946526 2582 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 02 12:38:37.261774 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.946541 2582 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 02 12:38:37.261774 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.946626 2582 reconstruct.go:97] "Volume reconstruction finished" Jul 02 12:38:37.261774 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.946636 2582 reconciler.go:29] "Reconciler: start to sync state" Jul 02 12:38:37.261774 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.946646 2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 02 12:38:37.261774 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.946762 2582 factory.go:55] Registering systemd factory Jul 02 12:38:37.261774 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.946775 2582 factory.go:223] Registration of the systemd container factory successfully Jul 02 12:38:37.261774 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.946961 2582 factory.go:153] Registering CRI-O factory Jul 02 12:38:37.263705 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.946973 2582 factory.go:223] Registration of the crio container factory successfully Jul 02 12:38:37.263705 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.947020 2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 02 12:38:37.263705 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.947042 2582 factory.go:103] Registering Raw factory Jul 02 12:38:37.263705 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.947055 2582 manager.go:1196] Started watching for new ooms in manager Jul 02 12:38:37.263705 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.947719 2582 manager.go:349] Starting recovery of all containers Jul 02 12:38:37.263705 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:36.948161 2582 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-7.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 02 12:38:37.263705 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:36.948299 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 02 12:38:37.263705 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.962147 2582 manager.go:354] Recovery completed Jul 02 12:38:37.263705 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.967554 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 12:38:37.263705 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.969513 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-7.ec2.internal" event="NodeHasSufficientMemory" Jul 02 12:38:37.263705 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.969545 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-7.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 12:38:37.263705 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.969561 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-7.ec2.internal" event="NodeHasSufficientPID" Jul 02 12:38:37.263705 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.970127 2582 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 02 12:38:37.263705 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.970138 2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 02 12:38:37.263705 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.970141 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 12:38:37.263705 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.970154 2582 state_mem.go:36] "Initialized new in-memory state store" Jul 02 12:38:37.263705 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.970768 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-7.ec2.internal" event="NodeHasSufficientMemory" Jul 02 12:38:37.263705 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.970792 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-7.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 12:38:37.263705 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.970804 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-7.ec2.internal" event="NodeHasSufficientPID" Jul 02 12:38:37.263705 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.971429 2582 policy_none.go:49] "None policy: Start" Jul 02 12:38:37.263705 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.971441 2582 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 02 12:38:37.263705 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.971451 2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 02 12:38:37.263705 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.972226 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2f4r7" Jul 02 12:38:37.263705 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.972534 2582 policy_none.go:47] "Start" Jul 02 12:38:37.263705 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:36.978618 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-7.ec2.internal.18be7956faf0ce38 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-7.ec2.internal,UID:ip-10-0-140-7.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-7.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-7.ec2.internal,},FirstTimestamp:2026-07-02 12:38:36.969528888 +0000 UTC m=+0.413710496,LastTimestamp:2026-07-02 12:38:36.969528888 +0000 UTC m=+0.413710496,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-7.ec2.internal,}" Jul 02 12:38:37.263705 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:36.980521 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2f4r7" Jul 02 12:38:37.263705 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:36.982296 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-7.ec2.internal.18be7956faf12d0e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-7.ec2.internal,UID:ip-10-0-140-7.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-7.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-7.ec2.internal,},FirstTimestamp:2026-07-02 12:38:36.969553166 +0000 UTC m=+0.413734776,LastTimestamp:2026-07-02 12:38:36.969553166 +0000 UTC m=+0.413734776,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-7.ec2.internal,}" Jul 02 12:38:37.263705 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.021402 2582 manager.go:337] "Starting Device Plugin manager" Jul 02 12:38:37.263705 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:37.021450 2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 02 12:38:37.263705 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.021462 2582 server.go:87] "Starting device plugin registration server" Jul 02 12:38:37.263705 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.021762 2582 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 02 12:38:37.263705 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.021774 2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 02 12:38:37.263705 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.022897 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 02 12:38:37.265664 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.024257 2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 02 12:38:37.265664 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.024341 2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 02 12:38:37.265664 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.024351 2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 02 12:38:37.265664 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.024452 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 02 12:38:37.265664 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.024484 2582 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 02 12:38:37.265664 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.024504 2582 kubelet.go:2448] "Starting kubelet main sync loop" Jul 02 12:38:37.265664 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:37.024541 2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 02 12:38:37.265664 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:37.024887 2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 02 12:38:37.265664 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:37.024931 2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-7.ec2.internal\" not found" Jul 02 12:38:37.265664 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.026494 2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 12:38:37.265664 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.122493 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 12:38:37.265664 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.123438 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-7.ec2.internal" event="NodeHasSufficientMemory" Jul 02 12:38:37.265664 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.123468 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-7.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 12:38:37.265664 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.123478 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-7.ec2.internal" event="NodeHasSufficientPID" Jul 02 12:38:37.265664 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.123503 2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-7.ec2.internal" Jul 02 12:38:37.265664 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.125574 2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-7.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-7.ec2.internal"] Jul 02 12:38:37.265664 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.125633 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 12:38:37.265664 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.126943 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-7.ec2.internal" event="NodeHasSufficientMemory" Jul 02 12:38:37.265664 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.126970 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-7.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 12:38:37.265664 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.126982 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-7.ec2.internal" event="NodeHasSufficientPID" Jul 02 12:38:37.265664 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.128384 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 12:38:37.265664 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.128503 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-7.ec2.internal" Jul 02 12:38:37.265664 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.128535 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 12:38:37.265664 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.129141 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-7.ec2.internal" event="NodeHasSufficientMemory" Jul 02 12:38:37.265664 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.129165 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-7.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 12:38:37.265664 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.129179 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-7.ec2.internal" event="NodeHasSufficientPID" Jul 02 12:38:37.265664 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.129241 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-7.ec2.internal" event="NodeHasSufficientMemory" Jul 02 12:38:37.265664 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.129263 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-7.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 12:38:37.265664 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.129278 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-7.ec2.internal" event="NodeHasSufficientPID" Jul 02 12:38:37.265664 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.130529 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-7.ec2.internal" Jul 02 12:38:37.265664 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.130553 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 12:38:37.265664 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.131173 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-7.ec2.internal" event="NodeHasSufficientMemory" Jul 02 12:38:37.265664 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.131191 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-7.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 12:38:37.265664 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.131201 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-7.ec2.internal" event="NodeHasSufficientPID" Jul 02 12:38:37.265664 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.133238 2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-7.ec2.internal" Jul 02 12:38:37.265664 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:37.133255 2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-7.ec2.internal\": node \"ip-10-0-140-7.ec2.internal\" not found" Jul 02 12:38:37.265664 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:37.156277 2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-7.ec2.internal\" not found" node="ip-10-0-140-7.ec2.internal" Jul 02 12:38:37.265664 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:37.160697 2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-7.ec2.internal\" not found" node="ip-10-0-140-7.ec2.internal" Jul 02 12:38:37.265664 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:37.161781 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-7.ec2.internal\" not found" Jul 02 12:38:37.267778 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.249960 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cc91c7bc68d3a8c7263cef4441283de1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-7.ec2.internal\" (UID: \"cc91c7bc68d3a8c7263cef4441283de1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-7.ec2.internal" Jul 02 12:38:37.267778 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.249986 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc91c7bc68d3a8c7263cef4441283de1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-7.ec2.internal\" (UID: \"cc91c7bc68d3a8c7263cef4441283de1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-7.ec2.internal" Jul 02 12:38:37.267778 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.250004 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bd91ebf43e810155cc24f7e478ff9f41-config\") pod \"kube-apiserver-proxy-ip-10-0-140-7.ec2.internal\" (UID: \"bd91ebf43e810155cc24f7e478ff9f41\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-7.ec2.internal" Jul 02 12:38:37.267778 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:37.262845 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-7.ec2.internal\" not found" Jul 02 12:38:37.372480 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.350817 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cc91c7bc68d3a8c7263cef4441283de1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-7.ec2.internal\" (UID: \"cc91c7bc68d3a8c7263cef4441283de1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-7.ec2.internal" Jul 02 12:38:37.372480 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.350858 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc91c7bc68d3a8c7263cef4441283de1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-7.ec2.internal\" (UID: \"cc91c7bc68d3a8c7263cef4441283de1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-7.ec2.internal" Jul 02 12:38:37.372480 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.350918 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc91c7bc68d3a8c7263cef4441283de1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-7.ec2.internal\" (UID: \"cc91c7bc68d3a8c7263cef4441283de1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-7.ec2.internal" Jul 02 12:38:37.372480 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.350920 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cc91c7bc68d3a8c7263cef4441283de1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-7.ec2.internal\" (UID: \"cc91c7bc68d3a8c7263cef4441283de1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-7.ec2.internal" Jul 02 12:38:37.372480 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.350963 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bd91ebf43e810155cc24f7e478ff9f41-config\") pod \"kube-apiserver-proxy-ip-10-0-140-7.ec2.internal\" (UID: \"bd91ebf43e810155cc24f7e478ff9f41\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-7.ec2.internal" Jul 02 12:38:37.372480 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.351000 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bd91ebf43e810155cc24f7e478ff9f41-config\") pod \"kube-apiserver-proxy-ip-10-0-140-7.ec2.internal\" (UID: \"bd91ebf43e810155cc24f7e478ff9f41\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-7.ec2.internal" Jul 02 12:38:37.372480 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:37.363894 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-7.ec2.internal\" not found" Jul 02 12:38:37.563758 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.460649 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-7.ec2.internal" Jul 02 12:38:37.563758 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:37.463986 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-7.ec2.internal\" not found" Jul 02 12:38:37.563758 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.465076 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-7.ec2.internal" Jul 02 12:38:37.565042 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:37.564465 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-7.ec2.internal\" not found" Jul 02 12:38:37.754977 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:37.664989 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-7.ec2.internal\" not found" Jul 02 12:38:37.941767 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:37.765484 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-7.ec2.internal\" not found" Jul 02 12:38:37.941767 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:37.865974 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-7.ec2.internal\" not found" Jul 02 12:38:37.941767 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.886122 2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 02 12:38:37.941767 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.886254 2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 12:38:38.096018 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:37.966997 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-7.ec2.internal\" not found" Jul 02 12:38:38.096018 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.985602 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 12:33:38 +0000 UTC" deadline="2028-02-18 12:23:12.625992696 +0000 UTC" Jul 02 12:38:38.096018 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:37.985628 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14303h44m34.640368081s" Jul 02 12:38:38.096018 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:38.006243 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 12:38:38.096018 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:38.007990 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-7.ec2.internal" event="NodeHasSufficientMemory" Jul 02 12:38:38.096018 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:38.008025 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-7.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 12:38:38.096018 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:38.008037 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-7.ec2.internal" event="NodeHasSufficientPID" Jul 02 12:38:38.096018 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:38.049700 2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 12:38:38.096018 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:38.067624 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-7.ec2.internal\" not found" Jul 02 12:38:38.240166 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:38.120336 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc91c7bc68d3a8c7263cef4441283de1.slice/crio-200bd2a7646e32fef0ea32282fc2eb722a2d2ed908ffeecf03150cefbc65fa2a WatchSource:0}: Error finding container 200bd2a7646e32fef0ea32282fc2eb722a2d2ed908ffeecf03150cefbc65fa2a: Status 404 returned error can't find the container with id 200bd2a7646e32fef0ea32282fc2eb722a2d2ed908ffeecf03150cefbc65fa2a Jul 02 12:38:38.240166 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:38.120864 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd91ebf43e810155cc24f7e478ff9f41.slice/crio-452c918aec8340c1ebd0b36c8fdedc0be297bdf7ba290576640bec477b3feee3 WatchSource:0}: Error finding container 452c918aec8340c1ebd0b36c8fdedc0be297bdf7ba290576640bec477b3feee3: Status 404 returned error can't find the container with id 452c918aec8340c1ebd0b36c8fdedc0be297bdf7ba290576640bec477b3feee3 Jul 02 12:38:38.240166 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:38.125763 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 12:38:38.240166 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:38.133067 2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 12:38:38.240166 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:38.156743 2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 12:38:38.398223 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:38.246138 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-7.ec2.internal" Jul 02 12:38:38.398223 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:38.258977 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 12:38:38.398223 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:38.260036 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-7.ec2.internal" Jul 02 12:38:38.398223 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:38.268576 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 12:38:40.469788 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.469703 2582 apiserver.go:52] "Watching apiserver" Jul 02 12:38:40.477310 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.477280 2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 02 12:38:40.478817 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.478763 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-vhrlk","openshift-multus/network-metrics-daemon-bxzt9","kube-system/konnectivity-agent-wsp6w","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz946","openshift-dns/node-resolver-hbp5q","openshift-image-registry/node-ca-r4xmq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-7.ec2.internal","openshift-network-diagnostics/network-check-target-zxj89","openshift-network-operator/iptables-alerter-rssjt","openshift-ovn-kubernetes/ovnkube-node-bfrv8","kube-system/global-pull-secret-syncer-b7x9v","kube-system/kube-apiserver-proxy-ip-10-0-140-7.ec2.internal","openshift-cluster-node-tuning-operator/tuned-zpkl8","openshift-multus/multus-additional-cni-plugins-2kcwd"] Jul 02 12:38:40.480597 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.480574 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxj89" Jul 02 12:38:40.480720 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:40.480683 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxj89" podUID="b151e533-cc30-4cea-bfa8-7fc75567a995" Jul 02 12:38:40.482032 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.482010 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxzt9" Jul 02 12:38:40.482128 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:40.482069 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxzt9" podUID="d3ed604e-9278-4403-b407-8f5aa8122793" Jul 02 12:38:40.483670 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.483628 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wsp6w" Jul 02 12:38:40.485359 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.485317 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2kcwd" Jul 02 12:38:40.486274 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.486106 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 02 12:38:40.486978 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.486339 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 02 12:38:40.486978 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.486537 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rvv7k\"" Jul 02 12:38:40.486978 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.486895 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hbp5q" Jul 02 12:38:40.487379 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.487349 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 02 12:38:40.487476 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.487395 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 02 12:38:40.487476 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.487440 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 02 12:38:40.487755 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.487736 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-d5chc\"" Jul 02 12:38:40.487870 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.487777 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 02 12:38:40.488016 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.487972 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 02 12:38:40.488287 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.488274 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zpkl8" Jul 02 12:38:40.489134 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.489112 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 02 12:38:40.492260 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.490641 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.492260 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.490848 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 02 12:38:40.492260 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.491532 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 02 12:38:40.492260 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.491892 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 02 12:38:40.492260 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.491917 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 02 12:38:40.492260 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.491988 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-kr8v8\"" Jul 02 12:38:40.492260 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.492117 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-p44xz\"" Jul 02 12:38:40.494230 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.493840 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz946" Jul 02 12:38:40.494327 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.494277 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 02 12:38:40.494389 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.494340 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 02 12:38:40.494389 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.494351 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mbxq9\"" Jul 02 12:38:40.494484 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.494407 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 02 12:38:40.494484 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.494416 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 02 12:38:40.494484 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.494414 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 02 12:38:40.494596 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.494525 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 02 12:38:40.496093 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.496072 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rssjt" Jul 02 12:38:40.496413 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.496289 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 02 12:38:40.496929 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.496907 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 02 12:38:40.497045 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.497027 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 02 12:38:40.497731 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.497709 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-66sh9\"" Jul 02 12:38:40.501412 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.498312 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7x9v" Jul 02 12:38:40.501412 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:40.498401 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7x9v" podUID="c7bdeed2-7b53-450b-a2e9-e3ae689e9c85" Jul 02 12:38:40.501412 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.499226 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 02 12:38:40.501412 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.499611 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 02 12:38:40.501412 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.499690 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 02 12:38:40.501412 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.500016 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-ngzpz\"" Jul 02 12:38:40.501412 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.500065 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-r4xmq" Jul 02 12:38:40.501816 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.501776 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 02 12:38:40.501872 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.501825 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.502312 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.502172 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 02 12:38:40.502770 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.502750 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vxb59\"" Jul 02 12:38:40.503748 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.502988 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 02 12:38:40.503748 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.503255 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d0e97d6f-9390-4869-a92b-763486d4fd64-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mz946\" (UID: \"d0e97d6f-9390-4869-a92b-763486d4fd64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz946" Jul 02 12:38:40.503748 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.503286 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5314ba0b-ba05-4cf4-bffe-54e925b98467-etc-sysctl-d\") pod \"tuned-zpkl8\" (UID: \"5314ba0b-ba05-4cf4-bffe-54e925b98467\") " pod="openshift-cluster-node-tuning-operator/tuned-zpkl8" Jul 02 12:38:40.503748 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.503314 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45891c6f-888b-490a-907f-1f58e3947b8a-host-run-ovn-kubernetes\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.503748 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.503340 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d0e97d6f-9390-4869-a92b-763486d4fd64-etc-selinux\") pod \"aws-ebs-csi-driver-node-mz946\" (UID: \"d0e97d6f-9390-4869-a92b-763486d4fd64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz946" Jul 02 12:38:40.503748 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.503364 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5314ba0b-ba05-4cf4-bffe-54e925b98467-etc-modprobe-d\") pod \"tuned-zpkl8\" (UID: \"5314ba0b-ba05-4cf4-bffe-54e925b98467\") " pod="openshift-cluster-node-tuning-operator/tuned-zpkl8" Jul 02 12:38:40.503748 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.503386 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5314ba0b-ba05-4cf4-bffe-54e925b98467-var-lib-kubelet\") pod \"tuned-zpkl8\" (UID: \"5314ba0b-ba05-4cf4-bffe-54e925b98467\") " pod="openshift-cluster-node-tuning-operator/tuned-zpkl8" Jul 02 12:38:40.503748 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.503432 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/45891c6f-888b-490a-907f-1f58e3947b8a-host-slash\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.503748 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.503471 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/45891c6f-888b-490a-907f-1f58e3947b8a-node-log\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.503748 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.503505 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mg5p\" (UniqueName: \"kubernetes.io/projected/45891c6f-888b-490a-907f-1f58e3947b8a-kube-api-access-4mg5p\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.503748 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.503538 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/69dad1af-5279-40e3-9676-662e8392842f-cni-binary-copy\") pod \"multus-additional-cni-plugins-2kcwd\" (UID: \"69dad1af-5279-40e3-9676-662e8392842f\") " pod="openshift-multus/multus-additional-cni-plugins-2kcwd" Jul 02 12:38:40.503748 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.503646 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f3416a26-326a-4325-b9c1-dcd3d38c27c4-hosts-file\") pod \"node-resolver-hbp5q\" (UID: \"f3416a26-326a-4325-b9c1-dcd3d38c27c4\") " pod="openshift-dns/node-resolver-hbp5q" Jul 02 12:38:40.503748 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.503688 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5314ba0b-ba05-4cf4-bffe-54e925b98467-etc-sysconfig\") pod \"tuned-zpkl8\" (UID: \"5314ba0b-ba05-4cf4-bffe-54e925b98467\") " pod="openshift-cluster-node-tuning-operator/tuned-zpkl8" Jul 02 12:38:40.503748 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.503711 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5314ba0b-ba05-4cf4-bffe-54e925b98467-etc-kubernetes\") pod \"tuned-zpkl8\" (UID: \"5314ba0b-ba05-4cf4-bffe-54e925b98467\") " pod="openshift-cluster-node-tuning-operator/tuned-zpkl8" Jul 02 12:38:40.503748 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.503742 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45891c6f-888b-490a-907f-1f58e3947b8a-run-openvswitch\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.504588 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.503768 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 02 12:38:40.504588 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.503787 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e3c36384-fc8b-4a2e-905a-bef30b2be7c6-agent-certs\") pod \"konnectivity-agent-wsp6w\" (UID: \"e3c36384-fc8b-4a2e-905a-bef30b2be7c6\") " pod="kube-system/konnectivity-agent-wsp6w" Jul 02 12:38:40.504588 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.503835 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/69dad1af-5279-40e3-9676-662e8392842f-cnibin\") pod \"multus-additional-cni-plugins-2kcwd\" (UID: \"69dad1af-5279-40e3-9676-662e8392842f\") " pod="openshift-multus/multus-additional-cni-plugins-2kcwd" Jul 02 12:38:40.504588 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.503904 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/69dad1af-5279-40e3-9676-662e8392842f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2kcwd\" (UID: \"69dad1af-5279-40e3-9676-662e8392842f\") " pod="openshift-multus/multus-additional-cni-plugins-2kcwd" Jul 02 12:38:40.504588 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.503927 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3416a26-326a-4325-b9c1-dcd3d38c27c4-tmp-dir\") pod \"node-resolver-hbp5q\" (UID: \"f3416a26-326a-4325-b9c1-dcd3d38c27c4\") " pod="openshift-dns/node-resolver-hbp5q" Jul 02 12:38:40.504588 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.503949 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5314ba0b-ba05-4cf4-bffe-54e925b98467-lib-modules\") pod \"tuned-zpkl8\" (UID: \"5314ba0b-ba05-4cf4-bffe-54e925b98467\") " pod="openshift-cluster-node-tuning-operator/tuned-zpkl8" Jul 02 12:38:40.504588 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.503970 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/45891c6f-888b-490a-907f-1f58e3947b8a-run-ovn\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.504588 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.503991 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/45891c6f-888b-490a-907f-1f58e3947b8a-ovnkube-script-lib\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.504588 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.504013 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d0e97d6f-9390-4869-a92b-763486d4fd64-registration-dir\") pod \"aws-ebs-csi-driver-node-mz946\" (UID: \"d0e97d6f-9390-4869-a92b-763486d4fd64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz946" Jul 02 12:38:40.504588 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.504033 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3ed604e-9278-4403-b407-8f5aa8122793-metrics-certs\") pod \"network-metrics-daemon-bxzt9\" (UID: \"d3ed604e-9278-4403-b407-8f5aa8122793\") " pod="openshift-multus/network-metrics-daemon-bxzt9" Jul 02 12:38:40.504588 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.504059 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45891c6f-888b-490a-907f-1f58e3947b8a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.504588 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.504095 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d0e97d6f-9390-4869-a92b-763486d4fd64-device-dir\") pod \"aws-ebs-csi-driver-node-mz946\" (UID: \"d0e97d6f-9390-4869-a92b-763486d4fd64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz946" Jul 02 12:38:40.504588 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.504139 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phq66\" (UniqueName: \"kubernetes.io/projected/d0e97d6f-9390-4869-a92b-763486d4fd64-kube-api-access-phq66\") pod \"aws-ebs-csi-driver-node-mz946\" (UID: \"d0e97d6f-9390-4869-a92b-763486d4fd64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz946" Jul 02 12:38:40.504588 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.504177 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69dad1af-5279-40e3-9676-662e8392842f-system-cni-dir\") pod \"multus-additional-cni-plugins-2kcwd\" (UID: \"69dad1af-5279-40e3-9676-662e8392842f\") " pod="openshift-multus/multus-additional-cni-plugins-2kcwd" Jul 02 12:38:40.504588 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.504287 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hgrq\" (UniqueName: \"kubernetes.io/projected/5314ba0b-ba05-4cf4-bffe-54e925b98467-kube-api-access-2hgrq\") pod \"tuned-zpkl8\" (UID: \"5314ba0b-ba05-4cf4-bffe-54e925b98467\") " pod="openshift-cluster-node-tuning-operator/tuned-zpkl8" Jul 02 12:38:40.504588 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.504319 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/45891c6f-888b-490a-907f-1f58e3947b8a-run-systemd\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.505364 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.504343 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/45891c6f-888b-490a-907f-1f58e3947b8a-ovn-node-metrics-cert\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.505364 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.504387 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/45891c6f-888b-490a-907f-1f58e3947b8a-host-run-netns\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.505364 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.504411 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/69dad1af-5279-40e3-9676-662e8392842f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2kcwd\" (UID: \"69dad1af-5279-40e3-9676-662e8392842f\") " pod="openshift-multus/multus-additional-cni-plugins-2kcwd" Jul 02 12:38:40.505364 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.504436 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcn4w\" (UniqueName: \"kubernetes.io/projected/69dad1af-5279-40e3-9676-662e8392842f-kube-api-access-xcn4w\") pod \"multus-additional-cni-plugins-2kcwd\" (UID: \"69dad1af-5279-40e3-9676-662e8392842f\") " pod="openshift-multus/multus-additional-cni-plugins-2kcwd" Jul 02 12:38:40.505364 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.504461 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wd6nf\" (UniqueName: \"kubernetes.io/projected/b151e533-cc30-4cea-bfa8-7fc75567a995-kube-api-access-wd6nf\") pod \"network-check-target-zxj89\" (UID: \"b151e533-cc30-4cea-bfa8-7fc75567a995\") " pod="openshift-network-diagnostics/network-check-target-zxj89" Jul 02 12:38:40.505364 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.504601 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/45891c6f-888b-490a-907f-1f58e3947b8a-ovnkube-config\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.505364 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.504624 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e3c36384-fc8b-4a2e-905a-bef30b2be7c6-konnectivity-ca\") pod \"konnectivity-agent-wsp6w\" (UID: \"e3c36384-fc8b-4a2e-905a-bef30b2be7c6\") " pod="kube-system/konnectivity-agent-wsp6w" Jul 02 12:38:40.505364 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.504724 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5314ba0b-ba05-4cf4-bffe-54e925b98467-etc-systemd\") pod \"tuned-zpkl8\" (UID: \"5314ba0b-ba05-4cf4-bffe-54e925b98467\") " pod="openshift-cluster-node-tuning-operator/tuned-zpkl8" Jul 02 12:38:40.505364 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.504752 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/45891c6f-888b-490a-907f-1f58e3947b8a-host-kubelet\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.505364 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.504774 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/45891c6f-888b-490a-907f-1f58e3947b8a-systemd-units\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.505364 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.504806 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/45891c6f-888b-490a-907f-1f58e3947b8a-host-cni-bin\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.505364 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.504860 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/45891c6f-888b-490a-907f-1f58e3947b8a-host-cni-netd\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.505364 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.504908 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc9t7\" (UniqueName: \"kubernetes.io/projected/f3416a26-326a-4325-b9c1-dcd3d38c27c4-kube-api-access-wc9t7\") pod \"node-resolver-hbp5q\" (UID: \"f3416a26-326a-4325-b9c1-dcd3d38c27c4\") " pod="openshift-dns/node-resolver-hbp5q" Jul 02 12:38:40.505364 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.504934 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5314ba0b-ba05-4cf4-bffe-54e925b98467-etc-tuned\") pod \"tuned-zpkl8\" (UID: \"5314ba0b-ba05-4cf4-bffe-54e925b98467\") " pod="openshift-cluster-node-tuning-operator/tuned-zpkl8" Jul 02 12:38:40.505364 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.504957 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5314ba0b-ba05-4cf4-bffe-54e925b98467-run\") pod \"tuned-zpkl8\" (UID: \"5314ba0b-ba05-4cf4-bffe-54e925b98467\") " pod="openshift-cluster-node-tuning-operator/tuned-zpkl8" Jul 02 12:38:40.505364 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.504967 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5l9w4\"" Jul 02 12:38:40.505364 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.504980 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/45891c6f-888b-490a-907f-1f58e3947b8a-env-overrides\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.506162 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.505002 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5314ba0b-ba05-4cf4-bffe-54e925b98467-tmp\") pod \"tuned-zpkl8\" (UID: \"5314ba0b-ba05-4cf4-bffe-54e925b98467\") " pod="openshift-cluster-node-tuning-operator/tuned-zpkl8" Jul 02 12:38:40.506162 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.505023 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45891c6f-888b-490a-907f-1f58e3947b8a-var-lib-openvswitch\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.506162 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.505044 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d0e97d6f-9390-4869-a92b-763486d4fd64-socket-dir\") pod \"aws-ebs-csi-driver-node-mz946\" (UID: \"d0e97d6f-9390-4869-a92b-763486d4fd64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz946" Jul 02 12:38:40.506162 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.505066 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/69dad1af-5279-40e3-9676-662e8392842f-os-release\") pod \"multus-additional-cni-plugins-2kcwd\" (UID: \"69dad1af-5279-40e3-9676-662e8392842f\") " pod="openshift-multus/multus-additional-cni-plugins-2kcwd" Jul 02 12:38:40.506162 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.505128 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5314ba0b-ba05-4cf4-bffe-54e925b98467-host\") pod \"tuned-zpkl8\" (UID: \"5314ba0b-ba05-4cf4-bffe-54e925b98467\") " pod="openshift-cluster-node-tuning-operator/tuned-zpkl8" Jul 02 12:38:40.506162 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.505151 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45891c6f-888b-490a-907f-1f58e3947b8a-etc-openvswitch\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.506162 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.505172 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5314ba0b-ba05-4cf4-bffe-54e925b98467-etc-sysctl-conf\") pod \"tuned-zpkl8\" (UID: \"5314ba0b-ba05-4cf4-bffe-54e925b98467\") " pod="openshift-cluster-node-tuning-operator/tuned-zpkl8" Jul 02 12:38:40.506162 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.505239 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/45891c6f-888b-490a-907f-1f58e3947b8a-log-socket\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.506162 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.505290 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d0e97d6f-9390-4869-a92b-763486d4fd64-sys-fs\") pod \"aws-ebs-csi-driver-node-mz946\" (UID: \"d0e97d6f-9390-4869-a92b-763486d4fd64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz946" Jul 02 12:38:40.506162 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.505342 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cx5dr\" (UniqueName: \"kubernetes.io/projected/d3ed604e-9278-4403-b407-8f5aa8122793-kube-api-access-cx5dr\") pod \"network-metrics-daemon-bxzt9\" (UID: \"d3ed604e-9278-4403-b407-8f5aa8122793\") " pod="openshift-multus/network-metrics-daemon-bxzt9" Jul 02 12:38:40.506162 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.505371 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/69dad1af-5279-40e3-9676-662e8392842f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2kcwd\" (UID: \"69dad1af-5279-40e3-9676-662e8392842f\") " pod="openshift-multus/multus-additional-cni-plugins-2kcwd" Jul 02 12:38:40.506162 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.505395 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5314ba0b-ba05-4cf4-bffe-54e925b98467-sys\") pod \"tuned-zpkl8\" (UID: \"5314ba0b-ba05-4cf4-bffe-54e925b98467\") " pod="openshift-cluster-node-tuning-operator/tuned-zpkl8" Jul 02 12:38:40.507446 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.507426 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 12:38:40.525633 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.525606 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qw2tj" Jul 02 12:38:40.537916 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.537889 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qw2tj" Jul 02 12:38:40.576850 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.576811 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-7.ec2.internal" event={"ID":"cc91c7bc68d3a8c7263cef4441283de1","Type":"ContainerStarted","Data":"200bd2a7646e32fef0ea32282fc2eb722a2d2ed908ffeecf03150cefbc65fa2a"} Jul 02 12:38:40.577909 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.577889 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-7.ec2.internal" event={"ID":"bd91ebf43e810155cc24f7e478ff9f41","Type":"ContainerStarted","Data":"452c918aec8340c1ebd0b36c8fdedc0be297bdf7ba290576640bec477b3feee3"} Jul 02 12:38:40.591485 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.591458 2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 02 12:38:40.606032 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.606007 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d0e97d6f-9390-4869-a92b-763486d4fd64-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mz946\" (UID: \"d0e97d6f-9390-4869-a92b-763486d4fd64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz946" Jul 02 12:38:40.606170 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.606045 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5314ba0b-ba05-4cf4-bffe-54e925b98467-etc-sysctl-d\") pod \"tuned-zpkl8\" (UID: \"5314ba0b-ba05-4cf4-bffe-54e925b98467\") " pod="openshift-cluster-node-tuning-operator/tuned-zpkl8" Jul 02 12:38:40.606170 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.606072 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45891c6f-888b-490a-907f-1f58e3947b8a-host-run-ovn-kubernetes\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.606170 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.606097 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d0e97d6f-9390-4869-a92b-763486d4fd64-etc-selinux\") pod \"aws-ebs-csi-driver-node-mz946\" (UID: \"d0e97d6f-9390-4869-a92b-763486d4fd64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz946" Jul 02 12:38:40.606170 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.606118 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5314ba0b-ba05-4cf4-bffe-54e925b98467-etc-modprobe-d\") pod \"tuned-zpkl8\" (UID: \"5314ba0b-ba05-4cf4-bffe-54e925b98467\") " pod="openshift-cluster-node-tuning-operator/tuned-zpkl8" Jul 02 12:38:40.606170 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.606142 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4cfd72de-67d1-41ae-9946-a0c526b08910-hostroot\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.606170 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.606153 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45891c6f-888b-490a-907f-1f58e3947b8a-host-run-ovn-kubernetes\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.606476 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.606155 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d0e97d6f-9390-4869-a92b-763486d4fd64-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mz946\" (UID: \"d0e97d6f-9390-4869-a92b-763486d4fd64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz946" Jul 02 12:38:40.606476 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.606213 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5314ba0b-ba05-4cf4-bffe-54e925b98467-etc-sysctl-d\") pod \"tuned-zpkl8\" (UID: \"5314ba0b-ba05-4cf4-bffe-54e925b98467\") " pod="openshift-cluster-node-tuning-operator/tuned-zpkl8" Jul 02 12:38:40.606476 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.606163 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c7bdeed2-7b53-450b-a2e9-e3ae689e9c85-kubelet-config\") pod \"global-pull-secret-syncer-b7x9v\" (UID: \"c7bdeed2-7b53-450b-a2e9-e3ae689e9c85\") " pod="kube-system/global-pull-secret-syncer-b7x9v" Jul 02 12:38:40.606476 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.606254 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5314ba0b-ba05-4cf4-bffe-54e925b98467-etc-modprobe-d\") pod \"tuned-zpkl8\" (UID: \"5314ba0b-ba05-4cf4-bffe-54e925b98467\") " pod="openshift-cluster-node-tuning-operator/tuned-zpkl8" Jul 02 12:38:40.606476 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.606257 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/48562a93-2235-4d95-bada-b1639f40db42-iptables-alerter-script\") pod \"iptables-alerter-rssjt\" (UID: \"48562a93-2235-4d95-bada-b1639f40db42\") " pod="openshift-network-operator/iptables-alerter-rssjt" Jul 02 12:38:40.606476 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.606227 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d0e97d6f-9390-4869-a92b-763486d4fd64-etc-selinux\") pod \"aws-ebs-csi-driver-node-mz946\" (UID: \"d0e97d6f-9390-4869-a92b-763486d4fd64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz946" Jul 02 12:38:40.606476 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.606289 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5314ba0b-ba05-4cf4-bffe-54e925b98467-var-lib-kubelet\") pod \"tuned-zpkl8\" (UID: \"5314ba0b-ba05-4cf4-bffe-54e925b98467\") " pod="openshift-cluster-node-tuning-operator/tuned-zpkl8" Jul 02 12:38:40.606476 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.606314 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/45891c6f-888b-490a-907f-1f58e3947b8a-host-slash\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.606476 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.606340 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/45891c6f-888b-490a-907f-1f58e3947b8a-node-log\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.606476 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.606351 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5314ba0b-ba05-4cf4-bffe-54e925b98467-var-lib-kubelet\") pod \"tuned-zpkl8\" (UID: \"5314ba0b-ba05-4cf4-bffe-54e925b98467\") " pod="openshift-cluster-node-tuning-operator/tuned-zpkl8" Jul 02 12:38:40.606476 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.606364 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mg5p\" (UniqueName: \"kubernetes.io/projected/45891c6f-888b-490a-907f-1f58e3947b8a-kube-api-access-4mg5p\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.606476 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.606372 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/45891c6f-888b-490a-907f-1f58e3947b8a-host-slash\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.606476 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.606387 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/69dad1af-5279-40e3-9676-662e8392842f-cni-binary-copy\") pod \"multus-additional-cni-plugins-2kcwd\" (UID: \"69dad1af-5279-40e3-9676-662e8392842f\") " pod="openshift-multus/multus-additional-cni-plugins-2kcwd" Jul 02 12:38:40.606476 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.606395 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/45891c6f-888b-490a-907f-1f58e3947b8a-node-log\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.606476 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.606409 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f3416a26-326a-4325-b9c1-dcd3d38c27c4-hosts-file\") pod \"node-resolver-hbp5q\" (UID: \"f3416a26-326a-4325-b9c1-dcd3d38c27c4\") " pod="openshift-dns/node-resolver-hbp5q" Jul 02 12:38:40.606476 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.606451 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5314ba0b-ba05-4cf4-bffe-54e925b98467-etc-sysconfig\") pod \"tuned-zpkl8\" (UID: \"5314ba0b-ba05-4cf4-bffe-54e925b98467\") " pod="openshift-cluster-node-tuning-operator/tuned-zpkl8" Jul 02 12:38:40.606476 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.606473 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5314ba0b-ba05-4cf4-bffe-54e925b98467-etc-kubernetes\") pod \"tuned-zpkl8\" (UID: \"5314ba0b-ba05-4cf4-bffe-54e925b98467\") " pod="openshift-cluster-node-tuning-operator/tuned-zpkl8" Jul 02 12:38:40.607309 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.606504 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45891c6f-888b-490a-907f-1f58e3947b8a-run-openvswitch\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.607309 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.606520 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f3416a26-326a-4325-b9c1-dcd3d38c27c4-hosts-file\") pod \"node-resolver-hbp5q\" (UID: \"f3416a26-326a-4325-b9c1-dcd3d38c27c4\") " pod="openshift-dns/node-resolver-hbp5q" Jul 02 12:38:40.607309 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.606543 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45891c6f-888b-490a-907f-1f58e3947b8a-run-openvswitch\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.607309 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.606553 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5314ba0b-ba05-4cf4-bffe-54e925b98467-etc-sysconfig\") pod \"tuned-zpkl8\" (UID: \"5314ba0b-ba05-4cf4-bffe-54e925b98467\") " pod="openshift-cluster-node-tuning-operator/tuned-zpkl8" Jul 02 12:38:40.607309 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.606590 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5314ba0b-ba05-4cf4-bffe-54e925b98467-etc-kubernetes\") pod \"tuned-zpkl8\" (UID: \"5314ba0b-ba05-4cf4-bffe-54e925b98467\") " pod="openshift-cluster-node-tuning-operator/tuned-zpkl8" Jul 02 12:38:40.607309 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.606592 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e3c36384-fc8b-4a2e-905a-bef30b2be7c6-agent-certs\") pod \"konnectivity-agent-wsp6w\" (UID: \"e3c36384-fc8b-4a2e-905a-bef30b2be7c6\") " pod="kube-system/konnectivity-agent-wsp6w" Jul 02 12:38:40.607309 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.606620 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/69dad1af-5279-40e3-9676-662e8392842f-cnibin\") pod \"multus-additional-cni-plugins-2kcwd\" (UID: \"69dad1af-5279-40e3-9676-662e8392842f\") " pod="openshift-multus/multus-additional-cni-plugins-2kcwd" Jul 02 12:38:40.607309 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.606643 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/69dad1af-5279-40e3-9676-662e8392842f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2kcwd\" (UID: \"69dad1af-5279-40e3-9676-662e8392842f\") " pod="openshift-multus/multus-additional-cni-plugins-2kcwd" Jul 02 12:38:40.607309 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.606689 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3416a26-326a-4325-b9c1-dcd3d38c27c4-tmp-dir\") pod \"node-resolver-hbp5q\" (UID: \"f3416a26-326a-4325-b9c1-dcd3d38c27c4\") " pod="openshift-dns/node-resolver-hbp5q" Jul 02 12:38:40.607309 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.606688 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/69dad1af-5279-40e3-9676-662e8392842f-cnibin\") pod \"multus-additional-cni-plugins-2kcwd\" (UID: \"69dad1af-5279-40e3-9676-662e8392842f\") " pod="openshift-multus/multus-additional-cni-plugins-2kcwd" Jul 02 12:38:40.607309 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.606725 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5314ba0b-ba05-4cf4-bffe-54e925b98467-lib-modules\") pod \"tuned-zpkl8\" (UID: \"5314ba0b-ba05-4cf4-bffe-54e925b98467\") " pod="openshift-cluster-node-tuning-operator/tuned-zpkl8" Jul 02 12:38:40.607309 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.606752 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4cfd72de-67d1-41ae-9946-a0c526b08910-system-cni-dir\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.607309 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.606775 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/45891c6f-888b-490a-907f-1f58e3947b8a-run-ovn\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.607309 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.606797 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/45891c6f-888b-490a-907f-1f58e3947b8a-ovnkube-script-lib\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.607309 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.606821 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d0e97d6f-9390-4869-a92b-763486d4fd64-registration-dir\") pod \"aws-ebs-csi-driver-node-mz946\" (UID: \"d0e97d6f-9390-4869-a92b-763486d4fd64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz946" Jul 02 12:38:40.607309 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.606841 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3ed604e-9278-4403-b407-8f5aa8122793-metrics-certs\") pod \"network-metrics-daemon-bxzt9\" (UID: \"d3ed604e-9278-4403-b407-8f5aa8122793\") " pod="openshift-multus/network-metrics-daemon-bxzt9" Jul 02 12:38:40.607309 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.606865 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4cfd72de-67d1-41ae-9946-a0c526b08910-host-var-lib-cni-multus\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.608014 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.606885 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5314ba0b-ba05-4cf4-bffe-54e925b98467-lib-modules\") pod \"tuned-zpkl8\" (UID: \"5314ba0b-ba05-4cf4-bffe-54e925b98467\") " pod="openshift-cluster-node-tuning-operator/tuned-zpkl8" Jul 02 12:38:40.608014 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.606889 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4cfd72de-67d1-41ae-9946-a0c526b08910-etc-kubernetes\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.608014 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.606911 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/48562a93-2235-4d95-bada-b1639f40db42-host-slash\") pod \"iptables-alerter-rssjt\" (UID: \"48562a93-2235-4d95-bada-b1639f40db42\") " pod="openshift-network-operator/iptables-alerter-rssjt" Jul 02 12:38:40.608014 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.606915 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d0e97d6f-9390-4869-a92b-763486d4fd64-registration-dir\") pod \"aws-ebs-csi-driver-node-mz946\" (UID: \"d0e97d6f-9390-4869-a92b-763486d4fd64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz946" Jul 02 12:38:40.608014 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.606865 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/45891c6f-888b-490a-907f-1f58e3947b8a-run-ovn\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.608014 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.606953 2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 02 12:38:40.608014 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.606977 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45891c6f-888b-490a-907f-1f58e3947b8a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.608014 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.607001 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d0e97d6f-9390-4869-a92b-763486d4fd64-device-dir\") pod \"aws-ebs-csi-driver-node-mz946\" (UID: \"d0e97d6f-9390-4869-a92b-763486d4fd64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz946" Jul 02 12:38:40.608014 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:40.607012 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 12:38:40.608014 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.607024 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phq66\" (UniqueName: \"kubernetes.io/projected/d0e97d6f-9390-4869-a92b-763486d4fd64-kube-api-access-phq66\") pod \"aws-ebs-csi-driver-node-mz946\" (UID: \"d0e97d6f-9390-4869-a92b-763486d4fd64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz946" Jul 02 12:38:40.608014 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.606959 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3416a26-326a-4325-b9c1-dcd3d38c27c4-tmp-dir\") pod \"node-resolver-hbp5q\" (UID: \"f3416a26-326a-4325-b9c1-dcd3d38c27c4\") " pod="openshift-dns/node-resolver-hbp5q" Jul 02 12:38:40.608014 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.607086 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69dad1af-5279-40e3-9676-662e8392842f-system-cni-dir\") pod \"multus-additional-cni-plugins-2kcwd\" (UID: \"69dad1af-5279-40e3-9676-662e8392842f\") " pod="openshift-multus/multus-additional-cni-plugins-2kcwd" Jul 02 12:38:40.608014 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.607049 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69dad1af-5279-40e3-9676-662e8392842f-system-cni-dir\") pod \"multus-additional-cni-plugins-2kcwd\" (UID: \"69dad1af-5279-40e3-9676-662e8392842f\") " pod="openshift-multus/multus-additional-cni-plugins-2kcwd" Jul 02 12:38:40.608014 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.607149 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/69dad1af-5279-40e3-9676-662e8392842f-cni-binary-copy\") pod \"multus-additional-cni-plugins-2kcwd\" (UID: \"69dad1af-5279-40e3-9676-662e8392842f\") " pod="openshift-multus/multus-additional-cni-plugins-2kcwd" Jul 02 12:38:40.608014 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.607154 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45891c6f-888b-490a-907f-1f58e3947b8a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.608014 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.607461 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/45891c6f-888b-490a-907f-1f58e3947b8a-ovnkube-script-lib\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.608014 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.607590 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/69dad1af-5279-40e3-9676-662e8392842f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2kcwd\" (UID: \"69dad1af-5279-40e3-9676-662e8392842f\") " pod="openshift-multus/multus-additional-cni-plugins-2kcwd" Jul 02 12:38:40.608848 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.607609 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d0e97d6f-9390-4869-a92b-763486d4fd64-device-dir\") pod \"aws-ebs-csi-driver-node-mz946\" (UID: \"d0e97d6f-9390-4869-a92b-763486d4fd64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz946" Jul 02 12:38:40.608848 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:40.607718 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3ed604e-9278-4403-b407-8f5aa8122793-metrics-certs podName:d3ed604e-9278-4403-b407-8f5aa8122793 nodeName:}" failed. No retries permitted until 2026-07-02 12:38:41.10706525 +0000 UTC m=+3.007328893 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3ed604e-9278-4403-b407-8f5aa8122793-metrics-certs") pod "network-metrics-daemon-bxzt9" (UID: "d3ed604e-9278-4403-b407-8f5aa8122793") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 12:38:40.608848 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.607766 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hgrq\" (UniqueName: \"kubernetes.io/projected/5314ba0b-ba05-4cf4-bffe-54e925b98467-kube-api-access-2hgrq\") pod \"tuned-zpkl8\" (UID: \"5314ba0b-ba05-4cf4-bffe-54e925b98467\") " pod="openshift-cluster-node-tuning-operator/tuned-zpkl8" Jul 02 12:38:40.608848 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.607795 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4cfd72de-67d1-41ae-9946-a0c526b08910-cnibin\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.608848 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.607820 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4cfd72de-67d1-41ae-9946-a0c526b08910-cni-binary-copy\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.608848 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.607845 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4cfd72de-67d1-41ae-9946-a0c526b08910-host-var-lib-cni-bin\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.608848 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.607871 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/45891c6f-888b-490a-907f-1f58e3947b8a-run-systemd\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.608848 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.607895 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/45891c6f-888b-490a-907f-1f58e3947b8a-ovn-node-metrics-cert\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.608848 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.607942 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4cfd72de-67d1-41ae-9946-a0c526b08910-multus-daemon-config\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.608848 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.607965 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/45891c6f-888b-490a-907f-1f58e3947b8a-run-systemd\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.608848 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.607970 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flg6w\" (UniqueName: \"kubernetes.io/projected/48562a93-2235-4d95-bada-b1639f40db42-kube-api-access-flg6w\") pod \"iptables-alerter-rssjt\" (UID: \"48562a93-2235-4d95-bada-b1639f40db42\") " pod="openshift-network-operator/iptables-alerter-rssjt" Jul 02 12:38:40.608848 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.608093 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/45891c6f-888b-490a-907f-1f58e3947b8a-host-run-netns\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.608848 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.608117 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/69dad1af-5279-40e3-9676-662e8392842f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2kcwd\" (UID: \"69dad1af-5279-40e3-9676-662e8392842f\") " pod="openshift-multus/multus-additional-cni-plugins-2kcwd" Jul 02 12:38:40.608848 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.608142 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcn4w\" (UniqueName: \"kubernetes.io/projected/69dad1af-5279-40e3-9676-662e8392842f-kube-api-access-xcn4w\") pod \"multus-additional-cni-plugins-2kcwd\" (UID: \"69dad1af-5279-40e3-9676-662e8392842f\") " pod="openshift-multus/multus-additional-cni-plugins-2kcwd" Jul 02 12:38:40.608848 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.608156 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/45891c6f-888b-490a-907f-1f58e3947b8a-host-run-netns\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.608848 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.608199 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd6nf\" (UniqueName: \"kubernetes.io/projected/b151e533-cc30-4cea-bfa8-7fc75567a995-kube-api-access-wd6nf\") pod \"network-check-target-zxj89\" (UID: \"b151e533-cc30-4cea-bfa8-7fc75567a995\") " pod="openshift-network-diagnostics/network-check-target-zxj89" Jul 02 12:38:40.609542 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.608257 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/45891c6f-888b-490a-907f-1f58e3947b8a-ovnkube-config\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.609542 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.608280 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e3c36384-fc8b-4a2e-905a-bef30b2be7c6-konnectivity-ca\") pod \"konnectivity-agent-wsp6w\" (UID: \"e3c36384-fc8b-4a2e-905a-bef30b2be7c6\") " pod="kube-system/konnectivity-agent-wsp6w" Jul 02 12:38:40.609542 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.608300 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/69dad1af-5279-40e3-9676-662e8392842f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2kcwd\" (UID: \"69dad1af-5279-40e3-9676-662e8392842f\") " pod="openshift-multus/multus-additional-cni-plugins-2kcwd" Jul 02 12:38:40.609542 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.608311 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5314ba0b-ba05-4cf4-bffe-54e925b98467-etc-systemd\") pod \"tuned-zpkl8\" (UID: \"5314ba0b-ba05-4cf4-bffe-54e925b98467\") " pod="openshift-cluster-node-tuning-operator/tuned-zpkl8" Jul 02 12:38:40.609542 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.608477 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4cfd72de-67d1-41ae-9946-a0c526b08910-host-run-netns\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.609542 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.608505 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd5bf081-bf94-44f1-99a9-9565fc764886-host\") pod \"node-ca-r4xmq\" (UID: \"bd5bf081-bf94-44f1-99a9-9565fc764886\") " pod="openshift-image-registry/node-ca-r4xmq" Jul 02 12:38:40.609542 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.608520 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5314ba0b-ba05-4cf4-bffe-54e925b98467-etc-systemd\") pod \"tuned-zpkl8\" (UID: \"5314ba0b-ba05-4cf4-bffe-54e925b98467\") " pod="openshift-cluster-node-tuning-operator/tuned-zpkl8" Jul 02 12:38:40.609542 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.608532 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/45891c6f-888b-490a-907f-1f58e3947b8a-host-kubelet\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.609542 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.608597 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/45891c6f-888b-490a-907f-1f58e3947b8a-systemd-units\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.609542 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.608623 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/45891c6f-888b-490a-907f-1f58e3947b8a-host-cni-bin\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.609542 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.608639 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/45891c6f-888b-490a-907f-1f58e3947b8a-host-kubelet\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.609542 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.608686 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/45891c6f-888b-490a-907f-1f58e3947b8a-host-cni-netd\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.609542 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.608735 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/45891c6f-888b-490a-907f-1f58e3947b8a-systemd-units\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.609542 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.608746 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/45891c6f-888b-490a-907f-1f58e3947b8a-host-cni-netd\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.609542 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.608764 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc9t7\" (UniqueName: \"kubernetes.io/projected/f3416a26-326a-4325-b9c1-dcd3d38c27c4-kube-api-access-wc9t7\") pod \"node-resolver-hbp5q\" (UID: \"f3416a26-326a-4325-b9c1-dcd3d38c27c4\") " pod="openshift-dns/node-resolver-hbp5q" Jul 02 12:38:40.609542 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.608793 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/45891c6f-888b-490a-907f-1f58e3947b8a-host-cni-bin\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.609542 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.608798 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5314ba0b-ba05-4cf4-bffe-54e925b98467-etc-tuned\") pod \"tuned-zpkl8\" (UID: \"5314ba0b-ba05-4cf4-bffe-54e925b98467\") " pod="openshift-cluster-node-tuning-operator/tuned-zpkl8" Jul 02 12:38:40.609542 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.608823 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5314ba0b-ba05-4cf4-bffe-54e925b98467-run\") pod \"tuned-zpkl8\" (UID: \"5314ba0b-ba05-4cf4-bffe-54e925b98467\") " pod="openshift-cluster-node-tuning-operator/tuned-zpkl8" Jul 02 12:38:40.610338 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.608846 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/45891c6f-888b-490a-907f-1f58e3947b8a-env-overrides\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.610338 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.608856 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e3c36384-fc8b-4a2e-905a-bef30b2be7c6-konnectivity-ca\") pod \"konnectivity-agent-wsp6w\" (UID: \"e3c36384-fc8b-4a2e-905a-bef30b2be7c6\") " pod="kube-system/konnectivity-agent-wsp6w" Jul 02 12:38:40.610338 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.608869 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5314ba0b-ba05-4cf4-bffe-54e925b98467-tmp\") pod \"tuned-zpkl8\" (UID: \"5314ba0b-ba05-4cf4-bffe-54e925b98467\") " pod="openshift-cluster-node-tuning-operator/tuned-zpkl8" Jul 02 12:38:40.610338 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.608908 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4cfd72de-67d1-41ae-9946-a0c526b08910-os-release\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.610338 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.608912 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/45891c6f-888b-490a-907f-1f58e3947b8a-ovnkube-config\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.610338 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.608933 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4cfd72de-67d1-41ae-9946-a0c526b08910-multus-socket-dir-parent\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.610338 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.608970 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5314ba0b-ba05-4cf4-bffe-54e925b98467-run\") pod \"tuned-zpkl8\" (UID: \"5314ba0b-ba05-4cf4-bffe-54e925b98467\") " pod="openshift-cluster-node-tuning-operator/tuned-zpkl8" Jul 02 12:38:40.610338 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.609017 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4cfd72de-67d1-41ae-9946-a0c526b08910-host-run-k8s-cni-cncf-io\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.610338 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.609049 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4cfd72de-67d1-41ae-9946-a0c526b08910-host-run-multus-certs\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.610338 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.609087 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bd5bf081-bf94-44f1-99a9-9565fc764886-serviceca\") pod \"node-ca-r4xmq\" (UID: \"bd5bf081-bf94-44f1-99a9-9565fc764886\") " pod="openshift-image-registry/node-ca-r4xmq" Jul 02 12:38:40.610338 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.609126 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45891c6f-888b-490a-907f-1f58e3947b8a-var-lib-openvswitch\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.610338 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.609151 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d0e97d6f-9390-4869-a92b-763486d4fd64-socket-dir\") pod \"aws-ebs-csi-driver-node-mz946\" (UID: \"d0e97d6f-9390-4869-a92b-763486d4fd64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz946" Jul 02 12:38:40.610338 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.609201 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/69dad1af-5279-40e3-9676-662e8392842f-os-release\") pod \"multus-additional-cni-plugins-2kcwd\" (UID: \"69dad1af-5279-40e3-9676-662e8392842f\") " pod="openshift-multus/multus-additional-cni-plugins-2kcwd" Jul 02 12:38:40.610338 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.609228 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45891c6f-888b-490a-907f-1f58e3947b8a-var-lib-openvswitch\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.610338 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.609270 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5314ba0b-ba05-4cf4-bffe-54e925b98467-host\") pod \"tuned-zpkl8\" (UID: \"5314ba0b-ba05-4cf4-bffe-54e925b98467\") " pod="openshift-cluster-node-tuning-operator/tuned-zpkl8" Jul 02 12:38:40.610338 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.609317 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d0e97d6f-9390-4869-a92b-763486d4fd64-socket-dir\") pod \"aws-ebs-csi-driver-node-mz946\" (UID: \"d0e97d6f-9390-4869-a92b-763486d4fd64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz946" Jul 02 12:38:40.610338 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.609313 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4cfd72de-67d1-41ae-9946-a0c526b08910-multus-cni-dir\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.610971 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.609363 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4cfd72de-67d1-41ae-9946-a0c526b08910-host-var-lib-kubelet\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.610971 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.609389 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5314ba0b-ba05-4cf4-bffe-54e925b98467-host\") pod \"tuned-zpkl8\" (UID: \"5314ba0b-ba05-4cf4-bffe-54e925b98467\") " pod="openshift-cluster-node-tuning-operator/tuned-zpkl8" Jul 02 12:38:40.610971 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.609394 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/69dad1af-5279-40e3-9676-662e8392842f-os-release\") pod \"multus-additional-cni-plugins-2kcwd\" (UID: \"69dad1af-5279-40e3-9676-662e8392842f\") " pod="openshift-multus/multus-additional-cni-plugins-2kcwd" Jul 02 12:38:40.610971 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.609399 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c7bdeed2-7b53-450b-a2e9-e3ae689e9c85-dbus\") pod \"global-pull-secret-syncer-b7x9v\" (UID: \"c7bdeed2-7b53-450b-a2e9-e3ae689e9c85\") " pod="kube-system/global-pull-secret-syncer-b7x9v" Jul 02 12:38:40.610971 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.609442 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45891c6f-888b-490a-907f-1f58e3947b8a-etc-openvswitch\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.610971 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.609478 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5314ba0b-ba05-4cf4-bffe-54e925b98467-etc-sysctl-conf\") pod \"tuned-zpkl8\" (UID: \"5314ba0b-ba05-4cf4-bffe-54e925b98467\") " pod="openshift-cluster-node-tuning-operator/tuned-zpkl8" Jul 02 12:38:40.610971 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.609479 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/45891c6f-888b-490a-907f-1f58e3947b8a-env-overrides\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.610971 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.609521 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4cfd72de-67d1-41ae-9946-a0c526b08910-multus-conf-dir\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.610971 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.609554 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45891c6f-888b-490a-907f-1f58e3947b8a-etc-openvswitch\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.610971 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.609594 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/45891c6f-888b-490a-907f-1f58e3947b8a-log-socket\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.610971 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.609605 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5314ba0b-ba05-4cf4-bffe-54e925b98467-etc-sysctl-conf\") pod \"tuned-zpkl8\" (UID: \"5314ba0b-ba05-4cf4-bffe-54e925b98467\") " pod="openshift-cluster-node-tuning-operator/tuned-zpkl8" Jul 02 12:38:40.610971 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.609617 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d0e97d6f-9390-4869-a92b-763486d4fd64-sys-fs\") pod \"aws-ebs-csi-driver-node-mz946\" (UID: \"d0e97d6f-9390-4869-a92b-763486d4fd64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz946" Jul 02 12:38:40.610971 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.609667 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/45891c6f-888b-490a-907f-1f58e3947b8a-log-socket\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.610971 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.609697 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cx5dr\" (UniqueName: \"kubernetes.io/projected/d3ed604e-9278-4403-b407-8f5aa8122793-kube-api-access-cx5dr\") pod \"network-metrics-daemon-bxzt9\" (UID: \"d3ed604e-9278-4403-b407-8f5aa8122793\") " pod="openshift-multus/network-metrics-daemon-bxzt9" Jul 02 12:38:40.610971 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.609724 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d0e97d6f-9390-4869-a92b-763486d4fd64-sys-fs\") pod \"aws-ebs-csi-driver-node-mz946\" (UID: \"d0e97d6f-9390-4869-a92b-763486d4fd64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz946" Jul 02 12:38:40.610971 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.609725 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/69dad1af-5279-40e3-9676-662e8392842f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2kcwd\" (UID: \"69dad1af-5279-40e3-9676-662e8392842f\") " pod="openshift-multus/multus-additional-cni-plugins-2kcwd" Jul 02 12:38:40.610971 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.609786 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7crd\" (UniqueName: \"kubernetes.io/projected/4cfd72de-67d1-41ae-9946-a0c526b08910-kube-api-access-w7crd\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.611485 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.609813 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7bdeed2-7b53-450b-a2e9-e3ae689e9c85-original-pull-secret\") pod \"global-pull-secret-syncer-b7x9v\" (UID: \"c7bdeed2-7b53-450b-a2e9-e3ae689e9c85\") " pod="kube-system/global-pull-secret-syncer-b7x9v" Jul 02 12:38:40.611485 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.609866 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5314ba0b-ba05-4cf4-bffe-54e925b98467-sys\") pod \"tuned-zpkl8\" (UID: \"5314ba0b-ba05-4cf4-bffe-54e925b98467\") " pod="openshift-cluster-node-tuning-operator/tuned-zpkl8" Jul 02 12:38:40.611485 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.609912 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2x2hk\" (UniqueName: \"kubernetes.io/projected/bd5bf081-bf94-44f1-99a9-9565fc764886-kube-api-access-2x2hk\") pod \"node-ca-r4xmq\" (UID: \"bd5bf081-bf94-44f1-99a9-9565fc764886\") " pod="openshift-image-registry/node-ca-r4xmq" Jul 02 12:38:40.611485 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.609995 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5314ba0b-ba05-4cf4-bffe-54e925b98467-sys\") pod \"tuned-zpkl8\" (UID: \"5314ba0b-ba05-4cf4-bffe-54e925b98467\") " pod="openshift-cluster-node-tuning-operator/tuned-zpkl8" Jul 02 12:38:40.611485 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.610226 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/69dad1af-5279-40e3-9676-662e8392842f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2kcwd\" (UID: \"69dad1af-5279-40e3-9676-662e8392842f\") " pod="openshift-multus/multus-additional-cni-plugins-2kcwd" Jul 02 12:38:40.611485 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.611084 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e3c36384-fc8b-4a2e-905a-bef30b2be7c6-agent-certs\") pod \"konnectivity-agent-wsp6w\" (UID: \"e3c36384-fc8b-4a2e-905a-bef30b2be7c6\") " pod="kube-system/konnectivity-agent-wsp6w" Jul 02 12:38:40.611485 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.611432 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/45891c6f-888b-490a-907f-1f58e3947b8a-ovn-node-metrics-cert\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.611935 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.611918 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5314ba0b-ba05-4cf4-bffe-54e925b98467-tmp\") pod \"tuned-zpkl8\" (UID: \"5314ba0b-ba05-4cf4-bffe-54e925b98467\") " pod="openshift-cluster-node-tuning-operator/tuned-zpkl8" Jul 02 12:38:40.612207 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.612185 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5314ba0b-ba05-4cf4-bffe-54e925b98467-etc-tuned\") pod \"tuned-zpkl8\" (UID: \"5314ba0b-ba05-4cf4-bffe-54e925b98467\") " pod="openshift-cluster-node-tuning-operator/tuned-zpkl8" Jul 02 12:38:40.621265 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.621245 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc9t7\" (UniqueName: \"kubernetes.io/projected/f3416a26-326a-4325-b9c1-dcd3d38c27c4-kube-api-access-wc9t7\") pod \"node-resolver-hbp5q\" (UID: \"f3416a26-326a-4325-b9c1-dcd3d38c27c4\") " pod="openshift-dns/node-resolver-hbp5q" Jul 02 12:38:40.627611 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.627589 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcn4w\" (UniqueName: \"kubernetes.io/projected/69dad1af-5279-40e3-9676-662e8392842f-kube-api-access-xcn4w\") pod \"multus-additional-cni-plugins-2kcwd\" (UID: \"69dad1af-5279-40e3-9676-662e8392842f\") " pod="openshift-multus/multus-additional-cni-plugins-2kcwd" Jul 02 12:38:40.627737 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.627718 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cx5dr\" (UniqueName: \"kubernetes.io/projected/d3ed604e-9278-4403-b407-8f5aa8122793-kube-api-access-cx5dr\") pod \"network-metrics-daemon-bxzt9\" (UID: \"d3ed604e-9278-4403-b407-8f5aa8122793\") " pod="openshift-multus/network-metrics-daemon-bxzt9" Jul 02 12:38:40.627856 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:40.627839 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 12:38:40.627903 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:40.627865 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 12:38:40.627903 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:40.627878 2582 projected.go:196] Error preparing data for projected volume kube-api-access-wd6nf for pod openshift-network-diagnostics/network-check-target-zxj89: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 12:38:40.627979 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:40.627954 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b151e533-cc30-4cea-bfa8-7fc75567a995-kube-api-access-wd6nf podName:b151e533-cc30-4cea-bfa8-7fc75567a995 nodeName:}" failed. No retries permitted until 2026-07-02 12:38:41.127934012 +0000 UTC m=+3.028197656 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wd6nf" (UniqueName: "kubernetes.io/projected/b151e533-cc30-4cea-bfa8-7fc75567a995-kube-api-access-wd6nf") pod "network-check-target-zxj89" (UID: "b151e533-cc30-4cea-bfa8-7fc75567a995") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 12:38:40.628569 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.628545 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mg5p\" (UniqueName: \"kubernetes.io/projected/45891c6f-888b-490a-907f-1f58e3947b8a-kube-api-access-4mg5p\") pod \"ovnkube-node-bfrv8\" (UID: \"45891c6f-888b-490a-907f-1f58e3947b8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.630235 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.630217 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hgrq\" (UniqueName: \"kubernetes.io/projected/5314ba0b-ba05-4cf4-bffe-54e925b98467-kube-api-access-2hgrq\") pod \"tuned-zpkl8\" (UID: \"5314ba0b-ba05-4cf4-bffe-54e925b98467\") " pod="openshift-cluster-node-tuning-operator/tuned-zpkl8" Jul 02 12:38:40.630944 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.630901 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phq66\" (UniqueName: \"kubernetes.io/projected/d0e97d6f-9390-4869-a92b-763486d4fd64-kube-api-access-phq66\") pod \"aws-ebs-csi-driver-node-mz946\" (UID: \"d0e97d6f-9390-4869-a92b-763486d4fd64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz946" Jul 02 12:38:40.711286 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.711243 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4cfd72de-67d1-41ae-9946-a0c526b08910-system-cni-dir\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.711286 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.711304 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4cfd72de-67d1-41ae-9946-a0c526b08910-host-var-lib-cni-multus\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.711498 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.711349 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4cfd72de-67d1-41ae-9946-a0c526b08910-host-var-lib-cni-multus\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.711498 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.711381 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4cfd72de-67d1-41ae-9946-a0c526b08910-system-cni-dir\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.711498 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.711422 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4cfd72de-67d1-41ae-9946-a0c526b08910-etc-kubernetes\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.711498 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.711454 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4cfd72de-67d1-41ae-9946-a0c526b08910-etc-kubernetes\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.711498 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.711463 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/48562a93-2235-4d95-bada-b1639f40db42-host-slash\") pod \"iptables-alerter-rssjt\" (UID: \"48562a93-2235-4d95-bada-b1639f40db42\") " pod="openshift-network-operator/iptables-alerter-rssjt" Jul 02 12:38:40.711498 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.711496 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4cfd72de-67d1-41ae-9946-a0c526b08910-cnibin\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.711738 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.711498 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/48562a93-2235-4d95-bada-b1639f40db42-host-slash\") pod \"iptables-alerter-rssjt\" (UID: \"48562a93-2235-4d95-bada-b1639f40db42\") " pod="openshift-network-operator/iptables-alerter-rssjt" Jul 02 12:38:40.711738 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.711520 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4cfd72de-67d1-41ae-9946-a0c526b08910-cni-binary-copy\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.711738 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.711545 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4cfd72de-67d1-41ae-9946-a0c526b08910-host-var-lib-cni-bin\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.711738 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.711551 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4cfd72de-67d1-41ae-9946-a0c526b08910-cnibin\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.711738 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.711571 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4cfd72de-67d1-41ae-9946-a0c526b08910-multus-daemon-config\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.711738 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.711611 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4cfd72de-67d1-41ae-9946-a0c526b08910-host-var-lib-cni-bin\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.711738 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.711637 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flg6w\" (UniqueName: \"kubernetes.io/projected/48562a93-2235-4d95-bada-b1639f40db42-kube-api-access-flg6w\") pod \"iptables-alerter-rssjt\" (UID: \"48562a93-2235-4d95-bada-b1639f40db42\") " pod="openshift-network-operator/iptables-alerter-rssjt" Jul 02 12:38:40.711738 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.711689 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4cfd72de-67d1-41ae-9946-a0c526b08910-host-run-netns\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.711738 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.711705 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd5bf081-bf94-44f1-99a9-9565fc764886-host\") pod \"node-ca-r4xmq\" (UID: \"bd5bf081-bf94-44f1-99a9-9565fc764886\") " pod="openshift-image-registry/node-ca-r4xmq" Jul 02 12:38:40.711738 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.711725 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4cfd72de-67d1-41ae-9946-a0c526b08910-os-release\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.712134 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.711745 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4cfd72de-67d1-41ae-9946-a0c526b08910-multus-socket-dir-parent\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.712134 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.711769 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4cfd72de-67d1-41ae-9946-a0c526b08910-host-run-k8s-cni-cncf-io\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.712134 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.711782 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4cfd72de-67d1-41ae-9946-a0c526b08910-host-run-netns\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.712134 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.711794 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4cfd72de-67d1-41ae-9946-a0c526b08910-host-run-multus-certs\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.712134 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.711807 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd5bf081-bf94-44f1-99a9-9565fc764886-host\") pod \"node-ca-r4xmq\" (UID: \"bd5bf081-bf94-44f1-99a9-9565fc764886\") " pod="openshift-image-registry/node-ca-r4xmq" Jul 02 12:38:40.712134 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.711847 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4cfd72de-67d1-41ae-9946-a0c526b08910-multus-socket-dir-parent\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.712134 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.711861 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4cfd72de-67d1-41ae-9946-a0c526b08910-host-run-multus-certs\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.712134 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.711865 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4cfd72de-67d1-41ae-9946-a0c526b08910-host-run-k8s-cni-cncf-io\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.712134 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.711816 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bd5bf081-bf94-44f1-99a9-9565fc764886-serviceca\") pod \"node-ca-r4xmq\" (UID: \"bd5bf081-bf94-44f1-99a9-9565fc764886\") " pod="openshift-image-registry/node-ca-r4xmq" Jul 02 12:38:40.712134 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.711913 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4cfd72de-67d1-41ae-9946-a0c526b08910-multus-cni-dir\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.712134 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.711920 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4cfd72de-67d1-41ae-9946-a0c526b08910-os-release\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.712134 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.711939 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4cfd72de-67d1-41ae-9946-a0c526b08910-host-var-lib-kubelet\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.712134 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.711963 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c7bdeed2-7b53-450b-a2e9-e3ae689e9c85-dbus\") pod \"global-pull-secret-syncer-b7x9v\" (UID: \"c7bdeed2-7b53-450b-a2e9-e3ae689e9c85\") " pod="kube-system/global-pull-secret-syncer-b7x9v" Jul 02 12:38:40.712134 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.711972 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4cfd72de-67d1-41ae-9946-a0c526b08910-multus-cni-dir\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.712134 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.711988 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4cfd72de-67d1-41ae-9946-a0c526b08910-multus-conf-dir\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.712134 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.712011 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4cfd72de-67d1-41ae-9946-a0c526b08910-host-var-lib-kubelet\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.712134 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.712015 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7crd\" (UniqueName: \"kubernetes.io/projected/4cfd72de-67d1-41ae-9946-a0c526b08910-kube-api-access-w7crd\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.712134 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.712040 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7bdeed2-7b53-450b-a2e9-e3ae689e9c85-original-pull-secret\") pod \"global-pull-secret-syncer-b7x9v\" (UID: \"c7bdeed2-7b53-450b-a2e9-e3ae689e9c85\") " pod="kube-system/global-pull-secret-syncer-b7x9v" Jul 02 12:38:40.712872 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.712065 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2x2hk\" (UniqueName: \"kubernetes.io/projected/bd5bf081-bf94-44f1-99a9-9565fc764886-kube-api-access-2x2hk\") pod \"node-ca-r4xmq\" (UID: \"bd5bf081-bf94-44f1-99a9-9565fc764886\") " pod="openshift-image-registry/node-ca-r4xmq" Jul 02 12:38:40.712872 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.712093 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4cfd72de-67d1-41ae-9946-a0c526b08910-hostroot\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.712872 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.712110 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4cfd72de-67d1-41ae-9946-a0c526b08910-multus-daemon-config\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.712872 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.712115 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c7bdeed2-7b53-450b-a2e9-e3ae689e9c85-kubelet-config\") pod \"global-pull-secret-syncer-b7x9v\" (UID: \"c7bdeed2-7b53-450b-a2e9-e3ae689e9c85\") " pod="kube-system/global-pull-secret-syncer-b7x9v" Jul 02 12:38:40.712872 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.712118 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4cfd72de-67d1-41ae-9946-a0c526b08910-cni-binary-copy\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.712872 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.712134 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c7bdeed2-7b53-450b-a2e9-e3ae689e9c85-dbus\") pod \"global-pull-secret-syncer-b7x9v\" (UID: \"c7bdeed2-7b53-450b-a2e9-e3ae689e9c85\") " pod="kube-system/global-pull-secret-syncer-b7x9v" Jul 02 12:38:40.712872 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.712140 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/48562a93-2235-4d95-bada-b1639f40db42-iptables-alerter-script\") pod \"iptables-alerter-rssjt\" (UID: \"48562a93-2235-4d95-bada-b1639f40db42\") " pod="openshift-network-operator/iptables-alerter-rssjt" Jul 02 12:38:40.712872 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.712154 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4cfd72de-67d1-41ae-9946-a0c526b08910-multus-conf-dir\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.712872 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.712186 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c7bdeed2-7b53-450b-a2e9-e3ae689e9c85-kubelet-config\") pod \"global-pull-secret-syncer-b7x9v\" (UID: \"c7bdeed2-7b53-450b-a2e9-e3ae689e9c85\") " pod="kube-system/global-pull-secret-syncer-b7x9v" Jul 02 12:38:40.712872 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.712188 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4cfd72de-67d1-41ae-9946-a0c526b08910-hostroot\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.712872 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:40.712225 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 12:38:40.712872 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:40.712277 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7bdeed2-7b53-450b-a2e9-e3ae689e9c85-original-pull-secret podName:c7bdeed2-7b53-450b-a2e9-e3ae689e9c85 nodeName:}" failed. No retries permitted until 2026-07-02 12:38:41.212259512 +0000 UTC m=+3.112523179 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c7bdeed2-7b53-450b-a2e9-e3ae689e9c85-original-pull-secret") pod "global-pull-secret-syncer-b7x9v" (UID: "c7bdeed2-7b53-450b-a2e9-e3ae689e9c85") : object "kube-system"/"original-pull-secret" not registered Jul 02 12:38:40.712872 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.712328 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bd5bf081-bf94-44f1-99a9-9565fc764886-serviceca\") pod \"node-ca-r4xmq\" (UID: \"bd5bf081-bf94-44f1-99a9-9565fc764886\") " pod="openshift-image-registry/node-ca-r4xmq" Jul 02 12:38:40.712872 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.712687 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/48562a93-2235-4d95-bada-b1639f40db42-iptables-alerter-script\") pod \"iptables-alerter-rssjt\" (UID: \"48562a93-2235-4d95-bada-b1639f40db42\") " pod="openshift-network-operator/iptables-alerter-rssjt" Jul 02 12:38:40.730910 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.730841 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flg6w\" (UniqueName: \"kubernetes.io/projected/48562a93-2235-4d95-bada-b1639f40db42-kube-api-access-flg6w\") pod \"iptables-alerter-rssjt\" (UID: \"48562a93-2235-4d95-bada-b1639f40db42\") " pod="openshift-network-operator/iptables-alerter-rssjt" Jul 02 12:38:40.732295 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.732274 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7crd\" (UniqueName: \"kubernetes.io/projected/4cfd72de-67d1-41ae-9946-a0c526b08910-kube-api-access-w7crd\") pod \"multus-vhrlk\" (UID: \"4cfd72de-67d1-41ae-9946-a0c526b08910\") " pod="openshift-multus/multus-vhrlk" Jul 02 12:38:40.735145 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.735122 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2x2hk\" (UniqueName: \"kubernetes.io/projected/bd5bf081-bf94-44f1-99a9-9565fc764886-kube-api-access-2x2hk\") pod \"node-ca-r4xmq\" (UID: \"bd5bf081-bf94-44f1-99a9-9565fc764886\") " pod="openshift-image-registry/node-ca-r4xmq" Jul 02 12:38:40.779059 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.779006 2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 12:38:40.798631 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.798598 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wsp6w" Jul 02 12:38:40.807692 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.807666 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2kcwd" Jul 02 12:38:40.823666 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.823622 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hbp5q" Jul 02 12:38:40.828576 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.828552 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zpkl8" Jul 02 12:38:40.836148 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.836123 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:38:40.843196 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.843177 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz946" Jul 02 12:38:40.852002 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.851979 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rssjt" Jul 02 12:38:40.859943 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.859924 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-r4xmq" Jul 02 12:38:40.865827 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:40.865803 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vhrlk" Jul 02 12:38:41.114056 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:41.113970 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3ed604e-9278-4403-b407-8f5aa8122793-metrics-certs\") pod \"network-metrics-daemon-bxzt9\" (UID: \"d3ed604e-9278-4403-b407-8f5aa8122793\") " pod="openshift-multus/network-metrics-daemon-bxzt9" Jul 02 12:38:41.114208 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:41.114164 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 12:38:41.114269 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:41.114242 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3ed604e-9278-4403-b407-8f5aa8122793-metrics-certs podName:d3ed604e-9278-4403-b407-8f5aa8122793 nodeName:}" failed. No retries permitted until 2026-07-02 12:38:42.114219458 +0000 UTC m=+4.014483104 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3ed604e-9278-4403-b407-8f5aa8122793-metrics-certs") pod "network-metrics-daemon-bxzt9" (UID: "d3ed604e-9278-4403-b407-8f5aa8122793") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 12:38:41.214719 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:41.214689 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd6nf\" (UniqueName: \"kubernetes.io/projected/b151e533-cc30-4cea-bfa8-7fc75567a995-kube-api-access-wd6nf\") pod \"network-check-target-zxj89\" (UID: \"b151e533-cc30-4cea-bfa8-7fc75567a995\") " pod="openshift-network-diagnostics/network-check-target-zxj89" Jul 02 12:38:41.214888 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:41.214738 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7bdeed2-7b53-450b-a2e9-e3ae689e9c85-original-pull-secret\") pod \"global-pull-secret-syncer-b7x9v\" (UID: \"c7bdeed2-7b53-450b-a2e9-e3ae689e9c85\") " pod="kube-system/global-pull-secret-syncer-b7x9v" Jul 02 12:38:41.214888 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:41.214837 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 12:38:41.214888 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:41.214852 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 12:38:41.214888 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:41.214874 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 12:38:41.214888 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:41.214884 2582 projected.go:196] Error preparing data for projected volume kube-api-access-wd6nf for pod openshift-network-diagnostics/network-check-target-zxj89: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 12:38:41.214888 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:41.214889 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7bdeed2-7b53-450b-a2e9-e3ae689e9c85-original-pull-secret podName:c7bdeed2-7b53-450b-a2e9-e3ae689e9c85 nodeName:}" failed. No retries permitted until 2026-07-02 12:38:42.214877137 +0000 UTC m=+4.115140766 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c7bdeed2-7b53-450b-a2e9-e3ae689e9c85-original-pull-secret") pod "global-pull-secret-syncer-b7x9v" (UID: "c7bdeed2-7b53-450b-a2e9-e3ae689e9c85") : object "kube-system"/"original-pull-secret" not registered Jul 02 12:38:41.215156 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:41.214933 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b151e533-cc30-4cea-bfa8-7fc75567a995-kube-api-access-wd6nf podName:b151e533-cc30-4cea-bfa8-7fc75567a995 nodeName:}" failed. No retries permitted until 2026-07-02 12:38:42.214914033 +0000 UTC m=+4.115177663 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wd6nf" (UniqueName: "kubernetes.io/projected/b151e533-cc30-4cea-bfa8-7fc75567a995-kube-api-access-wd6nf") pod "network-check-target-zxj89" (UID: "b151e533-cc30-4cea-bfa8-7fc75567a995") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 12:38:41.504030 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:41.504000 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5314ba0b_ba05_4cf4_bffe_54e925b98467.slice/crio-19b938d9f4c5781b3f6f91b753c7b98da195e2ad00300e972e172f62dc34a30f WatchSource:0}: Error finding container 19b938d9f4c5781b3f6f91b753c7b98da195e2ad00300e972e172f62dc34a30f: Status 404 returned error can't find the container with id 19b938d9f4c5781b3f6f91b753c7b98da195e2ad00300e972e172f62dc34a30f Jul 02 12:38:41.505402 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:41.505299 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3c36384_fc8b_4a2e_905a_bef30b2be7c6.slice/crio-8e7a893e5f1056438332c869ed7a380934e2771a829e20f665f66991559d8066 WatchSource:0}: Error finding container 8e7a893e5f1056438332c869ed7a380934e2771a829e20f665f66991559d8066: Status 404 returned error can't find the container with id 8e7a893e5f1056438332c869ed7a380934e2771a829e20f665f66991559d8066 Jul 02 12:38:41.508799 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:41.508773 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69dad1af_5279_40e3_9676_662e8392842f.slice/crio-895f7b1d9193148fe58a5c69b3fef371305cca6943efec9beeb9fe0a19110784 WatchSource:0}: Error finding container 895f7b1d9193148fe58a5c69b3fef371305cca6943efec9beeb9fe0a19110784: Status 404 returned error can't find the container with id 895f7b1d9193148fe58a5c69b3fef371305cca6943efec9beeb9fe0a19110784 Jul 02 12:38:41.509530 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:41.509512 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3416a26_326a_4325_b9c1_dcd3d38c27c4.slice/crio-1cd0506e30a10e16557648b98d8b2089ac7e62847fdd23eeda90ea029b58f3b5 WatchSource:0}: Error finding container 1cd0506e30a10e16557648b98d8b2089ac7e62847fdd23eeda90ea029b58f3b5: Status 404 returned error can't find the container with id 1cd0506e30a10e16557648b98d8b2089ac7e62847fdd23eeda90ea029b58f3b5 Jul 02 12:38:41.511842 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:41.511820 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cfd72de_67d1_41ae_9946_a0c526b08910.slice/crio-9435a6817e236ed59f284b46c82768fe834b5fb6fc4d3f1afd7224cf8ac5b45a WatchSource:0}: Error finding container 9435a6817e236ed59f284b46c82768fe834b5fb6fc4d3f1afd7224cf8ac5b45a: Status 404 returned error can't find the container with id 9435a6817e236ed59f284b46c82768fe834b5fb6fc4d3f1afd7224cf8ac5b45a Jul 02 12:38:41.513394 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:41.513369 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd5bf081_bf94_44f1_99a9_9565fc764886.slice/crio-d42da9c0b30694a87275abd3a1ac1a33f2f1637d4c6102cd247d8a71efa5fbd6 WatchSource:0}: Error finding container d42da9c0b30694a87275abd3a1ac1a33f2f1637d4c6102cd247d8a71efa5fbd6: Status 404 returned error can't find the container with id d42da9c0b30694a87275abd3a1ac1a33f2f1637d4c6102cd247d8a71efa5fbd6 Jul 02 12:38:41.513956 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:41.513934 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0e97d6f_9390_4869_a92b_763486d4fd64.slice/crio-6a03d4bfeb7b5a5f5b319dbc2efde11feec2cec87371560a2e146dd7faf7ae53 WatchSource:0}: Error finding container 6a03d4bfeb7b5a5f5b319dbc2efde11feec2cec87371560a2e146dd7faf7ae53: Status 404 returned error can't find the container with id 6a03d4bfeb7b5a5f5b319dbc2efde11feec2cec87371560a2e146dd7faf7ae53 Jul 02 12:38:41.514852 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:38:41.514823 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48562a93_2235_4d95_bada_b1639f40db42.slice/crio-3a494feaffb673d6bb2f228783131e3be0322ac25689ae0361e08dde17388a2f WatchSource:0}: Error finding container 3a494feaffb673d6bb2f228783131e3be0322ac25689ae0361e08dde17388a2f: Status 404 returned error can't find the container with id 3a494feaffb673d6bb2f228783131e3be0322ac25689ae0361e08dde17388a2f Jul 02 12:38:41.540684 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:41.540487 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 12:33:40 +0000 UTC" deadline="2028-04-10 12:44:18.873801328 +0000 UTC" Jul 02 12:38:41.540684 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:41.540681 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15552h5m37.333127584s" Jul 02 12:38:41.569223 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:41.569203 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxj89" Jul 02 12:38:41.569321 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:41.569292 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxj89" podUID="b151e533-cc30-4cea-bfa8-7fc75567a995" Jul 02 12:38:41.580973 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:41.580947 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vhrlk" event={"ID":"4cfd72de-67d1-41ae-9946-a0c526b08910","Type":"ContainerStarted","Data":"9435a6817e236ed59f284b46c82768fe834b5fb6fc4d3f1afd7224cf8ac5b45a"} Jul 02 12:38:41.582160 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:41.582135 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2kcwd" event={"ID":"69dad1af-5279-40e3-9676-662e8392842f","Type":"ContainerStarted","Data":"895f7b1d9193148fe58a5c69b3fef371305cca6943efec9beeb9fe0a19110784"} Jul 02 12:38:41.583545 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:41.583519 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wsp6w" event={"ID":"e3c36384-fc8b-4a2e-905a-bef30b2be7c6","Type":"ContainerStarted","Data":"8e7a893e5f1056438332c869ed7a380934e2771a829e20f665f66991559d8066"} Jul 02 12:38:41.586991 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:41.586966 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" event={"ID":"45891c6f-888b-490a-907f-1f58e3947b8a","Type":"ContainerStarted","Data":"7b6590d2bc4f5b329412fe234cb2c5402d0f136a5b61e0fe52d39b9459e45847"} Jul 02 12:38:41.588123 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:41.588100 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rssjt" event={"ID":"48562a93-2235-4d95-bada-b1639f40db42","Type":"ContainerStarted","Data":"3a494feaffb673d6bb2f228783131e3be0322ac25689ae0361e08dde17388a2f"} Jul 02 12:38:41.589241 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:41.589217 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hbp5q" event={"ID":"f3416a26-326a-4325-b9c1-dcd3d38c27c4","Type":"ContainerStarted","Data":"1cd0506e30a10e16557648b98d8b2089ac7e62847fdd23eeda90ea029b58f3b5"} Jul 02 12:38:41.590312 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:41.590293 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zpkl8" event={"ID":"5314ba0b-ba05-4cf4-bffe-54e925b98467","Type":"ContainerStarted","Data":"19b938d9f4c5781b3f6f91b753c7b98da195e2ad00300e972e172f62dc34a30f"} Jul 02 12:38:41.591479 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:41.591461 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz946" event={"ID":"d0e97d6f-9390-4869-a92b-763486d4fd64","Type":"ContainerStarted","Data":"6a03d4bfeb7b5a5f5b319dbc2efde11feec2cec87371560a2e146dd7faf7ae53"} Jul 02 12:38:41.592593 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:41.592575 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-r4xmq" event={"ID":"bd5bf081-bf94-44f1-99a9-9565fc764886","Type":"ContainerStarted","Data":"d42da9c0b30694a87275abd3a1ac1a33f2f1637d4c6102cd247d8a71efa5fbd6"} Jul 02 12:38:42.122062 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:42.121970 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3ed604e-9278-4403-b407-8f5aa8122793-metrics-certs\") pod \"network-metrics-daemon-bxzt9\" (UID: \"d3ed604e-9278-4403-b407-8f5aa8122793\") " pod="openshift-multus/network-metrics-daemon-bxzt9" Jul 02 12:38:42.122229 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:42.122130 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 12:38:42.122229 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:42.122196 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3ed604e-9278-4403-b407-8f5aa8122793-metrics-certs podName:d3ed604e-9278-4403-b407-8f5aa8122793 nodeName:}" failed. No retries permitted until 2026-07-02 12:38:44.122176519 +0000 UTC m=+6.022440148 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3ed604e-9278-4403-b407-8f5aa8122793-metrics-certs") pod "network-metrics-daemon-bxzt9" (UID: "d3ed604e-9278-4403-b407-8f5aa8122793") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 12:38:42.222683 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:42.222632 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7bdeed2-7b53-450b-a2e9-e3ae689e9c85-original-pull-secret\") pod \"global-pull-secret-syncer-b7x9v\" (UID: \"c7bdeed2-7b53-450b-a2e9-e3ae689e9c85\") " pod="kube-system/global-pull-secret-syncer-b7x9v" Jul 02 12:38:42.222862 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:42.222738 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd6nf\" (UniqueName: \"kubernetes.io/projected/b151e533-cc30-4cea-bfa8-7fc75567a995-kube-api-access-wd6nf\") pod \"network-check-target-zxj89\" (UID: \"b151e533-cc30-4cea-bfa8-7fc75567a995\") " pod="openshift-network-diagnostics/network-check-target-zxj89" Jul 02 12:38:42.222862 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:42.222781 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 12:38:42.222862 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:42.222853 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7bdeed2-7b53-450b-a2e9-e3ae689e9c85-original-pull-secret podName:c7bdeed2-7b53-450b-a2e9-e3ae689e9c85 nodeName:}" failed. No retries permitted until 2026-07-02 12:38:44.222833852 +0000 UTC m=+6.123097484 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c7bdeed2-7b53-450b-a2e9-e3ae689e9c85-original-pull-secret") pod "global-pull-secret-syncer-b7x9v" (UID: "c7bdeed2-7b53-450b-a2e9-e3ae689e9c85") : object "kube-system"/"original-pull-secret" not registered Jul 02 12:38:42.223021 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:42.222864 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 12:38:42.223021 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:42.222881 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 12:38:42.223021 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:42.222893 2582 projected.go:196] Error preparing data for projected volume kube-api-access-wd6nf for pod openshift-network-diagnostics/network-check-target-zxj89: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 12:38:42.223021 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:42.222940 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b151e533-cc30-4cea-bfa8-7fc75567a995-kube-api-access-wd6nf podName:b151e533-cc30-4cea-bfa8-7fc75567a995 nodeName:}" failed. No retries permitted until 2026-07-02 12:38:44.222926061 +0000 UTC m=+6.123189693 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wd6nf" (UniqueName: "kubernetes.io/projected/b151e533-cc30-4cea-bfa8-7fc75567a995-kube-api-access-wd6nf") pod "network-check-target-zxj89" (UID: "b151e533-cc30-4cea-bfa8-7fc75567a995") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 12:38:42.541635 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:42.541538 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 12:33:40 +0000 UTC" deadline="2028-03-29 07:10:06.56860906 +0000 UTC" Jul 02 12:38:42.541635 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:42.541608 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15258h31m24.027004943s" Jul 02 12:38:42.572853 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:42.572825 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxzt9" Jul 02 12:38:42.572995 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:42.572954 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxzt9" podUID="d3ed604e-9278-4403-b407-8f5aa8122793" Jul 02 12:38:42.573326 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:42.573306 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7x9v" Jul 02 12:38:42.573422 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:42.573404 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7x9v" podUID="c7bdeed2-7b53-450b-a2e9-e3ae689e9c85" Jul 02 12:38:42.607723 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:42.607675 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-7.ec2.internal" event={"ID":"bd91ebf43e810155cc24f7e478ff9f41","Type":"ContainerStarted","Data":"5cdb409ec25c7fdc1f528f2a4dee2efc6ab23853f8739ab37a10b482de77e98e"} Jul 02 12:38:42.621323 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:42.621289 2582 generic.go:356] "Generic (PLEG): container finished" podID="cc91c7bc68d3a8c7263cef4441283de1" containerID="5f7a01372bba59c55aa41591849b2ab5b9a9e336c94bf3bb7e25ab30c02054fe" exitCode=0 Jul 02 12:38:42.621500 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:42.621337 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-7.ec2.internal" event={"ID":"cc91c7bc68d3a8c7263cef4441283de1","Type":"ContainerDied","Data":"5f7a01372bba59c55aa41591849b2ab5b9a9e336c94bf3bb7e25ab30c02054fe"} Jul 02 12:38:42.640588 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:42.640534 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-7.ec2.internal" podStartSLOduration=3.640506858 podStartE2EDuration="3.640506858s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 12:38:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:38:42.625200265 +0000 UTC m=+4.525463918" watchObservedRunningTime="2026-07-02 12:38:42.640506858 +0000 UTC m=+4.540770511" Jul 02 12:38:43.568891 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:43.568863 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxj89" Jul 02 12:38:43.569424 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:43.568993 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxj89" podUID="b151e533-cc30-4cea-bfa8-7fc75567a995" Jul 02 12:38:43.634996 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:43.634956 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-7.ec2.internal" event={"ID":"cc91c7bc68d3a8c7263cef4441283de1","Type":"ContainerStarted","Data":"a369ee3360018c99ecd34ba94c7608c3eafad1e8bf908ecb0521fec6b47cbf31"} Jul 02 12:38:44.139363 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:44.139323 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3ed604e-9278-4403-b407-8f5aa8122793-metrics-certs\") pod \"network-metrics-daemon-bxzt9\" (UID: \"d3ed604e-9278-4403-b407-8f5aa8122793\") " pod="openshift-multus/network-metrics-daemon-bxzt9" Jul 02 12:38:44.139558 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:44.139541 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 12:38:44.139623 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:44.139610 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3ed604e-9278-4403-b407-8f5aa8122793-metrics-certs podName:d3ed604e-9278-4403-b407-8f5aa8122793 nodeName:}" failed. No retries permitted until 2026-07-02 12:38:48.139592252 +0000 UTC m=+10.039855884 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3ed604e-9278-4403-b407-8f5aa8122793-metrics-certs") pod "network-metrics-daemon-bxzt9" (UID: "d3ed604e-9278-4403-b407-8f5aa8122793") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 12:38:44.240689 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:44.240043 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd6nf\" (UniqueName: \"kubernetes.io/projected/b151e533-cc30-4cea-bfa8-7fc75567a995-kube-api-access-wd6nf\") pod \"network-check-target-zxj89\" (UID: \"b151e533-cc30-4cea-bfa8-7fc75567a995\") " pod="openshift-network-diagnostics/network-check-target-zxj89" Jul 02 12:38:44.240689 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:44.240111 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7bdeed2-7b53-450b-a2e9-e3ae689e9c85-original-pull-secret\") pod \"global-pull-secret-syncer-b7x9v\" (UID: \"c7bdeed2-7b53-450b-a2e9-e3ae689e9c85\") " pod="kube-system/global-pull-secret-syncer-b7x9v" Jul 02 12:38:44.240689 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:44.240249 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 12:38:44.240689 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:44.240309 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7bdeed2-7b53-450b-a2e9-e3ae689e9c85-original-pull-secret podName:c7bdeed2-7b53-450b-a2e9-e3ae689e9c85 nodeName:}" failed. No retries permitted until 2026-07-02 12:38:48.240292499 +0000 UTC m=+10.140556153 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c7bdeed2-7b53-450b-a2e9-e3ae689e9c85-original-pull-secret") pod "global-pull-secret-syncer-b7x9v" (UID: "c7bdeed2-7b53-450b-a2e9-e3ae689e9c85") : object "kube-system"/"original-pull-secret" not registered Jul 02 12:38:44.240689 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:44.240668 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 12:38:44.240689 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:44.240694 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 12:38:44.241143 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:44.240714 2582 projected.go:196] Error preparing data for projected volume kube-api-access-wd6nf for pod openshift-network-diagnostics/network-check-target-zxj89: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 12:38:44.241143 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:44.240773 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b151e533-cc30-4cea-bfa8-7fc75567a995-kube-api-access-wd6nf podName:b151e533-cc30-4cea-bfa8-7fc75567a995 nodeName:}" failed. No retries permitted until 2026-07-02 12:38:48.240756611 +0000 UTC m=+10.141020263 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wd6nf" (UniqueName: "kubernetes.io/projected/b151e533-cc30-4cea-bfa8-7fc75567a995-kube-api-access-wd6nf") pod "network-check-target-zxj89" (UID: "b151e533-cc30-4cea-bfa8-7fc75567a995") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 12:38:44.571182 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:44.569786 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxzt9" Jul 02 12:38:44.571182 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:44.569939 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxzt9" podUID="d3ed604e-9278-4403-b407-8f5aa8122793" Jul 02 12:38:44.571182 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:44.570344 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7x9v" Jul 02 12:38:44.571182 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:44.570431 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7x9v" podUID="c7bdeed2-7b53-450b-a2e9-e3ae689e9c85" Jul 02 12:38:45.569185 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:45.569148 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxj89" Jul 02 12:38:45.569367 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:45.569291 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxj89" podUID="b151e533-cc30-4cea-bfa8-7fc75567a995" Jul 02 12:38:46.569117 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:46.569079 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxzt9" Jul 02 12:38:46.569567 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:46.569245 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxzt9" podUID="d3ed604e-9278-4403-b407-8f5aa8122793" Jul 02 12:38:46.569673 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:46.569626 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7x9v" Jul 02 12:38:46.569781 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:46.569758 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7x9v" podUID="c7bdeed2-7b53-450b-a2e9-e3ae689e9c85" Jul 02 12:38:47.568901 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:47.568793 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxj89" Jul 02 12:38:47.569071 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:47.568925 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxj89" podUID="b151e533-cc30-4cea-bfa8-7fc75567a995" Jul 02 12:38:48.173815 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:48.173507 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3ed604e-9278-4403-b407-8f5aa8122793-metrics-certs\") pod \"network-metrics-daemon-bxzt9\" (UID: \"d3ed604e-9278-4403-b407-8f5aa8122793\") " pod="openshift-multus/network-metrics-daemon-bxzt9" Jul 02 12:38:48.173815 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:48.173638 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 12:38:48.173815 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:48.173725 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3ed604e-9278-4403-b407-8f5aa8122793-metrics-certs podName:d3ed604e-9278-4403-b407-8f5aa8122793 nodeName:}" failed. No retries permitted until 2026-07-02 12:38:56.173700778 +0000 UTC m=+18.073964407 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3ed604e-9278-4403-b407-8f5aa8122793-metrics-certs") pod "network-metrics-daemon-bxzt9" (UID: "d3ed604e-9278-4403-b407-8f5aa8122793") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 12:38:48.274245 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:48.273888 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7bdeed2-7b53-450b-a2e9-e3ae689e9c85-original-pull-secret\") pod \"global-pull-secret-syncer-b7x9v\" (UID: \"c7bdeed2-7b53-450b-a2e9-e3ae689e9c85\") " pod="kube-system/global-pull-secret-syncer-b7x9v" Jul 02 12:38:48.274245 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:48.273988 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd6nf\" (UniqueName: \"kubernetes.io/projected/b151e533-cc30-4cea-bfa8-7fc75567a995-kube-api-access-wd6nf\") pod \"network-check-target-zxj89\" (UID: \"b151e533-cc30-4cea-bfa8-7fc75567a995\") " pod="openshift-network-diagnostics/network-check-target-zxj89" Jul 02 12:38:48.274245 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:48.274162 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 12:38:48.274245 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:48.274171 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 12:38:48.274245 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:48.274180 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 12:38:48.274245 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:48.274195 2582 projected.go:196] Error preparing data for projected volume kube-api-access-wd6nf for pod openshift-network-diagnostics/network-check-target-zxj89: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 12:38:48.274245 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:48.274244 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7bdeed2-7b53-450b-a2e9-e3ae689e9c85-original-pull-secret podName:c7bdeed2-7b53-450b-a2e9-e3ae689e9c85 nodeName:}" failed. No retries permitted until 2026-07-02 12:38:56.27422474 +0000 UTC m=+18.174488376 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c7bdeed2-7b53-450b-a2e9-e3ae689e9c85-original-pull-secret") pod "global-pull-secret-syncer-b7x9v" (UID: "c7bdeed2-7b53-450b-a2e9-e3ae689e9c85") : object "kube-system"/"original-pull-secret" not registered Jul 02 12:38:48.274734 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:48.274264 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b151e533-cc30-4cea-bfa8-7fc75567a995-kube-api-access-wd6nf podName:b151e533-cc30-4cea-bfa8-7fc75567a995 nodeName:}" failed. No retries permitted until 2026-07-02 12:38:56.274253964 +0000 UTC m=+18.174517598 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wd6nf" (UniqueName: "kubernetes.io/projected/b151e533-cc30-4cea-bfa8-7fc75567a995-kube-api-access-wd6nf") pod "network-check-target-zxj89" (UID: "b151e533-cc30-4cea-bfa8-7fc75567a995") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 12:38:48.570763 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:48.570643 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7x9v" Jul 02 12:38:48.570923 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:48.570758 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7x9v" podUID="c7bdeed2-7b53-450b-a2e9-e3ae689e9c85" Jul 02 12:38:48.571080 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:48.571054 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxzt9" Jul 02 12:38:48.571291 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:48.571249 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxzt9" podUID="d3ed604e-9278-4403-b407-8f5aa8122793" Jul 02 12:38:49.569125 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:49.569024 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxj89" Jul 02 12:38:49.569557 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:49.569170 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxj89" podUID="b151e533-cc30-4cea-bfa8-7fc75567a995" Jul 02 12:38:50.569694 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:50.569663 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxzt9" Jul 02 12:38:50.570105 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:50.569809 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxzt9" podUID="d3ed604e-9278-4403-b407-8f5aa8122793" Jul 02 12:38:50.570330 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:50.570203 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7x9v" Jul 02 12:38:50.570330 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:50.570296 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7x9v" podUID="c7bdeed2-7b53-450b-a2e9-e3ae689e9c85" Jul 02 12:38:51.569632 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:51.569600 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxj89" Jul 02 12:38:51.569834 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:51.569786 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxj89" podUID="b151e533-cc30-4cea-bfa8-7fc75567a995" Jul 02 12:38:52.568859 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:52.568821 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxzt9" Jul 02 12:38:52.568859 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:52.568841 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7x9v" Jul 02 12:38:52.569092 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:52.568968 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxzt9" podUID="d3ed604e-9278-4403-b407-8f5aa8122793" Jul 02 12:38:52.569144 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:52.569086 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7x9v" podUID="c7bdeed2-7b53-450b-a2e9-e3ae689e9c85" Jul 02 12:38:53.569479 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:53.569438 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxj89" Jul 02 12:38:53.569949 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:53.569562 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxj89" podUID="b151e533-cc30-4cea-bfa8-7fc75567a995" Jul 02 12:38:54.569679 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:54.569582 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7x9v" Jul 02 12:38:54.569679 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:54.569627 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxzt9" Jul 02 12:38:54.570187 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:54.569734 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7x9v" podUID="c7bdeed2-7b53-450b-a2e9-e3ae689e9c85" Jul 02 12:38:54.570187 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:54.569874 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxzt9" podUID="d3ed604e-9278-4403-b407-8f5aa8122793" Jul 02 12:38:55.569381 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:55.569343 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxj89" Jul 02 12:38:55.569612 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:55.569483 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxj89" podUID="b151e533-cc30-4cea-bfa8-7fc75567a995" Jul 02 12:38:56.234781 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:56.234741 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3ed604e-9278-4403-b407-8f5aa8122793-metrics-certs\") pod \"network-metrics-daemon-bxzt9\" (UID: \"d3ed604e-9278-4403-b407-8f5aa8122793\") " pod="openshift-multus/network-metrics-daemon-bxzt9" Jul 02 12:38:56.235151 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:56.234892 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 12:38:56.235151 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:56.234960 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3ed604e-9278-4403-b407-8f5aa8122793-metrics-certs podName:d3ed604e-9278-4403-b407-8f5aa8122793 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:12.234939739 +0000 UTC m=+34.135203375 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3ed604e-9278-4403-b407-8f5aa8122793-metrics-certs") pod "network-metrics-daemon-bxzt9" (UID: "d3ed604e-9278-4403-b407-8f5aa8122793") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 12:38:56.335330 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:56.335294 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd6nf\" (UniqueName: \"kubernetes.io/projected/b151e533-cc30-4cea-bfa8-7fc75567a995-kube-api-access-wd6nf\") pod \"network-check-target-zxj89\" (UID: \"b151e533-cc30-4cea-bfa8-7fc75567a995\") " pod="openshift-network-diagnostics/network-check-target-zxj89" Jul 02 12:38:56.335330 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:56.335349 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7bdeed2-7b53-450b-a2e9-e3ae689e9c85-original-pull-secret\") pod \"global-pull-secret-syncer-b7x9v\" (UID: \"c7bdeed2-7b53-450b-a2e9-e3ae689e9c85\") " pod="kube-system/global-pull-secret-syncer-b7x9v" Jul 02 12:38:56.335565 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:56.335452 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 12:38:56.335565 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:56.335488 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 12:38:56.335565 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:56.335504 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7bdeed2-7b53-450b-a2e9-e3ae689e9c85-original-pull-secret podName:c7bdeed2-7b53-450b-a2e9-e3ae689e9c85 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:12.335490509 +0000 UTC m=+34.235754145 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c7bdeed2-7b53-450b-a2e9-e3ae689e9c85-original-pull-secret") pod "global-pull-secret-syncer-b7x9v" (UID: "c7bdeed2-7b53-450b-a2e9-e3ae689e9c85") : object "kube-system"/"original-pull-secret" not registered Jul 02 12:38:56.335565 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:56.335514 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 12:38:56.335565 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:56.335525 2582 projected.go:196] Error preparing data for projected volume kube-api-access-wd6nf for pod openshift-network-diagnostics/network-check-target-zxj89: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 12:38:56.335799 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:56.335574 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b151e533-cc30-4cea-bfa8-7fc75567a995-kube-api-access-wd6nf podName:b151e533-cc30-4cea-bfa8-7fc75567a995 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:12.335560357 +0000 UTC m=+34.235824002 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wd6nf" (UniqueName: "kubernetes.io/projected/b151e533-cc30-4cea-bfa8-7fc75567a995-kube-api-access-wd6nf") pod "network-check-target-zxj89" (UID: "b151e533-cc30-4cea-bfa8-7fc75567a995") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 12:38:56.569442 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:56.569346 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7x9v" Jul 02 12:38:56.569442 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:56.569363 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxzt9" Jul 02 12:38:56.569695 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:56.569489 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7x9v" podUID="c7bdeed2-7b53-450b-a2e9-e3ae689e9c85" Jul 02 12:38:56.569695 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:56.569633 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxzt9" podUID="d3ed604e-9278-4403-b407-8f5aa8122793" Jul 02 12:38:57.569087 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:57.569049 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxj89" Jul 02 12:38:57.569528 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:57.569166 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxj89" podUID="b151e533-cc30-4cea-bfa8-7fc75567a995" Jul 02 12:38:58.570360 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:58.570325 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxzt9" Jul 02 12:38:58.570806 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:58.570457 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7x9v" Jul 02 12:38:58.570806 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:58.570497 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxzt9" podUID="d3ed604e-9278-4403-b407-8f5aa8122793" Jul 02 12:38:58.570806 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:58.570536 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7x9v" podUID="c7bdeed2-7b53-450b-a2e9-e3ae689e9c85" Jul 02 12:38:59.568583 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:38:59.568545 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxj89" Jul 02 12:38:59.568796 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:38:59.568696 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxj89" podUID="b151e533-cc30-4cea-bfa8-7fc75567a995" Jul 02 12:39:00.569402 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:00.569195 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxzt9" Jul 02 12:39:00.569818 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:00.569511 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxzt9" podUID="d3ed604e-9278-4403-b407-8f5aa8122793" Jul 02 12:39:00.569923 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:00.569904 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7x9v" Jul 02 12:39:00.570029 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:00.570000 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7x9v" podUID="c7bdeed2-7b53-450b-a2e9-e3ae689e9c85" Jul 02 12:39:00.674300 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:00.674234 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2kcwd" event={"ID":"69dad1af-5279-40e3-9676-662e8392842f","Type":"ContainerStarted","Data":"659d4258cde2772dbeded78d8740c2cc24c0e4806dd419a2ec88f08345b90c3d"} Jul 02 12:39:00.676276 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:00.676209 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wsp6w" event={"ID":"e3c36384-fc8b-4a2e-905a-bef30b2be7c6","Type":"ContainerStarted","Data":"a9bdcb933e60ce3cbd2068feded2bf72d464c262f9e436e036298bd5027a9a93"} Jul 02 12:39:00.679745 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:00.679705 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" event={"ID":"45891c6f-888b-490a-907f-1f58e3947b8a","Type":"ContainerStarted","Data":"b3ebc4aecf3e33678374eeb464ab54876f83b4312c742164238c4fc012f77177"} Jul 02 12:39:00.683378 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:00.683311 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hbp5q" event={"ID":"f3416a26-326a-4325-b9c1-dcd3d38c27c4","Type":"ContainerStarted","Data":"c48e565afd4467df98aa0afc667e44a979d65e5eafc4d04bc2c3bf08202591b3"} Jul 02 12:39:00.689324 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:00.686638 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zpkl8" event={"ID":"5314ba0b-ba05-4cf4-bffe-54e925b98467","Type":"ContainerStarted","Data":"55514ad9044b31e25f1064f241da9dbf3f9b10b84f1687749e6cf5eb7d3bc28c"} Jul 02 12:39:00.690642 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:00.690592 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-r4xmq" event={"ID":"bd5bf081-bf94-44f1-99a9-9565fc764886","Type":"ContainerStarted","Data":"5fc51b4d2c50115250366c3f91bb35344403a83f21adddaf7bf153e61e24bf33"} Jul 02 12:39:00.701102 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:00.701030 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-7.ec2.internal" podStartSLOduration=21.701010747 podStartE2EDuration="21.701010747s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 12:38:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:38:43.652784274 +0000 UTC m=+5.553047927" watchObservedRunningTime="2026-07-02 12:39:00.701010747 +0000 UTC m=+22.601274429" Jul 02 12:39:00.713850 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:00.713476 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hbp5q" podStartSLOduration=3.785482665 podStartE2EDuration="22.713459284s" totalImagesPullingTime="18.927976619s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 12:38:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:39:00.712898689 +0000 UTC m=+22.613162342" watchObservedRunningTime="2026-07-02 12:39:00.713459284 +0000 UTC m=+22.613722938" Jul 02 12:39:00.729302 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:00.729266 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zpkl8" podStartSLOduration=3.794985744 podStartE2EDuration="22.729250709s" totalImagesPullingTime="18.934264965s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 12:38:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:39:00.72883244 +0000 UTC m=+22.629096094" watchObservedRunningTime="2026-07-02 12:39:00.729250709 +0000 UTC m=+22.629514360" Jul 02 12:39:00.743410 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:00.743368 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-r4xmq" podStartSLOduration=2.820060035 podStartE2EDuration="21.743353531s" totalImagesPullingTime="18.923293496s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 12:38:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:39:00.743164432 +0000 UTC m=+22.643428081" watchObservedRunningTime="2026-07-02 12:39:00.743353531 +0000 UTC m=+22.643617252" Jul 02 12:39:00.769340 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:00.769292 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vhrlk" podStartSLOduration=2.679912266 podStartE2EDuration="21.76927641s" totalImagesPullingTime="19.089364144s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 12:38:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:39:00.768637936 +0000 UTC m=+22.668901590" watchObservedRunningTime="2026-07-02 12:39:00.76927641 +0000 UTC m=+22.669540061" Jul 02 12:39:00.808105 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:00.806639 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-wsp6w" podStartSLOduration=12.327025301 podStartE2EDuration="22.806618596s" totalImagesPullingTime="10.479593295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 12:38:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:39:00.805278827 +0000 UTC m=+22.705542480" watchObservedRunningTime="2026-07-02 12:39:00.806618596 +0000 UTC m=+22.706882249" Jul 02 12:39:01.569240 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:01.569197 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxj89" Jul 02 12:39:01.569396 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:01.569305 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxj89" podUID="b151e533-cc30-4cea-bfa8-7fc75567a995" Jul 02 12:39:01.696610 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:01.696588 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfrv8_45891c6f-888b-490a-907f-1f58e3947b8a/ovn-acl-logging/0.log" Jul 02 12:39:01.697273 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:01.696934 2582 generic.go:356] "Generic (PLEG): container finished" podID="45891c6f-888b-490a-907f-1f58e3947b8a" containerID="f2a395b74a2ff0561357a11c8ddc7da83f391814669530df8406211e13facfbd" exitCode=1 Jul 02 12:39:01.697273 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:01.697006 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" event={"ID":"45891c6f-888b-490a-907f-1f58e3947b8a","Type":"ContainerStarted","Data":"ce9113eb23a6c81d549bb158de4210697560d6a3b304d3df9fe07c109a8c2c6a"} Jul 02 12:39:01.697273 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:01.697086 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" event={"ID":"45891c6f-888b-490a-907f-1f58e3947b8a","Type":"ContainerStarted","Data":"ff84898b4f3c4b76fc2400c2138f4248ea9c0dfa93099162549ab44632b29b84"} Jul 02 12:39:01.697273 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:01.697129 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" event={"ID":"45891c6f-888b-490a-907f-1f58e3947b8a","Type":"ContainerStarted","Data":"4816433f00f30d8622b8418267a153b144b1f662f31d313777f0dd22a6c228f2"} Jul 02 12:39:01.697273 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:01.697159 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" event={"ID":"45891c6f-888b-490a-907f-1f58e3947b8a","Type":"ContainerStarted","Data":"7814c9a436c0c3ce6a6d7cfa14504f9dc30f4905817fed54fd3295aac61e292e"} Jul 02 12:39:01.697273 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:01.697187 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" event={"ID":"45891c6f-888b-490a-907f-1f58e3947b8a","Type":"ContainerDied","Data":"f2a395b74a2ff0561357a11c8ddc7da83f391814669530df8406211e13facfbd"} Jul 02 12:39:01.698263 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:01.698243 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz946" event={"ID":"d0e97d6f-9390-4869-a92b-763486d4fd64","Type":"ContainerStarted","Data":"f46aaeb06c8ddb47650dbc7a75dd311aafe944bd308d5ec0492c7b540a20433d"} Jul 02 12:39:01.699376 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:01.699360 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vhrlk" event={"ID":"4cfd72de-67d1-41ae-9946-a0c526b08910","Type":"ContainerStarted","Data":"b68ff7043c13b282494bbe23fb34eda8f43a6f7b0b331708e88827ee03ba7cfb"} Jul 02 12:39:01.700670 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:01.700631 2582 generic.go:356] "Generic (PLEG): container finished" podID="69dad1af-5279-40e3-9676-662e8392842f" containerID="659d4258cde2772dbeded78d8740c2cc24c0e4806dd419a2ec88f08345b90c3d" exitCode=0 Jul 02 12:39:01.700756 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:01.700686 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2kcwd" event={"ID":"69dad1af-5279-40e3-9676-662e8392842f","Type":"ContainerDied","Data":"659d4258cde2772dbeded78d8740c2cc24c0e4806dd419a2ec88f08345b90c3d"} Jul 02 12:39:01.820753 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:01.820718 2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 02 12:39:02.569527 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:02.569495 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxzt9" Jul 02 12:39:02.569739 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:02.569497 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7x9v" Jul 02 12:39:02.569739 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:02.569642 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxzt9" podUID="d3ed604e-9278-4403-b407-8f5aa8122793" Jul 02 12:39:02.569739 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:02.569721 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7x9v" podUID="c7bdeed2-7b53-450b-a2e9-e3ae689e9c85" Jul 02 12:39:02.583887 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:02.583785 2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T12:39:01.820736133Z","UUID":"082b56a6-84c7-4f1d-9035-e5ab40c99b86","Handler":null,"Name":"","Endpoint":""} Jul 02 12:39:02.585479 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:02.585454 2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 02 12:39:02.585620 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:02.585500 2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 02 12:39:02.705268 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:02.705226 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rssjt" event={"ID":"48562a93-2235-4d95-bada-b1639f40db42","Type":"ContainerStarted","Data":"ec3cc22f49a6a376af5c911343f6f6d4ffce5cda17246145d02ec5c8d743e94e"} Jul 02 12:39:02.708098 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:02.708065 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz946" event={"ID":"d0e97d6f-9390-4869-a92b-763486d4fd64","Type":"ContainerStarted","Data":"756089bd6ecf78ac65d2bc7b74540da001823345cbc19aa6d4d225e8f7922684"} Jul 02 12:39:02.720176 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:02.720117 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rssjt" podStartSLOduration=4.812591326 podStartE2EDuration="23.720102375s" totalImagesPullingTime="18.907511049s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 12:38:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:39:02.719440367 +0000 UTC m=+24.619704018" watchObservedRunningTime="2026-07-02 12:39:02.720102375 +0000 UTC m=+24.620366026" Jul 02 12:39:03.569473 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:03.569227 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxj89" Jul 02 12:39:03.569666 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:03.569577 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxj89" podUID="b151e533-cc30-4cea-bfa8-7fc75567a995" Jul 02 12:39:03.714314 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:03.714282 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfrv8_45891c6f-888b-490a-907f-1f58e3947b8a/ovn-acl-logging/0.log" Jul 02 12:39:03.714818 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:03.714761 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" event={"ID":"45891c6f-888b-490a-907f-1f58e3947b8a","Type":"ContainerStarted","Data":"ed624a405610796643dc9ef5f5b2e181749efde6cedd976d748c2896bc5f784f"} Jul 02 12:39:03.717048 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:03.717012 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz946" event={"ID":"d0e97d6f-9390-4869-a92b-763486d4fd64","Type":"ContainerStarted","Data":"c0a43e82469b741e91de837bfffbbb4febb563b4d24191c151c81678ad3b4342"} Jul 02 12:39:03.734618 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:03.734562 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mz946" podStartSLOduration=3.350158293 podStartE2EDuration="24.734544573s" totalImagesPullingTime="21.38438628s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 12:38:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:39:03.734382754 +0000 UTC m=+25.634646406" watchObservedRunningTime="2026-07-02 12:39:03.734544573 +0000 UTC m=+25.634808227" Jul 02 12:39:03.808770 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:03.808693 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-wsp6w" Jul 02 12:39:03.809319 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:03.809300 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-wsp6w" Jul 02 12:39:04.568887 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:04.568855 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxzt9" Jul 02 12:39:04.568887 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:04.568886 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7x9v" Jul 02 12:39:04.569132 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:04.568998 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxzt9" podUID="d3ed604e-9278-4403-b407-8f5aa8122793" Jul 02 12:39:04.569132 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:04.569067 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7x9v" podUID="c7bdeed2-7b53-450b-a2e9-e3ae689e9c85" Jul 02 12:39:04.847392 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:04.847317 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-wsp6w" Jul 02 12:39:04.848022 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:04.848007 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wsp6w" Jul 02 12:39:05.569373 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:05.569343 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxj89" Jul 02 12:39:05.569546 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:05.569459 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxj89" podUID="b151e533-cc30-4cea-bfa8-7fc75567a995" Jul 02 12:39:06.568895 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:06.568701 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxzt9" Jul 02 12:39:06.569432 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:06.568744 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7x9v" Jul 02 12:39:06.569432 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:06.568990 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxzt9" podUID="d3ed604e-9278-4403-b407-8f5aa8122793" Jul 02 12:39:06.569432 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:06.569070 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7x9v" podUID="c7bdeed2-7b53-450b-a2e9-e3ae689e9c85" Jul 02 12:39:06.727042 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:06.726964 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfrv8_45891c6f-888b-490a-907f-1f58e3947b8a/ovn-acl-logging/0.log" Jul 02 12:39:06.727354 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:06.727327 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" event={"ID":"45891c6f-888b-490a-907f-1f58e3947b8a","Type":"ContainerStarted","Data":"db9c0aab67708fd221d94322ea1b9bf333c0515e00e2abd91e3919f06e91e265"} Jul 02 12:39:06.727580 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:06.727564 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:39:06.727806 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:06.727791 2582 scope.go:117] "RemoveContainer" containerID="f2a395b74a2ff0561357a11c8ddc7da83f391814669530df8406211e13facfbd" Jul 02 12:39:06.729296 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:06.729258 2582 generic.go:356] "Generic (PLEG): container finished" podID="69dad1af-5279-40e3-9676-662e8392842f" containerID="f4351e2441e84dd29a6eb1a736b1475717bc5bf080cf126426571edcb740ab59" exitCode=0 Jul 02 12:39:06.729408 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:06.729331 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2kcwd" event={"ID":"69dad1af-5279-40e3-9676-662e8392842f","Type":"ContainerDied","Data":"f4351e2441e84dd29a6eb1a736b1475717bc5bf080cf126426571edcb740ab59"} Jul 02 12:39:06.744423 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:06.744405 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:39:07.569349 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:07.569313 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxj89" Jul 02 12:39:07.569950 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:07.569444 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxj89" podUID="b151e533-cc30-4cea-bfa8-7fc75567a995" Jul 02 12:39:07.737564 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:07.737542 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfrv8_45891c6f-888b-490a-907f-1f58e3947b8a/ovn-acl-logging/0.log" Jul 02 12:39:07.737893 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:07.737874 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" event={"ID":"45891c6f-888b-490a-907f-1f58e3947b8a","Type":"ContainerStarted","Data":"e1b8fe53e58d886701106843a138ccbbd8bb6a8be85401d73c740ba095959b1b"} Jul 02 12:39:07.737971 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:07.737959 2582 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 02 12:39:07.738197 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:07.738178 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:39:07.752549 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:07.752531 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:39:07.770143 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:07.770093 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" podStartSLOduration=10.794761036 podStartE2EDuration="29.77007735s" totalImagesPullingTime="18.975316314s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 12:38:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:39:07.769076987 +0000 UTC m=+29.669340640" watchObservedRunningTime="2026-07-02 12:39:07.77007735 +0000 UTC m=+29.670341003" Jul 02 12:39:07.792513 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:07.792487 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b7x9v"] Jul 02 12:39:07.792630 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:07.792604 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7x9v" Jul 02 12:39:07.792754 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:07.792736 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7x9v" podUID="c7bdeed2-7b53-450b-a2e9-e3ae689e9c85" Jul 02 12:39:07.794425 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:07.794401 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bxzt9"] Jul 02 12:39:07.794527 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:07.794499 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxzt9" Jul 02 12:39:07.794619 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:07.794602 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxzt9" podUID="d3ed604e-9278-4403-b407-8f5aa8122793" Jul 02 12:39:07.797367 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:07.797340 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zxj89"] Jul 02 12:39:07.797462 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:07.797418 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxj89" Jul 02 12:39:07.797526 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:07.797507 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxj89" podUID="b151e533-cc30-4cea-bfa8-7fc75567a995" Jul 02 12:39:08.741863 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:08.741687 2582 generic.go:356] "Generic (PLEG): container finished" podID="69dad1af-5279-40e3-9676-662e8392842f" containerID="04bed4dc7bd97e7a0345ee19bf3ac3e7e5dea7d936e3c8a105d290678d0e9fdc" exitCode=0 Jul 02 12:39:08.742261 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:08.741769 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2kcwd" event={"ID":"69dad1af-5279-40e3-9676-662e8392842f","Type":"ContainerDied","Data":"04bed4dc7bd97e7a0345ee19bf3ac3e7e5dea7d936e3c8a105d290678d0e9fdc"} Jul 02 12:39:08.742261 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:08.741976 2582 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 02 12:39:08.880262 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:08.880226 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:39:09.569216 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:09.569184 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7x9v" Jul 02 12:39:09.569381 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:09.569184 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxj89" Jul 02 12:39:09.569381 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:09.569299 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7x9v" podUID="c7bdeed2-7b53-450b-a2e9-e3ae689e9c85" Jul 02 12:39:09.569463 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:09.569393 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxj89" podUID="b151e533-cc30-4cea-bfa8-7fc75567a995" Jul 02 12:39:09.569463 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:09.569187 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxzt9" Jul 02 12:39:09.569530 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:09.569512 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxzt9" podUID="d3ed604e-9278-4403-b407-8f5aa8122793" Jul 02 12:39:10.748571 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:10.748537 2582 generic.go:356] "Generic (PLEG): container finished" podID="69dad1af-5279-40e3-9676-662e8392842f" containerID="4e21992735aaad27b9356ddd48d0cb7a897312f888e17a6733f0f7cfa6377497" exitCode=0 Jul 02 12:39:10.749336 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:10.748625 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2kcwd" event={"ID":"69dad1af-5279-40e3-9676-662e8392842f","Type":"ContainerDied","Data":"4e21992735aaad27b9356ddd48d0cb7a897312f888e17a6733f0f7cfa6377497"} Jul 02 12:39:10.767052 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:10.767022 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" podUID="45891c6f-888b-490a-907f-1f58e3947b8a" containerName="ovnkube-controller" probeResult="failure" output="" Jul 02 12:39:11.568728 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:11.568699 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxzt9" Jul 02 12:39:11.568728 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:11.568729 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7x9v" Jul 02 12:39:11.568939 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:11.568730 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxj89" Jul 02 12:39:11.568939 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:11.568800 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxzt9" podUID="d3ed604e-9278-4403-b407-8f5aa8122793" Jul 02 12:39:11.568939 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:11.568913 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7x9v" podUID="c7bdeed2-7b53-450b-a2e9-e3ae689e9c85" Jul 02 12:39:11.569196 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:11.568999 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxj89" podUID="b151e533-cc30-4cea-bfa8-7fc75567a995" Jul 02 12:39:12.258348 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:12.258310 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3ed604e-9278-4403-b407-8f5aa8122793-metrics-certs\") pod \"network-metrics-daemon-bxzt9\" (UID: \"d3ed604e-9278-4403-b407-8f5aa8122793\") " pod="openshift-multus/network-metrics-daemon-bxzt9" Jul 02 12:39:12.258915 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:12.258481 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 12:39:12.258915 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:12.258556 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3ed604e-9278-4403-b407-8f5aa8122793-metrics-certs podName:d3ed604e-9278-4403-b407-8f5aa8122793 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:44.258535127 +0000 UTC m=+66.158798760 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3ed604e-9278-4403-b407-8f5aa8122793-metrics-certs") pod "network-metrics-daemon-bxzt9" (UID: "d3ed604e-9278-4403-b407-8f5aa8122793") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 12:39:12.359185 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:12.359145 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7bdeed2-7b53-450b-a2e9-e3ae689e9c85-original-pull-secret\") pod \"global-pull-secret-syncer-b7x9v\" (UID: \"c7bdeed2-7b53-450b-a2e9-e3ae689e9c85\") " pod="kube-system/global-pull-secret-syncer-b7x9v" Jul 02 12:39:12.359360 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:12.359241 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd6nf\" (UniqueName: \"kubernetes.io/projected/b151e533-cc30-4cea-bfa8-7fc75567a995-kube-api-access-wd6nf\") pod \"network-check-target-zxj89\" (UID: \"b151e533-cc30-4cea-bfa8-7fc75567a995\") " pod="openshift-network-diagnostics/network-check-target-zxj89" Jul 02 12:39:12.359360 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:12.359323 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 12:39:12.359467 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:12.359395 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7bdeed2-7b53-450b-a2e9-e3ae689e9c85-original-pull-secret podName:c7bdeed2-7b53-450b-a2e9-e3ae689e9c85 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:44.35937809 +0000 UTC m=+66.259641739 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c7bdeed2-7b53-450b-a2e9-e3ae689e9c85-original-pull-secret") pod "global-pull-secret-syncer-b7x9v" (UID: "c7bdeed2-7b53-450b-a2e9-e3ae689e9c85") : object "kube-system"/"original-pull-secret" not registered Jul 02 12:39:12.359467 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:12.359418 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 12:39:12.359467 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:12.359435 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 12:39:12.359467 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:12.359449 2582 projected.go:196] Error preparing data for projected volume kube-api-access-wd6nf for pod openshift-network-diagnostics/network-check-target-zxj89: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 12:39:12.359670 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:12.359493 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b151e533-cc30-4cea-bfa8-7fc75567a995-kube-api-access-wd6nf podName:b151e533-cc30-4cea-bfa8-7fc75567a995 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:44.359482598 +0000 UTC m=+66.259746228 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wd6nf" (UniqueName: "kubernetes.io/projected/b151e533-cc30-4cea-bfa8-7fc75567a995-kube-api-access-wd6nf") pod "network-check-target-zxj89" (UID: "b151e533-cc30-4cea-bfa8-7fc75567a995") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 12:39:13.391286 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.391223 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-7.ec2.internal" event="NodeReady" Jul 02 12:39:13.391715 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.391373 2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 02 12:39:13.438115 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.437922 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-96668c4f6-h8947"] Jul 02 12:39:13.440747 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.440725 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-96668c4f6-h8947" Jul 02 12:39:13.445423 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.445399 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 02 12:39:13.445913 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.445894 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 02 12:39:13.446010 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.445948 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 02 12:39:13.446157 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.446139 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rs2lw\"" Jul 02 12:39:13.451638 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.451618 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 02 12:39:13.469904 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.469880 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-96668c4f6-h8947"] Jul 02 12:39:13.476301 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.476279 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pv76q"] Jul 02 12:39:13.478605 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.478589 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pv76q" Jul 02 12:39:13.480951 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.480928 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 02 12:39:13.481114 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.481097 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5qtp9\"" Jul 02 12:39:13.481575 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.481549 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 02 12:39:13.485979 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.485957 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-5djd8"] Jul 02 12:39:13.488931 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.488911 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-sqd4q"] Jul 02 12:39:13.492106 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.489471 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-5djd8" Jul 02 12:39:13.492319 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.492296 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 02 12:39:13.492527 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.492500 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 02 12:39:13.492851 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.492827 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-69hw6\"" Jul 02 12:39:13.493351 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.493330 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-vhmpk"] Jul 02 12:39:13.493533 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.493517 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7fdbdf9c99-sqd4q" Jul 02 12:39:13.496214 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.496196 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-54fcb7b75-zz9dh"] Jul 02 12:39:13.496358 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.496336 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vhmpk" Jul 02 12:39:13.497574 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.497311 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 02 12:39:13.497574 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.497523 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-prqp9\"" Jul 02 12:39:13.497735 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.497712 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 02 12:39:13.497825 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.497807 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 02 12:39:13.498062 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.498045 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 02 12:39:13.498062 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.498061 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 02 12:39:13.501947 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.501087 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-tthth"] Jul 02 12:39:13.501947 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.501567 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-54fcb7b75-zz9dh" Jul 02 12:39:13.504072 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.504036 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5f67b55555-fv6k7"] Jul 02 12:39:13.504364 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.504344 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-tthth" Jul 02 12:39:13.504956 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.504603 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 02 12:39:13.505126 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.505106 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 02 12:39:13.507447 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.505818 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 02 12:39:13.507447 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.505915 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-slk5l\"" Jul 02 12:39:13.507447 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.506133 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 02 12:39:13.507447 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.506142 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 02 12:39:13.507447 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.506307 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-wn4vd\"" Jul 02 12:39:13.507447 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.506369 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 02 12:39:13.507447 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.506446 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 02 12:39:13.507447 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.506582 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 02 12:39:13.507447 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.507309 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-ztgnd\"" Jul 02 12:39:13.507944 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.507496 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 02 12:39:13.507944 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.507699 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 02 12:39:13.508051 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.508035 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 02 12:39:13.508608 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.508586 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-b5xqj"] Jul 02 12:39:13.509234 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.509218 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-fv6k7" Jul 02 12:39:13.511366 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.511345 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 02 12:39:13.511462 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.511419 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 02 12:39:13.511643 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.511627 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 02 12:39:13.511978 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.511745 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56499946bc-b5xqj" Jul 02 12:39:13.511978 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.511630 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 02 12:39:13.511978 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.511711 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-slfq4"] Jul 02 12:39:13.512466 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.512449 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 02 12:39:13.512853 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.512837 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-5nmvr\"" Jul 02 12:39:13.514001 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.513985 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 02 12:39:13.514145 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.514128 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-slfq4" Jul 02 12:39:13.514346 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.514045 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6hfbr"] Jul 02 12:39:13.514670 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.514638 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-l64ps\"" Jul 02 12:39:13.514913 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.514889 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 12:39:13.514999 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.514910 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 12:39:13.516638 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.516613 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2s7pm"] Jul 02 12:39:13.516751 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.516708 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6hfbr" Jul 02 12:39:13.516751 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.516732 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 02 12:39:13.517568 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.517541 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 02 12:39:13.518775 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.518410 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-9l2cf\"" Jul 02 12:39:13.518873 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.518836 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 02 12:39:13.519281 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.519263 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4g4pc\"" Jul 02 12:39:13.523130 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.523110 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-s8cdk"] Jul 02 12:39:13.525406 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.525368 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 02 12:39:13.530149 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.530128 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 02 12:39:13.531951 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.531714 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2s7pm" Jul 02 12:39:13.533929 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.533907 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 02 12:39:13.534636 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.534554 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 02 12:39:13.535233 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.535213 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-t49p7\"" Jul 02 12:39:13.536297 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.536277 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 02 12:39:13.536837 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.536815 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 02 12:39:13.536935 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.536843 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 02 12:39:13.537071 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.537048 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pv76q"] Jul 02 12:39:13.537491 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.537471 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-5djd8"] Jul 02 12:39:13.538061 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.538038 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-sqd4q"] Jul 02 12:39:13.538157 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.538077 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-fv6k7"] Jul 02 12:39:13.538157 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.538097 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-tthth"] Jul 02 12:39:13.538157 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.538122 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-vhmpk"] Jul 02 12:39:13.538157 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.538137 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-54fcb7b75-zz9dh"] Jul 02 12:39:13.538355 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.538160 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-b5xqj"] Jul 02 12:39:13.538355 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.538179 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6hfbr"] Jul 02 12:39:13.538355 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.538197 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-slfq4"] Jul 02 12:39:13.538355 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.538211 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2s7pm"] Jul 02 12:39:13.538355 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.538240 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-s8cdk" Jul 02 12:39:13.539066 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.539046 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-s8cdk"] Jul 02 12:39:13.540833 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.540359 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 02 12:39:13.540902 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.540856 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 02 12:39:13.541100 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.541086 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 02 12:39:13.541196 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.541184 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-v8xrr\"" Jul 02 12:39:13.541271 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.541252 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 02 12:39:13.568557 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.568524 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88zwr\" (UniqueName: \"kubernetes.io/projected/21ca6365-0380-4964-ad2c-6760f70ade05-kube-api-access-88zwr\") pod \"volume-data-source-validator-69d9f679db-5djd8\" (UID: \"21ca6365-0380-4964-ad2c-6760f70ade05\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-5djd8" Jul 02 12:39:13.568713 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.568581 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f639cf9-152c-4a8c-be48-309c48631998-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-vhmpk\" (UID: \"4f639cf9-152c-4a8c-be48-309c48631998\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vhmpk" Jul 02 12:39:13.568713 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.568609 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/95b6074d-8908-400e-85c7-c2d989e4b2d3-config\") pod \"console-operator-7fdbdf9c99-sqd4q\" (UID: \"95b6074d-8908-400e-85c7-c2d989e4b2d3\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-sqd4q" Jul 02 12:39:13.568713 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.568636 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-ca-trust-extracted\") pod \"image-registry-96668c4f6-h8947\" (UID: \"1012e2f1-8d7b-4cc7-8c6f-edafb06121c0\") " pod="openshift-image-registry/image-registry-96668c4f6-h8947" Jul 02 12:39:13.568713 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.568684 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-installation-pull-secrets\") pod \"image-registry-96668c4f6-h8947\" (UID: \"1012e2f1-8d7b-4cc7-8c6f-edafb06121c0\") " pod="openshift-image-registry/image-registry-96668c4f6-h8947" Jul 02 12:39:13.568934 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.568729 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-trusted-ca\") pod \"image-registry-96668c4f6-h8947\" (UID: \"1012e2f1-8d7b-4cc7-8c6f-edafb06121c0\") " pod="openshift-image-registry/image-registry-96668c4f6-h8947" Jul 02 12:39:13.568934 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.568752 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/436af359-0eff-4feb-a272-a74fedb5a0a1-tmp-dir\") pod \"dns-default-pv76q\" (UID: \"436af359-0eff-4feb-a272-a74fedb5a0a1\") " pod="openshift-dns/dns-default-pv76q" Jul 02 12:39:13.568934 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.568779 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkjww\" (UniqueName: \"kubernetes.io/projected/95b6074d-8908-400e-85c7-c2d989e4b2d3-kube-api-access-gkjww\") pod \"console-operator-7fdbdf9c99-sqd4q\" (UID: \"95b6074d-8908-400e-85c7-c2d989e4b2d3\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-sqd4q" Jul 02 12:39:13.568934 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.568801 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df6nt\" (UniqueName: \"kubernetes.io/projected/436af359-0eff-4feb-a272-a74fedb5a0a1-kube-api-access-df6nt\") pod \"dns-default-pv76q\" (UID: \"436af359-0eff-4feb-a272-a74fedb5a0a1\") " pod="openshift-dns/dns-default-pv76q" Jul 02 12:39:13.568934 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.568828 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/95b6074d-8908-400e-85c7-c2d989e4b2d3-serving-cert\") pod \"console-operator-7fdbdf9c99-sqd4q\" (UID: \"95b6074d-8908-400e-85c7-c2d989e4b2d3\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-sqd4q" Jul 02 12:39:13.568934 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.568856 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-image-registry-private-configuration\") pod \"image-registry-96668c4f6-h8947\" (UID: \"1012e2f1-8d7b-4cc7-8c6f-edafb06121c0\") " pod="openshift-image-registry/image-registry-96668c4f6-h8947" Jul 02 12:39:13.568934 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.568877 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxzt9" Jul 02 12:39:13.569250 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.568830 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxj89" Jul 02 12:39:13.569250 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.568883 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-registry-certificates\") pod \"image-registry-96668c4f6-h8947\" (UID: \"1012e2f1-8d7b-4cc7-8c6f-edafb06121c0\") " pod="openshift-image-registry/image-registry-96668c4f6-h8947" Jul 02 12:39:13.569355 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.569295 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4f639cf9-152c-4a8c-be48-309c48631998-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-vhmpk\" (UID: \"4f639cf9-152c-4a8c-be48-309c48631998\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vhmpk" Jul 02 12:39:13.569355 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.569328 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/95b6074d-8908-400e-85c7-c2d989e4b2d3-trusted-ca\") pod \"console-operator-7fdbdf9c99-sqd4q\" (UID: \"95b6074d-8908-400e-85c7-c2d989e4b2d3\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-sqd4q" Jul 02 12:39:13.569355 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.569354 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwh5p\" (UniqueName: \"kubernetes.io/projected/4f639cf9-152c-4a8c-be48-309c48631998-kube-api-access-xwh5p\") pod \"cluster-monitoring-operator-54cb84584-vhmpk\" (UID: \"4f639cf9-152c-4a8c-be48-309c48631998\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vhmpk" Jul 02 12:39:13.569578 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.569382 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-registry-tls\") pod \"image-registry-96668c4f6-h8947\" (UID: \"1012e2f1-8d7b-4cc7-8c6f-edafb06121c0\") " pod="openshift-image-registry/image-registry-96668c4f6-h8947" Jul 02 12:39:13.569578 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.569358 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7x9v" Jul 02 12:39:13.569578 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.569405 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-bound-sa-token\") pod \"image-registry-96668c4f6-h8947\" (UID: \"1012e2f1-8d7b-4cc7-8c6f-edafb06121c0\") " pod="openshift-image-registry/image-registry-96668c4f6-h8947" Jul 02 12:39:13.569578 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.569457 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87fm8\" (UniqueName: \"kubernetes.io/projected/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-kube-api-access-87fm8\") pod \"image-registry-96668c4f6-h8947\" (UID: \"1012e2f1-8d7b-4cc7-8c6f-edafb06121c0\") " pod="openshift-image-registry/image-registry-96668c4f6-h8947" Jul 02 12:39:13.569578 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.569485 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/436af359-0eff-4feb-a272-a74fedb5a0a1-config-volume\") pod \"dns-default-pv76q\" (UID: \"436af359-0eff-4feb-a272-a74fedb5a0a1\") " pod="openshift-dns/dns-default-pv76q" Jul 02 12:39:13.569578 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.569510 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/436af359-0eff-4feb-a272-a74fedb5a0a1-metrics-tls\") pod \"dns-default-pv76q\" (UID: \"436af359-0eff-4feb-a272-a74fedb5a0a1\") " pod="openshift-dns/dns-default-pv76q" Jul 02 12:39:13.571589 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.571568 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bwrzl\"" Jul 02 12:39:13.571879 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.571858 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 12:39:13.571988 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.571870 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mgbjz\"" Jul 02 12:39:13.572430 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.572411 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 12:39:13.670141 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.670106 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88zwr\" (UniqueName: \"kubernetes.io/projected/21ca6365-0380-4964-ad2c-6760f70ade05-kube-api-access-88zwr\") pod \"volume-data-source-validator-69d9f679db-5djd8\" (UID: \"21ca6365-0380-4964-ad2c-6760f70ade05\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-5djd8" Jul 02 12:39:13.670341 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.670152 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a21ecc40-b3d7-452d-9341-1658114a945c-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-2s7pm\" (UID: \"a21ecc40-b3d7-452d-9341-1658114a945c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2s7pm" Jul 02 12:39:13.670341 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.670175 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a21ecc40-b3d7-452d-9341-1658114a945c-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-2s7pm\" (UID: \"a21ecc40-b3d7-452d-9341-1658114a945c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2s7pm" Jul 02 12:39:13.670341 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.670219 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0e3103b-711d-4a9d-b5cc-0a911b218f12-service-ca-bundle\") pod \"router-default-54fcb7b75-zz9dh\" (UID: \"e0e3103b-711d-4a9d-b5cc-0a911b218f12\") " pod="openshift-ingress/router-default-54fcb7b75-zz9dh" Jul 02 12:39:13.670341 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.670277 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/436af359-0eff-4feb-a272-a74fedb5a0a1-metrics-tls\") pod \"dns-default-pv76q\" (UID: \"436af359-0eff-4feb-a272-a74fedb5a0a1\") " pod="openshift-dns/dns-default-pv76q" Jul 02 12:39:13.670544 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:13.670421 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 12:39:13.670544 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.670443 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4f639cf9-152c-4a8c-be48-309c48631998-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-vhmpk\" (UID: \"4f639cf9-152c-4a8c-be48-309c48631998\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vhmpk" Jul 02 12:39:13.670544 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.670468 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl25k\" (UniqueName: \"kubernetes.io/projected/30589b59-c043-4008-a1d8-e9fd71436bdc-kube-api-access-jl25k\") pod \"cluster-samples-operator-9ddc5ff76-tthth\" (UID: \"30589b59-c043-4008-a1d8-e9fd71436bdc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-tthth" Jul 02 12:39:13.670544 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:13.670497 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/436af359-0eff-4feb-a272-a74fedb5a0a1-metrics-tls podName:436af359-0eff-4feb-a272-a74fedb5a0a1 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:14.17047624 +0000 UTC m=+36.070739876 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/436af359-0eff-4feb-a272-a74fedb5a0a1-metrics-tls") pod "dns-default-pv76q" (UID: "436af359-0eff-4feb-a272-a74fedb5a0a1") : secret "dns-default-metrics-tls" not found Jul 02 12:39:13.670775 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.670550 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-registry-tls\") pod \"image-registry-96668c4f6-h8947\" (UID: \"1012e2f1-8d7b-4cc7-8c6f-edafb06121c0\") " pod="openshift-image-registry/image-registry-96668c4f6-h8947" Jul 02 12:39:13.670775 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.670587 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/95b6074d-8908-400e-85c7-c2d989e4b2d3-trusted-ca\") pod \"console-operator-7fdbdf9c99-sqd4q\" (UID: \"95b6074d-8908-400e-85c7-c2d989e4b2d3\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-sqd4q" Jul 02 12:39:13.670775 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.670615 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0e3103b-711d-4a9d-b5cc-0a911b218f12-metrics-certs\") pod \"router-default-54fcb7b75-zz9dh\" (UID: \"e0e3103b-711d-4a9d-b5cc-0a911b218f12\") " pod="openshift-ingress/router-default-54fcb7b75-zz9dh" Jul 02 12:39:13.670775 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.670645 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87fm8\" (UniqueName: \"kubernetes.io/projected/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-kube-api-access-87fm8\") pod \"image-registry-96668c4f6-h8947\" (UID: \"1012e2f1-8d7b-4cc7-8c6f-edafb06121c0\") " pod="openshift-image-registry/image-registry-96668c4f6-h8947" Jul 02 12:39:13.670775 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.670728 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1a5ab597-6c02-4d90-9656-a10f19699fbb-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-slfq4\" (UID: \"1a5ab597-6c02-4d90-9656-a10f19699fbb\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-slfq4" Jul 02 12:39:13.671025 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:13.670776 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 12:39:13.671025 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:13.670794 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-96668c4f6-h8947: secret "image-registry-tls" not found Jul 02 12:39:13.671025 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.670795 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/95b6074d-8908-400e-85c7-c2d989e4b2d3-config\") pod \"console-operator-7fdbdf9c99-sqd4q\" (UID: \"95b6074d-8908-400e-85c7-c2d989e4b2d3\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-sqd4q" Jul 02 12:39:13.671025 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.670862 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9f2j\" (UniqueName: \"kubernetes.io/projected/a21ecc40-b3d7-452d-9341-1658114a945c-kube-api-access-x9f2j\") pod \"kube-storage-version-migrator-operator-79964ff6f9-2s7pm\" (UID: \"a21ecc40-b3d7-452d-9341-1658114a945c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2s7pm" Jul 02 12:39:13.671025 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.670936 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a26b3699-7f1b-41b6-8451-0fe9c95aa096-serving-cert\") pod \"insights-operator-5f67b55555-fv6k7\" (UID: \"a26b3699-7f1b-41b6-8451-0fe9c95aa096\") " pod="openshift-insights/insights-operator-5f67b55555-fv6k7" Jul 02 12:39:13.671025 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.670976 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-trusted-ca\") pod \"image-registry-96668c4f6-h8947\" (UID: \"1012e2f1-8d7b-4cc7-8c6f-edafb06121c0\") " pod="openshift-image-registry/image-registry-96668c4f6-h8947" Jul 02 12:39:13.671025 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:13.670994 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-registry-tls podName:1012e2f1-8d7b-4cc7-8c6f-edafb06121c0 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:14.170971361 +0000 UTC m=+36.071234997 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-registry-tls") pod "image-registry-96668c4f6-h8947" (UID: "1012e2f1-8d7b-4cc7-8c6f-edafb06121c0") : secret "image-registry-tls" not found Jul 02 12:39:13.671381 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.671035 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/436af359-0eff-4feb-a272-a74fedb5a0a1-tmp-dir\") pod \"dns-default-pv76q\" (UID: \"436af359-0eff-4feb-a272-a74fedb5a0a1\") " pod="openshift-dns/dns-default-pv76q" Jul 02 12:39:13.671381 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.671067 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/30589b59-c043-4008-a1d8-e9fd71436bdc-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-tthth\" (UID: \"30589b59-c043-4008-a1d8-e9fd71436bdc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-tthth" Jul 02 12:39:13.671381 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.671102 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-installation-pull-secrets\") pod \"image-registry-96668c4f6-h8947\" (UID: \"1012e2f1-8d7b-4cc7-8c6f-edafb06121c0\") " pod="openshift-image-registry/image-registry-96668c4f6-h8947" Jul 02 12:39:13.671381 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.671142 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e0e3103b-711d-4a9d-b5cc-0a911b218f12-default-certificate\") pod \"router-default-54fcb7b75-zz9dh\" (UID: \"e0e3103b-711d-4a9d-b5cc-0a911b218f12\") " pod="openshift-ingress/router-default-54fcb7b75-zz9dh" Jul 02 12:39:13.671381 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.671188 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf9w5\" (UniqueName: \"kubernetes.io/projected/4c33d294-3dc2-4951-8a0e-59212bfc2ca6-kube-api-access-xf9w5\") pod \"ingress-canary-6hfbr\" (UID: \"4c33d294-3dc2-4951-8a0e-59212bfc2ca6\") " pod="openshift-ingress-canary/ingress-canary-6hfbr" Jul 02 12:39:13.671381 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.671220 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkjww\" (UniqueName: \"kubernetes.io/projected/95b6074d-8908-400e-85c7-c2d989e4b2d3-kube-api-access-gkjww\") pod \"console-operator-7fdbdf9c99-sqd4q\" (UID: \"95b6074d-8908-400e-85c7-c2d989e4b2d3\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-sqd4q" Jul 02 12:39:13.671381 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.671250 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df6nt\" (UniqueName: \"kubernetes.io/projected/436af359-0eff-4feb-a272-a74fedb5a0a1-kube-api-access-df6nt\") pod \"dns-default-pv76q\" (UID: \"436af359-0eff-4feb-a272-a74fedb5a0a1\") " pod="openshift-dns/dns-default-pv76q" Jul 02 12:39:13.671381 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.671275 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c33d294-3dc2-4951-8a0e-59212bfc2ca6-cert\") pod \"ingress-canary-6hfbr\" (UID: \"4c33d294-3dc2-4951-8a0e-59212bfc2ca6\") " pod="openshift-ingress-canary/ingress-canary-6hfbr" Jul 02 12:39:13.671381 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.671304 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/95b6074d-8908-400e-85c7-c2d989e4b2d3-serving-cert\") pod \"console-operator-7fdbdf9c99-sqd4q\" (UID: \"95b6074d-8908-400e-85c7-c2d989e4b2d3\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-sqd4q" Jul 02 12:39:13.671381 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.671331 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8x4w6\" (UniqueName: \"kubernetes.io/projected/97692f4f-de73-44c7-a10e-c87b4163131f-kube-api-access-8x4w6\") pod \"network-check-source-56499946bc-b5xqj\" (UID: \"97692f4f-de73-44c7-a10e-c87b4163131f\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-b5xqj" Jul 02 12:39:13.671381 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.671361 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1a5ab597-6c02-4d90-9656-a10f19699fbb-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-slfq4\" (UID: \"1a5ab597-6c02-4d90-9656-a10f19699fbb\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-slfq4" Jul 02 12:39:13.671872 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.671393 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-image-registry-private-configuration\") pod \"image-registry-96668c4f6-h8947\" (UID: \"1012e2f1-8d7b-4cc7-8c6f-edafb06121c0\") " pod="openshift-image-registry/image-registry-96668c4f6-h8947" Jul 02 12:39:13.671872 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.671423 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-registry-certificates\") pod \"image-registry-96668c4f6-h8947\" (UID: \"1012e2f1-8d7b-4cc7-8c6f-edafb06121c0\") " pod="openshift-image-registry/image-registry-96668c4f6-h8947" Jul 02 12:39:13.671872 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.671444 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a26b3699-7f1b-41b6-8451-0fe9c95aa096-service-ca-bundle\") pod \"insights-operator-5f67b55555-fv6k7\" (UID: \"a26b3699-7f1b-41b6-8451-0fe9c95aa096\") " pod="openshift-insights/insights-operator-5f67b55555-fv6k7" Jul 02 12:39:13.671872 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.671472 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-bound-sa-token\") pod \"image-registry-96668c4f6-h8947\" (UID: \"1012e2f1-8d7b-4cc7-8c6f-edafb06121c0\") " pod="openshift-image-registry/image-registry-96668c4f6-h8947" Jul 02 12:39:13.671872 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.671498 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/436af359-0eff-4feb-a272-a74fedb5a0a1-config-volume\") pod \"dns-default-pv76q\" (UID: \"436af359-0eff-4feb-a272-a74fedb5a0a1\") " pod="openshift-dns/dns-default-pv76q" Jul 02 12:39:13.671872 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.671525 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e0e3103b-711d-4a9d-b5cc-0a911b218f12-stats-auth\") pod \"router-default-54fcb7b75-zz9dh\" (UID: \"e0e3103b-711d-4a9d-b5cc-0a911b218f12\") " pod="openshift-ingress/router-default-54fcb7b75-zz9dh" Jul 02 12:39:13.671872 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.671552 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwh5p\" (UniqueName: \"kubernetes.io/projected/4f639cf9-152c-4a8c-be48-309c48631998-kube-api-access-xwh5p\") pod \"cluster-monitoring-operator-54cb84584-vhmpk\" (UID: \"4f639cf9-152c-4a8c-be48-309c48631998\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vhmpk" Jul 02 12:39:13.671872 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.671577 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klwql\" (UniqueName: \"kubernetes.io/projected/e0e3103b-711d-4a9d-b5cc-0a911b218f12-kube-api-access-klwql\") pod \"router-default-54fcb7b75-zz9dh\" (UID: \"e0e3103b-711d-4a9d-b5cc-0a911b218f12\") " pod="openshift-ingress/router-default-54fcb7b75-zz9dh" Jul 02 12:39:13.671872 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.671595 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/95b6074d-8908-400e-85c7-c2d989e4b2d3-config\") pod \"console-operator-7fdbdf9c99-sqd4q\" (UID: \"95b6074d-8908-400e-85c7-c2d989e4b2d3\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-sqd4q" Jul 02 12:39:13.671872 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.671601 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/277a2422-2cbc-4e30-976a-08d93cdfb549-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-s8cdk\" (UID: \"277a2422-2cbc-4e30-976a-08d93cdfb549\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-s8cdk" Jul 02 12:39:13.671872 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.671637 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/277a2422-2cbc-4e30-976a-08d93cdfb549-config\") pod \"service-ca-operator-5d7b7dc95c-s8cdk\" (UID: \"277a2422-2cbc-4e30-976a-08d93cdfb549\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-s8cdk" Jul 02 12:39:13.671872 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.671642 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4f639cf9-152c-4a8c-be48-309c48631998-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-vhmpk\" (UID: \"4f639cf9-152c-4a8c-be48-309c48631998\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vhmpk" Jul 02 12:39:13.671872 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.671705 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f639cf9-152c-4a8c-be48-309c48631998-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-vhmpk\" (UID: \"4f639cf9-152c-4a8c-be48-309c48631998\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vhmpk" Jul 02 12:39:13.671872 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.671732 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bbz9\" (UniqueName: \"kubernetes.io/projected/277a2422-2cbc-4e30-976a-08d93cdfb549-kube-api-access-4bbz9\") pod \"service-ca-operator-5d7b7dc95c-s8cdk\" (UID: \"277a2422-2cbc-4e30-976a-08d93cdfb549\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-s8cdk" Jul 02 12:39:13.671872 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.671731 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/436af359-0eff-4feb-a272-a74fedb5a0a1-tmp-dir\") pod \"dns-default-pv76q\" (UID: \"436af359-0eff-4feb-a272-a74fedb5a0a1\") " pod="openshift-dns/dns-default-pv76q" Jul 02 12:39:13.671872 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.671735 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/95b6074d-8908-400e-85c7-c2d989e4b2d3-trusted-ca\") pod \"console-operator-7fdbdf9c99-sqd4q\" (UID: \"95b6074d-8908-400e-85c7-c2d989e4b2d3\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-sqd4q" Jul 02 12:39:13.672398 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.671767 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsmzj\" (UniqueName: \"kubernetes.io/projected/a26b3699-7f1b-41b6-8451-0fe9c95aa096-kube-api-access-jsmzj\") pod \"insights-operator-5f67b55555-fv6k7\" (UID: \"a26b3699-7f1b-41b6-8451-0fe9c95aa096\") " pod="openshift-insights/insights-operator-5f67b55555-fv6k7" Jul 02 12:39:13.672398 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.671809 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-ca-trust-extracted\") pod \"image-registry-96668c4f6-h8947\" (UID: \"1012e2f1-8d7b-4cc7-8c6f-edafb06121c0\") " pod="openshift-image-registry/image-registry-96668c4f6-h8947" Jul 02 12:39:13.672398 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.671835 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a26b3699-7f1b-41b6-8451-0fe9c95aa096-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-fv6k7\" (UID: \"a26b3699-7f1b-41b6-8451-0fe9c95aa096\") " pod="openshift-insights/insights-operator-5f67b55555-fv6k7" Jul 02 12:39:13.672398 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.671877 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a26b3699-7f1b-41b6-8451-0fe9c95aa096-tmp\") pod \"insights-operator-5f67b55555-fv6k7\" (UID: \"a26b3699-7f1b-41b6-8451-0fe9c95aa096\") " pod="openshift-insights/insights-operator-5f67b55555-fv6k7" Jul 02 12:39:13.672398 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.671900 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a26b3699-7f1b-41b6-8451-0fe9c95aa096-snapshots\") pod \"insights-operator-5f67b55555-fv6k7\" (UID: \"a26b3699-7f1b-41b6-8451-0fe9c95aa096\") " pod="openshift-insights/insights-operator-5f67b55555-fv6k7" Jul 02 12:39:13.672398 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.672019 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-trusted-ca\") pod \"image-registry-96668c4f6-h8947\" (UID: \"1012e2f1-8d7b-4cc7-8c6f-edafb06121c0\") " pod="openshift-image-registry/image-registry-96668c4f6-h8947" Jul 02 12:39:13.672398 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.672158 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-registry-certificates\") pod \"image-registry-96668c4f6-h8947\" (UID: \"1012e2f1-8d7b-4cc7-8c6f-edafb06121c0\") " pod="openshift-image-registry/image-registry-96668c4f6-h8947" Jul 02 12:39:13.672398 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:13.672189 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 12:39:13.672398 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:13.672264 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f639cf9-152c-4a8c-be48-309c48631998-cluster-monitoring-operator-tls podName:4f639cf9-152c-4a8c-be48-309c48631998 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:14.172233758 +0000 UTC m=+36.072497400 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4f639cf9-152c-4a8c-be48-309c48631998-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-vhmpk" (UID: "4f639cf9-152c-4a8c-be48-309c48631998") : secret "cluster-monitoring-operator-tls" not found Jul 02 12:39:13.672838 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.672579 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-ca-trust-extracted\") pod \"image-registry-96668c4f6-h8947\" (UID: \"1012e2f1-8d7b-4cc7-8c6f-edafb06121c0\") " pod="openshift-image-registry/image-registry-96668c4f6-h8947" Jul 02 12:39:13.672838 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.672595 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/436af359-0eff-4feb-a272-a74fedb5a0a1-config-volume\") pod \"dns-default-pv76q\" (UID: \"436af359-0eff-4feb-a272-a74fedb5a0a1\") " pod="openshift-dns/dns-default-pv76q" Jul 02 12:39:13.676507 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.676363 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-image-registry-private-configuration\") pod \"image-registry-96668c4f6-h8947\" (UID: \"1012e2f1-8d7b-4cc7-8c6f-edafb06121c0\") " pod="openshift-image-registry/image-registry-96668c4f6-h8947" Jul 02 12:39:13.676617 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.676399 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/95b6074d-8908-400e-85c7-c2d989e4b2d3-serving-cert\") pod \"console-operator-7fdbdf9c99-sqd4q\" (UID: \"95b6074d-8908-400e-85c7-c2d989e4b2d3\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-sqd4q" Jul 02 12:39:13.676617 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.676441 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-installation-pull-secrets\") pod \"image-registry-96668c4f6-h8947\" (UID: \"1012e2f1-8d7b-4cc7-8c6f-edafb06121c0\") " pod="openshift-image-registry/image-registry-96668c4f6-h8947" Jul 02 12:39:13.693853 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.693828 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwh5p\" (UniqueName: \"kubernetes.io/projected/4f639cf9-152c-4a8c-be48-309c48631998-kube-api-access-xwh5p\") pod \"cluster-monitoring-operator-54cb84584-vhmpk\" (UID: \"4f639cf9-152c-4a8c-be48-309c48631998\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vhmpk" Jul 02 12:39:13.698399 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.698371 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-df6nt\" (UniqueName: \"kubernetes.io/projected/436af359-0eff-4feb-a272-a74fedb5a0a1-kube-api-access-df6nt\") pod \"dns-default-pv76q\" (UID: \"436af359-0eff-4feb-a272-a74fedb5a0a1\") " pod="openshift-dns/dns-default-pv76q" Jul 02 12:39:13.702144 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.702122 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-bound-sa-token\") pod \"image-registry-96668c4f6-h8947\" (UID: \"1012e2f1-8d7b-4cc7-8c6f-edafb06121c0\") " pod="openshift-image-registry/image-registry-96668c4f6-h8947" Jul 02 12:39:13.703886 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.703765 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkjww\" (UniqueName: \"kubernetes.io/projected/95b6074d-8908-400e-85c7-c2d989e4b2d3-kube-api-access-gkjww\") pod \"console-operator-7fdbdf9c99-sqd4q\" (UID: \"95b6074d-8908-400e-85c7-c2d989e4b2d3\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-sqd4q" Jul 02 12:39:13.706238 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.706215 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88zwr\" (UniqueName: \"kubernetes.io/projected/21ca6365-0380-4964-ad2c-6760f70ade05-kube-api-access-88zwr\") pod \"volume-data-source-validator-69d9f679db-5djd8\" (UID: \"21ca6365-0380-4964-ad2c-6760f70ade05\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-5djd8" Jul 02 12:39:13.707092 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.707072 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87fm8\" (UniqueName: \"kubernetes.io/projected/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-kube-api-access-87fm8\") pod \"image-registry-96668c4f6-h8947\" (UID: \"1012e2f1-8d7b-4cc7-8c6f-edafb06121c0\") " pod="openshift-image-registry/image-registry-96668c4f6-h8947" Jul 02 12:39:13.772428 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.772388 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e0e3103b-711d-4a9d-b5cc-0a911b218f12-stats-auth\") pod \"router-default-54fcb7b75-zz9dh\" (UID: \"e0e3103b-711d-4a9d-b5cc-0a911b218f12\") " pod="openshift-ingress/router-default-54fcb7b75-zz9dh" Jul 02 12:39:13.772428 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.772434 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klwql\" (UniqueName: \"kubernetes.io/projected/e0e3103b-711d-4a9d-b5cc-0a911b218f12-kube-api-access-klwql\") pod \"router-default-54fcb7b75-zz9dh\" (UID: \"e0e3103b-711d-4a9d-b5cc-0a911b218f12\") " pod="openshift-ingress/router-default-54fcb7b75-zz9dh" Jul 02 12:39:13.772712 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.772453 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/277a2422-2cbc-4e30-976a-08d93cdfb549-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-s8cdk\" (UID: \"277a2422-2cbc-4e30-976a-08d93cdfb549\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-s8cdk" Jul 02 12:39:13.772712 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.772473 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/277a2422-2cbc-4e30-976a-08d93cdfb549-config\") pod \"service-ca-operator-5d7b7dc95c-s8cdk\" (UID: \"277a2422-2cbc-4e30-976a-08d93cdfb549\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-s8cdk" Jul 02 12:39:13.772712 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.772509 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bbz9\" (UniqueName: \"kubernetes.io/projected/277a2422-2cbc-4e30-976a-08d93cdfb549-kube-api-access-4bbz9\") pod \"service-ca-operator-5d7b7dc95c-s8cdk\" (UID: \"277a2422-2cbc-4e30-976a-08d93cdfb549\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-s8cdk" Jul 02 12:39:13.772879 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.772752 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsmzj\" (UniqueName: \"kubernetes.io/projected/a26b3699-7f1b-41b6-8451-0fe9c95aa096-kube-api-access-jsmzj\") pod \"insights-operator-5f67b55555-fv6k7\" (UID: \"a26b3699-7f1b-41b6-8451-0fe9c95aa096\") " pod="openshift-insights/insights-operator-5f67b55555-fv6k7" Jul 02 12:39:13.772879 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.772797 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a26b3699-7f1b-41b6-8451-0fe9c95aa096-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-fv6k7\" (UID: \"a26b3699-7f1b-41b6-8451-0fe9c95aa096\") " pod="openshift-insights/insights-operator-5f67b55555-fv6k7" Jul 02 12:39:13.772879 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.772842 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a26b3699-7f1b-41b6-8451-0fe9c95aa096-tmp\") pod \"insights-operator-5f67b55555-fv6k7\" (UID: \"a26b3699-7f1b-41b6-8451-0fe9c95aa096\") " pod="openshift-insights/insights-operator-5f67b55555-fv6k7" Jul 02 12:39:13.772879 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.772868 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a26b3699-7f1b-41b6-8451-0fe9c95aa096-snapshots\") pod \"insights-operator-5f67b55555-fv6k7\" (UID: \"a26b3699-7f1b-41b6-8451-0fe9c95aa096\") " pod="openshift-insights/insights-operator-5f67b55555-fv6k7" Jul 02 12:39:13.773064 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.773008 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a21ecc40-b3d7-452d-9341-1658114a945c-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-2s7pm\" (UID: \"a21ecc40-b3d7-452d-9341-1658114a945c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2s7pm" Jul 02 12:39:13.773064 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.773049 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a21ecc40-b3d7-452d-9341-1658114a945c-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-2s7pm\" (UID: \"a21ecc40-b3d7-452d-9341-1658114a945c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2s7pm" Jul 02 12:39:13.773169 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.773102 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0e3103b-711d-4a9d-b5cc-0a911b218f12-service-ca-bundle\") pod \"router-default-54fcb7b75-zz9dh\" (UID: \"e0e3103b-711d-4a9d-b5cc-0a911b218f12\") " pod="openshift-ingress/router-default-54fcb7b75-zz9dh" Jul 02 12:39:13.773221 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.773176 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl25k\" (UniqueName: \"kubernetes.io/projected/30589b59-c043-4008-a1d8-e9fd71436bdc-kube-api-access-jl25k\") pod \"cluster-samples-operator-9ddc5ff76-tthth\" (UID: \"30589b59-c043-4008-a1d8-e9fd71436bdc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-tthth" Jul 02 12:39:13.773221 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.773180 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/277a2422-2cbc-4e30-976a-08d93cdfb549-config\") pod \"service-ca-operator-5d7b7dc95c-s8cdk\" (UID: \"277a2422-2cbc-4e30-976a-08d93cdfb549\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-s8cdk" Jul 02 12:39:13.773325 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.773256 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0e3103b-711d-4a9d-b5cc-0a911b218f12-metrics-certs\") pod \"router-default-54fcb7b75-zz9dh\" (UID: \"e0e3103b-711d-4a9d-b5cc-0a911b218f12\") " pod="openshift-ingress/router-default-54fcb7b75-zz9dh" Jul 02 12:39:13.773325 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.773260 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a26b3699-7f1b-41b6-8451-0fe9c95aa096-tmp\") pod \"insights-operator-5f67b55555-fv6k7\" (UID: \"a26b3699-7f1b-41b6-8451-0fe9c95aa096\") " pod="openshift-insights/insights-operator-5f67b55555-fv6k7" Jul 02 12:39:13.773419 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.773326 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1a5ab597-6c02-4d90-9656-a10f19699fbb-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-slfq4\" (UID: \"1a5ab597-6c02-4d90-9656-a10f19699fbb\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-slfq4" Jul 02 12:39:13.773419 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:13.773367 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 12:39:13.773419 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.773370 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9f2j\" (UniqueName: \"kubernetes.io/projected/a21ecc40-b3d7-452d-9341-1658114a945c-kube-api-access-x9f2j\") pod \"kube-storage-version-migrator-operator-79964ff6f9-2s7pm\" (UID: \"a21ecc40-b3d7-452d-9341-1658114a945c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2s7pm" Jul 02 12:39:13.773419 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.773407 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a26b3699-7f1b-41b6-8451-0fe9c95aa096-serving-cert\") pod \"insights-operator-5f67b55555-fv6k7\" (UID: \"a26b3699-7f1b-41b6-8451-0fe9c95aa096\") " pod="openshift-insights/insights-operator-5f67b55555-fv6k7" Jul 02 12:39:13.773679 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:13.773451 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0e3103b-711d-4a9d-b5cc-0a911b218f12-metrics-certs podName:e0e3103b-711d-4a9d-b5cc-0a911b218f12 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:14.273430085 +0000 UTC m=+36.173693720 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e0e3103b-711d-4a9d-b5cc-0a911b218f12-metrics-certs") pod "router-default-54fcb7b75-zz9dh" (UID: "e0e3103b-711d-4a9d-b5cc-0a911b218f12") : secret "router-metrics-certs-default" not found Jul 02 12:39:13.773679 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.773474 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/30589b59-c043-4008-a1d8-e9fd71436bdc-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-tthth\" (UID: \"30589b59-c043-4008-a1d8-e9fd71436bdc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-tthth" Jul 02 12:39:13.773679 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.773513 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e0e3103b-711d-4a9d-b5cc-0a911b218f12-default-certificate\") pod \"router-default-54fcb7b75-zz9dh\" (UID: \"e0e3103b-711d-4a9d-b5cc-0a911b218f12\") " pod="openshift-ingress/router-default-54fcb7b75-zz9dh" Jul 02 12:39:13.773679 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.773556 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf9w5\" (UniqueName: \"kubernetes.io/projected/4c33d294-3dc2-4951-8a0e-59212bfc2ca6-kube-api-access-xf9w5\") pod \"ingress-canary-6hfbr\" (UID: \"4c33d294-3dc2-4951-8a0e-59212bfc2ca6\") " pod="openshift-ingress-canary/ingress-canary-6hfbr" Jul 02 12:39:13.773679 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.773586 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c33d294-3dc2-4951-8a0e-59212bfc2ca6-cert\") pod \"ingress-canary-6hfbr\" (UID: \"4c33d294-3dc2-4951-8a0e-59212bfc2ca6\") " pod="openshift-ingress-canary/ingress-canary-6hfbr" Jul 02 12:39:13.773679 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.773616 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x4w6\" (UniqueName: \"kubernetes.io/projected/97692f4f-de73-44c7-a10e-c87b4163131f-kube-api-access-8x4w6\") pod \"network-check-source-56499946bc-b5xqj\" (UID: \"97692f4f-de73-44c7-a10e-c87b4163131f\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-b5xqj" Jul 02 12:39:13.773679 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.773644 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1a5ab597-6c02-4d90-9656-a10f19699fbb-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-slfq4\" (UID: \"1a5ab597-6c02-4d90-9656-a10f19699fbb\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-slfq4" Jul 02 12:39:13.774048 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.773692 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a26b3699-7f1b-41b6-8451-0fe9c95aa096-service-ca-bundle\") pod \"insights-operator-5f67b55555-fv6k7\" (UID: \"a26b3699-7f1b-41b6-8451-0fe9c95aa096\") " pod="openshift-insights/insights-operator-5f67b55555-fv6k7" Jul 02 12:39:13.775543 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:13.774149 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e0e3103b-711d-4a9d-b5cc-0a911b218f12-service-ca-bundle podName:e0e3103b-711d-4a9d-b5cc-0a911b218f12 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:14.27413103 +0000 UTC m=+36.174394663 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e0e3103b-711d-4a9d-b5cc-0a911b218f12-service-ca-bundle") pod "router-default-54fcb7b75-zz9dh" (UID: "e0e3103b-711d-4a9d-b5cc-0a911b218f12") : configmap references non-existent config key: service-ca.crt Jul 02 12:39:13.775543 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.774180 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a26b3699-7f1b-41b6-8451-0fe9c95aa096-service-ca-bundle\") pod \"insights-operator-5f67b55555-fv6k7\" (UID: \"a26b3699-7f1b-41b6-8451-0fe9c95aa096\") " pod="openshift-insights/insights-operator-5f67b55555-fv6k7" Jul 02 12:39:13.775543 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.774359 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a26b3699-7f1b-41b6-8451-0fe9c95aa096-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-fv6k7\" (UID: \"a26b3699-7f1b-41b6-8451-0fe9c95aa096\") " pod="openshift-insights/insights-operator-5f67b55555-fv6k7" Jul 02 12:39:13.775543 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:13.774873 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 12:39:13.775543 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:13.774922 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30589b59-c043-4008-a1d8-e9fd71436bdc-samples-operator-tls podName:30589b59-c043-4008-a1d8-e9fd71436bdc nodeName:}" failed. No retries permitted until 2026-07-02 12:39:14.274908192 +0000 UTC m=+36.175171822 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/30589b59-c043-4008-a1d8-e9fd71436bdc-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-tthth" (UID: "30589b59-c043-4008-a1d8-e9fd71436bdc") : secret "samples-operator-tls" not found Jul 02 12:39:13.775543 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.774978 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a26b3699-7f1b-41b6-8451-0fe9c95aa096-snapshots\") pod \"insights-operator-5f67b55555-fv6k7\" (UID: \"a26b3699-7f1b-41b6-8451-0fe9c95aa096\") " pod="openshift-insights/insights-operator-5f67b55555-fv6k7" Jul 02 12:39:13.775543 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:13.775075 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 12:39:13.775543 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:13.775232 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a5ab597-6c02-4d90-9656-a10f19699fbb-networking-console-plugin-cert podName:1a5ab597-6c02-4d90-9656-a10f19699fbb nodeName:}" failed. No retries permitted until 2026-07-02 12:39:14.275203176 +0000 UTC m=+36.175466807 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1a5ab597-6c02-4d90-9656-a10f19699fbb-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-slfq4" (UID: "1a5ab597-6c02-4d90-9656-a10f19699fbb") : secret "networking-console-plugin-cert" not found Jul 02 12:39:13.776095 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.775552 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e0e3103b-711d-4a9d-b5cc-0a911b218f12-stats-auth\") pod \"router-default-54fcb7b75-zz9dh\" (UID: \"e0e3103b-711d-4a9d-b5cc-0a911b218f12\") " pod="openshift-ingress/router-default-54fcb7b75-zz9dh" Jul 02 12:39:13.776095 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.775588 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a21ecc40-b3d7-452d-9341-1658114a945c-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-2s7pm\" (UID: \"a21ecc40-b3d7-452d-9341-1658114a945c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2s7pm" Jul 02 12:39:13.776095 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.775739 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/277a2422-2cbc-4e30-976a-08d93cdfb549-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-s8cdk\" (UID: \"277a2422-2cbc-4e30-976a-08d93cdfb549\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-s8cdk" Jul 02 12:39:13.776095 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.776037 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1a5ab597-6c02-4d90-9656-a10f19699fbb-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-slfq4\" (UID: \"1a5ab597-6c02-4d90-9656-a10f19699fbb\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-slfq4" Jul 02 12:39:13.776820 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.776775 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a21ecc40-b3d7-452d-9341-1658114a945c-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-2s7pm\" (UID: \"a21ecc40-b3d7-452d-9341-1658114a945c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2s7pm" Jul 02 12:39:13.777088 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.777062 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c33d294-3dc2-4951-8a0e-59212bfc2ca6-cert\") pod \"ingress-canary-6hfbr\" (UID: \"4c33d294-3dc2-4951-8a0e-59212bfc2ca6\") " pod="openshift-ingress-canary/ingress-canary-6hfbr" Jul 02 12:39:13.777360 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.777343 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e0e3103b-711d-4a9d-b5cc-0a911b218f12-default-certificate\") pod \"router-default-54fcb7b75-zz9dh\" (UID: \"e0e3103b-711d-4a9d-b5cc-0a911b218f12\") " pod="openshift-ingress/router-default-54fcb7b75-zz9dh" Jul 02 12:39:13.777735 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.777714 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a26b3699-7f1b-41b6-8451-0fe9c95aa096-serving-cert\") pod \"insights-operator-5f67b55555-fv6k7\" (UID: \"a26b3699-7f1b-41b6-8451-0fe9c95aa096\") " pod="openshift-insights/insights-operator-5f67b55555-fv6k7" Jul 02 12:39:13.786272 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.786248 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bbz9\" (UniqueName: \"kubernetes.io/projected/277a2422-2cbc-4e30-976a-08d93cdfb549-kube-api-access-4bbz9\") pod \"service-ca-operator-5d7b7dc95c-s8cdk\" (UID: \"277a2422-2cbc-4e30-976a-08d93cdfb549\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-s8cdk" Jul 02 12:39:13.786417 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.786292 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsmzj\" (UniqueName: \"kubernetes.io/projected/a26b3699-7f1b-41b6-8451-0fe9c95aa096-kube-api-access-jsmzj\") pod \"insights-operator-5f67b55555-fv6k7\" (UID: \"a26b3699-7f1b-41b6-8451-0fe9c95aa096\") " pod="openshift-insights/insights-operator-5f67b55555-fv6k7" Jul 02 12:39:13.788413 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.788390 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl25k\" (UniqueName: \"kubernetes.io/projected/30589b59-c043-4008-a1d8-e9fd71436bdc-kube-api-access-jl25k\") pod \"cluster-samples-operator-9ddc5ff76-tthth\" (UID: \"30589b59-c043-4008-a1d8-e9fd71436bdc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-tthth" Jul 02 12:39:13.793011 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.792990 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9f2j\" (UniqueName: \"kubernetes.io/projected/a21ecc40-b3d7-452d-9341-1658114a945c-kube-api-access-x9f2j\") pod \"kube-storage-version-migrator-operator-79964ff6f9-2s7pm\" (UID: \"a21ecc40-b3d7-452d-9341-1658114a945c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2s7pm" Jul 02 12:39:13.796562 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.796516 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klwql\" (UniqueName: \"kubernetes.io/projected/e0e3103b-711d-4a9d-b5cc-0a911b218f12-kube-api-access-klwql\") pod \"router-default-54fcb7b75-zz9dh\" (UID: \"e0e3103b-711d-4a9d-b5cc-0a911b218f12\") " pod="openshift-ingress/router-default-54fcb7b75-zz9dh" Jul 02 12:39:13.798596 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.798526 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8x4w6\" (UniqueName: \"kubernetes.io/projected/97692f4f-de73-44c7-a10e-c87b4163131f-kube-api-access-8x4w6\") pod \"network-check-source-56499946bc-b5xqj\" (UID: \"97692f4f-de73-44c7-a10e-c87b4163131f\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-b5xqj" Jul 02 12:39:13.799707 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.799675 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf9w5\" (UniqueName: \"kubernetes.io/projected/4c33d294-3dc2-4951-8a0e-59212bfc2ca6-kube-api-access-xf9w5\") pod \"ingress-canary-6hfbr\" (UID: \"4c33d294-3dc2-4951-8a0e-59212bfc2ca6\") " pod="openshift-ingress-canary/ingress-canary-6hfbr" Jul 02 12:39:13.802074 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.802054 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-5djd8" Jul 02 12:39:13.815667 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.815623 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7fdbdf9c99-sqd4q" Jul 02 12:39:13.859114 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.859079 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-fv6k7" Jul 02 12:39:13.867418 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.867392 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56499946bc-b5xqj" Jul 02 12:39:13.881754 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.881726 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6hfbr" Jul 02 12:39:13.888935 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.888911 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2s7pm" Jul 02 12:39:13.895847 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:13.895820 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-s8cdk" Jul 02 12:39:14.177701 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:14.177663 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/436af359-0eff-4feb-a272-a74fedb5a0a1-metrics-tls\") pod \"dns-default-pv76q\" (UID: \"436af359-0eff-4feb-a272-a74fedb5a0a1\") " pod="openshift-dns/dns-default-pv76q" Jul 02 12:39:14.177900 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:14.177823 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 12:39:14.177964 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:14.177903 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/436af359-0eff-4feb-a272-a74fedb5a0a1-metrics-tls podName:436af359-0eff-4feb-a272-a74fedb5a0a1 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:15.177886269 +0000 UTC m=+37.078149902 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/436af359-0eff-4feb-a272-a74fedb5a0a1-metrics-tls") pod "dns-default-pv76q" (UID: "436af359-0eff-4feb-a272-a74fedb5a0a1") : secret "dns-default-metrics-tls" not found Jul 02 12:39:14.177964 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:14.177828 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-registry-tls\") pod \"image-registry-96668c4f6-h8947\" (UID: \"1012e2f1-8d7b-4cc7-8c6f-edafb06121c0\") " pod="openshift-image-registry/image-registry-96668c4f6-h8947" Jul 02 12:39:14.177964 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:14.177925 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 12:39:14.177964 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:14.177945 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-96668c4f6-h8947: secret "image-registry-tls" not found Jul 02 12:39:14.178172 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:14.177997 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-registry-tls podName:1012e2f1-8d7b-4cc7-8c6f-edafb06121c0 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:15.177981979 +0000 UTC m=+37.078245611 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-registry-tls") pod "image-registry-96668c4f6-h8947" (UID: "1012e2f1-8d7b-4cc7-8c6f-edafb06121c0") : secret "image-registry-tls" not found Jul 02 12:39:14.178172 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:14.178117 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f639cf9-152c-4a8c-be48-309c48631998-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-vhmpk\" (UID: \"4f639cf9-152c-4a8c-be48-309c48631998\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vhmpk" Jul 02 12:39:14.178300 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:14.178211 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 12:39:14.178300 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:14.178253 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f639cf9-152c-4a8c-be48-309c48631998-cluster-monitoring-operator-tls podName:4f639cf9-152c-4a8c-be48-309c48631998 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:15.17824136 +0000 UTC m=+37.078504995 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4f639cf9-152c-4a8c-be48-309c48631998-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-vhmpk" (UID: "4f639cf9-152c-4a8c-be48-309c48631998") : secret "cluster-monitoring-operator-tls" not found Jul 02 12:39:14.279352 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:14.279312 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1a5ab597-6c02-4d90-9656-a10f19699fbb-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-slfq4\" (UID: \"1a5ab597-6c02-4d90-9656-a10f19699fbb\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-slfq4" Jul 02 12:39:14.279548 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:14.279433 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0e3103b-711d-4a9d-b5cc-0a911b218f12-service-ca-bundle\") pod \"router-default-54fcb7b75-zz9dh\" (UID: \"e0e3103b-711d-4a9d-b5cc-0a911b218f12\") " pod="openshift-ingress/router-default-54fcb7b75-zz9dh" Jul 02 12:39:14.279548 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:14.279476 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 12:39:14.279548 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:14.279497 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0e3103b-711d-4a9d-b5cc-0a911b218f12-metrics-certs\") pod \"router-default-54fcb7b75-zz9dh\" (UID: \"e0e3103b-711d-4a9d-b5cc-0a911b218f12\") " pod="openshift-ingress/router-default-54fcb7b75-zz9dh" Jul 02 12:39:14.279548 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:14.279542 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a5ab597-6c02-4d90-9656-a10f19699fbb-networking-console-plugin-cert podName:1a5ab597-6c02-4d90-9656-a10f19699fbb nodeName:}" failed. No retries permitted until 2026-07-02 12:39:15.279523342 +0000 UTC m=+37.179786991 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1a5ab597-6c02-4d90-9656-a10f19699fbb-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-slfq4" (UID: "1a5ab597-6c02-4d90-9656-a10f19699fbb") : secret "networking-console-plugin-cert" not found Jul 02 12:39:14.279791 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:14.279578 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 12:39:14.279791 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:14.279579 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/30589b59-c043-4008-a1d8-e9fd71436bdc-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-tthth\" (UID: \"30589b59-c043-4008-a1d8-e9fd71436bdc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-tthth" Jul 02 12:39:14.279791 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:14.279615 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0e3103b-711d-4a9d-b5cc-0a911b218f12-metrics-certs podName:e0e3103b-711d-4a9d-b5cc-0a911b218f12 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:15.279604614 +0000 UTC m=+37.179868248 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e0e3103b-711d-4a9d-b5cc-0a911b218f12-metrics-certs") pod "router-default-54fcb7b75-zz9dh" (UID: "e0e3103b-711d-4a9d-b5cc-0a911b218f12") : secret "router-metrics-certs-default" not found Jul 02 12:39:14.279791 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:14.279680 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 12:39:14.279791 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:14.279677 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e0e3103b-711d-4a9d-b5cc-0a911b218f12-service-ca-bundle podName:e0e3103b-711d-4a9d-b5cc-0a911b218f12 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:15.279634589 +0000 UTC m=+37.179898229 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e0e3103b-711d-4a9d-b5cc-0a911b218f12-service-ca-bundle") pod "router-default-54fcb7b75-zz9dh" (UID: "e0e3103b-711d-4a9d-b5cc-0a911b218f12") : configmap references non-existent config key: service-ca.crt Jul 02 12:39:14.279791 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:14.279732 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30589b59-c043-4008-a1d8-e9fd71436bdc-samples-operator-tls podName:30589b59-c043-4008-a1d8-e9fd71436bdc nodeName:}" failed. No retries permitted until 2026-07-02 12:39:15.279719929 +0000 UTC m=+37.179983560 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/30589b59-c043-4008-a1d8-e9fd71436bdc-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-tthth" (UID: "30589b59-c043-4008-a1d8-e9fd71436bdc") : secret "samples-operator-tls" not found Jul 02 12:39:14.991968 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:14.991179 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-fv6k7"] Jul 02 12:39:15.005884 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:39:15.005831 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda26b3699_7f1b_41b6_8451_0fe9c95aa096.slice/crio-3d2cfbd8b3ef8e260eda6e15fa4ee2e7309351c70ddb7c0faec837e4fdfbb043 WatchSource:0}: Error finding container 3d2cfbd8b3ef8e260eda6e15fa4ee2e7309351c70ddb7c0faec837e4fdfbb043: Status 404 returned error can't find the container with id 3d2cfbd8b3ef8e260eda6e15fa4ee2e7309351c70ddb7c0faec837e4fdfbb043 Jul 02 12:39:15.024534 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:15.024496 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-5djd8"] Jul 02 12:39:15.029531 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:39:15.029499 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21ca6365_0380_4964_ad2c_6760f70ade05.slice/crio-312ee89c1d460791df5a8554c020e714befb301cc3606f15521f4540ee65f0aa WatchSource:0}: Error finding container 312ee89c1d460791df5a8554c020e714befb301cc3606f15521f4540ee65f0aa: Status 404 returned error can't find the container with id 312ee89c1d460791df5a8554c020e714befb301cc3606f15521f4540ee65f0aa Jul 02 12:39:15.042627 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:15.042566 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-sqd4q"] Jul 02 12:39:15.047341 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:15.047321 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-s8cdk"] Jul 02 12:39:15.049895 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:15.049873 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6hfbr"] Jul 02 12:39:15.059576 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:15.059555 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2s7pm"] Jul 02 12:39:15.066435 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:15.066411 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-b5xqj"] Jul 02 12:39:15.069668 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:39:15.069625 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95b6074d_8908_400e_85c7_c2d989e4b2d3.slice/crio-bc3b80df7dbc5a00447fffebecc75e0ab2ecc550b82d419c2ec9c5bb5f6192a6 WatchSource:0}: Error finding container bc3b80df7dbc5a00447fffebecc75e0ab2ecc550b82d419c2ec9c5bb5f6192a6: Status 404 returned error can't find the container with id bc3b80df7dbc5a00447fffebecc75e0ab2ecc550b82d419c2ec9c5bb5f6192a6 Jul 02 12:39:15.070262 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:39:15.070215 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda21ecc40_b3d7_452d_9341_1658114a945c.slice/crio-3482d5705a79bfbab114512f991559a81ea0ce1d5edc6d51a9f2018130bbabee WatchSource:0}: Error finding container 3482d5705a79bfbab114512f991559a81ea0ce1d5edc6d51a9f2018130bbabee: Status 404 returned error can't find the container with id 3482d5705a79bfbab114512f991559a81ea0ce1d5edc6d51a9f2018130bbabee Jul 02 12:39:15.070979 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:39:15.070957 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97692f4f_de73_44c7_a10e_c87b4163131f.slice/crio-8e865523c081bbe07558cf8a3f83875acab6602c3e4730f06eaf7eda168c2207 WatchSource:0}: Error finding container 8e865523c081bbe07558cf8a3f83875acab6602c3e4730f06eaf7eda168c2207: Status 404 returned error can't find the container with id 8e865523c081bbe07558cf8a3f83875acab6602c3e4730f06eaf7eda168c2207 Jul 02 12:39:15.072477 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:39:15.072295 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c33d294_3dc2_4951_8a0e_59212bfc2ca6.slice/crio-202a47897837b0a44c6dd61c06983b8809630708029763f6ce57df898c136af7 WatchSource:0}: Error finding container 202a47897837b0a44c6dd61c06983b8809630708029763f6ce57df898c136af7: Status 404 returned error can't find the container with id 202a47897837b0a44c6dd61c06983b8809630708029763f6ce57df898c136af7 Jul 02 12:39:15.073358 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:39:15.073308 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod277a2422_2cbc_4e30_976a_08d93cdfb549.slice/crio-1ac2dd097a721198e11f4ad5486ff48e2cf6d54e752412a22bb7cc0de71b87d0 WatchSource:0}: Error finding container 1ac2dd097a721198e11f4ad5486ff48e2cf6d54e752412a22bb7cc0de71b87d0: Status 404 returned error can't find the container with id 1ac2dd097a721198e11f4ad5486ff48e2cf6d54e752412a22bb7cc0de71b87d0 Jul 02 12:39:15.191225 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:15.191196 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/436af359-0eff-4feb-a272-a74fedb5a0a1-metrics-tls\") pod \"dns-default-pv76q\" (UID: \"436af359-0eff-4feb-a272-a74fedb5a0a1\") " pod="openshift-dns/dns-default-pv76q" Jul 02 12:39:15.191365 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:15.191237 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-registry-tls\") pod \"image-registry-96668c4f6-h8947\" (UID: \"1012e2f1-8d7b-4cc7-8c6f-edafb06121c0\") " pod="openshift-image-registry/image-registry-96668c4f6-h8947" Jul 02 12:39:15.191365 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:15.191344 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 12:39:15.191365 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:15.191345 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 12:39:15.191476 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:15.191356 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-96668c4f6-h8947: secret "image-registry-tls" not found Jul 02 12:39:15.191476 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:15.191408 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/436af359-0eff-4feb-a272-a74fedb5a0a1-metrics-tls podName:436af359-0eff-4feb-a272-a74fedb5a0a1 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:17.191394169 +0000 UTC m=+39.091657799 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/436af359-0eff-4feb-a272-a74fedb5a0a1-metrics-tls") pod "dns-default-pv76q" (UID: "436af359-0eff-4feb-a272-a74fedb5a0a1") : secret "dns-default-metrics-tls" not found Jul 02 12:39:15.191476 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:15.191442 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-registry-tls podName:1012e2f1-8d7b-4cc7-8c6f-edafb06121c0 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:17.191428385 +0000 UTC m=+39.091692018 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-registry-tls") pod "image-registry-96668c4f6-h8947" (UID: "1012e2f1-8d7b-4cc7-8c6f-edafb06121c0") : secret "image-registry-tls" not found Jul 02 12:39:15.191595 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:15.191478 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f639cf9-152c-4a8c-be48-309c48631998-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-vhmpk\" (UID: \"4f639cf9-152c-4a8c-be48-309c48631998\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vhmpk" Jul 02 12:39:15.191595 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:15.191557 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 12:39:15.191595 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:15.191586 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f639cf9-152c-4a8c-be48-309c48631998-cluster-monitoring-operator-tls podName:4f639cf9-152c-4a8c-be48-309c48631998 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:17.191579207 +0000 UTC m=+39.091842837 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4f639cf9-152c-4a8c-be48-309c48631998-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-vhmpk" (UID: "4f639cf9-152c-4a8c-be48-309c48631998") : secret "cluster-monitoring-operator-tls" not found Jul 02 12:39:15.292056 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:15.291974 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0e3103b-711d-4a9d-b5cc-0a911b218f12-service-ca-bundle\") pod \"router-default-54fcb7b75-zz9dh\" (UID: \"e0e3103b-711d-4a9d-b5cc-0a911b218f12\") " pod="openshift-ingress/router-default-54fcb7b75-zz9dh" Jul 02 12:39:15.292056 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:15.292032 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0e3103b-711d-4a9d-b5cc-0a911b218f12-metrics-certs\") pod \"router-default-54fcb7b75-zz9dh\" (UID: \"e0e3103b-711d-4a9d-b5cc-0a911b218f12\") " pod="openshift-ingress/router-default-54fcb7b75-zz9dh" Jul 02 12:39:15.292256 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:15.292078 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/30589b59-c043-4008-a1d8-e9fd71436bdc-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-tthth\" (UID: \"30589b59-c043-4008-a1d8-e9fd71436bdc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-tthth" Jul 02 12:39:15.292256 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:15.292105 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1a5ab597-6c02-4d90-9656-a10f19699fbb-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-slfq4\" (UID: \"1a5ab597-6c02-4d90-9656-a10f19699fbb\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-slfq4" Jul 02 12:39:15.292256 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:15.292146 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e0e3103b-711d-4a9d-b5cc-0a911b218f12-service-ca-bundle podName:e0e3103b-711d-4a9d-b5cc-0a911b218f12 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:17.292125819 +0000 UTC m=+39.192389451 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e0e3103b-711d-4a9d-b5cc-0a911b218f12-service-ca-bundle") pod "router-default-54fcb7b75-zz9dh" (UID: "e0e3103b-711d-4a9d-b5cc-0a911b218f12") : configmap references non-existent config key: service-ca.crt Jul 02 12:39:15.292256 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:15.292197 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 12:39:15.292256 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:15.292222 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 12:39:15.292256 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:15.292252 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30589b59-c043-4008-a1d8-e9fd71436bdc-samples-operator-tls podName:30589b59-c043-4008-a1d8-e9fd71436bdc nodeName:}" failed. No retries permitted until 2026-07-02 12:39:17.292239023 +0000 UTC m=+39.192502657 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/30589b59-c043-4008-a1d8-e9fd71436bdc-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-tthth" (UID: "30589b59-c043-4008-a1d8-e9fd71436bdc") : secret "samples-operator-tls" not found Jul 02 12:39:15.292470 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:15.292203 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 12:39:15.292470 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:15.292277 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0e3103b-711d-4a9d-b5cc-0a911b218f12-metrics-certs podName:e0e3103b-711d-4a9d-b5cc-0a911b218f12 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:17.292261271 +0000 UTC m=+39.192524906 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e0e3103b-711d-4a9d-b5cc-0a911b218f12-metrics-certs") pod "router-default-54fcb7b75-zz9dh" (UID: "e0e3103b-711d-4a9d-b5cc-0a911b218f12") : secret "router-metrics-certs-default" not found Jul 02 12:39:15.292470 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:15.292295 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a5ab597-6c02-4d90-9656-a10f19699fbb-networking-console-plugin-cert podName:1a5ab597-6c02-4d90-9656-a10f19699fbb nodeName:}" failed. No retries permitted until 2026-07-02 12:39:17.292285707 +0000 UTC m=+39.192549353 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1a5ab597-6c02-4d90-9656-a10f19699fbb-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-slfq4" (UID: "1a5ab597-6c02-4d90-9656-a10f19699fbb") : secret "networking-console-plugin-cert" not found Jul 02 12:39:15.765939 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:15.765612 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2s7pm" event={"ID":"a21ecc40-b3d7-452d-9341-1658114a945c","Type":"ContainerStarted","Data":"3482d5705a79bfbab114512f991559a81ea0ce1d5edc6d51a9f2018130bbabee"} Jul 02 12:39:15.771246 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:15.771213 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-5djd8" event={"ID":"21ca6365-0380-4964-ad2c-6760f70ade05","Type":"ContainerStarted","Data":"312ee89c1d460791df5a8554c020e714befb301cc3606f15521f4540ee65f0aa"} Jul 02 12:39:15.773184 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:15.773156 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-sqd4q" event={"ID":"95b6074d-8908-400e-85c7-c2d989e4b2d3","Type":"ContainerStarted","Data":"bc3b80df7dbc5a00447fffebecc75e0ab2ecc550b82d419c2ec9c5bb5f6192a6"} Jul 02 12:39:15.775433 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:15.775392 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-s8cdk" event={"ID":"277a2422-2cbc-4e30-976a-08d93cdfb549","Type":"ContainerStarted","Data":"1ac2dd097a721198e11f4ad5486ff48e2cf6d54e752412a22bb7cc0de71b87d0"} Jul 02 12:39:15.777329 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:15.777302 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6hfbr" event={"ID":"4c33d294-3dc2-4951-8a0e-59212bfc2ca6","Type":"ContainerStarted","Data":"202a47897837b0a44c6dd61c06983b8809630708029763f6ce57df898c136af7"} Jul 02 12:39:15.778699 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:15.778675 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56499946bc-b5xqj" event={"ID":"97692f4f-de73-44c7-a10e-c87b4163131f","Type":"ContainerStarted","Data":"8e865523c081bbe07558cf8a3f83875acab6602c3e4730f06eaf7eda168c2207"} Jul 02 12:39:15.784100 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:15.784073 2582 generic.go:356] "Generic (PLEG): container finished" podID="69dad1af-5279-40e3-9676-662e8392842f" containerID="daf9ca8c8c6b20747281bdbeee82df7fc9fa59dd81a92c3fcf7d59687c0d075e" exitCode=0 Jul 02 12:39:15.784224 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:15.784150 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2kcwd" event={"ID":"69dad1af-5279-40e3-9676-662e8392842f","Type":"ContainerDied","Data":"daf9ca8c8c6b20747281bdbeee82df7fc9fa59dd81a92c3fcf7d59687c0d075e"} Jul 02 12:39:15.792091 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:15.792064 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-fv6k7" event={"ID":"a26b3699-7f1b-41b6-8451-0fe9c95aa096","Type":"ContainerStarted","Data":"3d2cfbd8b3ef8e260eda6e15fa4ee2e7309351c70ddb7c0faec837e4fdfbb043"} Jul 02 12:39:16.807400 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:16.807254 2582 generic.go:356] "Generic (PLEG): container finished" podID="69dad1af-5279-40e3-9676-662e8392842f" containerID="d16a70ffcb0e89358689d9a9788d50ce6af3958ebda70f39de2df60aa037a3cb" exitCode=0 Jul 02 12:39:16.807400 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:16.807306 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2kcwd" event={"ID":"69dad1af-5279-40e3-9676-662e8392842f","Type":"ContainerDied","Data":"d16a70ffcb0e89358689d9a9788d50ce6af3958ebda70f39de2df60aa037a3cb"} Jul 02 12:39:17.214546 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:17.214050 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f639cf9-152c-4a8c-be48-309c48631998-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-vhmpk\" (UID: \"4f639cf9-152c-4a8c-be48-309c48631998\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vhmpk" Jul 02 12:39:17.214546 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:17.214139 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/436af359-0eff-4feb-a272-a74fedb5a0a1-metrics-tls\") pod \"dns-default-pv76q\" (UID: \"436af359-0eff-4feb-a272-a74fedb5a0a1\") " pod="openshift-dns/dns-default-pv76q" Jul 02 12:39:17.214546 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:17.214187 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-registry-tls\") pod \"image-registry-96668c4f6-h8947\" (UID: \"1012e2f1-8d7b-4cc7-8c6f-edafb06121c0\") " pod="openshift-image-registry/image-registry-96668c4f6-h8947" Jul 02 12:39:17.214546 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:17.214206 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 12:39:17.214546 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:17.214289 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f639cf9-152c-4a8c-be48-309c48631998-cluster-monitoring-operator-tls podName:4f639cf9-152c-4a8c-be48-309c48631998 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:21.214264896 +0000 UTC m=+43.114528549 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4f639cf9-152c-4a8c-be48-309c48631998-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-vhmpk" (UID: "4f639cf9-152c-4a8c-be48-309c48631998") : secret "cluster-monitoring-operator-tls" not found Jul 02 12:39:17.214546 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:17.214350 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 12:39:17.214546 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:17.214364 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-96668c4f6-h8947: secret "image-registry-tls" not found Jul 02 12:39:17.214546 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:17.214409 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-registry-tls podName:1012e2f1-8d7b-4cc7-8c6f-edafb06121c0 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:21.214394953 +0000 UTC m=+43.114658597 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-registry-tls") pod "image-registry-96668c4f6-h8947" (UID: "1012e2f1-8d7b-4cc7-8c6f-edafb06121c0") : secret "image-registry-tls" not found Jul 02 12:39:17.214546 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:17.214469 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 12:39:17.214546 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:17.214500 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/436af359-0eff-4feb-a272-a74fedb5a0a1-metrics-tls podName:436af359-0eff-4feb-a272-a74fedb5a0a1 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:21.214489022 +0000 UTC m=+43.114752660 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/436af359-0eff-4feb-a272-a74fedb5a0a1-metrics-tls") pod "dns-default-pv76q" (UID: "436af359-0eff-4feb-a272-a74fedb5a0a1") : secret "dns-default-metrics-tls" not found Jul 02 12:39:17.315946 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:17.315413 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0e3103b-711d-4a9d-b5cc-0a911b218f12-service-ca-bundle\") pod \"router-default-54fcb7b75-zz9dh\" (UID: \"e0e3103b-711d-4a9d-b5cc-0a911b218f12\") " pod="openshift-ingress/router-default-54fcb7b75-zz9dh" Jul 02 12:39:17.315946 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:17.315509 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0e3103b-711d-4a9d-b5cc-0a911b218f12-metrics-certs\") pod \"router-default-54fcb7b75-zz9dh\" (UID: \"e0e3103b-711d-4a9d-b5cc-0a911b218f12\") " pod="openshift-ingress/router-default-54fcb7b75-zz9dh" Jul 02 12:39:17.315946 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:17.315565 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/30589b59-c043-4008-a1d8-e9fd71436bdc-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-tthth\" (UID: \"30589b59-c043-4008-a1d8-e9fd71436bdc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-tthth" Jul 02 12:39:17.315946 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:17.315609 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e0e3103b-711d-4a9d-b5cc-0a911b218f12-service-ca-bundle podName:e0e3103b-711d-4a9d-b5cc-0a911b218f12 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:21.315584635 +0000 UTC m=+43.215848313 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e0e3103b-711d-4a9d-b5cc-0a911b218f12-service-ca-bundle") pod "router-default-54fcb7b75-zz9dh" (UID: "e0e3103b-711d-4a9d-b5cc-0a911b218f12") : configmap references non-existent config key: service-ca.crt Jul 02 12:39:17.315946 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:17.315691 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1a5ab597-6c02-4d90-9656-a10f19699fbb-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-slfq4\" (UID: \"1a5ab597-6c02-4d90-9656-a10f19699fbb\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-slfq4" Jul 02 12:39:17.315946 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:17.315738 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 12:39:17.315946 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:17.315799 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30589b59-c043-4008-a1d8-e9fd71436bdc-samples-operator-tls podName:30589b59-c043-4008-a1d8-e9fd71436bdc nodeName:}" failed. No retries permitted until 2026-07-02 12:39:21.315781212 +0000 UTC m=+43.216044844 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/30589b59-c043-4008-a1d8-e9fd71436bdc-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-tthth" (UID: "30589b59-c043-4008-a1d8-e9fd71436bdc") : secret "samples-operator-tls" not found Jul 02 12:39:17.315946 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:17.315831 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 12:39:17.315946 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:17.315861 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 12:39:17.315946 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:17.315876 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a5ab597-6c02-4d90-9656-a10f19699fbb-networking-console-plugin-cert podName:1a5ab597-6c02-4d90-9656-a10f19699fbb nodeName:}" failed. No retries permitted until 2026-07-02 12:39:21.315861673 +0000 UTC m=+43.216125337 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1a5ab597-6c02-4d90-9656-a10f19699fbb-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-slfq4" (UID: "1a5ab597-6c02-4d90-9656-a10f19699fbb") : secret "networking-console-plugin-cert" not found Jul 02 12:39:17.315946 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:17.315895 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0e3103b-711d-4a9d-b5cc-0a911b218f12-metrics-certs podName:e0e3103b-711d-4a9d-b5cc-0a911b218f12 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:21.315883898 +0000 UTC m=+43.216147533 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e0e3103b-711d-4a9d-b5cc-0a911b218f12-metrics-certs") pod "router-default-54fcb7b75-zz9dh" (UID: "e0e3103b-711d-4a9d-b5cc-0a911b218f12") : secret "router-metrics-certs-default" not found Jul 02 12:39:21.254512 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:21.254472 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f639cf9-152c-4a8c-be48-309c48631998-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-vhmpk\" (UID: \"4f639cf9-152c-4a8c-be48-309c48631998\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vhmpk" Jul 02 12:39:21.255002 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:21.254550 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/436af359-0eff-4feb-a272-a74fedb5a0a1-metrics-tls\") pod \"dns-default-pv76q\" (UID: \"436af359-0eff-4feb-a272-a74fedb5a0a1\") " pod="openshift-dns/dns-default-pv76q" Jul 02 12:39:21.255002 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:21.254591 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-registry-tls\") pod \"image-registry-96668c4f6-h8947\" (UID: \"1012e2f1-8d7b-4cc7-8c6f-edafb06121c0\") " pod="openshift-image-registry/image-registry-96668c4f6-h8947" Jul 02 12:39:21.255002 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:21.254624 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 12:39:21.255002 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:21.254711 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f639cf9-152c-4a8c-be48-309c48631998-cluster-monitoring-operator-tls podName:4f639cf9-152c-4a8c-be48-309c48631998 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:29.254694222 +0000 UTC m=+51.154957854 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4f639cf9-152c-4a8c-be48-309c48631998-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-vhmpk" (UID: "4f639cf9-152c-4a8c-be48-309c48631998") : secret "cluster-monitoring-operator-tls" not found Jul 02 12:39:21.255002 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:21.254716 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 12:39:21.255002 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:21.254733 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 12:39:21.255002 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:21.254747 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-96668c4f6-h8947: secret "image-registry-tls" not found Jul 02 12:39:21.255002 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:21.254769 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/436af359-0eff-4feb-a272-a74fedb5a0a1-metrics-tls podName:436af359-0eff-4feb-a272-a74fedb5a0a1 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:29.254751451 +0000 UTC m=+51.155015081 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/436af359-0eff-4feb-a272-a74fedb5a0a1-metrics-tls") pod "dns-default-pv76q" (UID: "436af359-0eff-4feb-a272-a74fedb5a0a1") : secret "dns-default-metrics-tls" not found Jul 02 12:39:21.255002 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:21.254790 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-registry-tls podName:1012e2f1-8d7b-4cc7-8c6f-edafb06121c0 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:29.25477546 +0000 UTC m=+51.155039102 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-registry-tls") pod "image-registry-96668c4f6-h8947" (UID: "1012e2f1-8d7b-4cc7-8c6f-edafb06121c0") : secret "image-registry-tls" not found Jul 02 12:39:21.355124 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:21.355087 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0e3103b-711d-4a9d-b5cc-0a911b218f12-service-ca-bundle\") pod \"router-default-54fcb7b75-zz9dh\" (UID: \"e0e3103b-711d-4a9d-b5cc-0a911b218f12\") " pod="openshift-ingress/router-default-54fcb7b75-zz9dh" Jul 02 12:39:21.355318 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:21.355164 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0e3103b-711d-4a9d-b5cc-0a911b218f12-metrics-certs\") pod \"router-default-54fcb7b75-zz9dh\" (UID: \"e0e3103b-711d-4a9d-b5cc-0a911b218f12\") " pod="openshift-ingress/router-default-54fcb7b75-zz9dh" Jul 02 12:39:21.355318 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:21.355235 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/30589b59-c043-4008-a1d8-e9fd71436bdc-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-tthth\" (UID: \"30589b59-c043-4008-a1d8-e9fd71436bdc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-tthth" Jul 02 12:39:21.355318 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:21.355281 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e0e3103b-711d-4a9d-b5cc-0a911b218f12-service-ca-bundle podName:e0e3103b-711d-4a9d-b5cc-0a911b218f12 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:29.355261956 +0000 UTC m=+51.255525591 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e0e3103b-711d-4a9d-b5cc-0a911b218f12-service-ca-bundle") pod "router-default-54fcb7b75-zz9dh" (UID: "e0e3103b-711d-4a9d-b5cc-0a911b218f12") : configmap references non-existent config key: service-ca.crt Jul 02 12:39:21.355318 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:21.355310 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1a5ab597-6c02-4d90-9656-a10f19699fbb-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-slfq4\" (UID: \"1a5ab597-6c02-4d90-9656-a10f19699fbb\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-slfq4" Jul 02 12:39:21.355531 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:21.355348 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 12:39:21.355531 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:21.355348 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 12:39:21.355531 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:21.355409 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30589b59-c043-4008-a1d8-e9fd71436bdc-samples-operator-tls podName:30589b59-c043-4008-a1d8-e9fd71436bdc nodeName:}" failed. No retries permitted until 2026-07-02 12:39:29.355390376 +0000 UTC m=+51.255654023 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/30589b59-c043-4008-a1d8-e9fd71436bdc-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-tthth" (UID: "30589b59-c043-4008-a1d8-e9fd71436bdc") : secret "samples-operator-tls" not found Jul 02 12:39:21.355531 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:21.355419 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 12:39:21.355531 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:21.355445 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0e3103b-711d-4a9d-b5cc-0a911b218f12-metrics-certs podName:e0e3103b-711d-4a9d-b5cc-0a911b218f12 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:29.355432918 +0000 UTC m=+51.255696562 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e0e3103b-711d-4a9d-b5cc-0a911b218f12-metrics-certs") pod "router-default-54fcb7b75-zz9dh" (UID: "e0e3103b-711d-4a9d-b5cc-0a911b218f12") : secret "router-metrics-certs-default" not found Jul 02 12:39:21.355531 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:21.355466 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a5ab597-6c02-4d90-9656-a10f19699fbb-networking-console-plugin-cert podName:1a5ab597-6c02-4d90-9656-a10f19699fbb nodeName:}" failed. No retries permitted until 2026-07-02 12:39:29.355455208 +0000 UTC m=+51.255718839 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1a5ab597-6c02-4d90-9656-a10f19699fbb-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-slfq4" (UID: "1a5ab597-6c02-4d90-9656-a10f19699fbb") : secret "networking-console-plugin-cert" not found Jul 02 12:39:23.828455 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:23.828402 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-s8cdk" event={"ID":"277a2422-2cbc-4e30-976a-08d93cdfb549","Type":"ContainerStarted","Data":"9246b91cd70779fe252593750b4dacf4067aea2eb7a249f72ac50b722df5f940"} Jul 02 12:39:23.830332 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:23.830271 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6hfbr" event={"ID":"4c33d294-3dc2-4951-8a0e-59212bfc2ca6","Type":"ContainerStarted","Data":"60e062db474da71e7cc0521e72d164787ce352af7be9b83122a8c14eebadb4a9"} Jul 02 12:39:23.831927 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:23.831900 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56499946bc-b5xqj" event={"ID":"97692f4f-de73-44c7-a10e-c87b4163131f","Type":"ContainerStarted","Data":"2e7f6bf8f95d305f11dde4b20b4fda7388f27b525a024e0f44d823d54ab0fcf0"} Jul 02 12:39:23.836166 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:23.835767 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2kcwd" event={"ID":"69dad1af-5279-40e3-9676-662e8392842f","Type":"ContainerStarted","Data":"c38ab57dc9d960160bad4f49abffaa06688738c1be4bd10ed7f8f9572f657f14"} Jul 02 12:39:23.837375 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:23.837352 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-fv6k7" event={"ID":"a26b3699-7f1b-41b6-8451-0fe9c95aa096","Type":"ContainerStarted","Data":"51d12a87db98f62e7d0dd13a1dda58015b5486ed298f29db1b543dccb5f06a45"} Jul 02 12:39:23.838989 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:23.838961 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2s7pm" event={"ID":"a21ecc40-b3d7-452d-9341-1658114a945c","Type":"ContainerStarted","Data":"0e1c1b7f0dcdcee9df5a7b6fbd68a979ac8f400af26a00938255156d730340c3"} Jul 02 12:39:23.840524 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:23.840503 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-5djd8" event={"ID":"21ca6365-0380-4964-ad2c-6760f70ade05","Type":"ContainerStarted","Data":"b28b29e8e8823b10a21a4fd5db68df199a9ab836d97bc9ae2a88db0c8dc696c5"} Jul 02 12:39:23.842200 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:23.842182 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-sqd4q_95b6074d-8908-400e-85c7-c2d989e4b2d3/console-operator/0.log" Jul 02 12:39:23.842284 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:23.842218 2582 generic.go:356] "Generic (PLEG): container finished" podID="95b6074d-8908-400e-85c7-c2d989e4b2d3" containerID="ae62e9d56ea4edefb49f29beb812da2184521bf7156d53e5d02b897de3f07f2d" exitCode=255 Jul 02 12:39:23.842284 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:23.842253 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-sqd4q" event={"ID":"95b6074d-8908-400e-85c7-c2d989e4b2d3","Type":"ContainerDied","Data":"ae62e9d56ea4edefb49f29beb812da2184521bf7156d53e5d02b897de3f07f2d"} Jul 02 12:39:23.842436 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:23.842423 2582 scope.go:117] "RemoveContainer" containerID="ae62e9d56ea4edefb49f29beb812da2184521bf7156d53e5d02b897de3f07f2d" Jul 02 12:39:23.847522 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:23.847474 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-s8cdk" podStartSLOduration=21.171232606 podStartE2EDuration="28.847459375s" totalImagesPullingTime="7.676226769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 12:38:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:39:23.846452457 +0000 UTC m=+45.746716104" watchObservedRunningTime="2026-07-02 12:39:23.847459375 +0000 UTC m=+45.747723029" Jul 02 12:39:23.877666 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:23.872265 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2kcwd" podStartSLOduration=16.602716059 podStartE2EDuration="45.872245909s" totalImagesPullingTime="29.26952985s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 12:38:38 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:39:23.871785641 +0000 UTC m=+45.772049294" watchObservedRunningTime="2026-07-02 12:39:23.872245909 +0000 UTC m=+45.772509564" Jul 02 12:39:23.892146 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:23.890525 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-5djd8" podStartSLOduration=21.20140044 podStartE2EDuration="28.89050504s" totalImagesPullingTime="7.6891046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 12:38:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:39:23.888452379 +0000 UTC m=+45.788716032" watchObservedRunningTime="2026-07-02 12:39:23.89050504 +0000 UTC m=+45.790768695" Jul 02 12:39:23.940985 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:23.940919 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5f67b55555-fv6k7" podStartSLOduration=21.200211976 podStartE2EDuration="28.940884757s" totalImagesPullingTime="7.740672781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 12:38:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:39:23.910808673 +0000 UTC m=+45.811072326" watchObservedRunningTime="2026-07-02 12:39:23.940884757 +0000 UTC m=+45.841160591" Jul 02 12:39:23.942040 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:23.942008 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2s7pm" podStartSLOduration=20.26516154 podStartE2EDuration="27.941995547s" totalImagesPullingTime="7.676834007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 12:38:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:39:23.940135047 +0000 UTC m=+45.840398701" watchObservedRunningTime="2026-07-02 12:39:23.941995547 +0000 UTC m=+45.842259201" Jul 02 12:39:23.991544 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:23.991421 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56499946bc-b5xqj" podStartSLOduration=21.302489682 podStartE2EDuration="28.991398838s" totalImagesPullingTime="7.688909156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 12:38:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:39:23.989961498 +0000 UTC m=+45.890225153" watchObservedRunningTime="2026-07-02 12:39:23.991398838 +0000 UTC m=+45.891662489" Jul 02 12:39:24.008738 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:24.007285 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6hfbr" podStartSLOduration=3.3322901480000002 podStartE2EDuration="11.00727233s" totalImagesPullingTime="7.674982182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 12:39:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:39:24.006917722 +0000 UTC m=+45.907181374" watchObservedRunningTime="2026-07-02 12:39:24.00727233 +0000 UTC m=+45.907535983" Jul 02 12:39:24.285713 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:24.284421 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fnj9w"] Jul 02 12:39:24.314975 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:24.314939 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fnj9w"] Jul 02 12:39:24.315120 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:24.315065 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fnj9w" Jul 02 12:39:24.317369 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:24.317347 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 02 12:39:24.317542 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:24.317524 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 02 12:39:24.317623 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:24.317526 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kzvtc\"" Jul 02 12:39:24.383251 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:24.383221 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/88cd4454-9208-4cda-bb1f-c45f44c0d107-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fnj9w\" (UID: \"88cd4454-9208-4cda-bb1f-c45f44c0d107\") " pod="openshift-insights/insights-runtime-extractor-fnj9w" Jul 02 12:39:24.383447 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:24.383266 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/88cd4454-9208-4cda-bb1f-c45f44c0d107-crio-socket\") pod \"insights-runtime-extractor-fnj9w\" (UID: \"88cd4454-9208-4cda-bb1f-c45f44c0d107\") " pod="openshift-insights/insights-runtime-extractor-fnj9w" Jul 02 12:39:24.383447 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:24.383287 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/88cd4454-9208-4cda-bb1f-c45f44c0d107-data-volume\") pod \"insights-runtime-extractor-fnj9w\" (UID: \"88cd4454-9208-4cda-bb1f-c45f44c0d107\") " pod="openshift-insights/insights-runtime-extractor-fnj9w" Jul 02 12:39:24.383447 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:24.383354 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8ps5\" (UniqueName: \"kubernetes.io/projected/88cd4454-9208-4cda-bb1f-c45f44c0d107-kube-api-access-g8ps5\") pod \"insights-runtime-extractor-fnj9w\" (UID: \"88cd4454-9208-4cda-bb1f-c45f44c0d107\") " pod="openshift-insights/insights-runtime-extractor-fnj9w" Jul 02 12:39:24.383447 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:24.383379 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/88cd4454-9208-4cda-bb1f-c45f44c0d107-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fnj9w\" (UID: \"88cd4454-9208-4cda-bb1f-c45f44c0d107\") " pod="openshift-insights/insights-runtime-extractor-fnj9w" Jul 02 12:39:24.484242 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:24.484204 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8ps5\" (UniqueName: \"kubernetes.io/projected/88cd4454-9208-4cda-bb1f-c45f44c0d107-kube-api-access-g8ps5\") pod \"insights-runtime-extractor-fnj9w\" (UID: \"88cd4454-9208-4cda-bb1f-c45f44c0d107\") " pod="openshift-insights/insights-runtime-extractor-fnj9w" Jul 02 12:39:24.484242 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:24.484246 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/88cd4454-9208-4cda-bb1f-c45f44c0d107-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fnj9w\" (UID: \"88cd4454-9208-4cda-bb1f-c45f44c0d107\") " pod="openshift-insights/insights-runtime-extractor-fnj9w" Jul 02 12:39:24.484456 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:24.484426 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/88cd4454-9208-4cda-bb1f-c45f44c0d107-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fnj9w\" (UID: \"88cd4454-9208-4cda-bb1f-c45f44c0d107\") " pod="openshift-insights/insights-runtime-extractor-fnj9w" Jul 02 12:39:24.484497 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:24.484459 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/88cd4454-9208-4cda-bb1f-c45f44c0d107-crio-socket\") pod \"insights-runtime-extractor-fnj9w\" (UID: \"88cd4454-9208-4cda-bb1f-c45f44c0d107\") " pod="openshift-insights/insights-runtime-extractor-fnj9w" Jul 02 12:39:24.484497 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:24.484477 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/88cd4454-9208-4cda-bb1f-c45f44c0d107-data-volume\") pod \"insights-runtime-extractor-fnj9w\" (UID: \"88cd4454-9208-4cda-bb1f-c45f44c0d107\") " pod="openshift-insights/insights-runtime-extractor-fnj9w" Jul 02 12:39:24.484592 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:24.484506 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 12:39:24.484592 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:24.484568 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88cd4454-9208-4cda-bb1f-c45f44c0d107-insights-runtime-extractor-tls podName:88cd4454-9208-4cda-bb1f-c45f44c0d107 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:24.984552148 +0000 UTC m=+46.884815801 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/88cd4454-9208-4cda-bb1f-c45f44c0d107-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fnj9w" (UID: "88cd4454-9208-4cda-bb1f-c45f44c0d107") : secret "insights-runtime-extractor-tls" not found Jul 02 12:39:24.484592 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:24.484573 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 12:39:24.484764 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:24.484636 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/88cd4454-9208-4cda-bb1f-c45f44c0d107-kube-rbac-proxy-cm podName:88cd4454-9208-4cda-bb1f-c45f44c0d107 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:24.98461727 +0000 UTC m=+46.884880913 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/88cd4454-9208-4cda-bb1f-c45f44c0d107-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fnj9w" (UID: "88cd4454-9208-4cda-bb1f-c45f44c0d107") : configmap "kube-rbac-proxy" not found Jul 02 12:39:24.484764 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:24.484730 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/88cd4454-9208-4cda-bb1f-c45f44c0d107-crio-socket\") pod \"insights-runtime-extractor-fnj9w\" (UID: \"88cd4454-9208-4cda-bb1f-c45f44c0d107\") " pod="openshift-insights/insights-runtime-extractor-fnj9w" Jul 02 12:39:24.484835 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:24.484824 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/88cd4454-9208-4cda-bb1f-c45f44c0d107-data-volume\") pod \"insights-runtime-extractor-fnj9w\" (UID: \"88cd4454-9208-4cda-bb1f-c45f44c0d107\") " pod="openshift-insights/insights-runtime-extractor-fnj9w" Jul 02 12:39:24.496442 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:24.496417 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8ps5\" (UniqueName: \"kubernetes.io/projected/88cd4454-9208-4cda-bb1f-c45f44c0d107-kube-api-access-g8ps5\") pod \"insights-runtime-extractor-fnj9w\" (UID: \"88cd4454-9208-4cda-bb1f-c45f44c0d107\") " pod="openshift-insights/insights-runtime-extractor-fnj9w" Jul 02 12:39:24.847814 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:24.847780 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-sqd4q_95b6074d-8908-400e-85c7-c2d989e4b2d3/console-operator/1.log" Jul 02 12:39:24.848317 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:24.848237 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-sqd4q_95b6074d-8908-400e-85c7-c2d989e4b2d3/console-operator/0.log" Jul 02 12:39:24.848317 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:24.848272 2582 generic.go:356] "Generic (PLEG): container finished" podID="95b6074d-8908-400e-85c7-c2d989e4b2d3" containerID="3ef81395a9aa48376b78154ad9abbcfccdba2bbe7d4f7e7233af635fbdbcfa14" exitCode=255 Jul 02 12:39:24.848432 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:24.848367 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-sqd4q" event={"ID":"95b6074d-8908-400e-85c7-c2d989e4b2d3","Type":"ContainerDied","Data":"3ef81395a9aa48376b78154ad9abbcfccdba2bbe7d4f7e7233af635fbdbcfa14"} Jul 02 12:39:24.848469 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:24.848431 2582 scope.go:117] "RemoveContainer" containerID="ae62e9d56ea4edefb49f29beb812da2184521bf7156d53e5d02b897de3f07f2d" Jul 02 12:39:24.848764 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:24.848705 2582 scope.go:117] "RemoveContainer" containerID="3ef81395a9aa48376b78154ad9abbcfccdba2bbe7d4f7e7233af635fbdbcfa14" Jul 02 12:39:24.848947 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:24.848911 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-sqd4q_openshift-console-operator(95b6074d-8908-400e-85c7-c2d989e4b2d3)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-sqd4q" podUID="95b6074d-8908-400e-85c7-c2d989e4b2d3" Jul 02 12:39:24.989841 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:24.989805 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/88cd4454-9208-4cda-bb1f-c45f44c0d107-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fnj9w\" (UID: \"88cd4454-9208-4cda-bb1f-c45f44c0d107\") " pod="openshift-insights/insights-runtime-extractor-fnj9w" Jul 02 12:39:24.990031 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:24.989980 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 12:39:24.990100 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:24.990030 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/88cd4454-9208-4cda-bb1f-c45f44c0d107-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fnj9w\" (UID: \"88cd4454-9208-4cda-bb1f-c45f44c0d107\") " pod="openshift-insights/insights-runtime-extractor-fnj9w" Jul 02 12:39:24.990100 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:24.990053 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88cd4454-9208-4cda-bb1f-c45f44c0d107-insights-runtime-extractor-tls podName:88cd4454-9208-4cda-bb1f-c45f44c0d107 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:25.990033252 +0000 UTC m=+47.890296896 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/88cd4454-9208-4cda-bb1f-c45f44c0d107-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fnj9w" (UID: "88cd4454-9208-4cda-bb1f-c45f44c0d107") : secret "insights-runtime-extractor-tls" not found Jul 02 12:39:24.990100 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:24.990084 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 12:39:24.990225 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:24.990124 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/88cd4454-9208-4cda-bb1f-c45f44c0d107-kube-rbac-proxy-cm podName:88cd4454-9208-4cda-bb1f-c45f44c0d107 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:25.990112564 +0000 UTC m=+47.890376194 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/88cd4454-9208-4cda-bb1f-c45f44c0d107-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fnj9w" (UID: "88cd4454-9208-4cda-bb1f-c45f44c0d107") : configmap "kube-rbac-proxy" not found Jul 02 12:39:25.853177 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:25.853153 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-sqd4q_95b6074d-8908-400e-85c7-c2d989e4b2d3/console-operator/1.log" Jul 02 12:39:25.853526 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:25.853465 2582 scope.go:117] "RemoveContainer" containerID="3ef81395a9aa48376b78154ad9abbcfccdba2bbe7d4f7e7233af635fbdbcfa14" Jul 02 12:39:25.853629 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:25.853610 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-sqd4q_openshift-console-operator(95b6074d-8908-400e-85c7-c2d989e4b2d3)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-sqd4q" podUID="95b6074d-8908-400e-85c7-c2d989e4b2d3" Jul 02 12:39:25.999946 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:25.999906 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/88cd4454-9208-4cda-bb1f-c45f44c0d107-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fnj9w\" (UID: \"88cd4454-9208-4cda-bb1f-c45f44c0d107\") " pod="openshift-insights/insights-runtime-extractor-fnj9w" Jul 02 12:39:26.000108 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:26.000084 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 12:39:26.000149 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:26.000106 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/88cd4454-9208-4cda-bb1f-c45f44c0d107-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fnj9w\" (UID: \"88cd4454-9208-4cda-bb1f-c45f44c0d107\") " pod="openshift-insights/insights-runtime-extractor-fnj9w" Jul 02 12:39:26.000180 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:26.000159 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88cd4454-9208-4cda-bb1f-c45f44c0d107-insights-runtime-extractor-tls podName:88cd4454-9208-4cda-bb1f-c45f44c0d107 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:28.00013913 +0000 UTC m=+49.900402791 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/88cd4454-9208-4cda-bb1f-c45f44c0d107-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fnj9w" (UID: "88cd4454-9208-4cda-bb1f-c45f44c0d107") : secret "insights-runtime-extractor-tls" not found Jul 02 12:39:26.000219 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:26.000205 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 12:39:26.000273 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:26.000264 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/88cd4454-9208-4cda-bb1f-c45f44c0d107-kube-rbac-proxy-cm podName:88cd4454-9208-4cda-bb1f-c45f44c0d107 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:28.00024926 +0000 UTC m=+49.900512908 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/88cd4454-9208-4cda-bb1f-c45f44c0d107-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fnj9w" (UID: "88cd4454-9208-4cda-bb1f-c45f44c0d107") : configmap "kube-rbac-proxy" not found Jul 02 12:39:26.069759 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:26.069735 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hbp5q_f3416a26-326a-4325-b9c1-dcd3d38c27c4/dns-node-resolver/0.log" Jul 02 12:39:26.872801 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:26.872773 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-r4xmq_bd5bf081-bf94-44f1-99a9-9565fc764886/node-ca/0.log" Jul 02 12:39:27.473510 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:27.473479 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6hfbr_4c33d294-3dc2-4951-8a0e-59212bfc2ca6/serve-healthcheck-canary/0.log" Jul 02 12:39:28.017155 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:28.017112 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/88cd4454-9208-4cda-bb1f-c45f44c0d107-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fnj9w\" (UID: \"88cd4454-9208-4cda-bb1f-c45f44c0d107\") " pod="openshift-insights/insights-runtime-extractor-fnj9w" Jul 02 12:39:28.017607 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:28.017240 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 12:39:28.017607 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:28.017313 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/88cd4454-9208-4cda-bb1f-c45f44c0d107-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fnj9w\" (UID: \"88cd4454-9208-4cda-bb1f-c45f44c0d107\") " pod="openshift-insights/insights-runtime-extractor-fnj9w" Jul 02 12:39:28.017607 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:28.017321 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/88cd4454-9208-4cda-bb1f-c45f44c0d107-kube-rbac-proxy-cm podName:88cd4454-9208-4cda-bb1f-c45f44c0d107 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:32.017301646 +0000 UTC m=+53.917565296 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/88cd4454-9208-4cda-bb1f-c45f44c0d107-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fnj9w" (UID: "88cd4454-9208-4cda-bb1f-c45f44c0d107") : configmap "kube-rbac-proxy" not found Jul 02 12:39:28.017607 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:28.017472 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 12:39:28.017607 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:28.017534 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88cd4454-9208-4cda-bb1f-c45f44c0d107-insights-runtime-extractor-tls podName:88cd4454-9208-4cda-bb1f-c45f44c0d107 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:32.017518631 +0000 UTC m=+53.917782261 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/88cd4454-9208-4cda-bb1f-c45f44c0d107-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fnj9w" (UID: "88cd4454-9208-4cda-bb1f-c45f44c0d107") : secret "insights-runtime-extractor-tls" not found Jul 02 12:39:29.330302 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:29.330263 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/436af359-0eff-4feb-a272-a74fedb5a0a1-metrics-tls\") pod \"dns-default-pv76q\" (UID: \"436af359-0eff-4feb-a272-a74fedb5a0a1\") " pod="openshift-dns/dns-default-pv76q" Jul 02 12:39:29.330760 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:29.330314 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-registry-tls\") pod \"image-registry-96668c4f6-h8947\" (UID: \"1012e2f1-8d7b-4cc7-8c6f-edafb06121c0\") " pod="openshift-image-registry/image-registry-96668c4f6-h8947" Jul 02 12:39:29.330760 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:29.330413 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 12:39:29.330760 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:29.330415 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 12:39:29.330760 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:29.330480 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-96668c4f6-h8947: secret "image-registry-tls" not found Jul 02 12:39:29.330760 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:29.330482 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/436af359-0eff-4feb-a272-a74fedb5a0a1-metrics-tls podName:436af359-0eff-4feb-a272-a74fedb5a0a1 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:45.330465552 +0000 UTC m=+67.230729186 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/436af359-0eff-4feb-a272-a74fedb5a0a1-metrics-tls") pod "dns-default-pv76q" (UID: "436af359-0eff-4feb-a272-a74fedb5a0a1") : secret "dns-default-metrics-tls" not found Jul 02 12:39:29.330760 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:29.330526 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-registry-tls podName:1012e2f1-8d7b-4cc7-8c6f-edafb06121c0 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:45.330511204 +0000 UTC m=+67.230774852 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-registry-tls") pod "image-registry-96668c4f6-h8947" (UID: "1012e2f1-8d7b-4cc7-8c6f-edafb06121c0") : secret "image-registry-tls" not found Jul 02 12:39:29.330760 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:29.330590 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f639cf9-152c-4a8c-be48-309c48631998-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-vhmpk\" (UID: \"4f639cf9-152c-4a8c-be48-309c48631998\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vhmpk" Jul 02 12:39:29.330760 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:29.330689 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 12:39:29.330760 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:29.330723 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f639cf9-152c-4a8c-be48-309c48631998-cluster-monitoring-operator-tls podName:4f639cf9-152c-4a8c-be48-309c48631998 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:45.330709695 +0000 UTC m=+67.230973324 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4f639cf9-152c-4a8c-be48-309c48631998-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-vhmpk" (UID: "4f639cf9-152c-4a8c-be48-309c48631998") : secret "cluster-monitoring-operator-tls" not found Jul 02 12:39:29.431326 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:29.431288 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0e3103b-711d-4a9d-b5cc-0a911b218f12-service-ca-bundle\") pod \"router-default-54fcb7b75-zz9dh\" (UID: \"e0e3103b-711d-4a9d-b5cc-0a911b218f12\") " pod="openshift-ingress/router-default-54fcb7b75-zz9dh" Jul 02 12:39:29.431509 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:29.431346 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0e3103b-711d-4a9d-b5cc-0a911b218f12-metrics-certs\") pod \"router-default-54fcb7b75-zz9dh\" (UID: \"e0e3103b-711d-4a9d-b5cc-0a911b218f12\") " pod="openshift-ingress/router-default-54fcb7b75-zz9dh" Jul 02 12:39:29.431509 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:29.431463 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e0e3103b-711d-4a9d-b5cc-0a911b218f12-service-ca-bundle podName:e0e3103b-711d-4a9d-b5cc-0a911b218f12 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:45.431443891 +0000 UTC m=+67.331707521 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e0e3103b-711d-4a9d-b5cc-0a911b218f12-service-ca-bundle") pod "router-default-54fcb7b75-zz9dh" (UID: "e0e3103b-711d-4a9d-b5cc-0a911b218f12") : configmap references non-existent config key: service-ca.crt Jul 02 12:39:29.431509 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:29.431489 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 12:39:29.431610 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:29.431529 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0e3103b-711d-4a9d-b5cc-0a911b218f12-metrics-certs podName:e0e3103b-711d-4a9d-b5cc-0a911b218f12 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:45.431519139 +0000 UTC m=+67.331782770 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e0e3103b-711d-4a9d-b5cc-0a911b218f12-metrics-certs") pod "router-default-54fcb7b75-zz9dh" (UID: "e0e3103b-711d-4a9d-b5cc-0a911b218f12") : secret "router-metrics-certs-default" not found Jul 02 12:39:29.431610 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:29.431574 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/30589b59-c043-4008-a1d8-e9fd71436bdc-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-tthth\" (UID: \"30589b59-c043-4008-a1d8-e9fd71436bdc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-tthth" Jul 02 12:39:29.431710 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:29.431608 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1a5ab597-6c02-4d90-9656-a10f19699fbb-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-slfq4\" (UID: \"1a5ab597-6c02-4d90-9656-a10f19699fbb\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-slfq4" Jul 02 12:39:29.431710 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:29.431692 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 12:39:29.431773 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:29.431722 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a5ab597-6c02-4d90-9656-a10f19699fbb-networking-console-plugin-cert podName:1a5ab597-6c02-4d90-9656-a10f19699fbb nodeName:}" failed. No retries permitted until 2026-07-02 12:39:45.431714624 +0000 UTC m=+67.331978254 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1a5ab597-6c02-4d90-9656-a10f19699fbb-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-slfq4" (UID: "1a5ab597-6c02-4d90-9656-a10f19699fbb") : secret "networking-console-plugin-cert" not found Jul 02 12:39:29.431773 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:29.431744 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 12:39:29.431853 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:29.431790 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30589b59-c043-4008-a1d8-e9fd71436bdc-samples-operator-tls podName:30589b59-c043-4008-a1d8-e9fd71436bdc nodeName:}" failed. No retries permitted until 2026-07-02 12:39:45.431776778 +0000 UTC m=+67.332040427 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/30589b59-c043-4008-a1d8-e9fd71436bdc-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-tthth" (UID: "30589b59-c043-4008-a1d8-e9fd71436bdc") : secret "samples-operator-tls" not found Jul 02 12:39:32.054050 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:32.054011 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/88cd4454-9208-4cda-bb1f-c45f44c0d107-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fnj9w\" (UID: \"88cd4454-9208-4cda-bb1f-c45f44c0d107\") " pod="openshift-insights/insights-runtime-extractor-fnj9w" Jul 02 12:39:32.054866 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:32.054176 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 12:39:32.054866 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:32.054179 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/88cd4454-9208-4cda-bb1f-c45f44c0d107-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fnj9w\" (UID: \"88cd4454-9208-4cda-bb1f-c45f44c0d107\") " pod="openshift-insights/insights-runtime-extractor-fnj9w" Jul 02 12:39:32.054866 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:32.054250 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88cd4454-9208-4cda-bb1f-c45f44c0d107-insights-runtime-extractor-tls podName:88cd4454-9208-4cda-bb1f-c45f44c0d107 nodeName:}" failed. No retries permitted until 2026-07-02 12:39:40.054229518 +0000 UTC m=+61.954493152 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/88cd4454-9208-4cda-bb1f-c45f44c0d107-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fnj9w" (UID: "88cd4454-9208-4cda-bb1f-c45f44c0d107") : secret "insights-runtime-extractor-tls" not found Jul 02 12:39:32.054866 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:32.054767 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/88cd4454-9208-4cda-bb1f-c45f44c0d107-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fnj9w\" (UID: \"88cd4454-9208-4cda-bb1f-c45f44c0d107\") " pod="openshift-insights/insights-runtime-extractor-fnj9w" Jul 02 12:39:33.816285 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:33.816237 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-sqd4q" Jul 02 12:39:33.816716 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:33.816307 2582 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7fdbdf9c99-sqd4q" Jul 02 12:39:33.816716 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:33.816642 2582 scope.go:117] "RemoveContainer" containerID="3ef81395a9aa48376b78154ad9abbcfccdba2bbe7d4f7e7233af635fbdbcfa14" Jul 02 12:39:33.816838 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:39:33.816819 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-sqd4q_openshift-console-operator(95b6074d-8908-400e-85c7-c2d989e4b2d3)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-sqd4q" podUID="95b6074d-8908-400e-85c7-c2d989e4b2d3" Jul 02 12:39:40.128153 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:40.128116 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/88cd4454-9208-4cda-bb1f-c45f44c0d107-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fnj9w\" (UID: \"88cd4454-9208-4cda-bb1f-c45f44c0d107\") " pod="openshift-insights/insights-runtime-extractor-fnj9w" Jul 02 12:39:40.130337 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:40.130319 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/88cd4454-9208-4cda-bb1f-c45f44c0d107-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fnj9w\" (UID: \"88cd4454-9208-4cda-bb1f-c45f44c0d107\") " pod="openshift-insights/insights-runtime-extractor-fnj9w" Jul 02 12:39:40.228044 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:40.228014 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kzvtc\"" Jul 02 12:39:40.235623 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:40.235593 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fnj9w" Jul 02 12:39:40.370758 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:40.369042 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fnj9w"] Jul 02 12:39:40.374794 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:39:40.374766 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88cd4454_9208_4cda_bb1f_c45f44c0d107.slice/crio-6e44b2b95eec12e8ee8e6568a9a882b01bfd79645bf21b87de45c076449ff730 WatchSource:0}: Error finding container 6e44b2b95eec12e8ee8e6568a9a882b01bfd79645bf21b87de45c076449ff730: Status 404 returned error can't find the container with id 6e44b2b95eec12e8ee8e6568a9a882b01bfd79645bf21b87de45c076449ff730 Jul 02 12:39:40.759908 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:40.759876 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bfrv8" Jul 02 12:39:40.902761 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:40.902719 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fnj9w" event={"ID":"88cd4454-9208-4cda-bb1f-c45f44c0d107","Type":"ContainerStarted","Data":"6e44b2b95eec12e8ee8e6568a9a882b01bfd79645bf21b87de45c076449ff730"} Jul 02 12:39:44.266955 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:44.266855 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3ed604e-9278-4403-b407-8f5aa8122793-metrics-certs\") pod \"network-metrics-daemon-bxzt9\" (UID: \"d3ed604e-9278-4403-b407-8f5aa8122793\") " pod="openshift-multus/network-metrics-daemon-bxzt9" Jul 02 12:39:44.270376 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:44.270358 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 12:39:44.279843 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:44.279819 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3ed604e-9278-4403-b407-8f5aa8122793-metrics-certs\") pod \"network-metrics-daemon-bxzt9\" (UID: \"d3ed604e-9278-4403-b407-8f5aa8122793\") " pod="openshift-multus/network-metrics-daemon-bxzt9" Jul 02 12:39:44.367395 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:44.367357 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7bdeed2-7b53-450b-a2e9-e3ae689e9c85-original-pull-secret\") pod \"global-pull-secret-syncer-b7x9v\" (UID: \"c7bdeed2-7b53-450b-a2e9-e3ae689e9c85\") " pod="kube-system/global-pull-secret-syncer-b7x9v" Jul 02 12:39:44.367565 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:44.367510 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd6nf\" (UniqueName: \"kubernetes.io/projected/b151e533-cc30-4cea-bfa8-7fc75567a995-kube-api-access-wd6nf\") pod \"network-check-target-zxj89\" (UID: \"b151e533-cc30-4cea-bfa8-7fc75567a995\") " pod="openshift-network-diagnostics/network-check-target-zxj89" Jul 02 12:39:44.369899 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:44.369881 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 12:39:44.370079 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:44.370058 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd6nf\" (UniqueName: \"kubernetes.io/projected/b151e533-cc30-4cea-bfa8-7fc75567a995-kube-api-access-wd6nf\") pod \"network-check-target-zxj89\" (UID: \"b151e533-cc30-4cea-bfa8-7fc75567a995\") " pod="openshift-network-diagnostics/network-check-target-zxj89" Jul 02 12:39:44.379604 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:44.379576 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7bdeed2-7b53-450b-a2e9-e3ae689e9c85-original-pull-secret\") pod \"global-pull-secret-syncer-b7x9v\" (UID: \"c7bdeed2-7b53-450b-a2e9-e3ae689e9c85\") " pod="kube-system/global-pull-secret-syncer-b7x9v" Jul 02 12:39:44.504237 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:44.504206 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bwrzl\"" Jul 02 12:39:44.511230 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:44.511207 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mgbjz\"" Jul 02 12:39:44.512173 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:44.512145 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxzt9" Jul 02 12:39:44.515277 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:44.515255 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7x9v" Jul 02 12:39:44.520042 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:44.520024 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxj89" Jul 02 12:39:44.716134 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:44.716091 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zxj89"] Jul 02 12:39:44.719799 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:39:44.719769 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb151e533_cc30_4cea_bfa8_7fc75567a995.slice/crio-fca4f975a192ffaf4764b95019d6f650b49b52d3a5c994634734820bdabb5bb5 WatchSource:0}: Error finding container fca4f975a192ffaf4764b95019d6f650b49b52d3a5c994634734820bdabb5bb5: Status 404 returned error can't find the container with id fca4f975a192ffaf4764b95019d6f650b49b52d3a5c994634734820bdabb5bb5 Jul 02 12:39:44.739502 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:44.739477 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bxzt9"] Jul 02 12:39:44.744484 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:44.744460 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b7x9v"] Jul 02 12:39:44.746763 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:39:44.746735 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3ed604e_9278_4403_b407_8f5aa8122793.slice/crio-da91c77dc434379d06c016c06bf3518d4d62a09679a498039a5359b4754445b4 WatchSource:0}: Error finding container da91c77dc434379d06c016c06bf3518d4d62a09679a498039a5359b4754445b4: Status 404 returned error can't find the container with id da91c77dc434379d06c016c06bf3518d4d62a09679a498039a5359b4754445b4 Jul 02 12:39:44.747289 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:39:44.747262 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7bdeed2_7b53_450b_a2e9_e3ae689e9c85.slice/crio-e8d6dbbe68759d886b4c8eb9f8b06c1876b9441d441a817c6d5af51e67b93266 WatchSource:0}: Error finding container e8d6dbbe68759d886b4c8eb9f8b06c1876b9441d441a817c6d5af51e67b93266: Status 404 returned error can't find the container with id e8d6dbbe68759d886b4c8eb9f8b06c1876b9441d441a817c6d5af51e67b93266 Jul 02 12:39:44.923977 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:44.923938 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bxzt9" event={"ID":"d3ed604e-9278-4403-b407-8f5aa8122793","Type":"ContainerStarted","Data":"da91c77dc434379d06c016c06bf3518d4d62a09679a498039a5359b4754445b4"} Jul 02 12:39:44.925017 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:44.924989 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b7x9v" event={"ID":"c7bdeed2-7b53-450b-a2e9-e3ae689e9c85","Type":"ContainerStarted","Data":"e8d6dbbe68759d886b4c8eb9f8b06c1876b9441d441a817c6d5af51e67b93266"} Jul 02 12:39:44.926607 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:44.926587 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fnj9w" event={"ID":"88cd4454-9208-4cda-bb1f-c45f44c0d107","Type":"ContainerStarted","Data":"610105b5d8dc1bcda6050db1c914aef40b2a8e79eac9d99de625d5102018243a"} Jul 02 12:39:44.926704 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:44.926634 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fnj9w" event={"ID":"88cd4454-9208-4cda-bb1f-c45f44c0d107","Type":"ContainerStarted","Data":"90b40311fd3808e82daba057a80de4f11b25513cb271ce6b85f8ba938c3e34b4"} Jul 02 12:39:44.927872 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:44.927852 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zxj89" event={"ID":"b151e533-cc30-4cea-bfa8-7fc75567a995","Type":"ContainerStarted","Data":"6dde01f4cfea10eccc24108a4b479d8015beed4ab0b74b60616837fbdfceaad7"} Jul 02 12:39:44.927966 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:44.927889 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zxj89" event={"ID":"b151e533-cc30-4cea-bfa8-7fc75567a995","Type":"ContainerStarted","Data":"fca4f975a192ffaf4764b95019d6f650b49b52d3a5c994634734820bdabb5bb5"} Jul 02 12:39:44.928009 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:44.927984 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zxj89" Jul 02 12:39:44.944275 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:44.944218 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zxj89" podStartSLOduration=66.944204486 podStartE2EDuration="1m6.944204486s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 12:38:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:39:44.94300304 +0000 UTC m=+66.843266691" watchObservedRunningTime="2026-07-02 12:39:44.944204486 +0000 UTC m=+66.844468137" Jul 02 12:39:45.379413 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:45.378844 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f639cf9-152c-4a8c-be48-309c48631998-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-vhmpk\" (UID: \"4f639cf9-152c-4a8c-be48-309c48631998\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vhmpk" Jul 02 12:39:45.379413 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:45.378932 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/436af359-0eff-4feb-a272-a74fedb5a0a1-metrics-tls\") pod \"dns-default-pv76q\" (UID: \"436af359-0eff-4feb-a272-a74fedb5a0a1\") " pod="openshift-dns/dns-default-pv76q" Jul 02 12:39:45.379413 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:45.378969 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-registry-tls\") pod \"image-registry-96668c4f6-h8947\" (UID: \"1012e2f1-8d7b-4cc7-8c6f-edafb06121c0\") " pod="openshift-image-registry/image-registry-96668c4f6-h8947" Jul 02 12:39:45.384716 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:45.383031 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f639cf9-152c-4a8c-be48-309c48631998-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-vhmpk\" (UID: \"4f639cf9-152c-4a8c-be48-309c48631998\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vhmpk" Jul 02 12:39:45.384716 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:45.383531 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/436af359-0eff-4feb-a272-a74fedb5a0a1-metrics-tls\") pod \"dns-default-pv76q\" (UID: \"436af359-0eff-4feb-a272-a74fedb5a0a1\") " pod="openshift-dns/dns-default-pv76q" Jul 02 12:39:45.384716 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:45.384198 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-registry-tls\") pod \"image-registry-96668c4f6-h8947\" (UID: \"1012e2f1-8d7b-4cc7-8c6f-edafb06121c0\") " pod="openshift-image-registry/image-registry-96668c4f6-h8947" Jul 02 12:39:45.480433 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:45.479743 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0e3103b-711d-4a9d-b5cc-0a911b218f12-service-ca-bundle\") pod \"router-default-54fcb7b75-zz9dh\" (UID: \"e0e3103b-711d-4a9d-b5cc-0a911b218f12\") " pod="openshift-ingress/router-default-54fcb7b75-zz9dh" Jul 02 12:39:45.480433 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:45.479806 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0e3103b-711d-4a9d-b5cc-0a911b218f12-metrics-certs\") pod \"router-default-54fcb7b75-zz9dh\" (UID: \"e0e3103b-711d-4a9d-b5cc-0a911b218f12\") " pod="openshift-ingress/router-default-54fcb7b75-zz9dh" Jul 02 12:39:45.480433 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:45.479855 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/30589b59-c043-4008-a1d8-e9fd71436bdc-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-tthth\" (UID: \"30589b59-c043-4008-a1d8-e9fd71436bdc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-tthth" Jul 02 12:39:45.480433 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:45.479907 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1a5ab597-6c02-4d90-9656-a10f19699fbb-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-slfq4\" (UID: \"1a5ab597-6c02-4d90-9656-a10f19699fbb\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-slfq4" Jul 02 12:39:45.481349 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:45.481248 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0e3103b-711d-4a9d-b5cc-0a911b218f12-service-ca-bundle\") pod \"router-default-54fcb7b75-zz9dh\" (UID: \"e0e3103b-711d-4a9d-b5cc-0a911b218f12\") " pod="openshift-ingress/router-default-54fcb7b75-zz9dh" Jul 02 12:39:45.484027 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:45.483980 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1a5ab597-6c02-4d90-9656-a10f19699fbb-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-slfq4\" (UID: \"1a5ab597-6c02-4d90-9656-a10f19699fbb\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-slfq4" Jul 02 12:39:45.485217 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:45.485169 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/30589b59-c043-4008-a1d8-e9fd71436bdc-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-tthth\" (UID: \"30589b59-c043-4008-a1d8-e9fd71436bdc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-tthth" Jul 02 12:39:45.486030 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:45.485983 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0e3103b-711d-4a9d-b5cc-0a911b218f12-metrics-certs\") pod \"router-default-54fcb7b75-zz9dh\" (UID: \"e0e3103b-711d-4a9d-b5cc-0a911b218f12\") " pod="openshift-ingress/router-default-54fcb7b75-zz9dh" Jul 02 12:39:45.554276 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:45.554239 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rs2lw\"" Jul 02 12:39:45.562428 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:45.562204 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-96668c4f6-h8947" Jul 02 12:39:45.591715 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:45.591686 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5qtp9\"" Jul 02 12:39:45.599732 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:45.599704 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pv76q" Jul 02 12:39:45.636804 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:45.636723 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-slk5l\"" Jul 02 12:39:45.644598 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:45.644570 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vhmpk" Jul 02 12:39:45.646938 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:45.646750 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-wn4vd\"" Jul 02 12:39:45.653814 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:45.653789 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-ztgnd\"" Jul 02 12:39:45.654843 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:45.654749 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-54fcb7b75-zz9dh" Jul 02 12:39:45.661935 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:45.661885 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-tthth" Jul 02 12:39:45.678421 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:45.678215 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-9l2cf\"" Jul 02 12:39:45.686609 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:45.686553 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-slfq4" Jul 02 12:39:46.215537 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:46.215506 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-vhmpk"] Jul 02 12:39:46.261877 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:46.261738 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pv76q"] Jul 02 12:39:46.310303 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:39:46.310275 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f639cf9_152c_4a8c_be48_309c48631998.slice/crio-36b8672e946f9948f5c49877c7158efc0d9172b81dcb6c2ffbc99d9297f322a8 WatchSource:0}: Error finding container 36b8672e946f9948f5c49877c7158efc0d9172b81dcb6c2ffbc99d9297f322a8: Status 404 returned error can't find the container with id 36b8672e946f9948f5c49877c7158efc0d9172b81dcb6c2ffbc99d9297f322a8 Jul 02 12:39:46.310578 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:39:46.310552 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod436af359_0eff_4feb_a272_a74fedb5a0a1.slice/crio-b3ee18140e5db8b1e566721f3c46fbbca3a6383b93e8d83bcd7d66d5e58f7ddf WatchSource:0}: Error finding container b3ee18140e5db8b1e566721f3c46fbbca3a6383b93e8d83bcd7d66d5e58f7ddf: Status 404 returned error can't find the container with id b3ee18140e5db8b1e566721f3c46fbbca3a6383b93e8d83bcd7d66d5e58f7ddf Jul 02 12:39:46.319764 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:46.319089 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-96668c4f6-h8947"] Jul 02 12:39:46.321990 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:39:46.321948 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1012e2f1_8d7b_4cc7_8c6f_edafb06121c0.slice/crio-72d66acce78ff60571ea8fbb7acfca8f6653fb3bf5a5f3f8d54d1d06f59e8972 WatchSource:0}: Error finding container 72d66acce78ff60571ea8fbb7acfca8f6653fb3bf5a5f3f8d54d1d06f59e8972: Status 404 returned error can't find the container with id 72d66acce78ff60571ea8fbb7acfca8f6653fb3bf5a5f3f8d54d1d06f59e8972 Jul 02 12:39:46.323136 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:46.323077 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-slfq4"] Jul 02 12:39:46.325694 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:39:46.325076 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a5ab597_6c02_4d90_9656_a10f19699fbb.slice/crio-d7c4530677b3ecf62d060aa25a69267fe804583a708ee9f7fc50fe7e9360b0b7 WatchSource:0}: Error finding container d7c4530677b3ecf62d060aa25a69267fe804583a708ee9f7fc50fe7e9360b0b7: Status 404 returned error can't find the container with id d7c4530677b3ecf62d060aa25a69267fe804583a708ee9f7fc50fe7e9360b0b7 Jul 02 12:39:46.327317 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:46.327269 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-54fcb7b75-zz9dh"] Jul 02 12:39:46.330053 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:39:46.330027 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0e3103b_711d_4a9d_b5cc_0a911b218f12.slice/crio-23889c9d02a209d2c157366a0ac46a20c590f7401bc85b9f8a4ae81e7cd75d5b WatchSource:0}: Error finding container 23889c9d02a209d2c157366a0ac46a20c590f7401bc85b9f8a4ae81e7cd75d5b: Status 404 returned error can't find the container with id 23889c9d02a209d2c157366a0ac46a20c590f7401bc85b9f8a4ae81e7cd75d5b Jul 02 12:39:46.442337 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:46.442263 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-tthth"] Jul 02 12:39:46.939241 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:46.939200 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-54fcb7b75-zz9dh" event={"ID":"e0e3103b-711d-4a9d-b5cc-0a911b218f12","Type":"ContainerStarted","Data":"2bce65e026619a99456e5a908d0aef4dac35d6ba23b4cc1db7d0a5b059e615af"} Jul 02 12:39:46.939424 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:46.939274 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-54fcb7b75-zz9dh" event={"ID":"e0e3103b-711d-4a9d-b5cc-0a911b218f12","Type":"ContainerStarted","Data":"23889c9d02a209d2c157366a0ac46a20c590f7401bc85b9f8a4ae81e7cd75d5b"} Jul 02 12:39:46.940875 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:46.940848 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-tthth" event={"ID":"30589b59-c043-4008-a1d8-e9fd71436bdc","Type":"ContainerStarted","Data":"f47c2c3f7a1253ed1309bbdd68265ec6b7178551f189084fba9bc23294dc6494"} Jul 02 12:39:46.942513 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:46.942483 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vhmpk" event={"ID":"4f639cf9-152c-4a8c-be48-309c48631998","Type":"ContainerStarted","Data":"36b8672e946f9948f5c49877c7158efc0d9172b81dcb6c2ffbc99d9297f322a8"} Jul 02 12:39:46.944412 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:46.944360 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bxzt9" event={"ID":"d3ed604e-9278-4403-b407-8f5aa8122793","Type":"ContainerStarted","Data":"50a59404223dcd9a88e60624c3e7f73159c2ea82177faa223761c1b834a28515"} Jul 02 12:39:46.945802 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:46.945777 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pv76q" event={"ID":"436af359-0eff-4feb-a272-a74fedb5a0a1","Type":"ContainerStarted","Data":"b3ee18140e5db8b1e566721f3c46fbbca3a6383b93e8d83bcd7d66d5e58f7ddf"} Jul 02 12:39:46.947906 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:46.947807 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-96668c4f6-h8947" event={"ID":"1012e2f1-8d7b-4cc7-8c6f-edafb06121c0","Type":"ContainerStarted","Data":"defafd4eeddba4cfebe57157d5fd359a69170dcf260959022beeb13ba5272293"} Jul 02 12:39:46.947906 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:46.947845 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-96668c4f6-h8947" event={"ID":"1012e2f1-8d7b-4cc7-8c6f-edafb06121c0","Type":"ContainerStarted","Data":"72d66acce78ff60571ea8fbb7acfca8f6653fb3bf5a5f3f8d54d1d06f59e8972"} Jul 02 12:39:46.947906 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:46.947871 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-96668c4f6-h8947" Jul 02 12:39:46.949417 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:46.949386 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-slfq4" event={"ID":"1a5ab597-6c02-4d90-9656-a10f19699fbb","Type":"ContainerStarted","Data":"d7c4530677b3ecf62d060aa25a69267fe804583a708ee9f7fc50fe7e9360b0b7"} Jul 02 12:39:47.031178 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:47.031033 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-96668c4f6-h8947" podStartSLOduration=68.031010653 podStartE2EDuration="1m8.031010653s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 12:38:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:39:47.030428831 +0000 UTC m=+68.930692484" watchObservedRunningTime="2026-07-02 12:39:47.031010653 +0000 UTC m=+68.931274306" Jul 02 12:39:47.032156 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:47.031946 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-54fcb7b75-zz9dh" podStartSLOduration=52.03193127 podStartE2EDuration="52.03193127s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 12:38:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:39:46.99643833 +0000 UTC m=+68.896702007" watchObservedRunningTime="2026-07-02 12:39:47.03193127 +0000 UTC m=+68.932194923" Jul 02 12:39:47.655785 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:47.655749 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-54fcb7b75-zz9dh" Jul 02 12:39:47.658915 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:47.658886 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-54fcb7b75-zz9dh" Jul 02 12:39:47.953239 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:47.953206 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-54fcb7b75-zz9dh" Jul 02 12:39:47.954520 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:47.954497 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-54fcb7b75-zz9dh" Jul 02 12:39:49.569147 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:49.569110 2582 scope.go:117] "RemoveContainer" containerID="3ef81395a9aa48376b78154ad9abbcfccdba2bbe7d4f7e7233af635fbdbcfa14" Jul 02 12:39:51.973306 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:51.973264 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-tthth" event={"ID":"30589b59-c043-4008-a1d8-e9fd71436bdc","Type":"ContainerStarted","Data":"6d1fa202adae01a1cae3785f1baf4986a08c067bc3423621404443e965647a97"} Jul 02 12:39:51.973804 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:51.973365 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-tthth" event={"ID":"30589b59-c043-4008-a1d8-e9fd71436bdc","Type":"ContainerStarted","Data":"c04f33a113ea8665d11b2a477c622c4b90ae88cb30dc264b3c42e63bd0705e13"} Jul 02 12:39:51.975558 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:51.975372 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vhmpk" event={"ID":"4f639cf9-152c-4a8c-be48-309c48631998","Type":"ContainerStarted","Data":"4976045bf077fcf84c1a9e75a57611d48d1d01aba2407f99f85c5cb3a261f560"} Jul 02 12:39:51.977875 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:51.977847 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fnj9w" event={"ID":"88cd4454-9208-4cda-bb1f-c45f44c0d107","Type":"ContainerStarted","Data":"4fb93ade6ecd6dd6c82d393c9db755af772ee7d197b10adf02432569d90a38d4"} Jul 02 12:39:51.980458 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:51.980433 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bxzt9" event={"ID":"d3ed604e-9278-4403-b407-8f5aa8122793","Type":"ContainerStarted","Data":"ac2ec31d8554ff29fbc0b946f6474de5f482710b22fc1013c5ab084fc3fc78eb"} Jul 02 12:39:51.982025 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:51.981996 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b7x9v" event={"ID":"c7bdeed2-7b53-450b-a2e9-e3ae689e9c85","Type":"ContainerStarted","Data":"a0bf9bd64adcf3ba1fd3b95dbe02bb02a7d40bd12c86fac1417d1357df482ae3"} Jul 02 12:39:51.983884 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:51.983859 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pv76q" event={"ID":"436af359-0eff-4feb-a272-a74fedb5a0a1","Type":"ContainerStarted","Data":"131624b91fd1d64ce190a317c69912b3be4fd5109080bad9f53d06d6e81a0f6b"} Jul 02 12:39:51.983986 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:51.983911 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pv76q" event={"ID":"436af359-0eff-4feb-a272-a74fedb5a0a1","Type":"ContainerStarted","Data":"9cce7e6ef1615f85f26c2dcdac2034da74be632b6a212e1959eb1fa10384c211"} Jul 02 12:39:51.983986 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:51.983970 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pv76q" Jul 02 12:39:51.985763 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:51.985747 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-sqd4q_95b6074d-8908-400e-85c7-c2d989e4b2d3/console-operator/1.log" Jul 02 12:39:51.985829 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:51.985818 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-sqd4q" event={"ID":"95b6074d-8908-400e-85c7-c2d989e4b2d3","Type":"ContainerStarted","Data":"d0de35943a33c60c8f6ab356eb53d45be9d6a5528b5fd130a4e7d5f0169997ec"} Jul 02 12:39:51.986073 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:51.986052 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-sqd4q" Jul 02 12:39:51.987774 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:51.987753 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-slfq4" event={"ID":"1a5ab597-6c02-4d90-9656-a10f19699fbb","Type":"ContainerStarted","Data":"95fffeb9865659782ca54820b293ccca299fca62230cae760af1b478ce73494e"} Jul 02 12:39:52.006131 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:52.006073 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-tthth" podStartSLOduration=52.104285224 podStartE2EDuration="57.006052698s" totalImagesPullingTime="4.901767474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 12:38:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:39:52.003414507 +0000 UTC m=+73.903678160" watchObservedRunningTime="2026-07-02 12:39:52.006052698 +0000 UTC m=+73.906316350" Jul 02 12:39:52.026922 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:52.026855 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fnj9w" podStartSLOduration=17.628874089 podStartE2EDuration="28.026835909s" totalImagesPullingTime="10.39796182s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 12:39:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:39:52.0263174 +0000 UTC m=+73.926581053" watchObservedRunningTime="2026-07-02 12:39:52.026835909 +0000 UTC m=+73.927099571" Jul 02 12:39:52.052709 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:52.052633 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-b7x9v" podStartSLOduration=66.462087643 podStartE2EDuration="1m13.052609919s" totalImagesPullingTime="6.590522276s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 12:38:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:39:52.050844462 +0000 UTC m=+73.951108116" watchObservedRunningTime="2026-07-02 12:39:52.052609919 +0000 UTC m=+73.952873553" Jul 02 12:39:52.077288 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:52.077239 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bxzt9" podStartSLOduration=72.478136929 podStartE2EDuration="1m14.07722436s" totalImagesPullingTime="1.599087431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 12:38:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:39:52.075519734 +0000 UTC m=+73.975783386" watchObservedRunningTime="2026-07-02 12:39:52.07722436 +0000 UTC m=+73.977488012" Jul 02 12:39:52.136524 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:52.136459 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7fdbdf9c99-sqd4q" podStartSLOduration=49.458722134 podStartE2EDuration="57.136420851s" totalImagesPullingTime="7.677698717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 12:38:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:39:52.102993967 +0000 UTC m=+74.003257619" watchObservedRunningTime="2026-07-02 12:39:52.136420851 +0000 UTC m=+74.036684500" Jul 02 12:39:52.137965 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:52.137927 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-vhmpk" podStartSLOduration=52.13740268 podStartE2EDuration="57.137911941s" totalImagesPullingTime="5.000509261s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 12:38:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:39:52.135071055 +0000 UTC m=+74.035334709" watchObservedRunningTime="2026-07-02 12:39:52.137911941 +0000 UTC m=+74.038175596" Jul 02 12:39:52.163268 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:52.163225 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pv76q" podStartSLOduration=34.162390419 podStartE2EDuration="39.163210952s" totalImagesPullingTime="5.000820533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 12:39:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:39:52.162752203 +0000 UTC m=+74.063015856" watchObservedRunningTime="2026-07-02 12:39:52.163210952 +0000 UTC m=+74.063474604" Jul 02 12:39:52.188355 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:52.188301 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-slfq4" podStartSLOduration=52.187348765 podStartE2EDuration="57.188279931s" totalImagesPullingTime="5.000931166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 12:38:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:39:52.1880948 +0000 UTC m=+74.088358453" watchObservedRunningTime="2026-07-02 12:39:52.188279931 +0000 UTC m=+74.088543584" Jul 02 12:39:52.249703 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:39:52.249599 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-sqd4q" Jul 02 12:40:01.994081 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:01.993972 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pv76q" Jul 02 12:40:03.182640 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:03.182602 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f45474999-htfxv"] Jul 02 12:40:03.185824 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:03.185802 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f45474999-htfxv" Jul 02 12:40:03.187970 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:03.187952 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-ftbjz\"" Jul 02 12:40:03.188279 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:03.188262 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 02 12:40:03.188414 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:03.188398 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 02 12:40:03.188870 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:03.188849 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 02 12:40:03.188870 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:03.188865 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 02 12:40:03.189008 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:03.188916 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 02 12:40:03.189287 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:03.189275 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 02 12:40:03.191327 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:03.191304 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 02 12:40:03.201487 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:03.201462 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f45474999-htfxv"] Jul 02 12:40:03.223993 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:03.223961 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gz9r4\" (UniqueName: \"kubernetes.io/projected/eda6a9a8-1f00-4c48-96ea-20ff64e14cb7-kube-api-access-gz9r4\") pod \"console-6f45474999-htfxv\" (UID: \"eda6a9a8-1f00-4c48-96ea-20ff64e14cb7\") " pod="openshift-console/console-6f45474999-htfxv" Jul 02 12:40:03.224142 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:03.224012 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eda6a9a8-1f00-4c48-96ea-20ff64e14cb7-service-ca\") pod \"console-6f45474999-htfxv\" (UID: \"eda6a9a8-1f00-4c48-96ea-20ff64e14cb7\") " pod="openshift-console/console-6f45474999-htfxv" Jul 02 12:40:03.224142 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:03.224075 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eda6a9a8-1f00-4c48-96ea-20ff64e14cb7-oauth-serving-cert\") pod \"console-6f45474999-htfxv\" (UID: \"eda6a9a8-1f00-4c48-96ea-20ff64e14cb7\") " pod="openshift-console/console-6f45474999-htfxv" Jul 02 12:40:03.224245 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:03.224159 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eda6a9a8-1f00-4c48-96ea-20ff64e14cb7-console-config\") pod \"console-6f45474999-htfxv\" (UID: \"eda6a9a8-1f00-4c48-96ea-20ff64e14cb7\") " pod="openshift-console/console-6f45474999-htfxv" Jul 02 12:40:03.224245 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:03.224217 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eda6a9a8-1f00-4c48-96ea-20ff64e14cb7-console-serving-cert\") pod \"console-6f45474999-htfxv\" (UID: \"eda6a9a8-1f00-4c48-96ea-20ff64e14cb7\") " pod="openshift-console/console-6f45474999-htfxv" Jul 02 12:40:03.224320 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:03.224243 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eda6a9a8-1f00-4c48-96ea-20ff64e14cb7-console-oauth-config\") pod \"console-6f45474999-htfxv\" (UID: \"eda6a9a8-1f00-4c48-96ea-20ff64e14cb7\") " pod="openshift-console/console-6f45474999-htfxv" Jul 02 12:40:03.324553 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:03.324515 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eda6a9a8-1f00-4c48-96ea-20ff64e14cb7-oauth-serving-cert\") pod \"console-6f45474999-htfxv\" (UID: \"eda6a9a8-1f00-4c48-96ea-20ff64e14cb7\") " pod="openshift-console/console-6f45474999-htfxv" Jul 02 12:40:03.324754 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:03.324572 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eda6a9a8-1f00-4c48-96ea-20ff64e14cb7-console-config\") pod \"console-6f45474999-htfxv\" (UID: \"eda6a9a8-1f00-4c48-96ea-20ff64e14cb7\") " pod="openshift-console/console-6f45474999-htfxv" Jul 02 12:40:03.324754 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:03.324602 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eda6a9a8-1f00-4c48-96ea-20ff64e14cb7-console-serving-cert\") pod \"console-6f45474999-htfxv\" (UID: \"eda6a9a8-1f00-4c48-96ea-20ff64e14cb7\") " pod="openshift-console/console-6f45474999-htfxv" Jul 02 12:40:03.324754 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:03.324622 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eda6a9a8-1f00-4c48-96ea-20ff64e14cb7-console-oauth-config\") pod \"console-6f45474999-htfxv\" (UID: \"eda6a9a8-1f00-4c48-96ea-20ff64e14cb7\") " pod="openshift-console/console-6f45474999-htfxv" Jul 02 12:40:03.324754 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:03.324697 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gz9r4\" (UniqueName: \"kubernetes.io/projected/eda6a9a8-1f00-4c48-96ea-20ff64e14cb7-kube-api-access-gz9r4\") pod \"console-6f45474999-htfxv\" (UID: \"eda6a9a8-1f00-4c48-96ea-20ff64e14cb7\") " pod="openshift-console/console-6f45474999-htfxv" Jul 02 12:40:03.324754 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:03.324728 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eda6a9a8-1f00-4c48-96ea-20ff64e14cb7-service-ca\") pod \"console-6f45474999-htfxv\" (UID: \"eda6a9a8-1f00-4c48-96ea-20ff64e14cb7\") " pod="openshift-console/console-6f45474999-htfxv" Jul 02 12:40:03.325352 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:03.325325 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eda6a9a8-1f00-4c48-96ea-20ff64e14cb7-oauth-serving-cert\") pod \"console-6f45474999-htfxv\" (UID: \"eda6a9a8-1f00-4c48-96ea-20ff64e14cb7\") " pod="openshift-console/console-6f45474999-htfxv" Jul 02 12:40:03.325469 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:03.325327 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eda6a9a8-1f00-4c48-96ea-20ff64e14cb7-console-config\") pod \"console-6f45474999-htfxv\" (UID: \"eda6a9a8-1f00-4c48-96ea-20ff64e14cb7\") " pod="openshift-console/console-6f45474999-htfxv" Jul 02 12:40:03.325469 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:03.325438 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eda6a9a8-1f00-4c48-96ea-20ff64e14cb7-service-ca\") pod \"console-6f45474999-htfxv\" (UID: \"eda6a9a8-1f00-4c48-96ea-20ff64e14cb7\") " pod="openshift-console/console-6f45474999-htfxv" Jul 02 12:40:03.327130 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:03.327099 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eda6a9a8-1f00-4c48-96ea-20ff64e14cb7-console-oauth-config\") pod \"console-6f45474999-htfxv\" (UID: \"eda6a9a8-1f00-4c48-96ea-20ff64e14cb7\") " pod="openshift-console/console-6f45474999-htfxv" Jul 02 12:40:03.327213 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:03.327129 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eda6a9a8-1f00-4c48-96ea-20ff64e14cb7-console-serving-cert\") pod \"console-6f45474999-htfxv\" (UID: \"eda6a9a8-1f00-4c48-96ea-20ff64e14cb7\") " pod="openshift-console/console-6f45474999-htfxv" Jul 02 12:40:03.332836 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:03.332805 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gz9r4\" (UniqueName: \"kubernetes.io/projected/eda6a9a8-1f00-4c48-96ea-20ff64e14cb7-kube-api-access-gz9r4\") pod \"console-6f45474999-htfxv\" (UID: \"eda6a9a8-1f00-4c48-96ea-20ff64e14cb7\") " pod="openshift-console/console-6f45474999-htfxv" Jul 02 12:40:03.495855 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:03.495770 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f45474999-htfxv" Jul 02 12:40:03.641502 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:03.641473 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f45474999-htfxv"] Jul 02 12:40:03.645031 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:40:03.644989 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeda6a9a8_1f00_4c48_96ea_20ff64e14cb7.slice/crio-174cfe9271d124af39e3cf89bdd1ff3459b83767728f4fd54d057d4087b31ac5 WatchSource:0}: Error finding container 174cfe9271d124af39e3cf89bdd1ff3459b83767728f4fd54d057d4087b31ac5: Status 404 returned error can't find the container with id 174cfe9271d124af39e3cf89bdd1ff3459b83767728f4fd54d057d4087b31ac5 Jul 02 12:40:04.039564 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.039523 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f45474999-htfxv" event={"ID":"eda6a9a8-1f00-4c48-96ea-20ff64e14cb7","Type":"ContainerStarted","Data":"174cfe9271d124af39e3cf89bdd1ff3459b83767728f4fd54d057d4087b31ac5"} Jul 02 12:40:04.540440 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.540407 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-t2dr7"] Jul 02 12:40:04.543384 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.543366 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-t2dr7" Jul 02 12:40:04.546053 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.545913 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 02 12:40:04.546178 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.546106 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 02 12:40:04.546521 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.546500 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-mj4mk\"" Jul 02 12:40:04.549164 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.549140 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 02 12:40:04.549271 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.549146 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 02 12:40:04.560974 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.560947 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-tplzj"] Jul 02 12:40:04.563616 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.563593 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tplzj" Jul 02 12:40:04.575440 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:40:04.575408 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"node-exporter-dockercfg-jz7sf\" is forbidden: User \"system:node:ip-10-0-140-7.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-140-7.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jz7sf\"" type="*v1.Secret" Jul 02 12:40:04.575440 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:40:04.575409 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"node-exporter-kube-rbac-proxy-config\" is forbidden: User \"system:node:ip-10-0-140-7.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-140-7.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" type="*v1.Secret" Jul 02 12:40:04.575440 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:40:04.575409 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"node-exporter-accelerators-collector-config\" is forbidden: User \"system:node:ip-10-0-140-7.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-140-7.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" type="*v1.ConfigMap" Jul 02 12:40:04.576092 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:40:04.576060 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"node-exporter-tls\" is forbidden: User \"system:node:ip-10-0-140-7.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-140-7.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" type="*v1.Secret" Jul 02 12:40:04.576604 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.576581 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-t2dr7"] Jul 02 12:40:04.633751 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.633716 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a-node-exporter-wtmp\") pod \"node-exporter-tplzj\" (UID: \"f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a\") " pod="openshift-monitoring/node-exporter-tplzj" Jul 02 12:40:04.634047 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.633773 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d03d9c6-9e8f-4f1c-9460-9b96184b8ca5-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-t2dr7\" (UID: \"0d03d9c6-9e8f-4f1c-9460-9b96184b8ca5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-t2dr7" Jul 02 12:40:04.634047 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.633828 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tplzj\" (UID: \"f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a\") " pod="openshift-monitoring/node-exporter-tplzj" Jul 02 12:40:04.634047 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.633868 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a-node-exporter-textfile\") pod \"node-exporter-tplzj\" (UID: \"f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a\") " pod="openshift-monitoring/node-exporter-tplzj" Jul 02 12:40:04.634047 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.633900 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a-node-exporter-tls\") pod \"node-exporter-tplzj\" (UID: \"f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a\") " pod="openshift-monitoring/node-exporter-tplzj" Jul 02 12:40:04.634047 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.633928 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmw4z\" (UniqueName: \"kubernetes.io/projected/f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a-kube-api-access-mmw4z\") pod \"node-exporter-tplzj\" (UID: \"f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a\") " pod="openshift-monitoring/node-exporter-tplzj" Jul 02 12:40:04.634047 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.633974 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a-metrics-client-ca\") pod \"node-exporter-tplzj\" (UID: \"f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a\") " pod="openshift-monitoring/node-exporter-tplzj" Jul 02 12:40:04.634047 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.634001 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0d03d9c6-9e8f-4f1c-9460-9b96184b8ca5-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-t2dr7\" (UID: \"0d03d9c6-9e8f-4f1c-9460-9b96184b8ca5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-t2dr7" Jul 02 12:40:04.634047 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.634025 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a-sys\") pod \"node-exporter-tplzj\" (UID: \"f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a\") " pod="openshift-monitoring/node-exporter-tplzj" Jul 02 12:40:04.634414 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.634056 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d03d9c6-9e8f-4f1c-9460-9b96184b8ca5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-t2dr7\" (UID: \"0d03d9c6-9e8f-4f1c-9460-9b96184b8ca5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-t2dr7" Jul 02 12:40:04.634414 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.634098 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a-node-exporter-accelerators-collector-config\") pod \"node-exporter-tplzj\" (UID: \"f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a\") " pod="openshift-monitoring/node-exporter-tplzj" Jul 02 12:40:04.634414 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.634128 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0d03d9c6-9e8f-4f1c-9460-9b96184b8ca5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-t2dr7\" (UID: \"0d03d9c6-9e8f-4f1c-9460-9b96184b8ca5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-t2dr7" Jul 02 12:40:04.634414 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.634156 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqrn7\" (UniqueName: \"kubernetes.io/projected/0d03d9c6-9e8f-4f1c-9460-9b96184b8ca5-kube-api-access-kqrn7\") pod \"kube-state-metrics-845b954455-t2dr7\" (UID: \"0d03d9c6-9e8f-4f1c-9460-9b96184b8ca5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-t2dr7" Jul 02 12:40:04.634414 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.634188 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a-root\") pod \"node-exporter-tplzj\" (UID: \"f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a\") " pod="openshift-monitoring/node-exporter-tplzj" Jul 02 12:40:04.634414 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.634273 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d03d9c6-9e8f-4f1c-9460-9b96184b8ca5-metrics-client-ca\") pod \"kube-state-metrics-845b954455-t2dr7\" (UID: \"0d03d9c6-9e8f-4f1c-9460-9b96184b8ca5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-t2dr7" Jul 02 12:40:04.735383 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.735347 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0d03d9c6-9e8f-4f1c-9460-9b96184b8ca5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-t2dr7\" (UID: \"0d03d9c6-9e8f-4f1c-9460-9b96184b8ca5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-t2dr7" Jul 02 12:40:04.735571 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.735394 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqrn7\" (UniqueName: \"kubernetes.io/projected/0d03d9c6-9e8f-4f1c-9460-9b96184b8ca5-kube-api-access-kqrn7\") pod \"kube-state-metrics-845b954455-t2dr7\" (UID: \"0d03d9c6-9e8f-4f1c-9460-9b96184b8ca5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-t2dr7" Jul 02 12:40:04.735571 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.735419 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a-root\") pod \"node-exporter-tplzj\" (UID: \"f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a\") " pod="openshift-monitoring/node-exporter-tplzj" Jul 02 12:40:04.735571 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.735466 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d03d9c6-9e8f-4f1c-9460-9b96184b8ca5-metrics-client-ca\") pod \"kube-state-metrics-845b954455-t2dr7\" (UID: \"0d03d9c6-9e8f-4f1c-9460-9b96184b8ca5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-t2dr7" Jul 02 12:40:04.735571 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.735495 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a-node-exporter-wtmp\") pod \"node-exporter-tplzj\" (UID: \"f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a\") " pod="openshift-monitoring/node-exporter-tplzj" Jul 02 12:40:04.735571 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.735530 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d03d9c6-9e8f-4f1c-9460-9b96184b8ca5-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-t2dr7\" (UID: \"0d03d9c6-9e8f-4f1c-9460-9b96184b8ca5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-t2dr7" Jul 02 12:40:04.735571 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.735557 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tplzj\" (UID: \"f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a\") " pod="openshift-monitoring/node-exporter-tplzj" Jul 02 12:40:04.735898 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.735586 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a-node-exporter-textfile\") pod \"node-exporter-tplzj\" (UID: \"f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a\") " pod="openshift-monitoring/node-exporter-tplzj" Jul 02 12:40:04.735898 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.735619 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a-node-exporter-tls\") pod \"node-exporter-tplzj\" (UID: \"f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a\") " pod="openshift-monitoring/node-exporter-tplzj" Jul 02 12:40:04.735898 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.735674 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmw4z\" (UniqueName: \"kubernetes.io/projected/f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a-kube-api-access-mmw4z\") pod \"node-exporter-tplzj\" (UID: \"f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a\") " pod="openshift-monitoring/node-exporter-tplzj" Jul 02 12:40:04.735898 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.735703 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a-metrics-client-ca\") pod \"node-exporter-tplzj\" (UID: \"f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a\") " pod="openshift-monitoring/node-exporter-tplzj" Jul 02 12:40:04.735898 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.735699 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a-node-exporter-wtmp\") pod \"node-exporter-tplzj\" (UID: \"f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a\") " pod="openshift-monitoring/node-exporter-tplzj" Jul 02 12:40:04.735898 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.735734 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0d03d9c6-9e8f-4f1c-9460-9b96184b8ca5-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-t2dr7\" (UID: \"0d03d9c6-9e8f-4f1c-9460-9b96184b8ca5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-t2dr7" Jul 02 12:40:04.735898 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.735762 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a-sys\") pod \"node-exporter-tplzj\" (UID: \"f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a\") " pod="openshift-monitoring/node-exporter-tplzj" Jul 02 12:40:04.735898 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.735800 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d03d9c6-9e8f-4f1c-9460-9b96184b8ca5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-t2dr7\" (UID: \"0d03d9c6-9e8f-4f1c-9460-9b96184b8ca5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-t2dr7" Jul 02 12:40:04.735898 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.735835 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a-node-exporter-accelerators-collector-config\") pod \"node-exporter-tplzj\" (UID: \"f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a\") " pod="openshift-monitoring/node-exporter-tplzj" Jul 02 12:40:04.736342 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:40:04.735723 2582 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 02 12:40:04.736342 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:40:04.735986 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d03d9c6-9e8f-4f1c-9460-9b96184b8ca5-kube-state-metrics-tls podName:0d03d9c6-9e8f-4f1c-9460-9b96184b8ca5 nodeName:}" failed. No retries permitted until 2026-07-02 12:40:05.235965182 +0000 UTC m=+87.136228811 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/0d03d9c6-9e8f-4f1c-9460-9b96184b8ca5-kube-state-metrics-tls") pod "kube-state-metrics-845b954455-t2dr7" (UID: "0d03d9c6-9e8f-4f1c-9460-9b96184b8ca5") : secret "kube-state-metrics-tls" not found Jul 02 12:40:04.736342 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.736044 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a-node-exporter-textfile\") pod \"node-exporter-tplzj\" (UID: \"f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a\") " pod="openshift-monitoring/node-exporter-tplzj" Jul 02 12:40:04.736342 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.736104 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0d03d9c6-9e8f-4f1c-9460-9b96184b8ca5-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-t2dr7\" (UID: \"0d03d9c6-9e8f-4f1c-9460-9b96184b8ca5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-t2dr7" Jul 02 12:40:04.736342 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.736112 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a-sys\") pod \"node-exporter-tplzj\" (UID: \"f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a\") " pod="openshift-monitoring/node-exporter-tplzj" Jul 02 12:40:04.736342 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.735555 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a-root\") pod \"node-exporter-tplzj\" (UID: \"f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a\") " pod="openshift-monitoring/node-exporter-tplzj" Jul 02 12:40:04.736342 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.736213 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0d03d9c6-9e8f-4f1c-9460-9b96184b8ca5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-t2dr7\" (UID: \"0d03d9c6-9e8f-4f1c-9460-9b96184b8ca5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-t2dr7" Jul 02 12:40:04.736342 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.736267 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d03d9c6-9e8f-4f1c-9460-9b96184b8ca5-metrics-client-ca\") pod \"kube-state-metrics-845b954455-t2dr7\" (UID: \"0d03d9c6-9e8f-4f1c-9460-9b96184b8ca5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-t2dr7" Jul 02 12:40:04.736700 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.736486 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a-metrics-client-ca\") pod \"node-exporter-tplzj\" (UID: \"f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a\") " pod="openshift-monitoring/node-exporter-tplzj" Jul 02 12:40:04.738575 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.738550 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d03d9c6-9e8f-4f1c-9460-9b96184b8ca5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-t2dr7\" (UID: \"0d03d9c6-9e8f-4f1c-9460-9b96184b8ca5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-t2dr7" Jul 02 12:40:04.755313 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.755289 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmw4z\" (UniqueName: \"kubernetes.io/projected/f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a-kube-api-access-mmw4z\") pod \"node-exporter-tplzj\" (UID: \"f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a\") " pod="openshift-monitoring/node-exporter-tplzj" Jul 02 12:40:04.758548 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:04.758523 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqrn7\" (UniqueName: \"kubernetes.io/projected/0d03d9c6-9e8f-4f1c-9460-9b96184b8ca5-kube-api-access-kqrn7\") pod \"kube-state-metrics-845b954455-t2dr7\" (UID: \"0d03d9c6-9e8f-4f1c-9460-9b96184b8ca5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-t2dr7" Jul 02 12:40:05.240974 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:05.240920 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d03d9c6-9e8f-4f1c-9460-9b96184b8ca5-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-t2dr7\" (UID: \"0d03d9c6-9e8f-4f1c-9460-9b96184b8ca5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-t2dr7" Jul 02 12:40:05.243970 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:05.243945 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d03d9c6-9e8f-4f1c-9460-9b96184b8ca5-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-t2dr7\" (UID: \"0d03d9c6-9e8f-4f1c-9460-9b96184b8ca5\") " pod="openshift-monitoring/kube-state-metrics-845b954455-t2dr7" Jul 02 12:40:05.433885 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:05.433847 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 02 12:40:05.438548 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:05.438517 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tplzj\" (UID: \"f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a\") " pod="openshift-monitoring/node-exporter-tplzj" Jul 02 12:40:05.454943 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:05.454914 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-t2dr7" Jul 02 12:40:05.630832 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:05.630801 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-t2dr7"] Jul 02 12:40:05.674275 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:05.674247 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jz7sf\"" Jul 02 12:40:05.736509 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:40:05.736472 2582 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: failed to sync secret cache: timed out waiting for the condition Jul 02 12:40:05.736716 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:40:05.736573 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a-node-exporter-tls podName:f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a nodeName:}" failed. No retries permitted until 2026-07-02 12:40:06.236554246 +0000 UTC m=+88.136817876 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a-node-exporter-tls") pod "node-exporter-tplzj" (UID: "f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a") : failed to sync secret cache: timed out waiting for the condition Jul 02 12:40:05.736716 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:40:05.736472 2582 configmap.go:193] Couldn't get configMap openshift-monitoring/node-exporter-accelerators-collector-config: failed to sync configmap cache: timed out waiting for the condition Jul 02 12:40:05.736716 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:40:05.736708 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a-node-exporter-accelerators-collector-config podName:f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a nodeName:}" failed. No retries permitted until 2026-07-02 12:40:06.23668324 +0000 UTC m=+88.136946888 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-accelerators-collector-config" (UniqueName: "kubernetes.io/configmap/f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a-node-exporter-accelerators-collector-config") pod "node-exporter-tplzj" (UID: "f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a") : failed to sync configmap cache: timed out waiting for the condition Jul 02 12:40:05.799948 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:05.799860 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 02 12:40:05.995557 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:05.995513 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 12:40:05.999938 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:05.999916 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:40:06.005399 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.005373 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 02 12:40:06.005707 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.005688 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 02 12:40:06.005819 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.005710 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 02 12:40:06.006079 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.006058 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hprxk\"" Jul 02 12:40:06.006339 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.006313 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 02 12:40:06.006903 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.006887 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 02 12:40:06.009245 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.009225 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 02 12:40:06.014568 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.014548 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 02 12:40:06.014681 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.014582 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 02 12:40:06.016084 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.016059 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 02 12:40:06.022943 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.022858 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 12:40:06.047273 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.047222 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:40:06.047273 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.047262 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-web-config\") pod \"alertmanager-main-0\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:40:06.047487 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.047289 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rptwp\" (UniqueName: \"kubernetes.io/projected/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-kube-api-access-rptwp\") pod \"alertmanager-main-0\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:40:06.047487 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.047334 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:40:06.047487 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.047402 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-config-out\") pod \"alertmanager-main-0\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:40:06.047487 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.047426 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:40:06.047487 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.047450 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:40:06.047781 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.047499 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:40:06.047781 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.047525 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:40:06.047781 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.047556 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:40:06.047781 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.047585 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:40:06.047781 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.047611 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-config-volume\") pod \"alertmanager-main-0\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:40:06.047781 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.047637 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:40:06.148504 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.148423 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-config-out\") pod \"alertmanager-main-0\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:40:06.148504 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.148472 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:40:06.148752 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.148510 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:40:06.148752 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.148567 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:40:06.148752 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.148595 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:40:06.148752 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.148624 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:40:06.148752 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.148672 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:40:06.148752 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.148698 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-config-volume\") pod \"alertmanager-main-0\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:40:06.148752 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.148721 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:40:06.149092 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.148764 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:40:06.149092 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.148790 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-web-config\") pod \"alertmanager-main-0\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:40:06.149092 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.148812 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rptwp\" (UniqueName: \"kubernetes.io/projected/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-kube-api-access-rptwp\") pod \"alertmanager-main-0\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:40:06.149092 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.148870 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:40:06.149287 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.149260 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 02 12:40:06.149909 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.149747 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:40:06.156672 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.153893 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:40:06.156672 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.154134 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:40:06.156672 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.154222 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-config-out\") pod \"alertmanager-main-0\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:40:06.156672 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.154601 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:40:06.156672 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.154975 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-config-volume\") pod \"alertmanager-main-0\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:40:06.156672 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.156094 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:40:06.156672 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.156386 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:40:06.157076 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.156908 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:40:06.162035 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.162003 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:40:06.162240 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.162178 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:40:06.162811 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.162771 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-web-config\") pod \"alertmanager-main-0\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:40:06.168331 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.168308 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rptwp\" (UniqueName: \"kubernetes.io/projected/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-kube-api-access-rptwp\") pod \"alertmanager-main-0\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:40:06.250078 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.250041 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a-node-exporter-tls\") pod \"node-exporter-tplzj\" (UID: \"f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a\") " pod="openshift-monitoring/node-exporter-tplzj" Jul 02 12:40:06.250276 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.250121 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a-node-exporter-accelerators-collector-config\") pod \"node-exporter-tplzj\" (UID: \"f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a\") " pod="openshift-monitoring/node-exporter-tplzj" Jul 02 12:40:06.250715 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.250690 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a-node-exporter-accelerators-collector-config\") pod \"node-exporter-tplzj\" (UID: \"f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a\") " pod="openshift-monitoring/node-exporter-tplzj" Jul 02 12:40:06.252682 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.252636 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a-node-exporter-tls\") pod \"node-exporter-tplzj\" (UID: \"f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a\") " pod="openshift-monitoring/node-exporter-tplzj" Jul 02 12:40:06.312796 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.312748 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:40:06.375846 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.375809 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tplzj" Jul 02 12:40:06.593802 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:40:06.593769 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d03d9c6_9e8f_4f1c_9460_9b96184b8ca5.slice/crio-4589beaa7901a18cf4f6daf71b5da514789117f383f72d544df63c3a130beed1 WatchSource:0}: Error finding container 4589beaa7901a18cf4f6daf71b5da514789117f383f72d544df63c3a130beed1: Status 404 returned error can't find the container with id 4589beaa7901a18cf4f6daf71b5da514789117f383f72d544df63c3a130beed1 Jul 02 12:40:06.605201 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:40:06.605158 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf88cb30b_7df4_4d4f_8b9a_ee754bad0c8a.slice/crio-e59ebed53deb53ae00314df60fa9bb85426d01da6e658c613453b2fbd3494666 WatchSource:0}: Error finding container e59ebed53deb53ae00314df60fa9bb85426d01da6e658c613453b2fbd3494666: Status 404 returned error can't find the container with id e59ebed53deb53ae00314df60fa9bb85426d01da6e658c613453b2fbd3494666 Jul 02 12:40:06.755204 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:06.755177 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 12:40:06.756254 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:40:06.756225 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaa9768c_e49a_4dd0_b8b9_4a10ec82634d.slice/crio-b7b170e314df547c783995cdb596edf4a1adf25663c8911406b5230fb4c1811e WatchSource:0}: Error finding container b7b170e314df547c783995cdb596edf4a1adf25663c8911406b5230fb4c1811e: Status 404 returned error can't find the container with id b7b170e314df547c783995cdb596edf4a1adf25663c8911406b5230fb4c1811e Jul 02 12:40:07.055465 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:07.055428 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-t2dr7" event={"ID":"0d03d9c6-9e8f-4f1c-9460-9b96184b8ca5","Type":"ContainerStarted","Data":"4589beaa7901a18cf4f6daf71b5da514789117f383f72d544df63c3a130beed1"} Jul 02 12:40:07.057222 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:07.057184 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f45474999-htfxv" event={"ID":"eda6a9a8-1f00-4c48-96ea-20ff64e14cb7","Type":"ContainerStarted","Data":"a215042148c53850a84c0ab0c4814a8434be91794a91f7ab8475a4743afe0e17"} Jul 02 12:40:07.058453 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:07.058418 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tplzj" event={"ID":"f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a","Type":"ContainerStarted","Data":"e59ebed53deb53ae00314df60fa9bb85426d01da6e658c613453b2fbd3494666"} Jul 02 12:40:07.059710 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:07.059681 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"daa9768c-e49a-4dd0-b8b9-4a10ec82634d","Type":"ContainerStarted","Data":"b7b170e314df547c783995cdb596edf4a1adf25663c8911406b5230fb4c1811e"} Jul 02 12:40:07.093484 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:07.093421 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f45474999-htfxv" podStartSLOduration=1.109387001 podStartE2EDuration="4.093398229s" totalImagesPullingTime="2.984011228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 12:40:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:40:07.092257957 +0000 UTC m=+88.992521612" watchObservedRunningTime="2026-07-02 12:40:07.093398229 +0000 UTC m=+88.993661882" Jul 02 12:40:07.958765 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:07.958744 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-96668c4f6-h8947" Jul 02 12:40:08.066392 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:08.066359 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-t2dr7" event={"ID":"0d03d9c6-9e8f-4f1c-9460-9b96184b8ca5","Type":"ContainerStarted","Data":"c6baf9a24ddeaea7282d00c1f55fb78ccabb4e0677f0c50061d5a9493a87f974"} Jul 02 12:40:08.066604 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:08.066433 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-t2dr7" event={"ID":"0d03d9c6-9e8f-4f1c-9460-9b96184b8ca5","Type":"ContainerStarted","Data":"3f99c40d30d730388dc64d795bd3477887abdb4ac1e6b51b4651da4a967418a5"} Jul 02 12:40:08.068443 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:08.068201 2582 generic.go:356] "Generic (PLEG): container finished" podID="f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a" containerID="c5d2f20731aa00bee7f8f0e980408cd511bfb41e1e36d6b3115de0f7669504b8" exitCode=0 Jul 02 12:40:08.068443 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:08.068395 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tplzj" event={"ID":"f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a","Type":"ContainerDied","Data":"c5d2f20731aa00bee7f8f0e980408cd511bfb41e1e36d6b3115de0f7669504b8"} Jul 02 12:40:08.955231 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:08.955196 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-69656f596c-zwchc"] Jul 02 12:40:08.957703 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:08.957682 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-69656f596c-zwchc" Jul 02 12:40:08.961092 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:08.961057 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 02 12:40:08.961455 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:08.961057 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-61ruhr6vjb4l0\"" Jul 02 12:40:08.961455 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:08.961141 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-c6hsv\"" Jul 02 12:40:08.961455 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:08.961167 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 02 12:40:08.961455 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:08.961246 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 02 12:40:08.961592 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:08.961484 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 02 12:40:08.973792 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:08.973773 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/50683ab3-1453-4276-8d7a-3b3a7499a918-audit-log\") pod \"metrics-server-69656f596c-zwchc\" (UID: \"50683ab3-1453-4276-8d7a-3b3a7499a918\") " pod="openshift-monitoring/metrics-server-69656f596c-zwchc" Jul 02 12:40:08.973894 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:08.973816 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/50683ab3-1453-4276-8d7a-3b3a7499a918-secret-metrics-server-client-certs\") pod \"metrics-server-69656f596c-zwchc\" (UID: \"50683ab3-1453-4276-8d7a-3b3a7499a918\") " pod="openshift-monitoring/metrics-server-69656f596c-zwchc" Jul 02 12:40:08.973894 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:08.973855 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/50683ab3-1453-4276-8d7a-3b3a7499a918-secret-metrics-server-tls\") pod \"metrics-server-69656f596c-zwchc\" (UID: \"50683ab3-1453-4276-8d7a-3b3a7499a918\") " pod="openshift-monitoring/metrics-server-69656f596c-zwchc" Jul 02 12:40:08.973978 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:08.973899 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/50683ab3-1453-4276-8d7a-3b3a7499a918-metrics-server-audit-profiles\") pod \"metrics-server-69656f596c-zwchc\" (UID: \"50683ab3-1453-4276-8d7a-3b3a7499a918\") " pod="openshift-monitoring/metrics-server-69656f596c-zwchc" Jul 02 12:40:08.973978 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:08.973958 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50683ab3-1453-4276-8d7a-3b3a7499a918-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-69656f596c-zwchc\" (UID: \"50683ab3-1453-4276-8d7a-3b3a7499a918\") " pod="openshift-monitoring/metrics-server-69656f596c-zwchc" Jul 02 12:40:08.974051 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:08.973976 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/50683ab3-1453-4276-8d7a-3b3a7499a918-client-ca-bundle\") pod \"metrics-server-69656f596c-zwchc\" (UID: \"50683ab3-1453-4276-8d7a-3b3a7499a918\") " pod="openshift-monitoring/metrics-server-69656f596c-zwchc" Jul 02 12:40:08.974051 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:08.973995 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29x77\" (UniqueName: \"kubernetes.io/projected/50683ab3-1453-4276-8d7a-3b3a7499a918-kube-api-access-29x77\") pod \"metrics-server-69656f596c-zwchc\" (UID: \"50683ab3-1453-4276-8d7a-3b3a7499a918\") " pod="openshift-monitoring/metrics-server-69656f596c-zwchc" Jul 02 12:40:08.981601 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:08.981577 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-69656f596c-zwchc"] Jul 02 12:40:09.074494 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:09.074400 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/50683ab3-1453-4276-8d7a-3b3a7499a918-secret-metrics-server-client-certs\") pod \"metrics-server-69656f596c-zwchc\" (UID: \"50683ab3-1453-4276-8d7a-3b3a7499a918\") " pod="openshift-monitoring/metrics-server-69656f596c-zwchc" Jul 02 12:40:09.074494 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:09.074464 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/50683ab3-1453-4276-8d7a-3b3a7499a918-secret-metrics-server-tls\") pod \"metrics-server-69656f596c-zwchc\" (UID: \"50683ab3-1453-4276-8d7a-3b3a7499a918\") " pod="openshift-monitoring/metrics-server-69656f596c-zwchc" Jul 02 12:40:09.074759 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:09.074578 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/50683ab3-1453-4276-8d7a-3b3a7499a918-metrics-server-audit-profiles\") pod \"metrics-server-69656f596c-zwchc\" (UID: \"50683ab3-1453-4276-8d7a-3b3a7499a918\") " pod="openshift-monitoring/metrics-server-69656f596c-zwchc" Jul 02 12:40:09.074759 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:09.074615 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50683ab3-1453-4276-8d7a-3b3a7499a918-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-69656f596c-zwchc\" (UID: \"50683ab3-1453-4276-8d7a-3b3a7499a918\") " pod="openshift-monitoring/metrics-server-69656f596c-zwchc" Jul 02 12:40:09.074759 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:09.074640 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/50683ab3-1453-4276-8d7a-3b3a7499a918-client-ca-bundle\") pod \"metrics-server-69656f596c-zwchc\" (UID: \"50683ab3-1453-4276-8d7a-3b3a7499a918\") " pod="openshift-monitoring/metrics-server-69656f596c-zwchc" Jul 02 12:40:09.074759 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:09.074694 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29x77\" (UniqueName: \"kubernetes.io/projected/50683ab3-1453-4276-8d7a-3b3a7499a918-kube-api-access-29x77\") pod \"metrics-server-69656f596c-zwchc\" (UID: \"50683ab3-1453-4276-8d7a-3b3a7499a918\") " pod="openshift-monitoring/metrics-server-69656f596c-zwchc" Jul 02 12:40:09.074759 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:09.074740 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/50683ab3-1453-4276-8d7a-3b3a7499a918-audit-log\") pod \"metrics-server-69656f596c-zwchc\" (UID: \"50683ab3-1453-4276-8d7a-3b3a7499a918\") " pod="openshift-monitoring/metrics-server-69656f596c-zwchc" Jul 02 12:40:09.075101 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:09.075080 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/50683ab3-1453-4276-8d7a-3b3a7499a918-audit-log\") pod \"metrics-server-69656f596c-zwchc\" (UID: \"50683ab3-1453-4276-8d7a-3b3a7499a918\") " pod="openshift-monitoring/metrics-server-69656f596c-zwchc" Jul 02 12:40:09.075173 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:09.075146 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-t2dr7" event={"ID":"0d03d9c6-9e8f-4f1c-9460-9b96184b8ca5","Type":"ContainerStarted","Data":"32819c9a07d45450cee40f640c5d370884a9e872611186bd3d7425d2b99319f4"} Jul 02 12:40:09.075907 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:09.075883 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/50683ab3-1453-4276-8d7a-3b3a7499a918-metrics-server-audit-profiles\") pod \"metrics-server-69656f596c-zwchc\" (UID: \"50683ab3-1453-4276-8d7a-3b3a7499a918\") " pod="openshift-monitoring/metrics-server-69656f596c-zwchc" Jul 02 12:40:09.076124 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:09.076095 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50683ab3-1453-4276-8d7a-3b3a7499a918-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-69656f596c-zwchc\" (UID: \"50683ab3-1453-4276-8d7a-3b3a7499a918\") " pod="openshift-monitoring/metrics-server-69656f596c-zwchc" Jul 02 12:40:09.077418 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:09.077366 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/50683ab3-1453-4276-8d7a-3b3a7499a918-secret-metrics-server-client-certs\") pod \"metrics-server-69656f596c-zwchc\" (UID: \"50683ab3-1453-4276-8d7a-3b3a7499a918\") " pod="openshift-monitoring/metrics-server-69656f596c-zwchc" Jul 02 12:40:09.077590 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:09.077568 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/50683ab3-1453-4276-8d7a-3b3a7499a918-secret-metrics-server-tls\") pod \"metrics-server-69656f596c-zwchc\" (UID: \"50683ab3-1453-4276-8d7a-3b3a7499a918\") " pod="openshift-monitoring/metrics-server-69656f596c-zwchc" Jul 02 12:40:09.077676 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:09.077586 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/50683ab3-1453-4276-8d7a-3b3a7499a918-client-ca-bundle\") pod \"metrics-server-69656f596c-zwchc\" (UID: \"50683ab3-1453-4276-8d7a-3b3a7499a918\") " pod="openshift-monitoring/metrics-server-69656f596c-zwchc" Jul 02 12:40:09.077921 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:09.077895 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tplzj" event={"ID":"f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a","Type":"ContainerStarted","Data":"96f42c789b8da6a246fcf564e7e327ae4dbb6455fb713d0a3a0410f29527963c"} Jul 02 12:40:09.078023 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:09.077951 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tplzj" event={"ID":"f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a","Type":"ContainerStarted","Data":"b48aaf3c645fb217b69de12e6090892b9966f50f92b27eb5a2c3e2a6da6f350c"} Jul 02 12:40:09.079276 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:09.079252 2582 generic.go:356] "Generic (PLEG): container finished" podID="daa9768c-e49a-4dd0-b8b9-4a10ec82634d" containerID="c63867a4424e6059368653b932ca922e3edfd7553c9e3e03d87448e6f1f648df" exitCode=0 Jul 02 12:40:09.079342 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:09.079293 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"daa9768c-e49a-4dd0-b8b9-4a10ec82634d","Type":"ContainerDied","Data":"c63867a4424e6059368653b932ca922e3edfd7553c9e3e03d87448e6f1f648df"} Jul 02 12:40:09.090572 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:09.090543 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29x77\" (UniqueName: \"kubernetes.io/projected/50683ab3-1453-4276-8d7a-3b3a7499a918-kube-api-access-29x77\") pod \"metrics-server-69656f596c-zwchc\" (UID: \"50683ab3-1453-4276-8d7a-3b3a7499a918\") " pod="openshift-monitoring/metrics-server-69656f596c-zwchc" Jul 02 12:40:09.107487 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:09.107443 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-845b954455-t2dr7" podStartSLOduration=3.841952993 podStartE2EDuration="5.107428875s" totalImagesPullingTime="1.265475882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 12:40:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:40:09.106149947 +0000 UTC m=+91.006413600" watchObservedRunningTime="2026-07-02 12:40:09.107428875 +0000 UTC m=+91.007692557" Jul 02 12:40:09.128433 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:09.128378 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-tplzj" podStartSLOduration=3.801874638 podStartE2EDuration="5.128359304s" totalImagesPullingTime="1.240178292s" totalInitContainerRuntime="86.306374ms" isStatefulPod=true podCreationTimestamp="2026-07-02 12:40:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:40:09.12800309 +0000 UTC m=+91.028266752" watchObservedRunningTime="2026-07-02 12:40:09.128359304 +0000 UTC m=+91.028622956" Jul 02 12:40:09.268626 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:09.268572 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-69656f596c-zwchc" Jul 02 12:40:09.341553 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:09.341476 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f45474999-htfxv"] Jul 02 12:40:09.453960 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:09.453934 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-69656f596c-zwchc"] Jul 02 12:40:09.455560 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:40:09.455540 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50683ab3_1453_4276_8d7a_3b3a7499a918.slice/crio-12fbcb91b7a1b8af462861dee639084d07d55ed9a638d9435f696f2c7bd3ba9b WatchSource:0}: Error finding container 12fbcb91b7a1b8af462861dee639084d07d55ed9a638d9435f696f2c7bd3ba9b: Status 404 returned error can't find the container with id 12fbcb91b7a1b8af462861dee639084d07d55ed9a638d9435f696f2c7bd3ba9b Jul 02 12:40:10.085464 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:10.085425 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-69656f596c-zwchc" event={"ID":"50683ab3-1453-4276-8d7a-3b3a7499a918","Type":"ContainerStarted","Data":"12fbcb91b7a1b8af462861dee639084d07d55ed9a638d9435f696f2c7bd3ba9b"} Jul 02 12:40:12.096720 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:12.096679 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-69656f596c-zwchc" event={"ID":"50683ab3-1453-4276-8d7a-3b3a7499a918","Type":"ContainerStarted","Data":"71cc010368256ce1460022164ac4195ec09674bf63c366f63058f5ec9a6e9510"} Jul 02 12:40:12.099969 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:12.099942 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"daa9768c-e49a-4dd0-b8b9-4a10ec82634d","Type":"ContainerStarted","Data":"d92e06472b7ae9d2f7d425741d750a2ccb1e1085909cb7b65c09e5cf4536e283"} Jul 02 12:40:12.100071 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:12.100012 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"daa9768c-e49a-4dd0-b8b9-4a10ec82634d","Type":"ContainerStarted","Data":"6a97a659f3646f9cbb16d79b48f8bf131d2f79c0c87aebdd276ddf67991c35db"} Jul 02 12:40:12.100071 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:12.100052 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"daa9768c-e49a-4dd0-b8b9-4a10ec82634d","Type":"ContainerStarted","Data":"fb12388c6397a0fecf90839a36c2a8f55f02bf5d7f5a1da7c482c1641cea8fe3"} Jul 02 12:40:12.100158 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:12.100090 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"daa9768c-e49a-4dd0-b8b9-4a10ec82634d","Type":"ContainerStarted","Data":"276d72b75ed3fb541a44291cff3e2444b44f513260b7aaa3bd60b76f55a72901"} Jul 02 12:40:12.100158 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:12.100129 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"daa9768c-e49a-4dd0-b8b9-4a10ec82634d","Type":"ContainerStarted","Data":"260b876f8211be17666194978b728b84559e2e404e27c73fa404e35f6642ff5a"} Jul 02 12:40:12.127239 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:12.127175 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-69656f596c-zwchc" podStartSLOduration=1.9361058629999999 podStartE2EDuration="4.12715323s" totalImagesPullingTime="2.191047367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 12:40:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:40:12.125969456 +0000 UTC m=+94.026233110" watchObservedRunningTime="2026-07-02 12:40:12.12715323 +0000 UTC m=+94.027416883" Jul 02 12:40:12.153999 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:12.153926 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-96668c4f6-h8947"] Jul 02 12:40:13.107541 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:13.107497 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"daa9768c-e49a-4dd0-b8b9-4a10ec82634d","Type":"ContainerStarted","Data":"d1b8b7b342cc9792d43919e8da43c0462496bde9f87efb7d83d811bcacbd46f7"} Jul 02 12:40:13.144482 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:13.144424 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.941713813 podStartE2EDuration="8.144407511s" totalImagesPullingTime="5.187393569s" totalInitContainerRuntime="15.300129ms" isStatefulPod=false podCreationTimestamp="2026-07-02 12:40:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:40:13.141957211 +0000 UTC m=+95.042220873" watchObservedRunningTime="2026-07-02 12:40:13.144407511 +0000 UTC m=+95.044671163" Jul 02 12:40:13.496494 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:13.496448 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f45474999-htfxv" Jul 02 12:40:15.934681 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:15.934634 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zxj89" Jul 02 12:40:29.269091 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:29.269061 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-69656f596c-zwchc" Jul 02 12:40:29.269526 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:29.269118 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-69656f596c-zwchc" Jul 02 12:40:34.365551 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:34.365496 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6f45474999-htfxv" podUID="eda6a9a8-1f00-4c48-96ea-20ff64e14cb7" containerName="console" containerID="cri-o://a215042148c53850a84c0ab0c4814a8434be91794a91f7ab8475a4743afe0e17" gracePeriod=15 Jul 02 12:40:34.613283 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:34.613250 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f45474999-htfxv" Jul 02 12:40:34.702667 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:34.702632 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eda6a9a8-1f00-4c48-96ea-20ff64e14cb7-console-config\") pod \"eda6a9a8-1f00-4c48-96ea-20ff64e14cb7\" (UID: \"eda6a9a8-1f00-4c48-96ea-20ff64e14cb7\") " Jul 02 12:40:34.702859 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:34.702688 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eda6a9a8-1f00-4c48-96ea-20ff64e14cb7-console-oauth-config\") pod \"eda6a9a8-1f00-4c48-96ea-20ff64e14cb7\" (UID: \"eda6a9a8-1f00-4c48-96ea-20ff64e14cb7\") " Jul 02 12:40:34.702859 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:34.702720 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eda6a9a8-1f00-4c48-96ea-20ff64e14cb7-service-ca\") pod \"eda6a9a8-1f00-4c48-96ea-20ff64e14cb7\" (UID: \"eda6a9a8-1f00-4c48-96ea-20ff64e14cb7\") " Jul 02 12:40:34.702859 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:34.702743 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gz9r4\" (UniqueName: \"kubernetes.io/projected/eda6a9a8-1f00-4c48-96ea-20ff64e14cb7-kube-api-access-gz9r4\") pod \"eda6a9a8-1f00-4c48-96ea-20ff64e14cb7\" (UID: \"eda6a9a8-1f00-4c48-96ea-20ff64e14cb7\") " Jul 02 12:40:34.702859 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:34.702839 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eda6a9a8-1f00-4c48-96ea-20ff64e14cb7-console-serving-cert\") pod \"eda6a9a8-1f00-4c48-96ea-20ff64e14cb7\" (UID: \"eda6a9a8-1f00-4c48-96ea-20ff64e14cb7\") " Jul 02 12:40:34.703077 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:34.702919 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eda6a9a8-1f00-4c48-96ea-20ff64e14cb7-oauth-serving-cert\") pod \"eda6a9a8-1f00-4c48-96ea-20ff64e14cb7\" (UID: \"eda6a9a8-1f00-4c48-96ea-20ff64e14cb7\") " Jul 02 12:40:34.703207 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:34.703164 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eda6a9a8-1f00-4c48-96ea-20ff64e14cb7-console-config" (OuterVolumeSpecName: "console-config") pod "eda6a9a8-1f00-4c48-96ea-20ff64e14cb7" (UID: "eda6a9a8-1f00-4c48-96ea-20ff64e14cb7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 12:40:34.703287 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:34.703258 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eda6a9a8-1f00-4c48-96ea-20ff64e14cb7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "eda6a9a8-1f00-4c48-96ea-20ff64e14cb7" (UID: "eda6a9a8-1f00-4c48-96ea-20ff64e14cb7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 12:40:34.703359 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:34.703340 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eda6a9a8-1f00-4c48-96ea-20ff64e14cb7-service-ca" (OuterVolumeSpecName: "service-ca") pod "eda6a9a8-1f00-4c48-96ea-20ff64e14cb7" (UID: "eda6a9a8-1f00-4c48-96ea-20ff64e14cb7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 12:40:34.705012 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:34.704989 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eda6a9a8-1f00-4c48-96ea-20ff64e14cb7-kube-api-access-gz9r4" (OuterVolumeSpecName: "kube-api-access-gz9r4") pod "eda6a9a8-1f00-4c48-96ea-20ff64e14cb7" (UID: "eda6a9a8-1f00-4c48-96ea-20ff64e14cb7"). InnerVolumeSpecName "kube-api-access-gz9r4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 12:40:34.705369 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:34.705333 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eda6a9a8-1f00-4c48-96ea-20ff64e14cb7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "eda6a9a8-1f00-4c48-96ea-20ff64e14cb7" (UID: "eda6a9a8-1f00-4c48-96ea-20ff64e14cb7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 12:40:34.705465 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:34.705362 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eda6a9a8-1f00-4c48-96ea-20ff64e14cb7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "eda6a9a8-1f00-4c48-96ea-20ff64e14cb7" (UID: "eda6a9a8-1f00-4c48-96ea-20ff64e14cb7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 12:40:34.804295 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:34.804260 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eda6a9a8-1f00-4c48-96ea-20ff64e14cb7-oauth-serving-cert\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:40:34.804295 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:34.804287 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eda6a9a8-1f00-4c48-96ea-20ff64e14cb7-console-config\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:40:34.804295 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:34.804296 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eda6a9a8-1f00-4c48-96ea-20ff64e14cb7-console-oauth-config\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:40:34.804295 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:34.804304 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eda6a9a8-1f00-4c48-96ea-20ff64e14cb7-service-ca\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:40:34.804585 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:34.804313 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gz9r4\" (UniqueName: \"kubernetes.io/projected/eda6a9a8-1f00-4c48-96ea-20ff64e14cb7-kube-api-access-gz9r4\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:40:34.804585 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:34.804322 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eda6a9a8-1f00-4c48-96ea-20ff64e14cb7-console-serving-cert\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:40:35.195955 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:35.195925 2582 generic.go:356] "Generic (PLEG): container finished" podID="eda6a9a8-1f00-4c48-96ea-20ff64e14cb7" containerID="a215042148c53850a84c0ab0c4814a8434be91794a91f7ab8475a4743afe0e17" exitCode=0 Jul 02 12:40:35.196114 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:35.195972 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f45474999-htfxv" Jul 02 12:40:35.196114 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:35.196013 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f45474999-htfxv" event={"ID":"eda6a9a8-1f00-4c48-96ea-20ff64e14cb7","Type":"ContainerDied","Data":"a215042148c53850a84c0ab0c4814a8434be91794a91f7ab8475a4743afe0e17"} Jul 02 12:40:35.196114 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:35.196070 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f45474999-htfxv" event={"ID":"eda6a9a8-1f00-4c48-96ea-20ff64e14cb7","Type":"ContainerDied","Data":"174cfe9271d124af39e3cf89bdd1ff3459b83767728f4fd54d057d4087b31ac5"} Jul 02 12:40:35.196114 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:35.196096 2582 scope.go:117] "RemoveContainer" containerID="a215042148c53850a84c0ab0c4814a8434be91794a91f7ab8475a4743afe0e17" Jul 02 12:40:35.205024 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:35.205009 2582 scope.go:117] "RemoveContainer" containerID="a215042148c53850a84c0ab0c4814a8434be91794a91f7ab8475a4743afe0e17" Jul 02 12:40:35.205263 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:40:35.205244 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a215042148c53850a84c0ab0c4814a8434be91794a91f7ab8475a4743afe0e17\": container with ID starting with a215042148c53850a84c0ab0c4814a8434be91794a91f7ab8475a4743afe0e17 not found: ID does not exist" containerID="a215042148c53850a84c0ab0c4814a8434be91794a91f7ab8475a4743afe0e17" Jul 02 12:40:35.205321 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:35.205268 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a215042148c53850a84c0ab0c4814a8434be91794a91f7ab8475a4743afe0e17"} err="failed to get container status \"a215042148c53850a84c0ab0c4814a8434be91794a91f7ab8475a4743afe0e17\": rpc error: code = NotFound desc = could not find container \"a215042148c53850a84c0ab0c4814a8434be91794a91f7ab8475a4743afe0e17\": container with ID starting with a215042148c53850a84c0ab0c4814a8434be91794a91f7ab8475a4743afe0e17 not found: ID does not exist" Jul 02 12:40:35.220741 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:35.217202 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f45474999-htfxv"] Jul 02 12:40:35.223159 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:35.223135 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f45474999-htfxv"] Jul 02 12:40:36.573639 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:36.573605 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eda6a9a8-1f00-4c48-96ea-20ff64e14cb7" path="/var/lib/kubelet/pods/eda6a9a8-1f00-4c48-96ea-20ff64e14cb7/volumes" Jul 02 12:40:37.174874 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:37.174819 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-96668c4f6-h8947" podUID="1012e2f1-8d7b-4cc7-8c6f-edafb06121c0" containerName="registry" containerID="cri-o://defafd4eeddba4cfebe57157d5fd359a69170dcf260959022beeb13ba5272293" gracePeriod=30 Jul 02 12:40:37.429869 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:37.429807 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-96668c4f6-h8947" Jul 02 12:40:37.528170 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:37.528141 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-installation-pull-secrets\") pod \"1012e2f1-8d7b-4cc7-8c6f-edafb06121c0\" (UID: \"1012e2f1-8d7b-4cc7-8c6f-edafb06121c0\") " Jul 02 12:40:37.528372 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:37.528180 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-87fm8\" (UniqueName: \"kubernetes.io/projected/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-kube-api-access-87fm8\") pod \"1012e2f1-8d7b-4cc7-8c6f-edafb06121c0\" (UID: \"1012e2f1-8d7b-4cc7-8c6f-edafb06121c0\") " Jul 02 12:40:37.528372 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:37.528202 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-registry-tls\") pod \"1012e2f1-8d7b-4cc7-8c6f-edafb06121c0\" (UID: \"1012e2f1-8d7b-4cc7-8c6f-edafb06121c0\") " Jul 02 12:40:37.528372 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:37.528257 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-trusted-ca\") pod \"1012e2f1-8d7b-4cc7-8c6f-edafb06121c0\" (UID: \"1012e2f1-8d7b-4cc7-8c6f-edafb06121c0\") " Jul 02 12:40:37.528372 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:37.528293 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-ca-trust-extracted\") pod \"1012e2f1-8d7b-4cc7-8c6f-edafb06121c0\" (UID: \"1012e2f1-8d7b-4cc7-8c6f-edafb06121c0\") " Jul 02 12:40:37.528372 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:37.528319 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-image-registry-private-configuration\") pod \"1012e2f1-8d7b-4cc7-8c6f-edafb06121c0\" (UID: \"1012e2f1-8d7b-4cc7-8c6f-edafb06121c0\") " Jul 02 12:40:37.528637 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:37.528434 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-registry-certificates\") pod \"1012e2f1-8d7b-4cc7-8c6f-edafb06121c0\" (UID: \"1012e2f1-8d7b-4cc7-8c6f-edafb06121c0\") " Jul 02 12:40:37.528637 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:37.528466 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-bound-sa-token\") pod \"1012e2f1-8d7b-4cc7-8c6f-edafb06121c0\" (UID: \"1012e2f1-8d7b-4cc7-8c6f-edafb06121c0\") " Jul 02 12:40:37.528818 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:37.528788 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "1012e2f1-8d7b-4cc7-8c6f-edafb06121c0" (UID: "1012e2f1-8d7b-4cc7-8c6f-edafb06121c0"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 12:40:37.529200 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:37.529175 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "1012e2f1-8d7b-4cc7-8c6f-edafb06121c0" (UID: "1012e2f1-8d7b-4cc7-8c6f-edafb06121c0"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 12:40:37.530908 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:37.530851 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-kube-api-access-87fm8" (OuterVolumeSpecName: "kube-api-access-87fm8") pod "1012e2f1-8d7b-4cc7-8c6f-edafb06121c0" (UID: "1012e2f1-8d7b-4cc7-8c6f-edafb06121c0"). InnerVolumeSpecName "kube-api-access-87fm8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 12:40:37.531034 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:37.530950 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "1012e2f1-8d7b-4cc7-8c6f-edafb06121c0" (UID: "1012e2f1-8d7b-4cc7-8c6f-edafb06121c0"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 12:40:37.531089 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:37.531045 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1012e2f1-8d7b-4cc7-8c6f-edafb06121c0" (UID: "1012e2f1-8d7b-4cc7-8c6f-edafb06121c0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 12:40:37.531089 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:37.531055 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "1012e2f1-8d7b-4cc7-8c6f-edafb06121c0" (UID: "1012e2f1-8d7b-4cc7-8c6f-edafb06121c0"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 12:40:37.531161 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:37.531131 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "1012e2f1-8d7b-4cc7-8c6f-edafb06121c0" (UID: "1012e2f1-8d7b-4cc7-8c6f-edafb06121c0"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 12:40:37.536360 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:37.536334 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "1012e2f1-8d7b-4cc7-8c6f-edafb06121c0" (UID: "1012e2f1-8d7b-4cc7-8c6f-edafb06121c0"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 12:40:37.629362 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:37.629321 2582 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-installation-pull-secrets\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:40:37.629362 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:37.629354 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-87fm8\" (UniqueName: \"kubernetes.io/projected/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-kube-api-access-87fm8\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:40:37.629362 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:37.629364 2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-registry-tls\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:40:37.629362 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:37.629372 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-trusted-ca\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:40:37.629865 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:37.629382 2582 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-ca-trust-extracted\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:40:37.629865 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:37.629392 2582 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-image-registry-private-configuration\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:40:37.629865 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:37.629402 2582 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-registry-certificates\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:40:37.629865 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:37.629410 2582 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0-bound-sa-token\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:40:38.209088 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:38.209054 2582 generic.go:356] "Generic (PLEG): container finished" podID="1012e2f1-8d7b-4cc7-8c6f-edafb06121c0" containerID="defafd4eeddba4cfebe57157d5fd359a69170dcf260959022beeb13ba5272293" exitCode=0 Jul 02 12:40:38.209267 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:38.209103 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-96668c4f6-h8947" Jul 02 12:40:38.209267 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:38.209144 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-96668c4f6-h8947" event={"ID":"1012e2f1-8d7b-4cc7-8c6f-edafb06121c0","Type":"ContainerDied","Data":"defafd4eeddba4cfebe57157d5fd359a69170dcf260959022beeb13ba5272293"} Jul 02 12:40:38.209267 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:38.209200 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-96668c4f6-h8947" event={"ID":"1012e2f1-8d7b-4cc7-8c6f-edafb06121c0","Type":"ContainerDied","Data":"72d66acce78ff60571ea8fbb7acfca8f6653fb3bf5a5f3f8d54d1d06f59e8972"} Jul 02 12:40:38.209267 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:38.209221 2582 scope.go:117] "RemoveContainer" containerID="defafd4eeddba4cfebe57157d5fd359a69170dcf260959022beeb13ba5272293" Jul 02 12:40:38.218051 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:38.218023 2582 scope.go:117] "RemoveContainer" containerID="defafd4eeddba4cfebe57157d5fd359a69170dcf260959022beeb13ba5272293" Jul 02 12:40:38.218309 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:40:38.218291 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"defafd4eeddba4cfebe57157d5fd359a69170dcf260959022beeb13ba5272293\": container with ID starting with defafd4eeddba4cfebe57157d5fd359a69170dcf260959022beeb13ba5272293 not found: ID does not exist" containerID="defafd4eeddba4cfebe57157d5fd359a69170dcf260959022beeb13ba5272293" Jul 02 12:40:38.218355 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:38.218318 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"defafd4eeddba4cfebe57157d5fd359a69170dcf260959022beeb13ba5272293"} err="failed to get container status \"defafd4eeddba4cfebe57157d5fd359a69170dcf260959022beeb13ba5272293\": rpc error: code = NotFound desc = could not find container \"defafd4eeddba4cfebe57157d5fd359a69170dcf260959022beeb13ba5272293\": container with ID starting with defafd4eeddba4cfebe57157d5fd359a69170dcf260959022beeb13ba5272293 not found: ID does not exist" Jul 02 12:40:38.234750 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:38.234726 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-96668c4f6-h8947"] Jul 02 12:40:38.236122 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:38.236102 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-96668c4f6-h8947"] Jul 02 12:40:38.574624 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:38.574596 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1012e2f1-8d7b-4cc7-8c6f-edafb06121c0" path="/var/lib/kubelet/pods/1012e2f1-8d7b-4cc7-8c6f-edafb06121c0/volumes" Jul 02 12:40:49.250946 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:49.250909 2582 generic.go:356] "Generic (PLEG): container finished" podID="a21ecc40-b3d7-452d-9341-1658114a945c" containerID="0e1c1b7f0dcdcee9df5a7b6fbd68a979ac8f400af26a00938255156d730340c3" exitCode=0 Jul 02 12:40:49.251328 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:49.250982 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2s7pm" event={"ID":"a21ecc40-b3d7-452d-9341-1658114a945c","Type":"ContainerDied","Data":"0e1c1b7f0dcdcee9df5a7b6fbd68a979ac8f400af26a00938255156d730340c3"} Jul 02 12:40:49.251328 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:49.251276 2582 scope.go:117] "RemoveContainer" containerID="0e1c1b7f0dcdcee9df5a7b6fbd68a979ac8f400af26a00938255156d730340c3" Jul 02 12:40:49.275041 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:49.275007 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-69656f596c-zwchc" Jul 02 12:40:49.279420 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:49.279395 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-69656f596c-zwchc" Jul 02 12:40:50.257549 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:50.257512 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-2s7pm" event={"ID":"a21ecc40-b3d7-452d-9341-1658114a945c","Type":"ContainerStarted","Data":"c90489440dc5eb96f484d39328d12e26e41d6ee65ff4ab8adf3d6156a70a4aca"} Jul 02 12:40:54.274892 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:54.274860 2582 generic.go:356] "Generic (PLEG): container finished" podID="277a2422-2cbc-4e30-976a-08d93cdfb549" containerID="9246b91cd70779fe252593750b4dacf4067aea2eb7a249f72ac50b722df5f940" exitCode=0 Jul 02 12:40:54.275276 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:54.274897 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-s8cdk" event={"ID":"277a2422-2cbc-4e30-976a-08d93cdfb549","Type":"ContainerDied","Data":"9246b91cd70779fe252593750b4dacf4067aea2eb7a249f72ac50b722df5f940"} Jul 02 12:40:54.275276 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:54.275201 2582 scope.go:117] "RemoveContainer" containerID="9246b91cd70779fe252593750b4dacf4067aea2eb7a249f72ac50b722df5f940" Jul 02 12:40:55.280573 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:55.280535 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-s8cdk" event={"ID":"277a2422-2cbc-4e30-976a-08d93cdfb549","Type":"ContainerStarted","Data":"274fe9b1da909ac905603d66ed4101026e859aa6ee81f7c8cc0caa55bf232146"} Jul 02 12:40:59.296289 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:59.296252 2582 generic.go:356] "Generic (PLEG): container finished" podID="a26b3699-7f1b-41b6-8451-0fe9c95aa096" containerID="51d12a87db98f62e7d0dd13a1dda58015b5486ed298f29db1b543dccb5f06a45" exitCode=0 Jul 02 12:40:59.296704 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:59.296328 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-fv6k7" event={"ID":"a26b3699-7f1b-41b6-8451-0fe9c95aa096","Type":"ContainerDied","Data":"51d12a87db98f62e7d0dd13a1dda58015b5486ed298f29db1b543dccb5f06a45"} Jul 02 12:40:59.296704 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:40:59.296690 2582 scope.go:117] "RemoveContainer" containerID="51d12a87db98f62e7d0dd13a1dda58015b5486ed298f29db1b543dccb5f06a45" Jul 02 12:41:00.301575 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:00.301539 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-fv6k7" event={"ID":"a26b3699-7f1b-41b6-8451-0fe9c95aa096","Type":"ContainerStarted","Data":"8102911f60e16b2a6e822e379c522d9fc9bdbf618bc0f36e72cba0932d4b7562"} Jul 02 12:41:24.961181 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:24.961142 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 12:41:24.961679 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:24.961534 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="daa9768c-e49a-4dd0-b8b9-4a10ec82634d" containerName="alertmanager" containerID="cri-o://260b876f8211be17666194978b728b84559e2e404e27c73fa404e35f6642ff5a" gracePeriod=120 Jul 02 12:41:24.961679 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:24.961576 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="daa9768c-e49a-4dd0-b8b9-4a10ec82634d" containerName="kube-rbac-proxy-metric" containerID="cri-o://d92e06472b7ae9d2f7d425741d750a2ccb1e1085909cb7b65c09e5cf4536e283" gracePeriod=120 Jul 02 12:41:24.961679 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:24.961600 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="daa9768c-e49a-4dd0-b8b9-4a10ec82634d" containerName="prom-label-proxy" containerID="cri-o://d1b8b7b342cc9792d43919e8da43c0462496bde9f87efb7d83d811bcacbd46f7" gracePeriod=120 Jul 02 12:41:24.961679 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:24.961628 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="daa9768c-e49a-4dd0-b8b9-4a10ec82634d" containerName="kube-rbac-proxy" containerID="cri-o://6a97a659f3646f9cbb16d79b48f8bf131d2f79c0c87aebdd276ddf67991c35db" gracePeriod=120 Jul 02 12:41:24.961930 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:24.961606 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="daa9768c-e49a-4dd0-b8b9-4a10ec82634d" containerName="kube-rbac-proxy-web" containerID="cri-o://fb12388c6397a0fecf90839a36c2a8f55f02bf5d7f5a1da7c482c1641cea8fe3" gracePeriod=120 Jul 02 12:41:24.961930 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:24.961672 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="daa9768c-e49a-4dd0-b8b9-4a10ec82634d" containerName="config-reloader" containerID="cri-o://276d72b75ed3fb541a44291cff3e2444b44f513260b7aaa3bd60b76f55a72901" gracePeriod=120 Jul 02 12:41:25.404272 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:25.404181 2582 generic.go:356] "Generic (PLEG): container finished" podID="daa9768c-e49a-4dd0-b8b9-4a10ec82634d" containerID="d1b8b7b342cc9792d43919e8da43c0462496bde9f87efb7d83d811bcacbd46f7" exitCode=0 Jul 02 12:41:25.404272 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:25.404208 2582 generic.go:356] "Generic (PLEG): container finished" podID="daa9768c-e49a-4dd0-b8b9-4a10ec82634d" containerID="6a97a659f3646f9cbb16d79b48f8bf131d2f79c0c87aebdd276ddf67991c35db" exitCode=0 Jul 02 12:41:25.404272 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:25.404217 2582 generic.go:356] "Generic (PLEG): container finished" podID="daa9768c-e49a-4dd0-b8b9-4a10ec82634d" containerID="276d72b75ed3fb541a44291cff3e2444b44f513260b7aaa3bd60b76f55a72901" exitCode=0 Jul 02 12:41:25.404272 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:25.404224 2582 generic.go:356] "Generic (PLEG): container finished" podID="daa9768c-e49a-4dd0-b8b9-4a10ec82634d" containerID="260b876f8211be17666194978b728b84559e2e404e27c73fa404e35f6642ff5a" exitCode=0 Jul 02 12:41:25.404272 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:25.404250 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"daa9768c-e49a-4dd0-b8b9-4a10ec82634d","Type":"ContainerDied","Data":"d1b8b7b342cc9792d43919e8da43c0462496bde9f87efb7d83d811bcacbd46f7"} Jul 02 12:41:25.404546 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:25.404314 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"daa9768c-e49a-4dd0-b8b9-4a10ec82634d","Type":"ContainerDied","Data":"6a97a659f3646f9cbb16d79b48f8bf131d2f79c0c87aebdd276ddf67991c35db"} Jul 02 12:41:25.404546 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:25.404339 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"daa9768c-e49a-4dd0-b8b9-4a10ec82634d","Type":"ContainerDied","Data":"276d72b75ed3fb541a44291cff3e2444b44f513260b7aaa3bd60b76f55a72901"} Jul 02 12:41:25.404546 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:25.404363 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"daa9768c-e49a-4dd0-b8b9-4a10ec82634d","Type":"ContainerDied","Data":"260b876f8211be17666194978b728b84559e2e404e27c73fa404e35f6642ff5a"} Jul 02 12:41:26.205992 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.205965 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:41:26.331102 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.331021 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-secret-alertmanager-kube-rbac-proxy-web\") pod \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " Jul 02 12:41:26.331102 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.331054 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-web-config\") pod \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " Jul 02 12:41:26.331102 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.331081 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-alertmanager-main-db\") pod \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " Jul 02 12:41:26.331350 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.331108 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rptwp\" (UniqueName: \"kubernetes.io/projected/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-kube-api-access-rptwp\") pod \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " Jul 02 12:41:26.331350 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.331134 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-config-out\") pod \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " Jul 02 12:41:26.331350 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.331148 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-secret-alertmanager-kube-rbac-proxy\") pod \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " Jul 02 12:41:26.331350 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.331175 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-config-volume\") pod \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " Jul 02 12:41:26.331350 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.331203 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-alertmanager-trusted-ca-bundle\") pod \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " Jul 02 12:41:26.331350 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.331264 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-secret-alertmanager-main-tls\") pod \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " Jul 02 12:41:26.331350 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.331293 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-metrics-client-ca\") pod \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " Jul 02 12:41:26.331350 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.331338 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-cluster-tls-config\") pod \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " Jul 02 12:41:26.331812 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.331369 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-tls-assets\") pod \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " Jul 02 12:41:26.331812 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.331394 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\" (UID: \"daa9768c-e49a-4dd0-b8b9-4a10ec82634d\") " Jul 02 12:41:26.331812 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.331539 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "daa9768c-e49a-4dd0-b8b9-4a10ec82634d" (UID: "daa9768c-e49a-4dd0-b8b9-4a10ec82634d"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 12:41:26.331978 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.331957 2582 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-alertmanager-main-db\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:41:26.332383 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.332357 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "daa9768c-e49a-4dd0-b8b9-4a10ec82634d" (UID: "daa9768c-e49a-4dd0-b8b9-4a10ec82634d"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 12:41:26.332765 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.332739 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "daa9768c-e49a-4dd0-b8b9-4a10ec82634d" (UID: "daa9768c-e49a-4dd0-b8b9-4a10ec82634d"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 12:41:26.334016 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.333981 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "daa9768c-e49a-4dd0-b8b9-4a10ec82634d" (UID: "daa9768c-e49a-4dd0-b8b9-4a10ec82634d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 12:41:26.334421 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.334306 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "daa9768c-e49a-4dd0-b8b9-4a10ec82634d" (UID: "daa9768c-e49a-4dd0-b8b9-4a10ec82634d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 12:41:26.334421 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.334351 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-config-volume" (OuterVolumeSpecName: "config-volume") pod "daa9768c-e49a-4dd0-b8b9-4a10ec82634d" (UID: "daa9768c-e49a-4dd0-b8b9-4a10ec82634d"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 12:41:26.334421 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.334374 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-kube-api-access-rptwp" (OuterVolumeSpecName: "kube-api-access-rptwp") pod "daa9768c-e49a-4dd0-b8b9-4a10ec82634d" (UID: "daa9768c-e49a-4dd0-b8b9-4a10ec82634d"). InnerVolumeSpecName "kube-api-access-rptwp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 12:41:26.334674 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.334634 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "daa9768c-e49a-4dd0-b8b9-4a10ec82634d" (UID: "daa9768c-e49a-4dd0-b8b9-4a10ec82634d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 12:41:26.334991 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.334958 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-config-out" (OuterVolumeSpecName: "config-out") pod "daa9768c-e49a-4dd0-b8b9-4a10ec82634d" (UID: "daa9768c-e49a-4dd0-b8b9-4a10ec82634d"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 12:41:26.335091 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.335005 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "daa9768c-e49a-4dd0-b8b9-4a10ec82634d" (UID: "daa9768c-e49a-4dd0-b8b9-4a10ec82634d"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 12:41:26.336446 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.336428 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "daa9768c-e49a-4dd0-b8b9-4a10ec82634d" (UID: "daa9768c-e49a-4dd0-b8b9-4a10ec82634d"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 12:41:26.339770 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.339731 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "daa9768c-e49a-4dd0-b8b9-4a10ec82634d" (UID: "daa9768c-e49a-4dd0-b8b9-4a10ec82634d"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 12:41:26.344572 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.344551 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-web-config" (OuterVolumeSpecName: "web-config") pod "daa9768c-e49a-4dd0-b8b9-4a10ec82634d" (UID: "daa9768c-e49a-4dd0-b8b9-4a10ec82634d"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 12:41:26.411144 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.411112 2582 generic.go:356] "Generic (PLEG): container finished" podID="daa9768c-e49a-4dd0-b8b9-4a10ec82634d" containerID="d92e06472b7ae9d2f7d425741d750a2ccb1e1085909cb7b65c09e5cf4536e283" exitCode=0 Jul 02 12:41:26.411144 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.411139 2582 generic.go:356] "Generic (PLEG): container finished" podID="daa9768c-e49a-4dd0-b8b9-4a10ec82634d" containerID="fb12388c6397a0fecf90839a36c2a8f55f02bf5d7f5a1da7c482c1641cea8fe3" exitCode=0 Jul 02 12:41:26.411308 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.411187 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:41:26.411308 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.411192 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"daa9768c-e49a-4dd0-b8b9-4a10ec82634d","Type":"ContainerDied","Data":"d92e06472b7ae9d2f7d425741d750a2ccb1e1085909cb7b65c09e5cf4536e283"} Jul 02 12:41:26.411308 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.411262 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"daa9768c-e49a-4dd0-b8b9-4a10ec82634d","Type":"ContainerDied","Data":"fb12388c6397a0fecf90839a36c2a8f55f02bf5d7f5a1da7c482c1641cea8fe3"} Jul 02 12:41:26.411308 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.411294 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"daa9768c-e49a-4dd0-b8b9-4a10ec82634d","Type":"ContainerDied","Data":"b7b170e314df547c783995cdb596edf4a1adf25663c8911406b5230fb4c1811e"} Jul 02 12:41:26.411437 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.411324 2582 scope.go:117] "RemoveContainer" containerID="d1b8b7b342cc9792d43919e8da43c0462496bde9f87efb7d83d811bcacbd46f7" Jul 02 12:41:26.419888 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.419873 2582 scope.go:117] "RemoveContainer" containerID="d92e06472b7ae9d2f7d425741d750a2ccb1e1085909cb7b65c09e5cf4536e283" Jul 02 12:41:26.426536 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.426515 2582 scope.go:117] "RemoveContainer" containerID="6a97a659f3646f9cbb16d79b48f8bf131d2f79c0c87aebdd276ddf67991c35db" Jul 02 12:41:26.432767 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.432748 2582 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-web-config\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:41:26.432767 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.432767 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rptwp\" (UniqueName: \"kubernetes.io/projected/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-kube-api-access-rptwp\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:41:26.432933 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.432777 2582 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-config-out\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:41:26.432933 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.432788 2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:41:26.432933 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.432796 2582 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-config-volume\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:41:26.432933 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.432805 2582 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:41:26.432933 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.432813 2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-secret-alertmanager-main-tls\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:41:26.432933 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.432831 2582 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-metrics-client-ca\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:41:26.432933 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.432840 2582 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-cluster-tls-config\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:41:26.432933 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.432850 2582 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-tls-assets\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:41:26.432933 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.432863 2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:41:26.432933 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.432875 2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/daa9768c-e49a-4dd0-b8b9-4a10ec82634d-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:41:26.433383 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.433128 2582 scope.go:117] "RemoveContainer" containerID="fb12388c6397a0fecf90839a36c2a8f55f02bf5d7f5a1da7c482c1641cea8fe3" Jul 02 12:41:26.435410 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.435394 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 12:41:26.439760 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.439741 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 12:41:26.440780 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.440764 2582 scope.go:117] "RemoveContainer" containerID="276d72b75ed3fb541a44291cff3e2444b44f513260b7aaa3bd60b76f55a72901" Jul 02 12:41:26.447384 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.447370 2582 scope.go:117] "RemoveContainer" containerID="260b876f8211be17666194978b728b84559e2e404e27c73fa404e35f6642ff5a" Jul 02 12:41:26.455162 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.455145 2582 scope.go:117] "RemoveContainer" containerID="c63867a4424e6059368653b932ca922e3edfd7553c9e3e03d87448e6f1f648df" Jul 02 12:41:26.462308 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.462285 2582 scope.go:117] "RemoveContainer" containerID="d1b8b7b342cc9792d43919e8da43c0462496bde9f87efb7d83d811bcacbd46f7" Jul 02 12:41:26.462579 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:41:26.462558 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1b8b7b342cc9792d43919e8da43c0462496bde9f87efb7d83d811bcacbd46f7\": container with ID starting with d1b8b7b342cc9792d43919e8da43c0462496bde9f87efb7d83d811bcacbd46f7 not found: ID does not exist" containerID="d1b8b7b342cc9792d43919e8da43c0462496bde9f87efb7d83d811bcacbd46f7" Jul 02 12:41:26.462642 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.462587 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1b8b7b342cc9792d43919e8da43c0462496bde9f87efb7d83d811bcacbd46f7"} err="failed to get container status \"d1b8b7b342cc9792d43919e8da43c0462496bde9f87efb7d83d811bcacbd46f7\": rpc error: code = NotFound desc = could not find container \"d1b8b7b342cc9792d43919e8da43c0462496bde9f87efb7d83d811bcacbd46f7\": container with ID starting with d1b8b7b342cc9792d43919e8da43c0462496bde9f87efb7d83d811bcacbd46f7 not found: ID does not exist" Jul 02 12:41:26.462642 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.462604 2582 scope.go:117] "RemoveContainer" containerID="d92e06472b7ae9d2f7d425741d750a2ccb1e1085909cb7b65c09e5cf4536e283" Jul 02 12:41:26.462882 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:41:26.462864 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d92e06472b7ae9d2f7d425741d750a2ccb1e1085909cb7b65c09e5cf4536e283\": container with ID starting with d92e06472b7ae9d2f7d425741d750a2ccb1e1085909cb7b65c09e5cf4536e283 not found: ID does not exist" containerID="d92e06472b7ae9d2f7d425741d750a2ccb1e1085909cb7b65c09e5cf4536e283" Jul 02 12:41:26.462928 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.462886 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d92e06472b7ae9d2f7d425741d750a2ccb1e1085909cb7b65c09e5cf4536e283"} err="failed to get container status \"d92e06472b7ae9d2f7d425741d750a2ccb1e1085909cb7b65c09e5cf4536e283\": rpc error: code = NotFound desc = could not find container \"d92e06472b7ae9d2f7d425741d750a2ccb1e1085909cb7b65c09e5cf4536e283\": container with ID starting with d92e06472b7ae9d2f7d425741d750a2ccb1e1085909cb7b65c09e5cf4536e283 not found: ID does not exist" Jul 02 12:41:26.462928 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.462899 2582 scope.go:117] "RemoveContainer" containerID="6a97a659f3646f9cbb16d79b48f8bf131d2f79c0c87aebdd276ddf67991c35db" Jul 02 12:41:26.463139 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:41:26.463125 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a97a659f3646f9cbb16d79b48f8bf131d2f79c0c87aebdd276ddf67991c35db\": container with ID starting with 6a97a659f3646f9cbb16d79b48f8bf131d2f79c0c87aebdd276ddf67991c35db not found: ID does not exist" containerID="6a97a659f3646f9cbb16d79b48f8bf131d2f79c0c87aebdd276ddf67991c35db" Jul 02 12:41:26.463194 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.463140 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a97a659f3646f9cbb16d79b48f8bf131d2f79c0c87aebdd276ddf67991c35db"} err="failed to get container status \"6a97a659f3646f9cbb16d79b48f8bf131d2f79c0c87aebdd276ddf67991c35db\": rpc error: code = NotFound desc = could not find container \"6a97a659f3646f9cbb16d79b48f8bf131d2f79c0c87aebdd276ddf67991c35db\": container with ID starting with 6a97a659f3646f9cbb16d79b48f8bf131d2f79c0c87aebdd276ddf67991c35db not found: ID does not exist" Jul 02 12:41:26.463194 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.463151 2582 scope.go:117] "RemoveContainer" containerID="fb12388c6397a0fecf90839a36c2a8f55f02bf5d7f5a1da7c482c1641cea8fe3" Jul 02 12:41:26.463349 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:41:26.463335 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb12388c6397a0fecf90839a36c2a8f55f02bf5d7f5a1da7c482c1641cea8fe3\": container with ID starting with fb12388c6397a0fecf90839a36c2a8f55f02bf5d7f5a1da7c482c1641cea8fe3 not found: ID does not exist" containerID="fb12388c6397a0fecf90839a36c2a8f55f02bf5d7f5a1da7c482c1641cea8fe3" Jul 02 12:41:26.463386 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.463352 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb12388c6397a0fecf90839a36c2a8f55f02bf5d7f5a1da7c482c1641cea8fe3"} err="failed to get container status \"fb12388c6397a0fecf90839a36c2a8f55f02bf5d7f5a1da7c482c1641cea8fe3\": rpc error: code = NotFound desc = could not find container \"fb12388c6397a0fecf90839a36c2a8f55f02bf5d7f5a1da7c482c1641cea8fe3\": container with ID starting with fb12388c6397a0fecf90839a36c2a8f55f02bf5d7f5a1da7c482c1641cea8fe3 not found: ID does not exist" Jul 02 12:41:26.463386 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.463364 2582 scope.go:117] "RemoveContainer" containerID="276d72b75ed3fb541a44291cff3e2444b44f513260b7aaa3bd60b76f55a72901" Jul 02 12:41:26.463597 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:41:26.463578 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"276d72b75ed3fb541a44291cff3e2444b44f513260b7aaa3bd60b76f55a72901\": container with ID starting with 276d72b75ed3fb541a44291cff3e2444b44f513260b7aaa3bd60b76f55a72901 not found: ID does not exist" containerID="276d72b75ed3fb541a44291cff3e2444b44f513260b7aaa3bd60b76f55a72901" Jul 02 12:41:26.463684 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.463608 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"276d72b75ed3fb541a44291cff3e2444b44f513260b7aaa3bd60b76f55a72901"} err="failed to get container status \"276d72b75ed3fb541a44291cff3e2444b44f513260b7aaa3bd60b76f55a72901\": rpc error: code = NotFound desc = could not find container \"276d72b75ed3fb541a44291cff3e2444b44f513260b7aaa3bd60b76f55a72901\": container with ID starting with 276d72b75ed3fb541a44291cff3e2444b44f513260b7aaa3bd60b76f55a72901 not found: ID does not exist" Jul 02 12:41:26.463684 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.463630 2582 scope.go:117] "RemoveContainer" containerID="260b876f8211be17666194978b728b84559e2e404e27c73fa404e35f6642ff5a" Jul 02 12:41:26.463859 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:41:26.463843 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"260b876f8211be17666194978b728b84559e2e404e27c73fa404e35f6642ff5a\": container with ID starting with 260b876f8211be17666194978b728b84559e2e404e27c73fa404e35f6642ff5a not found: ID does not exist" containerID="260b876f8211be17666194978b728b84559e2e404e27c73fa404e35f6642ff5a" Jul 02 12:41:26.463903 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.463862 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"260b876f8211be17666194978b728b84559e2e404e27c73fa404e35f6642ff5a"} err="failed to get container status \"260b876f8211be17666194978b728b84559e2e404e27c73fa404e35f6642ff5a\": rpc error: code = NotFound desc = could not find container \"260b876f8211be17666194978b728b84559e2e404e27c73fa404e35f6642ff5a\": container with ID starting with 260b876f8211be17666194978b728b84559e2e404e27c73fa404e35f6642ff5a not found: ID does not exist" Jul 02 12:41:26.463903 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.463874 2582 scope.go:117] "RemoveContainer" containerID="c63867a4424e6059368653b932ca922e3edfd7553c9e3e03d87448e6f1f648df" Jul 02 12:41:26.464070 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:41:26.464051 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c63867a4424e6059368653b932ca922e3edfd7553c9e3e03d87448e6f1f648df\": container with ID starting with c63867a4424e6059368653b932ca922e3edfd7553c9e3e03d87448e6f1f648df not found: ID does not exist" containerID="c63867a4424e6059368653b932ca922e3edfd7553c9e3e03d87448e6f1f648df" Jul 02 12:41:26.464465 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.464445 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c63867a4424e6059368653b932ca922e3edfd7553c9e3e03d87448e6f1f648df"} err="failed to get container status \"c63867a4424e6059368653b932ca922e3edfd7553c9e3e03d87448e6f1f648df\": rpc error: code = NotFound desc = could not find container \"c63867a4424e6059368653b932ca922e3edfd7553c9e3e03d87448e6f1f648df\": container with ID starting with c63867a4424e6059368653b932ca922e3edfd7553c9e3e03d87448e6f1f648df not found: ID does not exist" Jul 02 12:41:26.464503 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.464467 2582 scope.go:117] "RemoveContainer" containerID="d1b8b7b342cc9792d43919e8da43c0462496bde9f87efb7d83d811bcacbd46f7" Jul 02 12:41:26.464709 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.464693 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1b8b7b342cc9792d43919e8da43c0462496bde9f87efb7d83d811bcacbd46f7"} err="failed to get container status \"d1b8b7b342cc9792d43919e8da43c0462496bde9f87efb7d83d811bcacbd46f7\": rpc error: code = NotFound desc = could not find container \"d1b8b7b342cc9792d43919e8da43c0462496bde9f87efb7d83d811bcacbd46f7\": container with ID starting with d1b8b7b342cc9792d43919e8da43c0462496bde9f87efb7d83d811bcacbd46f7 not found: ID does not exist" Jul 02 12:41:26.464755 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.464710 2582 scope.go:117] "RemoveContainer" containerID="d92e06472b7ae9d2f7d425741d750a2ccb1e1085909cb7b65c09e5cf4536e283" Jul 02 12:41:26.464934 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.464917 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d92e06472b7ae9d2f7d425741d750a2ccb1e1085909cb7b65c09e5cf4536e283"} err="failed to get container status \"d92e06472b7ae9d2f7d425741d750a2ccb1e1085909cb7b65c09e5cf4536e283\": rpc error: code = NotFound desc = could not find container \"d92e06472b7ae9d2f7d425741d750a2ccb1e1085909cb7b65c09e5cf4536e283\": container with ID starting with d92e06472b7ae9d2f7d425741d750a2ccb1e1085909cb7b65c09e5cf4536e283 not found: ID does not exist" Jul 02 12:41:26.464979 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.464934 2582 scope.go:117] "RemoveContainer" containerID="6a97a659f3646f9cbb16d79b48f8bf131d2f79c0c87aebdd276ddf67991c35db" Jul 02 12:41:26.465137 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.465119 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a97a659f3646f9cbb16d79b48f8bf131d2f79c0c87aebdd276ddf67991c35db"} err="failed to get container status \"6a97a659f3646f9cbb16d79b48f8bf131d2f79c0c87aebdd276ddf67991c35db\": rpc error: code = NotFound desc = could not find container \"6a97a659f3646f9cbb16d79b48f8bf131d2f79c0c87aebdd276ddf67991c35db\": container with ID starting with 6a97a659f3646f9cbb16d79b48f8bf131d2f79c0c87aebdd276ddf67991c35db not found: ID does not exist" Jul 02 12:41:26.465205 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.465140 2582 scope.go:117] "RemoveContainer" containerID="fb12388c6397a0fecf90839a36c2a8f55f02bf5d7f5a1da7c482c1641cea8fe3" Jul 02 12:41:26.465372 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.465353 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb12388c6397a0fecf90839a36c2a8f55f02bf5d7f5a1da7c482c1641cea8fe3"} err="failed to get container status \"fb12388c6397a0fecf90839a36c2a8f55f02bf5d7f5a1da7c482c1641cea8fe3\": rpc error: code = NotFound desc = could not find container \"fb12388c6397a0fecf90839a36c2a8f55f02bf5d7f5a1da7c482c1641cea8fe3\": container with ID starting with fb12388c6397a0fecf90839a36c2a8f55f02bf5d7f5a1da7c482c1641cea8fe3 not found: ID does not exist" Jul 02 12:41:26.465421 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.465373 2582 scope.go:117] "RemoveContainer" containerID="276d72b75ed3fb541a44291cff3e2444b44f513260b7aaa3bd60b76f55a72901" Jul 02 12:41:26.465578 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.465561 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"276d72b75ed3fb541a44291cff3e2444b44f513260b7aaa3bd60b76f55a72901"} err="failed to get container status \"276d72b75ed3fb541a44291cff3e2444b44f513260b7aaa3bd60b76f55a72901\": rpc error: code = NotFound desc = could not find container \"276d72b75ed3fb541a44291cff3e2444b44f513260b7aaa3bd60b76f55a72901\": container with ID starting with 276d72b75ed3fb541a44291cff3e2444b44f513260b7aaa3bd60b76f55a72901 not found: ID does not exist" Jul 02 12:41:26.465615 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.465579 2582 scope.go:117] "RemoveContainer" containerID="260b876f8211be17666194978b728b84559e2e404e27c73fa404e35f6642ff5a" Jul 02 12:41:26.465780 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.465766 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"260b876f8211be17666194978b728b84559e2e404e27c73fa404e35f6642ff5a"} err="failed to get container status \"260b876f8211be17666194978b728b84559e2e404e27c73fa404e35f6642ff5a\": rpc error: code = NotFound desc = could not find container \"260b876f8211be17666194978b728b84559e2e404e27c73fa404e35f6642ff5a\": container with ID starting with 260b876f8211be17666194978b728b84559e2e404e27c73fa404e35f6642ff5a not found: ID does not exist" Jul 02 12:41:26.465825 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.465780 2582 scope.go:117] "RemoveContainer" containerID="c63867a4424e6059368653b932ca922e3edfd7553c9e3e03d87448e6f1f648df" Jul 02 12:41:26.465960 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.465942 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c63867a4424e6059368653b932ca922e3edfd7553c9e3e03d87448e6f1f648df"} err="failed to get container status \"c63867a4424e6059368653b932ca922e3edfd7553c9e3e03d87448e6f1f648df\": rpc error: code = NotFound desc = could not find container \"c63867a4424e6059368653b932ca922e3edfd7553c9e3e03d87448e6f1f648df\": container with ID starting with c63867a4424e6059368653b932ca922e3edfd7553c9e3e03d87448e6f1f648df not found: ID does not exist" Jul 02 12:41:26.469096 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.469076 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 12:41:26.469374 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.469357 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="daa9768c-e49a-4dd0-b8b9-4a10ec82634d" containerName="kube-rbac-proxy" Jul 02 12:41:26.469374 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.469373 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="daa9768c-e49a-4dd0-b8b9-4a10ec82634d" containerName="kube-rbac-proxy" Jul 02 12:41:26.469499 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.469382 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="daa9768c-e49a-4dd0-b8b9-4a10ec82634d" containerName="prom-label-proxy" Jul 02 12:41:26.469499 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.469387 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="daa9768c-e49a-4dd0-b8b9-4a10ec82634d" containerName="prom-label-proxy" Jul 02 12:41:26.469499 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.469396 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="daa9768c-e49a-4dd0-b8b9-4a10ec82634d" containerName="alertmanager" Jul 02 12:41:26.469499 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.469401 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="daa9768c-e49a-4dd0-b8b9-4a10ec82634d" containerName="alertmanager" Jul 02 12:41:26.469499 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.469408 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="daa9768c-e49a-4dd0-b8b9-4a10ec82634d" containerName="init-config-reloader" Jul 02 12:41:26.469499 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.469413 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="daa9768c-e49a-4dd0-b8b9-4a10ec82634d" containerName="init-config-reloader" Jul 02 12:41:26.469499 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.469419 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="daa9768c-e49a-4dd0-b8b9-4a10ec82634d" containerName="kube-rbac-proxy-web" Jul 02 12:41:26.469499 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.469424 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="daa9768c-e49a-4dd0-b8b9-4a10ec82634d" containerName="kube-rbac-proxy-web" Jul 02 12:41:26.469499 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.469433 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eda6a9a8-1f00-4c48-96ea-20ff64e14cb7" containerName="console" Jul 02 12:41:26.469499 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.469438 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="eda6a9a8-1f00-4c48-96ea-20ff64e14cb7" containerName="console" Jul 02 12:41:26.469499 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.469446 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1012e2f1-8d7b-4cc7-8c6f-edafb06121c0" containerName="registry" Jul 02 12:41:26.469499 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.469451 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1012e2f1-8d7b-4cc7-8c6f-edafb06121c0" containerName="registry" Jul 02 12:41:26.469499 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.469458 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="daa9768c-e49a-4dd0-b8b9-4a10ec82634d" containerName="config-reloader" Jul 02 12:41:26.469499 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.469464 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="daa9768c-e49a-4dd0-b8b9-4a10ec82634d" containerName="config-reloader" Jul 02 12:41:26.469499 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.469472 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="daa9768c-e49a-4dd0-b8b9-4a10ec82634d" containerName="kube-rbac-proxy-metric" Jul 02 12:41:26.469499 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.469477 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="daa9768c-e49a-4dd0-b8b9-4a10ec82634d" containerName="kube-rbac-proxy-metric" Jul 02 12:41:26.470028 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.469522 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="daa9768c-e49a-4dd0-b8b9-4a10ec82634d" containerName="alertmanager" Jul 02 12:41:26.470028 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.469531 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1012e2f1-8d7b-4cc7-8c6f-edafb06121c0" containerName="registry" Jul 02 12:41:26.470028 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.469537 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="daa9768c-e49a-4dd0-b8b9-4a10ec82634d" containerName="kube-rbac-proxy" Jul 02 12:41:26.470028 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.469544 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="daa9768c-e49a-4dd0-b8b9-4a10ec82634d" containerName="kube-rbac-proxy-web" Jul 02 12:41:26.470028 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.469549 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="daa9768c-e49a-4dd0-b8b9-4a10ec82634d" containerName="prom-label-proxy" Jul 02 12:41:26.470028 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.469554 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="eda6a9a8-1f00-4c48-96ea-20ff64e14cb7" containerName="console" Jul 02 12:41:26.470028 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.469559 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="daa9768c-e49a-4dd0-b8b9-4a10ec82634d" containerName="config-reloader" Jul 02 12:41:26.470028 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.469564 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="daa9768c-e49a-4dd0-b8b9-4a10ec82634d" containerName="kube-rbac-proxy-metric" Jul 02 12:41:26.473186 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.473171 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:41:26.475284 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.475267 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 02 12:41:26.475400 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.475326 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 02 12:41:26.475400 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.475326 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 02 12:41:26.475542 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.475527 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 02 12:41:26.475683 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.475633 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 02 12:41:26.475774 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.475738 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 02 12:41:26.475838 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.475803 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 02 12:41:26.475955 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.475941 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hprxk\"" Jul 02 12:41:26.476087 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.476070 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 02 12:41:26.481451 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.481432 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 02 12:41:26.489193 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.489167 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 12:41:26.577578 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.574602 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="daa9768c-e49a-4dd0-b8b9-4a10ec82634d" path="/var/lib/kubelet/pods/daa9768c-e49a-4dd0-b8b9-4a10ec82634d/volumes" Jul 02 12:41:26.634617 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.634544 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdxkk\" (UniqueName: \"kubernetes.io/projected/870c5db4-143e-4020-b8fa-8117b8ebce9a-kube-api-access-wdxkk\") pod \"alertmanager-main-0\" (UID: \"870c5db4-143e-4020-b8fa-8117b8ebce9a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:41:26.634617 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.634579 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/870c5db4-143e-4020-b8fa-8117b8ebce9a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"870c5db4-143e-4020-b8fa-8117b8ebce9a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:41:26.634617 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.634598 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/870c5db4-143e-4020-b8fa-8117b8ebce9a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"870c5db4-143e-4020-b8fa-8117b8ebce9a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:41:26.634851 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.634647 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/870c5db4-143e-4020-b8fa-8117b8ebce9a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"870c5db4-143e-4020-b8fa-8117b8ebce9a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:41:26.634851 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.634700 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/870c5db4-143e-4020-b8fa-8117b8ebce9a-web-config\") pod \"alertmanager-main-0\" (UID: \"870c5db4-143e-4020-b8fa-8117b8ebce9a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:41:26.634851 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.634719 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/870c5db4-143e-4020-b8fa-8117b8ebce9a-config-volume\") pod \"alertmanager-main-0\" (UID: \"870c5db4-143e-4020-b8fa-8117b8ebce9a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:41:26.634851 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.634735 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/870c5db4-143e-4020-b8fa-8117b8ebce9a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"870c5db4-143e-4020-b8fa-8117b8ebce9a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:41:26.634851 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.634762 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/870c5db4-143e-4020-b8fa-8117b8ebce9a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"870c5db4-143e-4020-b8fa-8117b8ebce9a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:41:26.634851 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.634825 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/870c5db4-143e-4020-b8fa-8117b8ebce9a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"870c5db4-143e-4020-b8fa-8117b8ebce9a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:41:26.634851 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.634841 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/870c5db4-143e-4020-b8fa-8117b8ebce9a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"870c5db4-143e-4020-b8fa-8117b8ebce9a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:41:26.635058 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.634858 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/870c5db4-143e-4020-b8fa-8117b8ebce9a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"870c5db4-143e-4020-b8fa-8117b8ebce9a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:41:26.635058 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.634873 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/870c5db4-143e-4020-b8fa-8117b8ebce9a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"870c5db4-143e-4020-b8fa-8117b8ebce9a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:41:26.635058 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.634935 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/870c5db4-143e-4020-b8fa-8117b8ebce9a-config-out\") pod \"alertmanager-main-0\" (UID: \"870c5db4-143e-4020-b8fa-8117b8ebce9a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:41:26.736236 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.736202 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/870c5db4-143e-4020-b8fa-8117b8ebce9a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"870c5db4-143e-4020-b8fa-8117b8ebce9a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:41:26.736236 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.736239 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/870c5db4-143e-4020-b8fa-8117b8ebce9a-web-config\") pod \"alertmanager-main-0\" (UID: \"870c5db4-143e-4020-b8fa-8117b8ebce9a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:41:26.736447 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.736260 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/870c5db4-143e-4020-b8fa-8117b8ebce9a-config-volume\") pod \"alertmanager-main-0\" (UID: \"870c5db4-143e-4020-b8fa-8117b8ebce9a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:41:26.736447 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.736284 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/870c5db4-143e-4020-b8fa-8117b8ebce9a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"870c5db4-143e-4020-b8fa-8117b8ebce9a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:41:26.736447 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.736311 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/870c5db4-143e-4020-b8fa-8117b8ebce9a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"870c5db4-143e-4020-b8fa-8117b8ebce9a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:41:26.736447 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.736338 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/870c5db4-143e-4020-b8fa-8117b8ebce9a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"870c5db4-143e-4020-b8fa-8117b8ebce9a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:41:26.736447 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.736360 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/870c5db4-143e-4020-b8fa-8117b8ebce9a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"870c5db4-143e-4020-b8fa-8117b8ebce9a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:41:26.736447 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.736382 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/870c5db4-143e-4020-b8fa-8117b8ebce9a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"870c5db4-143e-4020-b8fa-8117b8ebce9a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:41:26.736447 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.736407 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/870c5db4-143e-4020-b8fa-8117b8ebce9a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"870c5db4-143e-4020-b8fa-8117b8ebce9a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:41:26.736447 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.736450 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/870c5db4-143e-4020-b8fa-8117b8ebce9a-config-out\") pod \"alertmanager-main-0\" (UID: \"870c5db4-143e-4020-b8fa-8117b8ebce9a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:41:26.736916 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.736520 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdxkk\" (UniqueName: \"kubernetes.io/projected/870c5db4-143e-4020-b8fa-8117b8ebce9a-kube-api-access-wdxkk\") pod \"alertmanager-main-0\" (UID: \"870c5db4-143e-4020-b8fa-8117b8ebce9a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:41:26.736916 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.736556 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/870c5db4-143e-4020-b8fa-8117b8ebce9a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"870c5db4-143e-4020-b8fa-8117b8ebce9a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:41:26.736916 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.736581 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/870c5db4-143e-4020-b8fa-8117b8ebce9a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"870c5db4-143e-4020-b8fa-8117b8ebce9a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:41:26.737070 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.736968 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/870c5db4-143e-4020-b8fa-8117b8ebce9a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"870c5db4-143e-4020-b8fa-8117b8ebce9a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:41:26.737330 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.737300 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/870c5db4-143e-4020-b8fa-8117b8ebce9a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"870c5db4-143e-4020-b8fa-8117b8ebce9a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:41:26.737722 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.737692 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/870c5db4-143e-4020-b8fa-8117b8ebce9a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"870c5db4-143e-4020-b8fa-8117b8ebce9a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:41:26.739261 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.739234 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/870c5db4-143e-4020-b8fa-8117b8ebce9a-web-config\") pod \"alertmanager-main-0\" (UID: \"870c5db4-143e-4020-b8fa-8117b8ebce9a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:41:26.739369 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.739268 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/870c5db4-143e-4020-b8fa-8117b8ebce9a-config-volume\") pod \"alertmanager-main-0\" (UID: \"870c5db4-143e-4020-b8fa-8117b8ebce9a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:41:26.739459 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.739433 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/870c5db4-143e-4020-b8fa-8117b8ebce9a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"870c5db4-143e-4020-b8fa-8117b8ebce9a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:41:26.739569 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.739547 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/870c5db4-143e-4020-b8fa-8117b8ebce9a-config-out\") pod \"alertmanager-main-0\" (UID: \"870c5db4-143e-4020-b8fa-8117b8ebce9a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:41:26.740042 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.739969 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/870c5db4-143e-4020-b8fa-8117b8ebce9a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"870c5db4-143e-4020-b8fa-8117b8ebce9a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:41:26.740419 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.740397 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/870c5db4-143e-4020-b8fa-8117b8ebce9a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"870c5db4-143e-4020-b8fa-8117b8ebce9a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:41:26.740850 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.740829 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/870c5db4-143e-4020-b8fa-8117b8ebce9a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"870c5db4-143e-4020-b8fa-8117b8ebce9a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:41:26.741193 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.741172 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/870c5db4-143e-4020-b8fa-8117b8ebce9a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"870c5db4-143e-4020-b8fa-8117b8ebce9a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:41:26.741741 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.741720 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/870c5db4-143e-4020-b8fa-8117b8ebce9a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"870c5db4-143e-4020-b8fa-8117b8ebce9a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:41:26.747327 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.747305 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdxkk\" (UniqueName: \"kubernetes.io/projected/870c5db4-143e-4020-b8fa-8117b8ebce9a-kube-api-access-wdxkk\") pod \"alertmanager-main-0\" (UID: \"870c5db4-143e-4020-b8fa-8117b8ebce9a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:41:26.782753 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.782723 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 12:41:26.920304 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:26.920277 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 12:41:26.923719 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:41:26.923693 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod870c5db4_143e_4020_b8fa_8117b8ebce9a.slice/crio-c10f9a5f1a2186246cb9f41a5456deb6a553c91e075d71385f6a39f2b3fc98c1 WatchSource:0}: Error finding container c10f9a5f1a2186246cb9f41a5456deb6a553c91e075d71385f6a39f2b3fc98c1: Status 404 returned error can't find the container with id c10f9a5f1a2186246cb9f41a5456deb6a553c91e075d71385f6a39f2b3fc98c1 Jul 02 12:41:27.417704 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:27.417669 2582 generic.go:356] "Generic (PLEG): container finished" podID="870c5db4-143e-4020-b8fa-8117b8ebce9a" containerID="0657af7e2427206afad8b6dcbf1946bb72797fd184c3bdbe5983d51cb090435c" exitCode=0 Jul 02 12:41:27.418226 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:27.417721 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"870c5db4-143e-4020-b8fa-8117b8ebce9a","Type":"ContainerDied","Data":"0657af7e2427206afad8b6dcbf1946bb72797fd184c3bdbe5983d51cb090435c"} Jul 02 12:41:27.418226 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:27.417767 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"870c5db4-143e-4020-b8fa-8117b8ebce9a","Type":"ContainerStarted","Data":"c10f9a5f1a2186246cb9f41a5456deb6a553c91e075d71385f6a39f2b3fc98c1"} Jul 02 12:41:28.425883 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:28.425846 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"870c5db4-143e-4020-b8fa-8117b8ebce9a","Type":"ContainerStarted","Data":"e9f10780b96cc48716069f1a7b38b44818f9e492110a7e724d94799e2f750141"} Jul 02 12:41:28.426276 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:28.425925 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"870c5db4-143e-4020-b8fa-8117b8ebce9a","Type":"ContainerStarted","Data":"05cf2a0c871e5720e19cd1d753f428e4e44b1d240166a796aa1d036202f8a60a"} Jul 02 12:41:28.426276 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:28.425965 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"870c5db4-143e-4020-b8fa-8117b8ebce9a","Type":"ContainerStarted","Data":"77be117b5030e3eb9c6d4a9dd1cc6b89427d7cd390e164280384851f69ebcbe9"} Jul 02 12:41:28.426276 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:28.426000 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"870c5db4-143e-4020-b8fa-8117b8ebce9a","Type":"ContainerStarted","Data":"1b622711ce3b802cb33af74c4e597b0a14afa10a1bbf926093dc1257bf9bd61e"} Jul 02 12:41:28.426276 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:28.426034 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"870c5db4-143e-4020-b8fa-8117b8ebce9a","Type":"ContainerStarted","Data":"769d873cd41ff25cd7c776fff4383f7e5969bbb16da0d790b12185294a4c6eb5"} Jul 02 12:41:28.426276 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:28.426069 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"870c5db4-143e-4020-b8fa-8117b8ebce9a","Type":"ContainerStarted","Data":"f39edb753faa4fa80d832f6f33d85234d070c4d8c674c60de5adae0b235dca02"} Jul 02 12:41:28.457156 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:28.457083 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.437967993 podStartE2EDuration="2.457069401s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.101408ms" isStatefulPod=false podCreationTimestamp="2026-07-02 12:41:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:41:28.456598728 +0000 UTC m=+170.356862418" watchObservedRunningTime="2026-07-02 12:41:28.457069401 +0000 UTC m=+170.357333053" Jul 02 12:41:28.982795 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:28.982763 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-696b9f5dcf-gh4xn"] Jul 02 12:41:28.986117 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:28.986098 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-696b9f5dcf-gh4xn" Jul 02 12:41:28.988263 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:28.988239 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 02 12:41:28.988405 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:28.988278 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 02 12:41:28.988405 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:28.988359 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 02 12:41:28.988520 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:28.988413 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 02 12:41:28.988703 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:28.988684 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-p25xq\"" Jul 02 12:41:28.988764 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:28.988730 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 02 12:41:28.993902 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:28.993884 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 02 12:41:28.998723 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:28.998703 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-696b9f5dcf-gh4xn"] Jul 02 12:41:29.057372 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:29.057342 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9-telemeter-client-tls\") pod \"telemeter-client-696b9f5dcf-gh4xn\" (UID: \"b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9\") " pod="openshift-monitoring/telemeter-client-696b9f5dcf-gh4xn" Jul 02 12:41:29.057372 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:29.057374 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9-federate-client-tls\") pod \"telemeter-client-696b9f5dcf-gh4xn\" (UID: \"b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9\") " pod="openshift-monitoring/telemeter-client-696b9f5dcf-gh4xn" Jul 02 12:41:29.057640 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:29.057394 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-696b9f5dcf-gh4xn\" (UID: \"b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9\") " pod="openshift-monitoring/telemeter-client-696b9f5dcf-gh4xn" Jul 02 12:41:29.057640 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:29.057438 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5j6l\" (UniqueName: \"kubernetes.io/projected/b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9-kube-api-access-p5j6l\") pod \"telemeter-client-696b9f5dcf-gh4xn\" (UID: \"b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9\") " pod="openshift-monitoring/telemeter-client-696b9f5dcf-gh4xn" Jul 02 12:41:29.057640 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:29.057504 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9-secret-telemeter-client\") pod \"telemeter-client-696b9f5dcf-gh4xn\" (UID: \"b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9\") " pod="openshift-monitoring/telemeter-client-696b9f5dcf-gh4xn" Jul 02 12:41:29.057640 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:29.057535 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-696b9f5dcf-gh4xn\" (UID: \"b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9\") " pod="openshift-monitoring/telemeter-client-696b9f5dcf-gh4xn" Jul 02 12:41:29.057640 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:29.057566 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9-metrics-client-ca\") pod \"telemeter-client-696b9f5dcf-gh4xn\" (UID: \"b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9\") " pod="openshift-monitoring/telemeter-client-696b9f5dcf-gh4xn" Jul 02 12:41:29.057640 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:29.057613 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9-serving-certs-ca-bundle\") pod \"telemeter-client-696b9f5dcf-gh4xn\" (UID: \"b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9\") " pod="openshift-monitoring/telemeter-client-696b9f5dcf-gh4xn" Jul 02 12:41:29.158767 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:29.158725 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9-metrics-client-ca\") pod \"telemeter-client-696b9f5dcf-gh4xn\" (UID: \"b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9\") " pod="openshift-monitoring/telemeter-client-696b9f5dcf-gh4xn" Jul 02 12:41:29.158767 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:29.158771 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9-serving-certs-ca-bundle\") pod \"telemeter-client-696b9f5dcf-gh4xn\" (UID: \"b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9\") " pod="openshift-monitoring/telemeter-client-696b9f5dcf-gh4xn" Jul 02 12:41:29.159019 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:29.158833 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9-telemeter-client-tls\") pod \"telemeter-client-696b9f5dcf-gh4xn\" (UID: \"b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9\") " pod="openshift-monitoring/telemeter-client-696b9f5dcf-gh4xn" Jul 02 12:41:29.159019 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:29.158906 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9-federate-client-tls\") pod \"telemeter-client-696b9f5dcf-gh4xn\" (UID: \"b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9\") " pod="openshift-monitoring/telemeter-client-696b9f5dcf-gh4xn" Jul 02 12:41:29.159019 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:29.158945 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-696b9f5dcf-gh4xn\" (UID: \"b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9\") " pod="openshift-monitoring/telemeter-client-696b9f5dcf-gh4xn" Jul 02 12:41:29.159019 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:29.159006 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5j6l\" (UniqueName: \"kubernetes.io/projected/b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9-kube-api-access-p5j6l\") pod \"telemeter-client-696b9f5dcf-gh4xn\" (UID: \"b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9\") " pod="openshift-monitoring/telemeter-client-696b9f5dcf-gh4xn" Jul 02 12:41:29.159275 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:29.159039 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9-secret-telemeter-client\") pod \"telemeter-client-696b9f5dcf-gh4xn\" (UID: \"b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9\") " pod="openshift-monitoring/telemeter-client-696b9f5dcf-gh4xn" Jul 02 12:41:29.159275 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:29.159066 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-696b9f5dcf-gh4xn\" (UID: \"b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9\") " pod="openshift-monitoring/telemeter-client-696b9f5dcf-gh4xn" Jul 02 12:41:29.159573 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:29.159544 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9-serving-certs-ca-bundle\") pod \"telemeter-client-696b9f5dcf-gh4xn\" (UID: \"b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9\") " pod="openshift-monitoring/telemeter-client-696b9f5dcf-gh4xn" Jul 02 12:41:29.159747 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:29.159720 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9-metrics-client-ca\") pod \"telemeter-client-696b9f5dcf-gh4xn\" (UID: \"b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9\") " pod="openshift-monitoring/telemeter-client-696b9f5dcf-gh4xn" Jul 02 12:41:29.159903 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:29.159879 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-696b9f5dcf-gh4xn\" (UID: \"b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9\") " pod="openshift-monitoring/telemeter-client-696b9f5dcf-gh4xn" Jul 02 12:41:29.161369 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:29.161345 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9-telemeter-client-tls\") pod \"telemeter-client-696b9f5dcf-gh4xn\" (UID: \"b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9\") " pod="openshift-monitoring/telemeter-client-696b9f5dcf-gh4xn" Jul 02 12:41:29.161614 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:29.161593 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9-federate-client-tls\") pod \"telemeter-client-696b9f5dcf-gh4xn\" (UID: \"b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9\") " pod="openshift-monitoring/telemeter-client-696b9f5dcf-gh4xn" Jul 02 12:41:29.161859 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:29.161839 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9-secret-telemeter-client\") pod \"telemeter-client-696b9f5dcf-gh4xn\" (UID: \"b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9\") " pod="openshift-monitoring/telemeter-client-696b9f5dcf-gh4xn" Jul 02 12:41:29.161859 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:29.161848 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-696b9f5dcf-gh4xn\" (UID: \"b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9\") " pod="openshift-monitoring/telemeter-client-696b9f5dcf-gh4xn" Jul 02 12:41:29.166885 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:29.166864 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5j6l\" (UniqueName: \"kubernetes.io/projected/b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9-kube-api-access-p5j6l\") pod \"telemeter-client-696b9f5dcf-gh4xn\" (UID: \"b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9\") " pod="openshift-monitoring/telemeter-client-696b9f5dcf-gh4xn" Jul 02 12:41:29.296963 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:29.296882 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-696b9f5dcf-gh4xn" Jul 02 12:41:29.433390 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:29.433038 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-696b9f5dcf-gh4xn"] Jul 02 12:41:29.438623 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:41:29.438588 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2b1a084_f4ec_4aa5_ba50_0cb7ae34d0c9.slice/crio-9906323a6a476f69e6654aa652349dad7cb9a88124d7c363fa3326998638d240 WatchSource:0}: Error finding container 9906323a6a476f69e6654aa652349dad7cb9a88124d7c363fa3326998638d240: Status 404 returned error can't find the container with id 9906323a6a476f69e6654aa652349dad7cb9a88124d7c363fa3326998638d240 Jul 02 12:41:30.435942 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:30.435854 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-696b9f5dcf-gh4xn" event={"ID":"b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9","Type":"ContainerStarted","Data":"9906323a6a476f69e6654aa652349dad7cb9a88124d7c363fa3326998638d240"} Jul 02 12:41:31.442020 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:31.441985 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-696b9f5dcf-gh4xn" event={"ID":"b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9","Type":"ContainerStarted","Data":"23f4a864d2bcf9eeb0607bec93e0a051d4cba604cb1ca085553b05adbba99c0a"} Jul 02 12:41:32.448320 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:32.448283 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-696b9f5dcf-gh4xn" event={"ID":"b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9","Type":"ContainerStarted","Data":"537fa9572534456a27b4fdc50621a7c5f5a002947b3c35e03dd7e6518c098934"} Jul 02 12:41:32.448724 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:32.448341 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-696b9f5dcf-gh4xn" event={"ID":"b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9","Type":"ContainerStarted","Data":"2ef2992c4bee33e3cbd773458ab128394e49ff09b57593c9aa56dad01e224705"} Jul 02 12:41:32.469906 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:32.469854 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-696b9f5dcf-gh4xn" podStartSLOduration=2.604385869 podStartE2EDuration="4.469835501s" totalImagesPullingTime="1.865449632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 12:41:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:41:32.469259125 +0000 UTC m=+174.369522791" watchObservedRunningTime="2026-07-02 12:41:32.469835501 +0000 UTC m=+174.370099159" Jul 02 12:41:33.203817 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:33.203784 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-765cd9b56-vwwnd"] Jul 02 12:41:33.207272 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:33.207248 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-765cd9b56-vwwnd" Jul 02 12:41:33.210113 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:33.210086 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 02 12:41:33.210113 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:33.210116 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 02 12:41:33.210295 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:33.210132 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 02 12:41:33.210972 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:33.210832 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 02 12:41:33.210972 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:33.210879 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 02 12:41:33.210972 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:33.210885 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 02 12:41:33.210972 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:33.210908 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 02 12:41:33.210972 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:33.210887 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-ftbjz\"" Jul 02 12:41:33.217215 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:33.217193 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 02 12:41:33.221209 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:33.221187 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-765cd9b56-vwwnd"] Jul 02 12:41:33.298013 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:33.297965 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a2c99a8-de5f-4255-8133-e28b92561ac6-service-ca\") pod \"console-765cd9b56-vwwnd\" (UID: \"5a2c99a8-de5f-4255-8133-e28b92561ac6\") " pod="openshift-console/console-765cd9b56-vwwnd" Jul 02 12:41:33.298013 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:33.298007 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75hzc\" (UniqueName: \"kubernetes.io/projected/5a2c99a8-de5f-4255-8133-e28b92561ac6-kube-api-access-75hzc\") pod \"console-765cd9b56-vwwnd\" (UID: \"5a2c99a8-de5f-4255-8133-e28b92561ac6\") " pod="openshift-console/console-765cd9b56-vwwnd" Jul 02 12:41:33.298240 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:33.298048 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a2c99a8-de5f-4255-8133-e28b92561ac6-console-config\") pod \"console-765cd9b56-vwwnd\" (UID: \"5a2c99a8-de5f-4255-8133-e28b92561ac6\") " pod="openshift-console/console-765cd9b56-vwwnd" Jul 02 12:41:33.298240 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:33.298073 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a2c99a8-de5f-4255-8133-e28b92561ac6-console-oauth-config\") pod \"console-765cd9b56-vwwnd\" (UID: \"5a2c99a8-de5f-4255-8133-e28b92561ac6\") " pod="openshift-console/console-765cd9b56-vwwnd" Jul 02 12:41:33.298240 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:33.298088 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a2c99a8-de5f-4255-8133-e28b92561ac6-trusted-ca-bundle\") pod \"console-765cd9b56-vwwnd\" (UID: \"5a2c99a8-de5f-4255-8133-e28b92561ac6\") " pod="openshift-console/console-765cd9b56-vwwnd" Jul 02 12:41:33.298240 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:33.298116 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a2c99a8-de5f-4255-8133-e28b92561ac6-console-serving-cert\") pod \"console-765cd9b56-vwwnd\" (UID: \"5a2c99a8-de5f-4255-8133-e28b92561ac6\") " pod="openshift-console/console-765cd9b56-vwwnd" Jul 02 12:41:33.298240 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:33.298139 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a2c99a8-de5f-4255-8133-e28b92561ac6-oauth-serving-cert\") pod \"console-765cd9b56-vwwnd\" (UID: \"5a2c99a8-de5f-4255-8133-e28b92561ac6\") " pod="openshift-console/console-765cd9b56-vwwnd" Jul 02 12:41:33.398962 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:33.398929 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a2c99a8-de5f-4255-8133-e28b92561ac6-console-config\") pod \"console-765cd9b56-vwwnd\" (UID: \"5a2c99a8-de5f-4255-8133-e28b92561ac6\") " pod="openshift-console/console-765cd9b56-vwwnd" Jul 02 12:41:33.398962 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:33.398966 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a2c99a8-de5f-4255-8133-e28b92561ac6-console-oauth-config\") pod \"console-765cd9b56-vwwnd\" (UID: \"5a2c99a8-de5f-4255-8133-e28b92561ac6\") " pod="openshift-console/console-765cd9b56-vwwnd" Jul 02 12:41:33.399191 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:33.398985 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a2c99a8-de5f-4255-8133-e28b92561ac6-trusted-ca-bundle\") pod \"console-765cd9b56-vwwnd\" (UID: \"5a2c99a8-de5f-4255-8133-e28b92561ac6\") " pod="openshift-console/console-765cd9b56-vwwnd" Jul 02 12:41:33.399191 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:33.399007 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a2c99a8-de5f-4255-8133-e28b92561ac6-console-serving-cert\") pod \"console-765cd9b56-vwwnd\" (UID: \"5a2c99a8-de5f-4255-8133-e28b92561ac6\") " pod="openshift-console/console-765cd9b56-vwwnd" Jul 02 12:41:33.399191 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:33.399043 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a2c99a8-de5f-4255-8133-e28b92561ac6-oauth-serving-cert\") pod \"console-765cd9b56-vwwnd\" (UID: \"5a2c99a8-de5f-4255-8133-e28b92561ac6\") " pod="openshift-console/console-765cd9b56-vwwnd" Jul 02 12:41:33.399191 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:33.399127 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a2c99a8-de5f-4255-8133-e28b92561ac6-service-ca\") pod \"console-765cd9b56-vwwnd\" (UID: \"5a2c99a8-de5f-4255-8133-e28b92561ac6\") " pod="openshift-console/console-765cd9b56-vwwnd" Jul 02 12:41:33.399191 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:33.399159 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75hzc\" (UniqueName: \"kubernetes.io/projected/5a2c99a8-de5f-4255-8133-e28b92561ac6-kube-api-access-75hzc\") pod \"console-765cd9b56-vwwnd\" (UID: \"5a2c99a8-de5f-4255-8133-e28b92561ac6\") " pod="openshift-console/console-765cd9b56-vwwnd" Jul 02 12:41:33.399839 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:33.399802 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a2c99a8-de5f-4255-8133-e28b92561ac6-console-config\") pod \"console-765cd9b56-vwwnd\" (UID: \"5a2c99a8-de5f-4255-8133-e28b92561ac6\") " pod="openshift-console/console-765cd9b56-vwwnd" Jul 02 12:41:33.399957 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:33.399914 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a2c99a8-de5f-4255-8133-e28b92561ac6-trusted-ca-bundle\") pod \"console-765cd9b56-vwwnd\" (UID: \"5a2c99a8-de5f-4255-8133-e28b92561ac6\") " pod="openshift-console/console-765cd9b56-vwwnd" Jul 02 12:41:33.399957 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:33.399932 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a2c99a8-de5f-4255-8133-e28b92561ac6-oauth-serving-cert\") pod \"console-765cd9b56-vwwnd\" (UID: \"5a2c99a8-de5f-4255-8133-e28b92561ac6\") " pod="openshift-console/console-765cd9b56-vwwnd" Jul 02 12:41:33.400067 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:33.399968 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a2c99a8-de5f-4255-8133-e28b92561ac6-service-ca\") pod \"console-765cd9b56-vwwnd\" (UID: \"5a2c99a8-de5f-4255-8133-e28b92561ac6\") " pod="openshift-console/console-765cd9b56-vwwnd" Jul 02 12:41:33.401488 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:33.401466 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a2c99a8-de5f-4255-8133-e28b92561ac6-console-oauth-config\") pod \"console-765cd9b56-vwwnd\" (UID: \"5a2c99a8-de5f-4255-8133-e28b92561ac6\") " pod="openshift-console/console-765cd9b56-vwwnd" Jul 02 12:41:33.401607 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:33.401589 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a2c99a8-de5f-4255-8133-e28b92561ac6-console-serving-cert\") pod \"console-765cd9b56-vwwnd\" (UID: \"5a2c99a8-de5f-4255-8133-e28b92561ac6\") " pod="openshift-console/console-765cd9b56-vwwnd" Jul 02 12:41:33.406382 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:33.406363 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75hzc\" (UniqueName: \"kubernetes.io/projected/5a2c99a8-de5f-4255-8133-e28b92561ac6-kube-api-access-75hzc\") pod \"console-765cd9b56-vwwnd\" (UID: \"5a2c99a8-de5f-4255-8133-e28b92561ac6\") " pod="openshift-console/console-765cd9b56-vwwnd" Jul 02 12:41:33.519161 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:33.519075 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-765cd9b56-vwwnd" Jul 02 12:41:33.648873 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:33.648844 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-765cd9b56-vwwnd"] Jul 02 12:41:33.652296 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:41:33.652267 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a2c99a8_de5f_4255_8133_e28b92561ac6.slice/crio-7db6e80428cfd73b4a6fbe26678c85ce6acee2377b5cc87582006d23d306f3a7 WatchSource:0}: Error finding container 7db6e80428cfd73b4a6fbe26678c85ce6acee2377b5cc87582006d23d306f3a7: Status 404 returned error can't find the container with id 7db6e80428cfd73b4a6fbe26678c85ce6acee2377b5cc87582006d23d306f3a7 Jul 02 12:41:34.459939 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:34.459907 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-765cd9b56-vwwnd" event={"ID":"5a2c99a8-de5f-4255-8133-e28b92561ac6","Type":"ContainerStarted","Data":"6a3158c97466cb78dffd7f2f9aae4c1957e85d27e6d0829a22e83b1d356a1a9c"} Jul 02 12:41:34.460103 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:34.459955 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-765cd9b56-vwwnd" event={"ID":"5a2c99a8-de5f-4255-8133-e28b92561ac6","Type":"ContainerStarted","Data":"7db6e80428cfd73b4a6fbe26678c85ce6acee2377b5cc87582006d23d306f3a7"} Jul 02 12:41:34.498544 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:34.498493 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-765cd9b56-vwwnd" podStartSLOduration=1.4984753880000001 podStartE2EDuration="1.498475388s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 12:41:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:41:34.49841742 +0000 UTC m=+176.398681118" watchObservedRunningTime="2026-07-02 12:41:34.498475388 +0000 UTC m=+176.398739039" Jul 02 12:41:43.519435 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:43.519406 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-765cd9b56-vwwnd" Jul 02 12:41:43.519961 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:43.519549 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-765cd9b56-vwwnd" Jul 02 12:41:43.524311 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:43.524291 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-765cd9b56-vwwnd" Jul 02 12:41:44.503768 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:41:44.503741 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-765cd9b56-vwwnd" Jul 02 12:42:52.640967 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:42:52.640930 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7776db66f5-nkrmq"] Jul 02 12:42:52.644688 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:42:52.644645 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7776db66f5-nkrmq" Jul 02 12:42:52.656694 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:42:52.656667 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7776db66f5-nkrmq"] Jul 02 12:42:52.789577 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:42:52.789545 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e046eaaa-7c14-49cd-863d-f78019fa534e-trusted-ca-bundle\") pod \"console-7776db66f5-nkrmq\" (UID: \"e046eaaa-7c14-49cd-863d-f78019fa534e\") " pod="openshift-console/console-7776db66f5-nkrmq" Jul 02 12:42:52.789760 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:42:52.789597 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e046eaaa-7c14-49cd-863d-f78019fa534e-console-config\") pod \"console-7776db66f5-nkrmq\" (UID: \"e046eaaa-7c14-49cd-863d-f78019fa534e\") " pod="openshift-console/console-7776db66f5-nkrmq" Jul 02 12:42:52.789760 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:42:52.789621 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e046eaaa-7c14-49cd-863d-f78019fa534e-oauth-serving-cert\") pod \"console-7776db66f5-nkrmq\" (UID: \"e046eaaa-7c14-49cd-863d-f78019fa534e\") " pod="openshift-console/console-7776db66f5-nkrmq" Jul 02 12:42:52.789760 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:42:52.789646 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e046eaaa-7c14-49cd-863d-f78019fa534e-service-ca\") pod \"console-7776db66f5-nkrmq\" (UID: \"e046eaaa-7c14-49cd-863d-f78019fa534e\") " pod="openshift-console/console-7776db66f5-nkrmq" Jul 02 12:42:52.789867 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:42:52.789757 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e046eaaa-7c14-49cd-863d-f78019fa534e-console-serving-cert\") pod \"console-7776db66f5-nkrmq\" (UID: \"e046eaaa-7c14-49cd-863d-f78019fa534e\") " pod="openshift-console/console-7776db66f5-nkrmq" Jul 02 12:42:52.789867 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:42:52.789782 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e046eaaa-7c14-49cd-863d-f78019fa534e-console-oauth-config\") pod \"console-7776db66f5-nkrmq\" (UID: \"e046eaaa-7c14-49cd-863d-f78019fa534e\") " pod="openshift-console/console-7776db66f5-nkrmq" Jul 02 12:42:52.789867 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:42:52.789801 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8mrd\" (UniqueName: \"kubernetes.io/projected/e046eaaa-7c14-49cd-863d-f78019fa534e-kube-api-access-m8mrd\") pod \"console-7776db66f5-nkrmq\" (UID: \"e046eaaa-7c14-49cd-863d-f78019fa534e\") " pod="openshift-console/console-7776db66f5-nkrmq" Jul 02 12:42:52.890428 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:42:52.890396 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e046eaaa-7c14-49cd-863d-f78019fa534e-console-serving-cert\") pod \"console-7776db66f5-nkrmq\" (UID: \"e046eaaa-7c14-49cd-863d-f78019fa534e\") " pod="openshift-console/console-7776db66f5-nkrmq" Jul 02 12:42:52.890428 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:42:52.890433 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e046eaaa-7c14-49cd-863d-f78019fa534e-console-oauth-config\") pod \"console-7776db66f5-nkrmq\" (UID: \"e046eaaa-7c14-49cd-863d-f78019fa534e\") " pod="openshift-console/console-7776db66f5-nkrmq" Jul 02 12:42:52.890683 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:42:52.890457 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8mrd\" (UniqueName: \"kubernetes.io/projected/e046eaaa-7c14-49cd-863d-f78019fa534e-kube-api-access-m8mrd\") pod \"console-7776db66f5-nkrmq\" (UID: \"e046eaaa-7c14-49cd-863d-f78019fa534e\") " pod="openshift-console/console-7776db66f5-nkrmq" Jul 02 12:42:52.890683 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:42:52.890584 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e046eaaa-7c14-49cd-863d-f78019fa534e-trusted-ca-bundle\") pod \"console-7776db66f5-nkrmq\" (UID: \"e046eaaa-7c14-49cd-863d-f78019fa534e\") " pod="openshift-console/console-7776db66f5-nkrmq" Jul 02 12:42:52.890770 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:42:52.890683 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e046eaaa-7c14-49cd-863d-f78019fa534e-console-config\") pod \"console-7776db66f5-nkrmq\" (UID: \"e046eaaa-7c14-49cd-863d-f78019fa534e\") " pod="openshift-console/console-7776db66f5-nkrmq" Jul 02 12:42:52.890770 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:42:52.890717 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e046eaaa-7c14-49cd-863d-f78019fa534e-oauth-serving-cert\") pod \"console-7776db66f5-nkrmq\" (UID: \"e046eaaa-7c14-49cd-863d-f78019fa534e\") " pod="openshift-console/console-7776db66f5-nkrmq" Jul 02 12:42:52.890770 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:42:52.890750 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e046eaaa-7c14-49cd-863d-f78019fa534e-service-ca\") pod \"console-7776db66f5-nkrmq\" (UID: \"e046eaaa-7c14-49cd-863d-f78019fa534e\") " pod="openshift-console/console-7776db66f5-nkrmq" Jul 02 12:42:52.891470 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:42:52.891408 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e046eaaa-7c14-49cd-863d-f78019fa534e-console-config\") pod \"console-7776db66f5-nkrmq\" (UID: \"e046eaaa-7c14-49cd-863d-f78019fa534e\") " pod="openshift-console/console-7776db66f5-nkrmq" Jul 02 12:42:52.891589 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:42:52.891479 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e046eaaa-7c14-49cd-863d-f78019fa534e-oauth-serving-cert\") pod \"console-7776db66f5-nkrmq\" (UID: \"e046eaaa-7c14-49cd-863d-f78019fa534e\") " pod="openshift-console/console-7776db66f5-nkrmq" Jul 02 12:42:52.891589 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:42:52.891495 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e046eaaa-7c14-49cd-863d-f78019fa534e-trusted-ca-bundle\") pod \"console-7776db66f5-nkrmq\" (UID: \"e046eaaa-7c14-49cd-863d-f78019fa534e\") " pod="openshift-console/console-7776db66f5-nkrmq" Jul 02 12:42:52.891733 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:42:52.891602 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e046eaaa-7c14-49cd-863d-f78019fa534e-service-ca\") pod \"console-7776db66f5-nkrmq\" (UID: \"e046eaaa-7c14-49cd-863d-f78019fa534e\") " pod="openshift-console/console-7776db66f5-nkrmq" Jul 02 12:42:52.893123 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:42:52.893092 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e046eaaa-7c14-49cd-863d-f78019fa534e-console-oauth-config\") pod \"console-7776db66f5-nkrmq\" (UID: \"e046eaaa-7c14-49cd-863d-f78019fa534e\") " pod="openshift-console/console-7776db66f5-nkrmq" Jul 02 12:42:52.893216 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:42:52.893188 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e046eaaa-7c14-49cd-863d-f78019fa534e-console-serving-cert\") pod \"console-7776db66f5-nkrmq\" (UID: \"e046eaaa-7c14-49cd-863d-f78019fa534e\") " pod="openshift-console/console-7776db66f5-nkrmq" Jul 02 12:42:52.898197 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:42:52.898179 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8mrd\" (UniqueName: \"kubernetes.io/projected/e046eaaa-7c14-49cd-863d-f78019fa534e-kube-api-access-m8mrd\") pod \"console-7776db66f5-nkrmq\" (UID: \"e046eaaa-7c14-49cd-863d-f78019fa534e\") " pod="openshift-console/console-7776db66f5-nkrmq" Jul 02 12:42:52.956045 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:42:52.956012 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7776db66f5-nkrmq" Jul 02 12:42:53.088877 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:42:53.088854 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7776db66f5-nkrmq"] Jul 02 12:42:53.090841 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:42:53.090805 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode046eaaa_7c14_49cd_863d_f78019fa534e.slice/crio-dba9caa5afeea65003dc85cf44e6453c6bfbf0b72f3b7dde6b319834bce4fd03 WatchSource:0}: Error finding container dba9caa5afeea65003dc85cf44e6453c6bfbf0b72f3b7dde6b319834bce4fd03: Status 404 returned error can't find the container with id dba9caa5afeea65003dc85cf44e6453c6bfbf0b72f3b7dde6b319834bce4fd03 Jul 02 12:42:53.779553 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:42:53.779516 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7776db66f5-nkrmq" event={"ID":"e046eaaa-7c14-49cd-863d-f78019fa534e","Type":"ContainerStarted","Data":"abccfbea8eba3594ccc6780a40224e1eaa2f615058e2b37fccc2bb67ff5cf6c4"} Jul 02 12:42:53.780052 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:42:53.779562 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7776db66f5-nkrmq" event={"ID":"e046eaaa-7c14-49cd-863d-f78019fa534e","Type":"ContainerStarted","Data":"dba9caa5afeea65003dc85cf44e6453c6bfbf0b72f3b7dde6b319834bce4fd03"} Jul 02 12:42:53.803005 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:42:53.802960 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7776db66f5-nkrmq" podStartSLOduration=1.802943459 podStartE2EDuration="1.802943459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 12:42:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:42:53.8019847 +0000 UTC m=+255.702248351" watchObservedRunningTime="2026-07-02 12:42:53.802943459 +0000 UTC m=+255.703207111" Jul 02 12:43:02.956290 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:43:02.956194 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7776db66f5-nkrmq" Jul 02 12:43:02.956290 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:43:02.956266 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7776db66f5-nkrmq" Jul 02 12:43:02.961138 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:43:02.961116 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7776db66f5-nkrmq" Jul 02 12:43:03.826446 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:43:03.826417 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7776db66f5-nkrmq" Jul 02 12:43:03.876149 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:43:03.876108 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-765cd9b56-vwwnd"] Jul 02 12:43:28.902169 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:43:28.902101 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-765cd9b56-vwwnd" podUID="5a2c99a8-de5f-4255-8133-e28b92561ac6" containerName="console" containerID="cri-o://6a3158c97466cb78dffd7f2f9aae4c1957e85d27e6d0829a22e83b1d356a1a9c" gracePeriod=15 Jul 02 12:43:29.144977 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:43:29.144945 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-765cd9b56-vwwnd" Jul 02 12:43:29.216025 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:43:29.215984 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a2c99a8-de5f-4255-8133-e28b92561ac6-trusted-ca-bundle\") pod \"5a2c99a8-de5f-4255-8133-e28b92561ac6\" (UID: \"5a2c99a8-de5f-4255-8133-e28b92561ac6\") " Jul 02 12:43:29.216025 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:43:29.216026 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-75hzc\" (UniqueName: \"kubernetes.io/projected/5a2c99a8-de5f-4255-8133-e28b92561ac6-kube-api-access-75hzc\") pod \"5a2c99a8-de5f-4255-8133-e28b92561ac6\" (UID: \"5a2c99a8-de5f-4255-8133-e28b92561ac6\") " Jul 02 12:43:29.216296 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:43:29.216043 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a2c99a8-de5f-4255-8133-e28b92561ac6-console-oauth-config\") pod \"5a2c99a8-de5f-4255-8133-e28b92561ac6\" (UID: \"5a2c99a8-de5f-4255-8133-e28b92561ac6\") " Jul 02 12:43:29.216296 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:43:29.216213 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a2c99a8-de5f-4255-8133-e28b92561ac6-console-config\") pod \"5a2c99a8-de5f-4255-8133-e28b92561ac6\" (UID: \"5a2c99a8-de5f-4255-8133-e28b92561ac6\") " Jul 02 12:43:29.216296 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:43:29.216248 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a2c99a8-de5f-4255-8133-e28b92561ac6-oauth-serving-cert\") pod \"5a2c99a8-de5f-4255-8133-e28b92561ac6\" (UID: \"5a2c99a8-de5f-4255-8133-e28b92561ac6\") " Jul 02 12:43:29.216451 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:43:29.216311 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a2c99a8-de5f-4255-8133-e28b92561ac6-service-ca\") pod \"5a2c99a8-de5f-4255-8133-e28b92561ac6\" (UID: \"5a2c99a8-de5f-4255-8133-e28b92561ac6\") " Jul 02 12:43:29.216451 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:43:29.216342 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a2c99a8-de5f-4255-8133-e28b92561ac6-console-serving-cert\") pod \"5a2c99a8-de5f-4255-8133-e28b92561ac6\" (UID: \"5a2c99a8-de5f-4255-8133-e28b92561ac6\") " Jul 02 12:43:29.216565 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:43:29.216447 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a2c99a8-de5f-4255-8133-e28b92561ac6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5a2c99a8-de5f-4255-8133-e28b92561ac6" (UID: "5a2c99a8-de5f-4255-8133-e28b92561ac6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 12:43:29.216634 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:43:29.216603 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a2c99a8-de5f-4255-8133-e28b92561ac6-console-config" (OuterVolumeSpecName: "console-config") pod "5a2c99a8-de5f-4255-8133-e28b92561ac6" (UID: "5a2c99a8-de5f-4255-8133-e28b92561ac6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 12:43:29.216718 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:43:29.216691 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a2c99a8-de5f-4255-8133-e28b92561ac6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5a2c99a8-de5f-4255-8133-e28b92561ac6" (UID: "5a2c99a8-de5f-4255-8133-e28b92561ac6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 12:43:29.216718 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:43:29.216701 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a2c99a8-de5f-4255-8133-e28b92561ac6-service-ca" (OuterVolumeSpecName: "service-ca") pod "5a2c99a8-de5f-4255-8133-e28b92561ac6" (UID: "5a2c99a8-de5f-4255-8133-e28b92561ac6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 12:43:29.216839 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:43:29.216771 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a2c99a8-de5f-4255-8133-e28b92561ac6-trusted-ca-bundle\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:43:29.216839 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:43:29.216789 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a2c99a8-de5f-4255-8133-e28b92561ac6-console-config\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:43:29.218289 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:43:29.218266 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a2c99a8-de5f-4255-8133-e28b92561ac6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5a2c99a8-de5f-4255-8133-e28b92561ac6" (UID: "5a2c99a8-de5f-4255-8133-e28b92561ac6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 12:43:29.218289 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:43:29.218276 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a2c99a8-de5f-4255-8133-e28b92561ac6-kube-api-access-75hzc" (OuterVolumeSpecName: "kube-api-access-75hzc") pod "5a2c99a8-de5f-4255-8133-e28b92561ac6" (UID: "5a2c99a8-de5f-4255-8133-e28b92561ac6"). InnerVolumeSpecName "kube-api-access-75hzc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 12:43:29.218410 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:43:29.218282 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a2c99a8-de5f-4255-8133-e28b92561ac6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5a2c99a8-de5f-4255-8133-e28b92561ac6" (UID: "5a2c99a8-de5f-4255-8133-e28b92561ac6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 12:43:29.318067 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:43:29.318033 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75hzc\" (UniqueName: \"kubernetes.io/projected/5a2c99a8-de5f-4255-8133-e28b92561ac6-kube-api-access-75hzc\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:43:29.318067 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:43:29.318063 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a2c99a8-de5f-4255-8133-e28b92561ac6-console-oauth-config\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:43:29.318067 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:43:29.318073 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a2c99a8-de5f-4255-8133-e28b92561ac6-oauth-serving-cert\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:43:29.318322 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:43:29.318083 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a2c99a8-de5f-4255-8133-e28b92561ac6-service-ca\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:43:29.318322 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:43:29.318091 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a2c99a8-de5f-4255-8133-e28b92561ac6-console-serving-cert\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:43:29.931742 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:43:29.931704 2582 generic.go:356] "Generic (PLEG): container finished" podID="5a2c99a8-de5f-4255-8133-e28b92561ac6" containerID="6a3158c97466cb78dffd7f2f9aae4c1957e85d27e6d0829a22e83b1d356a1a9c" exitCode=0 Jul 02 12:43:29.932120 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:43:29.931755 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-765cd9b56-vwwnd" Jul 02 12:43:29.932120 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:43:29.931790 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-765cd9b56-vwwnd" event={"ID":"5a2c99a8-de5f-4255-8133-e28b92561ac6","Type":"ContainerDied","Data":"6a3158c97466cb78dffd7f2f9aae4c1957e85d27e6d0829a22e83b1d356a1a9c"} Jul 02 12:43:29.932120 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:43:29.931847 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-765cd9b56-vwwnd" event={"ID":"5a2c99a8-de5f-4255-8133-e28b92561ac6","Type":"ContainerDied","Data":"7db6e80428cfd73b4a6fbe26678c85ce6acee2377b5cc87582006d23d306f3a7"} Jul 02 12:43:29.932120 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:43:29.931868 2582 scope.go:117] "RemoveContainer" containerID="6a3158c97466cb78dffd7f2f9aae4c1957e85d27e6d0829a22e83b1d356a1a9c" Jul 02 12:43:29.940553 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:43:29.940535 2582 scope.go:117] "RemoveContainer" containerID="6a3158c97466cb78dffd7f2f9aae4c1957e85d27e6d0829a22e83b1d356a1a9c" Jul 02 12:43:29.940832 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:43:29.940811 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a3158c97466cb78dffd7f2f9aae4c1957e85d27e6d0829a22e83b1d356a1a9c\": container with ID starting with 6a3158c97466cb78dffd7f2f9aae4c1957e85d27e6d0829a22e83b1d356a1a9c not found: ID does not exist" containerID="6a3158c97466cb78dffd7f2f9aae4c1957e85d27e6d0829a22e83b1d356a1a9c" Jul 02 12:43:29.940875 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:43:29.940840 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a3158c97466cb78dffd7f2f9aae4c1957e85d27e6d0829a22e83b1d356a1a9c"} err="failed to get container status \"6a3158c97466cb78dffd7f2f9aae4c1957e85d27e6d0829a22e83b1d356a1a9c\": rpc error: code = NotFound desc = could not find container \"6a3158c97466cb78dffd7f2f9aae4c1957e85d27e6d0829a22e83b1d356a1a9c\": container with ID starting with 6a3158c97466cb78dffd7f2f9aae4c1957e85d27e6d0829a22e83b1d356a1a9c not found: ID does not exist" Jul 02 12:43:29.950949 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:43:29.950925 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-765cd9b56-vwwnd"] Jul 02 12:43:29.954563 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:43:29.954542 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-765cd9b56-vwwnd"] Jul 02 12:43:30.573851 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:43:30.573825 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a2c99a8-de5f-4255-8133-e28b92561ac6" path="/var/lib/kubelet/pods/5a2c99a8-de5f-4255-8133-e28b92561ac6/volumes" Jul 02 12:43:38.503130 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:43:38.503105 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-sqd4q_95b6074d-8908-400e-85c7-c2d989e4b2d3/console-operator/1.log" Jul 02 12:43:38.505881 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:43:38.505861 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfrv8_45891c6f-888b-490a-907f-1f58e3947b8a/ovn-acl-logging/0.log" Jul 02 12:43:38.507228 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:43:38.507208 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-sqd4q_95b6074d-8908-400e-85c7-c2d989e4b2d3/console-operator/1.log" Jul 02 12:43:38.510033 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:43:38.510011 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfrv8_45891c6f-888b-490a-907f-1f58e3947b8a/ovn-acl-logging/0.log" Jul 02 12:43:38.513222 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:43:38.513205 2582 kubelet.go:1648] "Image garbage collection succeeded" Jul 02 12:45:24.724681 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:24.724632 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5892qw99"] Jul 02 12:45:24.725142 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:24.725023 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a2c99a8-de5f-4255-8133-e28b92561ac6" containerName="console" Jul 02 12:45:24.725142 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:24.725035 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a2c99a8-de5f-4255-8133-e28b92561ac6" containerName="console" Jul 02 12:45:24.725142 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:24.725104 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a2c99a8-de5f-4255-8133-e28b92561ac6" containerName="console" Jul 02 12:45:24.728267 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:24.728250 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5892qw99" Jul 02 12:45:24.730773 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:24.730752 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 02 12:45:24.731476 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:24.731454 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 02 12:45:24.731564 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:24.731456 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gr8c5\"" Jul 02 12:45:24.747668 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:24.747626 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5892qw99"] Jul 02 12:45:24.889435 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:24.889390 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ef1274c-b412-49b2-ae02-d79cf4c8650f-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5892qw99\" (UID: \"2ef1274c-b412-49b2-ae02-d79cf4c8650f\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5892qw99" Jul 02 12:45:24.889614 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:24.889479 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncq8m\" (UniqueName: \"kubernetes.io/projected/2ef1274c-b412-49b2-ae02-d79cf4c8650f-kube-api-access-ncq8m\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5892qw99\" (UID: \"2ef1274c-b412-49b2-ae02-d79cf4c8650f\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5892qw99" Jul 02 12:45:24.889614 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:24.889531 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ef1274c-b412-49b2-ae02-d79cf4c8650f-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5892qw99\" (UID: \"2ef1274c-b412-49b2-ae02-d79cf4c8650f\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5892qw99" Jul 02 12:45:24.990311 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:24.990229 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ef1274c-b412-49b2-ae02-d79cf4c8650f-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5892qw99\" (UID: \"2ef1274c-b412-49b2-ae02-d79cf4c8650f\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5892qw99" Jul 02 12:45:24.990311 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:24.990293 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncq8m\" (UniqueName: \"kubernetes.io/projected/2ef1274c-b412-49b2-ae02-d79cf4c8650f-kube-api-access-ncq8m\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5892qw99\" (UID: \"2ef1274c-b412-49b2-ae02-d79cf4c8650f\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5892qw99" Jul 02 12:45:24.990459 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:24.990337 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ef1274c-b412-49b2-ae02-d79cf4c8650f-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5892qw99\" (UID: \"2ef1274c-b412-49b2-ae02-d79cf4c8650f\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5892qw99" Jul 02 12:45:24.990610 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:24.990591 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ef1274c-b412-49b2-ae02-d79cf4c8650f-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5892qw99\" (UID: \"2ef1274c-b412-49b2-ae02-d79cf4c8650f\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5892qw99" Jul 02 12:45:24.990646 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:24.990619 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ef1274c-b412-49b2-ae02-d79cf4c8650f-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5892qw99\" (UID: \"2ef1274c-b412-49b2-ae02-d79cf4c8650f\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5892qw99" Jul 02 12:45:24.998971 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:24.998940 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncq8m\" (UniqueName: \"kubernetes.io/projected/2ef1274c-b412-49b2-ae02-d79cf4c8650f-kube-api-access-ncq8m\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5892qw99\" (UID: \"2ef1274c-b412-49b2-ae02-d79cf4c8650f\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5892qw99" Jul 02 12:45:25.037249 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:25.037227 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5892qw99" Jul 02 12:45:25.166484 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:25.166452 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5892qw99"] Jul 02 12:45:25.168845 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:45:25.168805 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ef1274c_b412_49b2_ae02_d79cf4c8650f.slice/crio-4a7ae21c353c3bdb31416d5c07c491518420c10d68f4263a34386e10712d9c14 WatchSource:0}: Error finding container 4a7ae21c353c3bdb31416d5c07c491518420c10d68f4263a34386e10712d9c14: Status 404 returned error can't find the container with id 4a7ae21c353c3bdb31416d5c07c491518420c10d68f4263a34386e10712d9c14 Jul 02 12:45:25.170751 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:25.170725 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 12:45:25.395919 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:25.395840 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5892qw99" event={"ID":"2ef1274c-b412-49b2-ae02-d79cf4c8650f","Type":"ContainerStarted","Data":"4a7ae21c353c3bdb31416d5c07c491518420c10d68f4263a34386e10712d9c14"} Jul 02 12:45:32.432010 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:32.431973 2582 generic.go:356] "Generic (PLEG): container finished" podID="2ef1274c-b412-49b2-ae02-d79cf4c8650f" containerID="fd76675e462bb8b4f54570e45e0af8fb8b3f784ed27b656b7222d0fc620fb332" exitCode=0 Jul 02 12:45:32.432421 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:32.432069 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5892qw99" event={"ID":"2ef1274c-b412-49b2-ae02-d79cf4c8650f","Type":"ContainerDied","Data":"fd76675e462bb8b4f54570e45e0af8fb8b3f784ed27b656b7222d0fc620fb332"} Jul 02 12:45:35.446467 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:35.446436 2582 generic.go:356] "Generic (PLEG): container finished" podID="2ef1274c-b412-49b2-ae02-d79cf4c8650f" containerID="e162b37c671752e0aaa521e839e954052da61fdc616f2f8a0e01748d34c09d97" exitCode=0 Jul 02 12:45:35.446931 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:35.446514 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5892qw99" event={"ID":"2ef1274c-b412-49b2-ae02-d79cf4c8650f","Type":"ContainerDied","Data":"e162b37c671752e0aaa521e839e954052da61fdc616f2f8a0e01748d34c09d97"} Jul 02 12:45:42.481220 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:42.481182 2582 generic.go:356] "Generic (PLEG): container finished" podID="2ef1274c-b412-49b2-ae02-d79cf4c8650f" containerID="00783c968f424369a13091100768965b1f00dfcfcc6f9c5cf699a38a1a9a26da" exitCode=0 Jul 02 12:45:42.481685 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:42.481271 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5892qw99" event={"ID":"2ef1274c-b412-49b2-ae02-d79cf4c8650f","Type":"ContainerDied","Data":"00783c968f424369a13091100768965b1f00dfcfcc6f9c5cf699a38a1a9a26da"} Jul 02 12:45:43.612222 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:43.612197 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5892qw99" Jul 02 12:45:43.655923 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:43.655896 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ef1274c-b412-49b2-ae02-d79cf4c8650f-bundle\") pod \"2ef1274c-b412-49b2-ae02-d79cf4c8650f\" (UID: \"2ef1274c-b412-49b2-ae02-d79cf4c8650f\") " Jul 02 12:45:43.656096 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:43.655972 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ncq8m\" (UniqueName: \"kubernetes.io/projected/2ef1274c-b412-49b2-ae02-d79cf4c8650f-kube-api-access-ncq8m\") pod \"2ef1274c-b412-49b2-ae02-d79cf4c8650f\" (UID: \"2ef1274c-b412-49b2-ae02-d79cf4c8650f\") " Jul 02 12:45:43.656096 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:43.655994 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ef1274c-b412-49b2-ae02-d79cf4c8650f-util\") pod \"2ef1274c-b412-49b2-ae02-d79cf4c8650f\" (UID: \"2ef1274c-b412-49b2-ae02-d79cf4c8650f\") " Jul 02 12:45:43.656807 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:43.656768 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ef1274c-b412-49b2-ae02-d79cf4c8650f-bundle" (OuterVolumeSpecName: "bundle") pod "2ef1274c-b412-49b2-ae02-d79cf4c8650f" (UID: "2ef1274c-b412-49b2-ae02-d79cf4c8650f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 12:45:43.658147 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:43.658112 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ef1274c-b412-49b2-ae02-d79cf4c8650f-kube-api-access-ncq8m" (OuterVolumeSpecName: "kube-api-access-ncq8m") pod "2ef1274c-b412-49b2-ae02-d79cf4c8650f" (UID: "2ef1274c-b412-49b2-ae02-d79cf4c8650f"). InnerVolumeSpecName "kube-api-access-ncq8m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 12:45:43.660052 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:43.660027 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ef1274c-b412-49b2-ae02-d79cf4c8650f-util" (OuterVolumeSpecName: "util") pod "2ef1274c-b412-49b2-ae02-d79cf4c8650f" (UID: "2ef1274c-b412-49b2-ae02-d79cf4c8650f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 12:45:43.756775 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:43.756694 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ef1274c-b412-49b2-ae02-d79cf4c8650f-bundle\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:45:43.756775 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:43.756722 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ncq8m\" (UniqueName: \"kubernetes.io/projected/2ef1274c-b412-49b2-ae02-d79cf4c8650f-kube-api-access-ncq8m\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:45:43.756775 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:43.756734 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ef1274c-b412-49b2-ae02-d79cf4c8650f-util\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:45:44.491536 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:44.491501 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5892qw99" event={"ID":"2ef1274c-b412-49b2-ae02-d79cf4c8650f","Type":"ContainerDied","Data":"4a7ae21c353c3bdb31416d5c07c491518420c10d68f4263a34386e10712d9c14"} Jul 02 12:45:44.491536 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:44.491524 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5892qw99" Jul 02 12:45:44.491770 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:44.491547 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4a7ae21c353c3bdb31416d5c07c491518420c10d68f4263a34386e10712d9c14" Jul 02 12:45:47.809434 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:47.809394 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-rp9jm"] Jul 02 12:45:47.809955 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:47.809863 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ef1274c-b412-49b2-ae02-d79cf4c8650f" containerName="pull" Jul 02 12:45:47.809955 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:47.809882 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ef1274c-b412-49b2-ae02-d79cf4c8650f" containerName="pull" Jul 02 12:45:47.809955 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:47.809898 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ef1274c-b412-49b2-ae02-d79cf4c8650f" containerName="util" Jul 02 12:45:47.809955 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:47.809906 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ef1274c-b412-49b2-ae02-d79cf4c8650f" containerName="util" Jul 02 12:45:47.809955 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:47.809922 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ef1274c-b412-49b2-ae02-d79cf4c8650f" containerName="extract" Jul 02 12:45:47.809955 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:47.809931 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ef1274c-b412-49b2-ae02-d79cf4c8650f" containerName="extract" Jul 02 12:45:47.810244 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:47.810021 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ef1274c-b412-49b2-ae02-d79cf4c8650f" containerName="extract" Jul 02 12:45:47.854385 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:47.854352 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-rp9jm"] Jul 02 12:45:47.854531 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:47.854461 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-rp9jm" Jul 02 12:45:47.857077 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:47.857051 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 02 12:45:47.857457 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:47.857440 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 02 12:45:47.857564 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:47.857446 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-cl9lv\"" Jul 02 12:45:47.858000 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:47.857981 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 02 12:45:47.891086 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:47.891058 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzcrd\" (UniqueName: \"kubernetes.io/projected/b75ac66f-e444-4993-bcd8-5c145d74b974-kube-api-access-lzcrd\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-rp9jm\" (UID: \"b75ac66f-e444-4993-bcd8-5c145d74b974\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-rp9jm" Jul 02 12:45:47.891227 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:47.891097 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/b75ac66f-e444-4993-bcd8-5c145d74b974-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-rp9jm\" (UID: \"b75ac66f-e444-4993-bcd8-5c145d74b974\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-rp9jm" Jul 02 12:45:47.991675 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:47.991612 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/b75ac66f-e444-4993-bcd8-5c145d74b974-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-rp9jm\" (UID: \"b75ac66f-e444-4993-bcd8-5c145d74b974\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-rp9jm" Jul 02 12:45:47.991850 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:47.991728 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzcrd\" (UniqueName: \"kubernetes.io/projected/b75ac66f-e444-4993-bcd8-5c145d74b974-kube-api-access-lzcrd\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-rp9jm\" (UID: \"b75ac66f-e444-4993-bcd8-5c145d74b974\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-rp9jm" Jul 02 12:45:47.994010 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:47.993978 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/b75ac66f-e444-4993-bcd8-5c145d74b974-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-rp9jm\" (UID: \"b75ac66f-e444-4993-bcd8-5c145d74b974\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-rp9jm" Jul 02 12:45:48.011268 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:48.011230 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzcrd\" (UniqueName: \"kubernetes.io/projected/b75ac66f-e444-4993-bcd8-5c145d74b974-kube-api-access-lzcrd\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-rp9jm\" (UID: \"b75ac66f-e444-4993-bcd8-5c145d74b974\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-rp9jm" Jul 02 12:45:48.164854 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:48.164820 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-rp9jm" Jul 02 12:45:48.319517 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:48.319482 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-rp9jm"] Jul 02 12:45:48.323739 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:45:48.323705 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb75ac66f_e444_4993_bcd8_5c145d74b974.slice/crio-7f897209f7e66aac622bd53ff12b8ce0f2a05a2df156f85b0243fd47bb5cca59 WatchSource:0}: Error finding container 7f897209f7e66aac622bd53ff12b8ce0f2a05a2df156f85b0243fd47bb5cca59: Status 404 returned error can't find the container with id 7f897209f7e66aac622bd53ff12b8ce0f2a05a2df156f85b0243fd47bb5cca59 Jul 02 12:45:48.509064 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:48.508984 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-rp9jm" event={"ID":"b75ac66f-e444-4993-bcd8-5c145d74b974","Type":"ContainerStarted","Data":"7f897209f7e66aac622bd53ff12b8ce0f2a05a2df156f85b0243fd47bb5cca59"} Jul 02 12:45:53.394173 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:53.394135 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-68bff59c-4dj6g"] Jul 02 12:45:53.396646 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:53.396623 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-4dj6g" Jul 02 12:45:53.398764 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:53.398742 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 02 12:45:53.398877 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:53.398790 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-f7bxr\"" Jul 02 12:45:53.398877 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:53.398744 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" Jul 02 12:45:53.408828 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:53.408798 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-4dj6g"] Jul 02 12:45:53.438405 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:53.438373 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79c8x\" (UniqueName: \"kubernetes.io/projected/029a5795-da10-4d39-9549-d3a57640ec9b-kube-api-access-79c8x\") pod \"keda-operator-68bff59c-4dj6g\" (UID: \"029a5795-da10-4d39-9549-d3a57640ec9b\") " pod="openshift-keda/keda-operator-68bff59c-4dj6g" Jul 02 12:45:53.438574 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:53.438423 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/029a5795-da10-4d39-9549-d3a57640ec9b-cabundle0\") pod \"keda-operator-68bff59c-4dj6g\" (UID: \"029a5795-da10-4d39-9549-d3a57640ec9b\") " pod="openshift-keda/keda-operator-68bff59c-4dj6g" Jul 02 12:45:53.438574 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:53.438508 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/029a5795-da10-4d39-9549-d3a57640ec9b-certificates\") pod \"keda-operator-68bff59c-4dj6g\" (UID: \"029a5795-da10-4d39-9549-d3a57640ec9b\") " pod="openshift-keda/keda-operator-68bff59c-4dj6g" Jul 02 12:45:53.534490 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:53.534455 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-rp9jm" event={"ID":"b75ac66f-e444-4993-bcd8-5c145d74b974","Type":"ContainerStarted","Data":"62038361f186b1bf37b094e7fdaf26571da6df1db5ff80d83c540bd02f5ec35d"} Jul 02 12:45:53.534689 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:53.534590 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-rp9jm" Jul 02 12:45:53.538995 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:53.538972 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/029a5795-da10-4d39-9549-d3a57640ec9b-cabundle0\") pod \"keda-operator-68bff59c-4dj6g\" (UID: \"029a5795-da10-4d39-9549-d3a57640ec9b\") " pod="openshift-keda/keda-operator-68bff59c-4dj6g" Jul 02 12:45:53.539073 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:53.539021 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/029a5795-da10-4d39-9549-d3a57640ec9b-certificates\") pod \"keda-operator-68bff59c-4dj6g\" (UID: \"029a5795-da10-4d39-9549-d3a57640ec9b\") " pod="openshift-keda/keda-operator-68bff59c-4dj6g" Jul 02 12:45:53.539073 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:53.539062 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79c8x\" (UniqueName: \"kubernetes.io/projected/029a5795-da10-4d39-9549-d3a57640ec9b-kube-api-access-79c8x\") pod \"keda-operator-68bff59c-4dj6g\" (UID: \"029a5795-da10-4d39-9549-d3a57640ec9b\") " pod="openshift-keda/keda-operator-68bff59c-4dj6g" Jul 02 12:45:53.539238 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:45:53.539187 2582 secret.go:281] references non-existent secret key: ca.crt Jul 02 12:45:53.539238 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:45:53.539205 2582 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 02 12:45:53.539238 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:45:53.539216 2582 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-68bff59c-4dj6g: references non-existent secret key: ca.crt Jul 02 12:45:53.539387 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:45:53.539282 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/029a5795-da10-4d39-9549-d3a57640ec9b-certificates podName:029a5795-da10-4d39-9549-d3a57640ec9b nodeName:}" failed. No retries permitted until 2026-07-02 12:45:54.039263821 +0000 UTC m=+435.939527465 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/029a5795-da10-4d39-9549-d3a57640ec9b-certificates") pod "keda-operator-68bff59c-4dj6g" (UID: "029a5795-da10-4d39-9549-d3a57640ec9b") : references non-existent secret key: ca.crt Jul 02 12:45:53.539582 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:53.539562 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/029a5795-da10-4d39-9549-d3a57640ec9b-cabundle0\") pod \"keda-operator-68bff59c-4dj6g\" (UID: \"029a5795-da10-4d39-9549-d3a57640ec9b\") " pod="openshift-keda/keda-operator-68bff59c-4dj6g" Jul 02 12:45:53.547859 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:53.547840 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79c8x\" (UniqueName: \"kubernetes.io/projected/029a5795-da10-4d39-9549-d3a57640ec9b-kube-api-access-79c8x\") pod \"keda-operator-68bff59c-4dj6g\" (UID: \"029a5795-da10-4d39-9549-d3a57640ec9b\") " pod="openshift-keda/keda-operator-68bff59c-4dj6g" Jul 02 12:45:53.560677 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:53.558243 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-rp9jm" podStartSLOduration=2.240856665 podStartE2EDuration="6.558218536s" totalImagesPullingTime="4.317361871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 12:45:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:45:53.554343189 +0000 UTC m=+435.454606841" watchObservedRunningTime="2026-07-02 12:45:53.558218536 +0000 UTC m=+435.458482188" Jul 02 12:45:54.028191 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:54.028153 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-c6j5m"] Jul 02 12:45:54.031624 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:54.031601 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-c6j5m" Jul 02 12:45:54.033736 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:54.033716 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Jul 02 12:45:54.042487 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:54.042465 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-c6j5m"] Jul 02 12:45:54.044005 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:54.043983 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/029a5795-da10-4d39-9549-d3a57640ec9b-certificates\") pod \"keda-operator-68bff59c-4dj6g\" (UID: \"029a5795-da10-4d39-9549-d3a57640ec9b\") " pod="openshift-keda/keda-operator-68bff59c-4dj6g" Jul 02 12:45:54.046281 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:54.046258 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/029a5795-da10-4d39-9549-d3a57640ec9b-certificates\") pod \"keda-operator-68bff59c-4dj6g\" (UID: \"029a5795-da10-4d39-9549-d3a57640ec9b\") " pod="openshift-keda/keda-operator-68bff59c-4dj6g" Jul 02 12:45:54.145034 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:54.144993 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6w66\" (UniqueName: \"kubernetes.io/projected/d0f5fac2-8440-4c16-910d-97127c379704-kube-api-access-p6w66\") pod \"keda-metrics-apiserver-559f75f947-c6j5m\" (UID: \"d0f5fac2-8440-4c16-910d-97127c379704\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-c6j5m" Jul 02 12:45:54.145034 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:54.145041 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/d0f5fac2-8440-4c16-910d-97127c379704-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-c6j5m\" (UID: \"d0f5fac2-8440-4c16-910d-97127c379704\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-c6j5m" Jul 02 12:45:54.145266 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:54.145075 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/d0f5fac2-8440-4c16-910d-97127c379704-certificates\") pod \"keda-metrics-apiserver-559f75f947-c6j5m\" (UID: \"d0f5fac2-8440-4c16-910d-97127c379704\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-c6j5m" Jul 02 12:45:54.246034 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:54.246000 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/d0f5fac2-8440-4c16-910d-97127c379704-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-c6j5m\" (UID: \"d0f5fac2-8440-4c16-910d-97127c379704\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-c6j5m" Jul 02 12:45:54.246201 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:54.246043 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/d0f5fac2-8440-4c16-910d-97127c379704-certificates\") pod \"keda-metrics-apiserver-559f75f947-c6j5m\" (UID: \"d0f5fac2-8440-4c16-910d-97127c379704\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-c6j5m" Jul 02 12:45:54.246201 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:54.246111 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6w66\" (UniqueName: \"kubernetes.io/projected/d0f5fac2-8440-4c16-910d-97127c379704-kube-api-access-p6w66\") pod \"keda-metrics-apiserver-559f75f947-c6j5m\" (UID: \"d0f5fac2-8440-4c16-910d-97127c379704\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-c6j5m" Jul 02 12:45:54.246352 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:54.246332 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/d0f5fac2-8440-4c16-910d-97127c379704-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-c6j5m\" (UID: \"d0f5fac2-8440-4c16-910d-97127c379704\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-c6j5m" Jul 02 12:45:54.248468 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:54.248447 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/d0f5fac2-8440-4c16-910d-97127c379704-certificates\") pod \"keda-metrics-apiserver-559f75f947-c6j5m\" (UID: \"d0f5fac2-8440-4c16-910d-97127c379704\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-c6j5m" Jul 02 12:45:54.256012 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:54.255989 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6w66\" (UniqueName: \"kubernetes.io/projected/d0f5fac2-8440-4c16-910d-97127c379704-kube-api-access-p6w66\") pod \"keda-metrics-apiserver-559f75f947-c6j5m\" (UID: \"d0f5fac2-8440-4c16-910d-97127c379704\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-c6j5m" Jul 02 12:45:54.307094 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:54.307009 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-4dj6g" Jul 02 12:45:54.343688 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:54.343637 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-c6j5m" Jul 02 12:45:54.463400 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:54.463292 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-4dj6g"] Jul 02 12:45:54.467074 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:45:54.467044 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod029a5795_da10_4d39_9549_d3a57640ec9b.slice/crio-87a83016860ea5c75e09fe33c4fd8c916553e5c35fc78982dce68cd89856a304 WatchSource:0}: Error finding container 87a83016860ea5c75e09fe33c4fd8c916553e5c35fc78982dce68cd89856a304: Status 404 returned error can't find the container with id 87a83016860ea5c75e09fe33c4fd8c916553e5c35fc78982dce68cd89856a304 Jul 02 12:45:54.495499 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:54.495469 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-c6j5m"] Jul 02 12:45:54.498579 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:45:54.498552 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0f5fac2_8440_4c16_910d_97127c379704.slice/crio-13ec6284bd0de8abf7c94bfffbc50c0c46ee5e10091325ea1a95a642664bd0ba WatchSource:0}: Error finding container 13ec6284bd0de8abf7c94bfffbc50c0c46ee5e10091325ea1a95a642664bd0ba: Status 404 returned error can't find the container with id 13ec6284bd0de8abf7c94bfffbc50c0c46ee5e10091325ea1a95a642664bd0ba Jul 02 12:45:54.540999 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:54.540956 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-4dj6g" event={"ID":"029a5795-da10-4d39-9549-d3a57640ec9b","Type":"ContainerStarted","Data":"87a83016860ea5c75e09fe33c4fd8c916553e5c35fc78982dce68cd89856a304"} Jul 02 12:45:54.542013 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:54.541988 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-c6j5m" event={"ID":"d0f5fac2-8440-4c16-910d-97127c379704","Type":"ContainerStarted","Data":"13ec6284bd0de8abf7c94bfffbc50c0c46ee5e10091325ea1a95a642664bd0ba"} Jul 02 12:45:59.570938 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:59.570897 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-4dj6g" event={"ID":"029a5795-da10-4d39-9549-d3a57640ec9b","Type":"ContainerStarted","Data":"c7f2c5d4ff709f1840be8c19a41d251ccb0cdb97c837736e7bbe2f038df0c83f"} Jul 02 12:45:59.571408 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:59.571006 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-68bff59c-4dj6g" Jul 02 12:45:59.572372 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:59.572344 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-c6j5m" event={"ID":"d0f5fac2-8440-4c16-910d-97127c379704","Type":"ContainerStarted","Data":"b13af739cc1485a855fb76bb94d0543b5a7a731c5ee0e3d61d1cd0a546e57690"} Jul 02 12:45:59.572494 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:59.572469 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-c6j5m" Jul 02 12:45:59.587006 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:59.586957 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-68bff59c-4dj6g" podStartSLOduration=2.395734195 podStartE2EDuration="6.586940157s" totalImagesPullingTime="4.191205962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 12:45:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:45:59.585988723 +0000 UTC m=+441.486252378" watchObservedRunningTime="2026-07-02 12:45:59.586940157 +0000 UTC m=+441.487203808" Jul 02 12:45:59.601262 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:45:59.601216 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-559f75f947-c6j5m" podStartSLOduration=1.446396258 podStartE2EDuration="5.601199287s" totalImagesPullingTime="4.154803029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 12:45:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:45:59.600411384 +0000 UTC m=+441.500675037" watchObservedRunningTime="2026-07-02 12:45:59.601199287 +0000 UTC m=+441.501462940" Jul 02 12:46:10.582176 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:46:10.582147 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-c6j5m" Jul 02 12:46:14.545033 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:46:14.545005 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-rp9jm" Jul 02 12:46:20.579070 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:46:20.579045 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-68bff59c-4dj6g" Jul 02 12:46:53.284603 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:46:53.284567 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-748f6586df-djc9c"] Jul 02 12:46:53.287184 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:46:53.287166 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-748f6586df-djc9c" Jul 02 12:46:53.319735 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:46:53.319699 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-748f6586df-djc9c"] Jul 02 12:46:53.362596 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:46:53.362568 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fckb6\" (UniqueName: \"kubernetes.io/projected/1da7e513-5148-4a89-b453-87be9028b0cc-kube-api-access-fckb6\") pod \"console-748f6586df-djc9c\" (UID: \"1da7e513-5148-4a89-b453-87be9028b0cc\") " pod="openshift-console/console-748f6586df-djc9c" Jul 02 12:46:53.362811 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:46:53.362609 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1da7e513-5148-4a89-b453-87be9028b0cc-trusted-ca-bundle\") pod \"console-748f6586df-djc9c\" (UID: \"1da7e513-5148-4a89-b453-87be9028b0cc\") " pod="openshift-console/console-748f6586df-djc9c" Jul 02 12:46:53.362811 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:46:53.362631 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1da7e513-5148-4a89-b453-87be9028b0cc-service-ca\") pod \"console-748f6586df-djc9c\" (UID: \"1da7e513-5148-4a89-b453-87be9028b0cc\") " pod="openshift-console/console-748f6586df-djc9c" Jul 02 12:46:53.362811 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:46:53.362681 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1da7e513-5148-4a89-b453-87be9028b0cc-oauth-serving-cert\") pod \"console-748f6586df-djc9c\" (UID: \"1da7e513-5148-4a89-b453-87be9028b0cc\") " pod="openshift-console/console-748f6586df-djc9c" Jul 02 12:46:53.362811 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:46:53.362754 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1da7e513-5148-4a89-b453-87be9028b0cc-console-config\") pod \"console-748f6586df-djc9c\" (UID: \"1da7e513-5148-4a89-b453-87be9028b0cc\") " pod="openshift-console/console-748f6586df-djc9c" Jul 02 12:46:53.362811 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:46:53.362776 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1da7e513-5148-4a89-b453-87be9028b0cc-console-serving-cert\") pod \"console-748f6586df-djc9c\" (UID: \"1da7e513-5148-4a89-b453-87be9028b0cc\") " pod="openshift-console/console-748f6586df-djc9c" Jul 02 12:46:53.362811 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:46:53.362790 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1da7e513-5148-4a89-b453-87be9028b0cc-console-oauth-config\") pod \"console-748f6586df-djc9c\" (UID: \"1da7e513-5148-4a89-b453-87be9028b0cc\") " pod="openshift-console/console-748f6586df-djc9c" Jul 02 12:46:53.463453 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:46:53.463417 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1da7e513-5148-4a89-b453-87be9028b0cc-service-ca\") pod \"console-748f6586df-djc9c\" (UID: \"1da7e513-5148-4a89-b453-87be9028b0cc\") " pod="openshift-console/console-748f6586df-djc9c" Jul 02 12:46:53.463453 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:46:53.463454 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1da7e513-5148-4a89-b453-87be9028b0cc-oauth-serving-cert\") pod \"console-748f6586df-djc9c\" (UID: \"1da7e513-5148-4a89-b453-87be9028b0cc\") " pod="openshift-console/console-748f6586df-djc9c" Jul 02 12:46:53.463746 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:46:53.463515 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1da7e513-5148-4a89-b453-87be9028b0cc-console-config\") pod \"console-748f6586df-djc9c\" (UID: \"1da7e513-5148-4a89-b453-87be9028b0cc\") " pod="openshift-console/console-748f6586df-djc9c" Jul 02 12:46:53.463746 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:46:53.463541 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1da7e513-5148-4a89-b453-87be9028b0cc-console-serving-cert\") pod \"console-748f6586df-djc9c\" (UID: \"1da7e513-5148-4a89-b453-87be9028b0cc\") " pod="openshift-console/console-748f6586df-djc9c" Jul 02 12:46:53.463746 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:46:53.463562 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1da7e513-5148-4a89-b453-87be9028b0cc-console-oauth-config\") pod \"console-748f6586df-djc9c\" (UID: \"1da7e513-5148-4a89-b453-87be9028b0cc\") " pod="openshift-console/console-748f6586df-djc9c" Jul 02 12:46:53.463746 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:46:53.463624 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fckb6\" (UniqueName: \"kubernetes.io/projected/1da7e513-5148-4a89-b453-87be9028b0cc-kube-api-access-fckb6\") pod \"console-748f6586df-djc9c\" (UID: \"1da7e513-5148-4a89-b453-87be9028b0cc\") " pod="openshift-console/console-748f6586df-djc9c" Jul 02 12:46:53.463746 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:46:53.463700 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1da7e513-5148-4a89-b453-87be9028b0cc-trusted-ca-bundle\") pod \"console-748f6586df-djc9c\" (UID: \"1da7e513-5148-4a89-b453-87be9028b0cc\") " pod="openshift-console/console-748f6586df-djc9c" Jul 02 12:46:53.464712 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:46:53.464599 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1da7e513-5148-4a89-b453-87be9028b0cc-service-ca\") pod \"console-748f6586df-djc9c\" (UID: \"1da7e513-5148-4a89-b453-87be9028b0cc\") " pod="openshift-console/console-748f6586df-djc9c" Jul 02 12:46:53.464712 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:46:53.464643 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1da7e513-5148-4a89-b453-87be9028b0cc-console-config\") pod \"console-748f6586df-djc9c\" (UID: \"1da7e513-5148-4a89-b453-87be9028b0cc\") " pod="openshift-console/console-748f6586df-djc9c" Jul 02 12:46:53.464885 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:46:53.464742 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1da7e513-5148-4a89-b453-87be9028b0cc-oauth-serving-cert\") pod \"console-748f6586df-djc9c\" (UID: \"1da7e513-5148-4a89-b453-87be9028b0cc\") " pod="openshift-console/console-748f6586df-djc9c" Jul 02 12:46:53.464885 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:46:53.464850 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1da7e513-5148-4a89-b453-87be9028b0cc-trusted-ca-bundle\") pod \"console-748f6586df-djc9c\" (UID: \"1da7e513-5148-4a89-b453-87be9028b0cc\") " pod="openshift-console/console-748f6586df-djc9c" Jul 02 12:46:53.471120 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:46:53.471099 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1da7e513-5148-4a89-b453-87be9028b0cc-console-oauth-config\") pod \"console-748f6586df-djc9c\" (UID: \"1da7e513-5148-4a89-b453-87be9028b0cc\") " pod="openshift-console/console-748f6586df-djc9c" Jul 02 12:46:53.471241 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:46:53.471194 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1da7e513-5148-4a89-b453-87be9028b0cc-console-serving-cert\") pod \"console-748f6586df-djc9c\" (UID: \"1da7e513-5148-4a89-b453-87be9028b0cc\") " pod="openshift-console/console-748f6586df-djc9c" Jul 02 12:46:53.476242 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:46:53.476209 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fckb6\" (UniqueName: \"kubernetes.io/projected/1da7e513-5148-4a89-b453-87be9028b0cc-kube-api-access-fckb6\") pod \"console-748f6586df-djc9c\" (UID: \"1da7e513-5148-4a89-b453-87be9028b0cc\") " pod="openshift-console/console-748f6586df-djc9c" Jul 02 12:46:53.597214 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:46:53.597133 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-748f6586df-djc9c" Jul 02 12:46:53.748102 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:46:53.748072 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-748f6586df-djc9c"] Jul 02 12:46:53.751345 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:46:53.751318 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1da7e513_5148_4a89_b453_87be9028b0cc.slice/crio-6dd71c1c1fb9a3bad9019091f1c05dde5891d4c7512084a12597b1f0714b52e6 WatchSource:0}: Error finding container 6dd71c1c1fb9a3bad9019091f1c05dde5891d4c7512084a12597b1f0714b52e6: Status 404 returned error can't find the container with id 6dd71c1c1fb9a3bad9019091f1c05dde5891d4c7512084a12597b1f0714b52e6 Jul 02 12:46:53.817494 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:46:53.817461 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-748f6586df-djc9c" event={"ID":"1da7e513-5148-4a89-b453-87be9028b0cc","Type":"ContainerStarted","Data":"e5fa9f72126149af4df4d8960d5dd6a05bf8e1d9a979b1fc2595200643a4008c"} Jul 02 12:46:53.817648 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:46:53.817519 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-748f6586df-djc9c" event={"ID":"1da7e513-5148-4a89-b453-87be9028b0cc","Type":"ContainerStarted","Data":"6dd71c1c1fb9a3bad9019091f1c05dde5891d4c7512084a12597b1f0714b52e6"} Jul 02 12:46:53.844396 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:46:53.844335 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-748f6586df-djc9c" podStartSLOduration=0.84431416 podStartE2EDuration="844.31416ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 12:46:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:46:53.841369244 +0000 UTC m=+495.741632896" watchObservedRunningTime="2026-07-02 12:46:53.84431416 +0000 UTC m=+495.744577812" Jul 02 12:47:03.597728 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:03.597688 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-748f6586df-djc9c" Jul 02 12:47:03.598197 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:03.597753 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-748f6586df-djc9c" Jul 02 12:47:03.604014 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:03.603988 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-748f6586df-djc9c" Jul 02 12:47:03.871548 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:03.871456 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-748f6586df-djc9c" Jul 02 12:47:03.929742 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:03.929703 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7776db66f5-nkrmq"] Jul 02 12:47:04.320415 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:04.320381 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-wlx4q"] Jul 02 12:47:04.323070 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:04.323053 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-67d95fdc48-wlx4q" Jul 02 12:47:04.325810 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:04.325788 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Jul 02 12:47:04.325810 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:04.325808 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 02 12:47:04.326090 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:04.326074 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-zx228\"" Jul 02 12:47:04.326148 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:04.326083 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 02 12:47:04.353816 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:04.353785 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-wlx4q"] Jul 02 12:47:04.471571 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:04.471535 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5n9l\" (UniqueName: \"kubernetes.io/projected/19cf590e-d443-45a4-99e7-6fc7d0a98aae-kube-api-access-j5n9l\") pod \"llmisvc-controller-manager-67d95fdc48-wlx4q\" (UID: \"19cf590e-d443-45a4-99e7-6fc7d0a98aae\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-wlx4q" Jul 02 12:47:04.471810 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:04.471600 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19cf590e-d443-45a4-99e7-6fc7d0a98aae-cert\") pod \"llmisvc-controller-manager-67d95fdc48-wlx4q\" (UID: \"19cf590e-d443-45a4-99e7-6fc7d0a98aae\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-wlx4q" Jul 02 12:47:04.572360 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:04.572279 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5n9l\" (UniqueName: \"kubernetes.io/projected/19cf590e-d443-45a4-99e7-6fc7d0a98aae-kube-api-access-j5n9l\") pod \"llmisvc-controller-manager-67d95fdc48-wlx4q\" (UID: \"19cf590e-d443-45a4-99e7-6fc7d0a98aae\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-wlx4q" Jul 02 12:47:04.572360 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:04.572332 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19cf590e-d443-45a4-99e7-6fc7d0a98aae-cert\") pod \"llmisvc-controller-manager-67d95fdc48-wlx4q\" (UID: \"19cf590e-d443-45a4-99e7-6fc7d0a98aae\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-wlx4q" Jul 02 12:47:04.574735 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:04.574712 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19cf590e-d443-45a4-99e7-6fc7d0a98aae-cert\") pod \"llmisvc-controller-manager-67d95fdc48-wlx4q\" (UID: \"19cf590e-d443-45a4-99e7-6fc7d0a98aae\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-wlx4q" Jul 02 12:47:04.582970 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:04.582946 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5n9l\" (UniqueName: \"kubernetes.io/projected/19cf590e-d443-45a4-99e7-6fc7d0a98aae-kube-api-access-j5n9l\") pod \"llmisvc-controller-manager-67d95fdc48-wlx4q\" (UID: \"19cf590e-d443-45a4-99e7-6fc7d0a98aae\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-wlx4q" Jul 02 12:47:04.633823 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:04.633787 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-67d95fdc48-wlx4q" Jul 02 12:47:04.765084 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:04.765032 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-wlx4q"] Jul 02 12:47:04.767955 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:47:04.767924 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod19cf590e_d443_45a4_99e7_6fc7d0a98aae.slice/crio-cd9578266e85bb579d737d7f98515ea5519b4ce34c513e5eee7e7a7c6d994975 WatchSource:0}: Error finding container cd9578266e85bb579d737d7f98515ea5519b4ce34c513e5eee7e7a7c6d994975: Status 404 returned error can't find the container with id cd9578266e85bb579d737d7f98515ea5519b4ce34c513e5eee7e7a7c6d994975 Jul 02 12:47:04.867978 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:04.867888 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-wlx4q" event={"ID":"19cf590e-d443-45a4-99e7-6fc7d0a98aae","Type":"ContainerStarted","Data":"cd9578266e85bb579d737d7f98515ea5519b4ce34c513e5eee7e7a7c6d994975"} Jul 02 12:47:06.881694 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:06.881641 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-wlx4q" event={"ID":"19cf590e-d443-45a4-99e7-6fc7d0a98aae","Type":"ContainerStarted","Data":"3f35d7b586074ab139dce4badb9869e292af5fb60fd443857bf85666e97938f6"} Jul 02 12:47:06.882083 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:06.881770 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-wlx4q" Jul 02 12:47:06.897403 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:06.897351 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-67d95fdc48-wlx4q" podStartSLOduration=0.952522002 podStartE2EDuration="2.897332928s" totalImagesPullingTime="1.944810926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 12:47:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:47:06.896378994 +0000 UTC m=+508.796642646" watchObservedRunningTime="2026-07-02 12:47:06.897332928 +0000 UTC m=+508.797596582" Jul 02 12:47:28.952842 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:28.952766 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7776db66f5-nkrmq" podUID="e046eaaa-7c14-49cd-863d-f78019fa534e" containerName="console" containerID="cri-o://abccfbea8eba3594ccc6780a40224e1eaa2f615058e2b37fccc2bb67ff5cf6c4" gracePeriod=15 Jul 02 12:47:29.204163 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:29.204102 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7776db66f5-nkrmq" Jul 02 12:47:29.285391 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:29.285357 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e046eaaa-7c14-49cd-863d-f78019fa534e-trusted-ca-bundle\") pod \"e046eaaa-7c14-49cd-863d-f78019fa534e\" (UID: \"e046eaaa-7c14-49cd-863d-f78019fa534e\") " Jul 02 12:47:29.285391 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:29.285387 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e046eaaa-7c14-49cd-863d-f78019fa534e-console-serving-cert\") pod \"e046eaaa-7c14-49cd-863d-f78019fa534e\" (UID: \"e046eaaa-7c14-49cd-863d-f78019fa534e\") " Jul 02 12:47:29.285641 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:29.285415 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m8mrd\" (UniqueName: \"kubernetes.io/projected/e046eaaa-7c14-49cd-863d-f78019fa534e-kube-api-access-m8mrd\") pod \"e046eaaa-7c14-49cd-863d-f78019fa534e\" (UID: \"e046eaaa-7c14-49cd-863d-f78019fa534e\") " Jul 02 12:47:29.285641 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:29.285441 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e046eaaa-7c14-49cd-863d-f78019fa534e-service-ca\") pod \"e046eaaa-7c14-49cd-863d-f78019fa534e\" (UID: \"e046eaaa-7c14-49cd-863d-f78019fa534e\") " Jul 02 12:47:29.285641 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:29.285465 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e046eaaa-7c14-49cd-863d-f78019fa534e-console-oauth-config\") pod \"e046eaaa-7c14-49cd-863d-f78019fa534e\" (UID: \"e046eaaa-7c14-49cd-863d-f78019fa534e\") " Jul 02 12:47:29.285641 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:29.285502 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e046eaaa-7c14-49cd-863d-f78019fa534e-oauth-serving-cert\") pod \"e046eaaa-7c14-49cd-863d-f78019fa534e\" (UID: \"e046eaaa-7c14-49cd-863d-f78019fa534e\") " Jul 02 12:47:29.285641 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:29.285526 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e046eaaa-7c14-49cd-863d-f78019fa534e-console-config\") pod \"e046eaaa-7c14-49cd-863d-f78019fa534e\" (UID: \"e046eaaa-7c14-49cd-863d-f78019fa534e\") " Jul 02 12:47:29.285971 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:29.285943 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e046eaaa-7c14-49cd-863d-f78019fa534e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e046eaaa-7c14-49cd-863d-f78019fa534e" (UID: "e046eaaa-7c14-49cd-863d-f78019fa534e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 12:47:29.286029 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:29.285985 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e046eaaa-7c14-49cd-863d-f78019fa534e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e046eaaa-7c14-49cd-863d-f78019fa534e" (UID: "e046eaaa-7c14-49cd-863d-f78019fa534e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 12:47:29.286105 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:29.286081 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e046eaaa-7c14-49cd-863d-f78019fa534e-console-config" (OuterVolumeSpecName: "console-config") pod "e046eaaa-7c14-49cd-863d-f78019fa534e" (UID: "e046eaaa-7c14-49cd-863d-f78019fa534e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 12:47:29.286227 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:29.286163 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e046eaaa-7c14-49cd-863d-f78019fa534e-service-ca" (OuterVolumeSpecName: "service-ca") pod "e046eaaa-7c14-49cd-863d-f78019fa534e" (UID: "e046eaaa-7c14-49cd-863d-f78019fa534e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 12:47:29.287691 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:29.287646 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e046eaaa-7c14-49cd-863d-f78019fa534e-kube-api-access-m8mrd" (OuterVolumeSpecName: "kube-api-access-m8mrd") pod "e046eaaa-7c14-49cd-863d-f78019fa534e" (UID: "e046eaaa-7c14-49cd-863d-f78019fa534e"). InnerVolumeSpecName "kube-api-access-m8mrd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 12:47:29.287994 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:29.287973 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e046eaaa-7c14-49cd-863d-f78019fa534e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e046eaaa-7c14-49cd-863d-f78019fa534e" (UID: "e046eaaa-7c14-49cd-863d-f78019fa534e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 12:47:29.288071 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:29.287992 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e046eaaa-7c14-49cd-863d-f78019fa534e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e046eaaa-7c14-49cd-863d-f78019fa534e" (UID: "e046eaaa-7c14-49cd-863d-f78019fa534e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 12:47:29.386638 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:29.386600 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e046eaaa-7c14-49cd-863d-f78019fa534e-service-ca\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:47:29.386638 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:29.386633 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e046eaaa-7c14-49cd-863d-f78019fa534e-console-oauth-config\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:47:29.386638 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:29.386643 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e046eaaa-7c14-49cd-863d-f78019fa534e-oauth-serving-cert\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:47:29.386902 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:29.386678 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e046eaaa-7c14-49cd-863d-f78019fa534e-console-config\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:47:29.386902 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:29.386687 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e046eaaa-7c14-49cd-863d-f78019fa534e-trusted-ca-bundle\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:47:29.386902 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:29.386695 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e046eaaa-7c14-49cd-863d-f78019fa534e-console-serving-cert\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:47:29.386902 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:29.386704 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8mrd\" (UniqueName: \"kubernetes.io/projected/e046eaaa-7c14-49cd-863d-f78019fa534e-kube-api-access-m8mrd\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:47:29.985680 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:29.985587 2582 generic.go:356] "Generic (PLEG): container finished" podID="e046eaaa-7c14-49cd-863d-f78019fa534e" containerID="abccfbea8eba3594ccc6780a40224e1eaa2f615058e2b37fccc2bb67ff5cf6c4" exitCode=0 Jul 02 12:47:29.985680 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:29.985634 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7776db66f5-nkrmq" Jul 02 12:47:29.986152 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:29.985682 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7776db66f5-nkrmq" event={"ID":"e046eaaa-7c14-49cd-863d-f78019fa534e","Type":"ContainerDied","Data":"abccfbea8eba3594ccc6780a40224e1eaa2f615058e2b37fccc2bb67ff5cf6c4"} Jul 02 12:47:29.986152 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:29.985741 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7776db66f5-nkrmq" event={"ID":"e046eaaa-7c14-49cd-863d-f78019fa534e","Type":"ContainerDied","Data":"dba9caa5afeea65003dc85cf44e6453c6bfbf0b72f3b7dde6b319834bce4fd03"} Jul 02 12:47:29.986152 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:29.985770 2582 scope.go:117] "RemoveContainer" containerID="abccfbea8eba3594ccc6780a40224e1eaa2f615058e2b37fccc2bb67ff5cf6c4" Jul 02 12:47:29.994675 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:29.994643 2582 scope.go:117] "RemoveContainer" containerID="abccfbea8eba3594ccc6780a40224e1eaa2f615058e2b37fccc2bb67ff5cf6c4" Jul 02 12:47:29.994932 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:47:29.994915 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abccfbea8eba3594ccc6780a40224e1eaa2f615058e2b37fccc2bb67ff5cf6c4\": container with ID starting with abccfbea8eba3594ccc6780a40224e1eaa2f615058e2b37fccc2bb67ff5cf6c4 not found: ID does not exist" containerID="abccfbea8eba3594ccc6780a40224e1eaa2f615058e2b37fccc2bb67ff5cf6c4" Jul 02 12:47:29.994976 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:29.994940 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abccfbea8eba3594ccc6780a40224e1eaa2f615058e2b37fccc2bb67ff5cf6c4"} err="failed to get container status \"abccfbea8eba3594ccc6780a40224e1eaa2f615058e2b37fccc2bb67ff5cf6c4\": rpc error: code = NotFound desc = could not find container \"abccfbea8eba3594ccc6780a40224e1eaa2f615058e2b37fccc2bb67ff5cf6c4\": container with ID starting with abccfbea8eba3594ccc6780a40224e1eaa2f615058e2b37fccc2bb67ff5cf6c4 not found: ID does not exist" Jul 02 12:47:30.005464 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:30.005442 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7776db66f5-nkrmq"] Jul 02 12:47:30.008995 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:30.008974 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7776db66f5-nkrmq"] Jul 02 12:47:30.574274 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:30.574235 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e046eaaa-7c14-49cd-863d-f78019fa534e" path="/var/lib/kubelet/pods/e046eaaa-7c14-49cd-863d-f78019fa534e/volumes" Jul 02 12:47:37.889517 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:47:37.889480 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-wlx4q" Jul 02 12:48:12.340503 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:48:12.340467 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-fd65d7d6-44hmj"] Jul 02 12:48:12.340990 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:48:12.340869 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e046eaaa-7c14-49cd-863d-f78019fa534e" containerName="console" Jul 02 12:48:12.340990 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:48:12.340882 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e046eaaa-7c14-49cd-863d-f78019fa534e" containerName="console" Jul 02 12:48:12.340990 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:48:12.340947 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e046eaaa-7c14-49cd-863d-f78019fa534e" containerName="console" Jul 02 12:48:12.343062 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:48:12.343046 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-84b54b7f97-sjw88"] Jul 02 12:48:12.343172 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:48:12.343153 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-44hmj" Jul 02 12:48:12.345434 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:48:12.345417 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-84b54b7f97-sjw88" Jul 02 12:48:12.353643 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:48:12.353615 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\"" Jul 02 12:48:12.353759 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:48:12.353711 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\"" Jul 02 12:48:12.354172 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:48:12.354159 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-6wz5z\"" Jul 02 12:48:12.354239 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:48:12.354161 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-q9975\"" Jul 02 12:48:12.360023 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:48:12.360002 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbp7j\" (UniqueName: \"kubernetes.io/projected/a16f5d9f-f38d-451c-9b72-c3533b6ae0d1-kube-api-access-fbp7j\") pod \"model-serving-api-fd65d7d6-44hmj\" (UID: \"a16f5d9f-f38d-451c-9b72-c3533b6ae0d1\") " pod="kserve/model-serving-api-fd65d7d6-44hmj" Jul 02 12:48:12.360101 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:48:12.360035 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jnjt\" (UniqueName: \"kubernetes.io/projected/3d581ca6-8a62-4597-84ab-11c0d48a26e9-kube-api-access-7jnjt\") pod \"odh-model-controller-84b54b7f97-sjw88\" (UID: \"3d581ca6-8a62-4597-84ab-11c0d48a26e9\") " pod="kserve/odh-model-controller-84b54b7f97-sjw88" Jul 02 12:48:12.360141 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:48:12.360108 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a16f5d9f-f38d-451c-9b72-c3533b6ae0d1-tls-certs\") pod \"model-serving-api-fd65d7d6-44hmj\" (UID: \"a16f5d9f-f38d-451c-9b72-c3533b6ae0d1\") " pod="kserve/model-serving-api-fd65d7d6-44hmj" Jul 02 12:48:12.360175 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:48:12.360158 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d581ca6-8a62-4597-84ab-11c0d48a26e9-cert\") pod \"odh-model-controller-84b54b7f97-sjw88\" (UID: \"3d581ca6-8a62-4597-84ab-11c0d48a26e9\") " pod="kserve/odh-model-controller-84b54b7f97-sjw88" Jul 02 12:48:12.365154 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:48:12.365125 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-44hmj"] Jul 02 12:48:12.381117 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:48:12.381095 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-84b54b7f97-sjw88"] Jul 02 12:48:12.460588 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:48:12.460554 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d581ca6-8a62-4597-84ab-11c0d48a26e9-cert\") pod \"odh-model-controller-84b54b7f97-sjw88\" (UID: \"3d581ca6-8a62-4597-84ab-11c0d48a26e9\") " pod="kserve/odh-model-controller-84b54b7f97-sjw88" Jul 02 12:48:12.460821 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:48:12.460615 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbp7j\" (UniqueName: \"kubernetes.io/projected/a16f5d9f-f38d-451c-9b72-c3533b6ae0d1-kube-api-access-fbp7j\") pod \"model-serving-api-fd65d7d6-44hmj\" (UID: \"a16f5d9f-f38d-451c-9b72-c3533b6ae0d1\") " pod="kserve/model-serving-api-fd65d7d6-44hmj" Jul 02 12:48:12.460821 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:48:12.460647 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jnjt\" (UniqueName: \"kubernetes.io/projected/3d581ca6-8a62-4597-84ab-11c0d48a26e9-kube-api-access-7jnjt\") pod \"odh-model-controller-84b54b7f97-sjw88\" (UID: \"3d581ca6-8a62-4597-84ab-11c0d48a26e9\") " pod="kserve/odh-model-controller-84b54b7f97-sjw88" Jul 02 12:48:12.460821 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:48:12.460706 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a16f5d9f-f38d-451c-9b72-c3533b6ae0d1-tls-certs\") pod \"model-serving-api-fd65d7d6-44hmj\" (UID: \"a16f5d9f-f38d-451c-9b72-c3533b6ae0d1\") " pod="kserve/model-serving-api-fd65d7d6-44hmj" Jul 02 12:48:12.460821 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:48:12.460725 2582 secret.go:189] Couldn't get secret kserve/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 02 12:48:12.460821 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:48:12.460804 2582 secret.go:189] Couldn't get secret kserve/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 02 12:48:12.461060 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:48:12.460816 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d581ca6-8a62-4597-84ab-11c0d48a26e9-cert podName:3d581ca6-8a62-4597-84ab-11c0d48a26e9 nodeName:}" failed. No retries permitted until 2026-07-02 12:48:12.960791269 +0000 UTC m=+574.861054900 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3d581ca6-8a62-4597-84ab-11c0d48a26e9-cert") pod "odh-model-controller-84b54b7f97-sjw88" (UID: "3d581ca6-8a62-4597-84ab-11c0d48a26e9") : secret "odh-model-controller-webhook-cert" not found Jul 02 12:48:12.461060 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:48:12.460880 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a16f5d9f-f38d-451c-9b72-c3533b6ae0d1-tls-certs podName:a16f5d9f-f38d-451c-9b72-c3533b6ae0d1 nodeName:}" failed. No retries permitted until 2026-07-02 12:48:12.960863962 +0000 UTC m=+574.861127596 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/a16f5d9f-f38d-451c-9b72-c3533b6ae0d1-tls-certs") pod "model-serving-api-fd65d7d6-44hmj" (UID: "a16f5d9f-f38d-451c-9b72-c3533b6ae0d1") : secret "model-serving-api-tls" not found Jul 02 12:48:12.486384 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:48:12.486355 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbp7j\" (UniqueName: \"kubernetes.io/projected/a16f5d9f-f38d-451c-9b72-c3533b6ae0d1-kube-api-access-fbp7j\") pod \"model-serving-api-fd65d7d6-44hmj\" (UID: \"a16f5d9f-f38d-451c-9b72-c3533b6ae0d1\") " pod="kserve/model-serving-api-fd65d7d6-44hmj" Jul 02 12:48:12.487561 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:48:12.487540 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jnjt\" (UniqueName: \"kubernetes.io/projected/3d581ca6-8a62-4597-84ab-11c0d48a26e9-kube-api-access-7jnjt\") pod \"odh-model-controller-84b54b7f97-sjw88\" (UID: \"3d581ca6-8a62-4597-84ab-11c0d48a26e9\") " pod="kserve/odh-model-controller-84b54b7f97-sjw88" Jul 02 12:48:12.965983 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:48:12.965946 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d581ca6-8a62-4597-84ab-11c0d48a26e9-cert\") pod \"odh-model-controller-84b54b7f97-sjw88\" (UID: \"3d581ca6-8a62-4597-84ab-11c0d48a26e9\") " pod="kserve/odh-model-controller-84b54b7f97-sjw88" Jul 02 12:48:12.966180 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:48:12.966012 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a16f5d9f-f38d-451c-9b72-c3533b6ae0d1-tls-certs\") pod \"model-serving-api-fd65d7d6-44hmj\" (UID: \"a16f5d9f-f38d-451c-9b72-c3533b6ae0d1\") " pod="kserve/model-serving-api-fd65d7d6-44hmj" Jul 02 12:48:12.968373 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:48:12.968344 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a16f5d9f-f38d-451c-9b72-c3533b6ae0d1-tls-certs\") pod \"model-serving-api-fd65d7d6-44hmj\" (UID: \"a16f5d9f-f38d-451c-9b72-c3533b6ae0d1\") " pod="kserve/model-serving-api-fd65d7d6-44hmj" Jul 02 12:48:12.968531 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:48:12.968508 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d581ca6-8a62-4597-84ab-11c0d48a26e9-cert\") pod \"odh-model-controller-84b54b7f97-sjw88\" (UID: \"3d581ca6-8a62-4597-84ab-11c0d48a26e9\") " pod="kserve/odh-model-controller-84b54b7f97-sjw88" Jul 02 12:48:13.254610 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:48:13.254511 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-44hmj" Jul 02 12:48:13.260798 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:48:13.260763 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-84b54b7f97-sjw88" Jul 02 12:48:13.399612 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:48:13.399574 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-44hmj"] Jul 02 12:48:13.403817 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:48:13.403774 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda16f5d9f_f38d_451c_9b72_c3533b6ae0d1.slice/crio-1ea51e752981357c15a935a681787b97d9cacb58dac657eaf2a5c62e2b16c615 WatchSource:0}: Error finding container 1ea51e752981357c15a935a681787b97d9cacb58dac657eaf2a5c62e2b16c615: Status 404 returned error can't find the container with id 1ea51e752981357c15a935a681787b97d9cacb58dac657eaf2a5c62e2b16c615 Jul 02 12:48:13.418115 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:48:13.418092 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-84b54b7f97-sjw88"] Jul 02 12:48:13.420571 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:48:13.420547 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d581ca6_8a62_4597_84ab_11c0d48a26e9.slice/crio-73f42e6f5a4b10d5a699fdc50f0d97dafee5c9f7fc91c6659748c4e605e451d6 WatchSource:0}: Error finding container 73f42e6f5a4b10d5a699fdc50f0d97dafee5c9f7fc91c6659748c4e605e451d6: Status 404 returned error can't find the container with id 73f42e6f5a4b10d5a699fdc50f0d97dafee5c9f7fc91c6659748c4e605e451d6 Jul 02 12:48:14.189070 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:48:14.189027 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-84b54b7f97-sjw88" event={"ID":"3d581ca6-8a62-4597-84ab-11c0d48a26e9","Type":"ContainerStarted","Data":"73f42e6f5a4b10d5a699fdc50f0d97dafee5c9f7fc91c6659748c4e605e451d6"} Jul 02 12:48:14.191371 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:48:14.191306 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-44hmj" event={"ID":"a16f5d9f-f38d-451c-9b72-c3533b6ae0d1","Type":"ContainerStarted","Data":"1ea51e752981357c15a935a681787b97d9cacb58dac657eaf2a5c62e2b16c615"} Jul 02 12:48:17.209573 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:48:17.209536 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-84b54b7f97-sjw88" event={"ID":"3d581ca6-8a62-4597-84ab-11c0d48a26e9","Type":"ContainerStarted","Data":"906f44af01186b3121c457a97412749e802dfec78bcc53aa00e8b31b6d245fa1"} Jul 02 12:48:17.210061 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:48:17.209669 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-84b54b7f97-sjw88" Jul 02 12:48:17.211190 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:48:17.211158 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-44hmj" event={"ID":"a16f5d9f-f38d-451c-9b72-c3533b6ae0d1","Type":"ContainerStarted","Data":"75eebe91b1f7286bbda66e922d491eac8977f1fed30759a535da6785e5008f43"} Jul 02 12:48:17.211313 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:48:17.211204 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-fd65d7d6-44hmj" Jul 02 12:48:17.228313 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:48:17.228270 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/odh-model-controller-84b54b7f97-sjw88" podStartSLOduration=1.587547426 podStartE2EDuration="5.22825621s" totalImagesPullingTime="3.640708784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 12:48:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:48:17.227234451 +0000 UTC m=+579.127498126" watchObservedRunningTime="2026-07-02 12:48:17.22825621 +0000 UTC m=+579.128519862" Jul 02 12:48:17.252802 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:48:17.252745 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/model-serving-api-fd65d7d6-44hmj" podStartSLOduration=1.6008077219999999 podStartE2EDuration="5.252727077s" totalImagesPullingTime="3.651919355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 12:48:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:48:17.25161378 +0000 UTC m=+579.151877431" watchObservedRunningTime="2026-07-02 12:48:17.252727077 +0000 UTC m=+579.152990728" Jul 02 12:48:28.218777 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:48:28.218750 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-84b54b7f97-sjw88" Jul 02 12:48:28.220544 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:48:28.220526 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-fd65d7d6-44hmj" Jul 02 12:48:38.536944 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:48:38.536917 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-sqd4q_95b6074d-8908-400e-85c7-c2d989e4b2d3/console-operator/1.log" Jul 02 12:48:38.538027 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:48:38.537999 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-sqd4q_95b6074d-8908-400e-85c7-c2d989e4b2d3/console-operator/1.log" Jul 02 12:48:38.539822 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:48:38.539803 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfrv8_45891c6f-888b-490a-907f-1f58e3947b8a/ovn-acl-logging/0.log" Jul 02 12:48:38.540672 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:48:38.540639 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfrv8_45891c6f-888b-490a-907f-1f58e3947b8a/ovn-acl-logging/0.log" Jul 02 12:50:13.015740 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:50:13.015701 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd"] Jul 02 12:50:13.018793 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:50:13.018771 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd" Jul 02 12:50:13.021494 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:50:13.021474 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\"" Jul 02 12:50:13.021775 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:50:13.021758 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 02 12:50:13.021853 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:50:13.021838 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\"" Jul 02 12:50:13.023147 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:50:13.023127 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-p74sx\"" Jul 02 12:50:13.023569 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:50:13.023542 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\"" Jul 02 12:50:13.023668 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:50:13.023583 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\"" Jul 02 12:50:13.023805 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:50:13.023791 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-predictor-serving-cert\"" Jul 02 12:50:13.032902 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:50:13.032882 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd"] Jul 02 12:50:13.160405 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:50:13.160373 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/eda568ff-555c-4dec-b550-7b68621524b4-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd\" (UID: \"eda568ff-555c-4dec-b550-7b68621524b4\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd" Jul 02 12:50:13.160600 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:50:13.160429 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xxgj\" (UniqueName: \"kubernetes.io/projected/eda568ff-555c-4dec-b550-7b68621524b4-kube-api-access-6xxgj\") pod \"isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd\" (UID: \"eda568ff-555c-4dec-b550-7b68621524b4\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd" Jul 02 12:50:13.160600 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:50:13.160487 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/eda568ff-555c-4dec-b550-7b68621524b4-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd\" (UID: \"eda568ff-555c-4dec-b550-7b68621524b4\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd" Jul 02 12:50:13.160600 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:50:13.160534 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/eda568ff-555c-4dec-b550-7b68621524b4-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd\" (UID: \"eda568ff-555c-4dec-b550-7b68621524b4\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd" Jul 02 12:50:13.160600 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:50:13.160561 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/eda568ff-555c-4dec-b550-7b68621524b4-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd\" (UID: \"eda568ff-555c-4dec-b550-7b68621524b4\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd" Jul 02 12:50:13.261482 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:50:13.261444 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/eda568ff-555c-4dec-b550-7b68621524b4-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd\" (UID: \"eda568ff-555c-4dec-b550-7b68621524b4\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd" Jul 02 12:50:13.261482 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:50:13.261488 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xxgj\" (UniqueName: \"kubernetes.io/projected/eda568ff-555c-4dec-b550-7b68621524b4-kube-api-access-6xxgj\") pod \"isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd\" (UID: \"eda568ff-555c-4dec-b550-7b68621524b4\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd" Jul 02 12:50:13.261734 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:50:13.261518 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/eda568ff-555c-4dec-b550-7b68621524b4-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd\" (UID: \"eda568ff-555c-4dec-b550-7b68621524b4\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd" Jul 02 12:50:13.261734 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:50:13.261545 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/eda568ff-555c-4dec-b550-7b68621524b4-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd\" (UID: \"eda568ff-555c-4dec-b550-7b68621524b4\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd" Jul 02 12:50:13.261734 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:50:13.261564 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/eda568ff-555c-4dec-b550-7b68621524b4-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd\" (UID: \"eda568ff-555c-4dec-b550-7b68621524b4\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd" Jul 02 12:50:13.261955 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:50:13.261932 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/eda568ff-555c-4dec-b550-7b68621524b4-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd\" (UID: \"eda568ff-555c-4dec-b550-7b68621524b4\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd" Jul 02 12:50:13.262220 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:50:13.262196 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/eda568ff-555c-4dec-b550-7b68621524b4-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd\" (UID: \"eda568ff-555c-4dec-b550-7b68621524b4\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd" Jul 02 12:50:13.262342 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:50:13.262250 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/eda568ff-555c-4dec-b550-7b68621524b4-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd\" (UID: \"eda568ff-555c-4dec-b550-7b68621524b4\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd" Jul 02 12:50:13.263964 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:50:13.263948 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/eda568ff-555c-4dec-b550-7b68621524b4-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd\" (UID: \"eda568ff-555c-4dec-b550-7b68621524b4\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd" Jul 02 12:50:13.269921 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:50:13.269864 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xxgj\" (UniqueName: \"kubernetes.io/projected/eda568ff-555c-4dec-b550-7b68621524b4-kube-api-access-6xxgj\") pod \"isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd\" (UID: \"eda568ff-555c-4dec-b550-7b68621524b4\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd" Jul 02 12:50:13.329608 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:50:13.329576 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd" Jul 02 12:50:13.471591 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:50:13.471565 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd"] Jul 02 12:50:13.474443 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:50:13.474415 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeda568ff_555c_4dec_b550_7b68621524b4.slice/crio-fc39e4e6cf1476abc51642c1c2f5377ba03ebb5be3f59d58df507c1813039344 WatchSource:0}: Error finding container fc39e4e6cf1476abc51642c1c2f5377ba03ebb5be3f59d58df507c1813039344: Status 404 returned error can't find the container with id fc39e4e6cf1476abc51642c1c2f5377ba03ebb5be3f59d58df507c1813039344 Jul 02 12:50:13.749017 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:50:13.748978 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd" event={"ID":"eda568ff-555c-4dec-b550-7b68621524b4","Type":"ContainerStarted","Data":"fc39e4e6cf1476abc51642c1c2f5377ba03ebb5be3f59d58df507c1813039344"} Jul 02 12:50:17.773684 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:50:17.773636 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd" event={"ID":"eda568ff-555c-4dec-b550-7b68621524b4","Type":"ContainerStarted","Data":"4e6fb8554f029be9bc8f6cf8ffe61edc781df5b2b7b8970cf1050a469eb69fb7"} Jul 02 12:50:20.789205 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:50:20.789171 2582 generic.go:356] "Generic (PLEG): container finished" podID="eda568ff-555c-4dec-b550-7b68621524b4" containerID="4e6fb8554f029be9bc8f6cf8ffe61edc781df5b2b7b8970cf1050a469eb69fb7" exitCode=0 Jul 02 12:50:20.789603 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:50:20.789243 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd" event={"ID":"eda568ff-555c-4dec-b550-7b68621524b4","Type":"ContainerDied","Data":"4e6fb8554f029be9bc8f6cf8ffe61edc781df5b2b7b8970cf1050a469eb69fb7"} Jul 02 12:50:34.306581 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:50:34.306562 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 12:50:34.886444 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:50:34.886358 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd" event={"ID":"eda568ff-555c-4dec-b550-7b68621524b4","Type":"ContainerStarted","Data":"95d309578158d5aefde01fa2ebd8a1d1a515e7b0850e4a11219089bd482c6202"} Jul 02 12:50:36.898871 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:50:36.898769 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd" event={"ID":"eda568ff-555c-4dec-b550-7b68621524b4","Type":"ContainerStarted","Data":"e1976e194f58e147f13e76c4efa43d6148649c1849ac9c481211f1a91ff7fd9e"} Jul 02 12:50:36.898871 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:50:36.898850 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd" Jul 02 12:50:36.899365 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:50:36.898989 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd" Jul 02 12:50:36.900440 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:50:36.900415 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd" podUID="eda568ff-555c-4dec-b550-7b68621524b4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.36:8080: connect: connection refused" Jul 02 12:50:37.905516 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:50:37.905467 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd" podUID="eda568ff-555c-4dec-b550-7b68621524b4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.36:8080: connect: connection refused" Jul 02 12:50:42.910291 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:50:42.910261 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd" Jul 02 12:50:42.910842 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:50:42.910816 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd" podUID="eda568ff-555c-4dec-b550-7b68621524b4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.36:8080: connect: connection refused" Jul 02 12:50:42.930258 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:50:42.930206 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd" podStartSLOduration=8.266754016 podStartE2EDuration="30.930186494s" totalImagesPullingTime="19.072994386s" totalInitContainerRuntime="3.590438092s" isStatefulPod=false podCreationTimestamp="2026-07-02 12:50:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:50:36.957071548 +0000 UTC m=+718.857335200" watchObservedRunningTime="2026-07-02 12:50:42.930186494 +0000 UTC m=+724.830450146" Jul 02 12:50:52.910772 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:50:52.910731 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd" podUID="eda568ff-555c-4dec-b550-7b68621524b4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.36:8080: connect: connection refused" Jul 02 12:51:02.910747 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:51:02.910701 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd" podUID="eda568ff-555c-4dec-b550-7b68621524b4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.36:8080: connect: connection refused" Jul 02 12:51:12.911048 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:51:12.911010 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd" podUID="eda568ff-555c-4dec-b550-7b68621524b4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.36:8080: connect: connection refused" Jul 02 12:51:22.910986 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:51:22.910943 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd" podUID="eda568ff-555c-4dec-b550-7b68621524b4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.36:8080: connect: connection refused" Jul 02 12:51:32.501902 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:51:32.501869 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-75b89-6449db88c5-qt9lc"] Jul 02 12:51:32.504619 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:51:32.504602 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-75b89-6449db88c5-qt9lc" Jul 02 12:51:32.506667 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:51:32.506635 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-75b89-kube-rbac-proxy-sar-config\"" Jul 02 12:51:32.506785 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:51:32.506722 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-75b89-serving-cert\"" Jul 02 12:51:32.514231 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:51:32.514205 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-75b89-6449db88c5-qt9lc"] Jul 02 12:51:32.575900 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:51:32.575868 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a689b081-9855-4c37-a268-7bfa6c95ce35-openshift-service-ca-bundle\") pod \"switch-graph-75b89-6449db88c5-qt9lc\" (UID: \"a689b081-9855-4c37-a268-7bfa6c95ce35\") " pod="kserve-ci-e2e-test/switch-graph-75b89-6449db88c5-qt9lc" Jul 02 12:51:32.576070 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:51:32.575970 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a689b081-9855-4c37-a268-7bfa6c95ce35-proxy-tls\") pod \"switch-graph-75b89-6449db88c5-qt9lc\" (UID: \"a689b081-9855-4c37-a268-7bfa6c95ce35\") " pod="kserve-ci-e2e-test/switch-graph-75b89-6449db88c5-qt9lc" Jul 02 12:51:32.677141 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:51:32.677106 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a689b081-9855-4c37-a268-7bfa6c95ce35-openshift-service-ca-bundle\") pod \"switch-graph-75b89-6449db88c5-qt9lc\" (UID: \"a689b081-9855-4c37-a268-7bfa6c95ce35\") " pod="kserve-ci-e2e-test/switch-graph-75b89-6449db88c5-qt9lc" Jul 02 12:51:32.677342 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:51:32.677189 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a689b081-9855-4c37-a268-7bfa6c95ce35-proxy-tls\") pod \"switch-graph-75b89-6449db88c5-qt9lc\" (UID: \"a689b081-9855-4c37-a268-7bfa6c95ce35\") " pod="kserve-ci-e2e-test/switch-graph-75b89-6449db88c5-qt9lc" Jul 02 12:51:32.677342 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:51:32.677280 2582 secret.go:189] Couldn't get secret kserve-ci-e2e-test/switch-graph-75b89-serving-cert: secret "switch-graph-75b89-serving-cert" not found Jul 02 12:51:32.677342 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:51:32.677343 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a689b081-9855-4c37-a268-7bfa6c95ce35-proxy-tls podName:a689b081-9855-4c37-a268-7bfa6c95ce35 nodeName:}" failed. No retries permitted until 2026-07-02 12:51:33.177325672 +0000 UTC m=+775.077589302 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/a689b081-9855-4c37-a268-7bfa6c95ce35-proxy-tls") pod "switch-graph-75b89-6449db88c5-qt9lc" (UID: "a689b081-9855-4c37-a268-7bfa6c95ce35") : secret "switch-graph-75b89-serving-cert" not found Jul 02 12:51:32.677885 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:51:32.677859 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a689b081-9855-4c37-a268-7bfa6c95ce35-openshift-service-ca-bundle\") pod \"switch-graph-75b89-6449db88c5-qt9lc\" (UID: \"a689b081-9855-4c37-a268-7bfa6c95ce35\") " pod="kserve-ci-e2e-test/switch-graph-75b89-6449db88c5-qt9lc" Jul 02 12:51:32.911583 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:51:32.911491 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd" podUID="eda568ff-555c-4dec-b550-7b68621524b4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.36:8080: connect: connection refused" Jul 02 12:51:33.182071 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:51:33.182039 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a689b081-9855-4c37-a268-7bfa6c95ce35-proxy-tls\") pod \"switch-graph-75b89-6449db88c5-qt9lc\" (UID: \"a689b081-9855-4c37-a268-7bfa6c95ce35\") " pod="kserve-ci-e2e-test/switch-graph-75b89-6449db88c5-qt9lc" Jul 02 12:51:33.184578 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:51:33.184554 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a689b081-9855-4c37-a268-7bfa6c95ce35-proxy-tls\") pod \"switch-graph-75b89-6449db88c5-qt9lc\" (UID: \"a689b081-9855-4c37-a268-7bfa6c95ce35\") " pod="kserve-ci-e2e-test/switch-graph-75b89-6449db88c5-qt9lc" Jul 02 12:51:33.415169 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:51:33.415132 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-75b89-6449db88c5-qt9lc" Jul 02 12:51:33.549109 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:51:33.549084 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-75b89-6449db88c5-qt9lc"] Jul 02 12:51:33.551762 ip-10-0-140-7 kubenswrapper[2582]: W0702 12:51:33.551735 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda689b081_9855_4c37_a268_7bfa6c95ce35.slice/crio-1177940feeca265b674529071156a903d910e1e815d12bbff092e1a55c738cca WatchSource:0}: Error finding container 1177940feeca265b674529071156a903d910e1e815d12bbff092e1a55c738cca: Status 404 returned error can't find the container with id 1177940feeca265b674529071156a903d910e1e815d12bbff092e1a55c738cca Jul 02 12:51:34.170982 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:51:34.170942 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-75b89-6449db88c5-qt9lc" event={"ID":"a689b081-9855-4c37-a268-7bfa6c95ce35","Type":"ContainerStarted","Data":"1177940feeca265b674529071156a903d910e1e815d12bbff092e1a55c738cca"} Jul 02 12:51:36.183280 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:51:36.183242 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-75b89-6449db88c5-qt9lc" event={"ID":"a689b081-9855-4c37-a268-7bfa6c95ce35","Type":"ContainerStarted","Data":"4ad1fc2afd0165a3b1dbbc7cfe2eb3ac3c64ce577cbccb4f15dbdbc8d4c9157b"} Jul 02 12:51:36.183767 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:51:36.183340 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-75b89-6449db88c5-qt9lc" Jul 02 12:51:36.200152 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:51:36.200104 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-75b89-6449db88c5-qt9lc" podStartSLOduration=1.962538323 podStartE2EDuration="4.200088736s" totalImagesPullingTime="2.237550413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 12:51:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 12:51:36.199199455 +0000 UTC m=+778.099463108" watchObservedRunningTime="2026-07-02 12:51:36.200088736 +0000 UTC m=+778.100352388" Jul 02 12:51:42.195228 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:51:42.195201 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-75b89-6449db88c5-qt9lc" Jul 02 12:51:42.627899 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:51:42.627818 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-75b89-6449db88c5-qt9lc"] Jul 02 12:51:42.628088 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:51:42.628042 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-75b89-6449db88c5-qt9lc" podUID="a689b081-9855-4c37-a268-7bfa6c95ce35" containerName="switch-graph-75b89" containerID="cri-o://4ad1fc2afd0165a3b1dbbc7cfe2eb3ac3c64ce577cbccb4f15dbdbc8d4c9157b" gracePeriod=30 Jul 02 12:51:42.910887 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:51:42.910802 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd" podUID="eda568ff-555c-4dec-b550-7b68621524b4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.36:8080: connect: connection refused" Jul 02 12:51:47.194437 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:51:47.194394 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-75b89-6449db88c5-qt9lc" podUID="a689b081-9855-4c37-a268-7bfa6c95ce35" containerName="switch-graph-75b89" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 12:51:51.571015 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:51:51.570985 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd" Jul 02 12:51:52.194073 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:51:52.194038 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-75b89-6449db88c5-qt9lc" podUID="a689b081-9855-4c37-a268-7bfa6c95ce35" containerName="switch-graph-75b89" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 12:51:57.193444 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:51:57.193405 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-75b89-6449db88c5-qt9lc" podUID="a689b081-9855-4c37-a268-7bfa6c95ce35" containerName="switch-graph-75b89" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 12:51:57.193932 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:51:57.193515 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-75b89-6449db88c5-qt9lc" Jul 02 12:52:02.193950 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:02.193861 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-75b89-6449db88c5-qt9lc" podUID="a689b081-9855-4c37-a268-7bfa6c95ce35" containerName="switch-graph-75b89" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 12:52:07.194104 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:07.194067 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-75b89-6449db88c5-qt9lc" podUID="a689b081-9855-4c37-a268-7bfa6c95ce35" containerName="switch-graph-75b89" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 12:52:12.193735 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:12.193695 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-75b89-6449db88c5-qt9lc" podUID="a689b081-9855-4c37-a268-7bfa6c95ce35" containerName="switch-graph-75b89" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 12:52:12.782557 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:12.782534 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-75b89-6449db88c5-qt9lc" Jul 02 12:52:12.839942 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:12.839905 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a689b081-9855-4c37-a268-7bfa6c95ce35-proxy-tls\") pod \"a689b081-9855-4c37-a268-7bfa6c95ce35\" (UID: \"a689b081-9855-4c37-a268-7bfa6c95ce35\") " Jul 02 12:52:12.840103 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:12.840026 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a689b081-9855-4c37-a268-7bfa6c95ce35-openshift-service-ca-bundle\") pod \"a689b081-9855-4c37-a268-7bfa6c95ce35\" (UID: \"a689b081-9855-4c37-a268-7bfa6c95ce35\") " Jul 02 12:52:12.840409 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:12.840385 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a689b081-9855-4c37-a268-7bfa6c95ce35-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "a689b081-9855-4c37-a268-7bfa6c95ce35" (UID: "a689b081-9855-4c37-a268-7bfa6c95ce35"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 12:52:12.842041 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:12.842018 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a689b081-9855-4c37-a268-7bfa6c95ce35-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "a689b081-9855-4c37-a268-7bfa6c95ce35" (UID: "a689b081-9855-4c37-a268-7bfa6c95ce35"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 12:52:12.941118 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:12.941072 2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a689b081-9855-4c37-a268-7bfa6c95ce35-openshift-service-ca-bundle\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:52:12.941118 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:12.941113 2582 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a689b081-9855-4c37-a268-7bfa6c95ce35-proxy-tls\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:52:13.360019 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:13.359931 2582 generic.go:356] "Generic (PLEG): container finished" podID="a689b081-9855-4c37-a268-7bfa6c95ce35" containerID="4ad1fc2afd0165a3b1dbbc7cfe2eb3ac3c64ce577cbccb4f15dbdbc8d4c9157b" exitCode=0 Jul 02 12:52:13.360019 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:13.359989 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-75b89-6449db88c5-qt9lc" Jul 02 12:52:13.360435 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:13.360021 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-75b89-6449db88c5-qt9lc" event={"ID":"a689b081-9855-4c37-a268-7bfa6c95ce35","Type":"ContainerDied","Data":"4ad1fc2afd0165a3b1dbbc7cfe2eb3ac3c64ce577cbccb4f15dbdbc8d4c9157b"} Jul 02 12:52:13.360435 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:13.360104 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-75b89-6449db88c5-qt9lc" event={"ID":"a689b081-9855-4c37-a268-7bfa6c95ce35","Type":"ContainerDied","Data":"1177940feeca265b674529071156a903d910e1e815d12bbff092e1a55c738cca"} Jul 02 12:52:13.360435 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:13.360131 2582 scope.go:117] "RemoveContainer" containerID="4ad1fc2afd0165a3b1dbbc7cfe2eb3ac3c64ce577cbccb4f15dbdbc8d4c9157b" Jul 02 12:52:13.371293 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:13.371266 2582 scope.go:117] "RemoveContainer" containerID="4ad1fc2afd0165a3b1dbbc7cfe2eb3ac3c64ce577cbccb4f15dbdbc8d4c9157b" Jul 02 12:52:13.371740 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:52:13.371712 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ad1fc2afd0165a3b1dbbc7cfe2eb3ac3c64ce577cbccb4f15dbdbc8d4c9157b\": container with ID starting with 4ad1fc2afd0165a3b1dbbc7cfe2eb3ac3c64ce577cbccb4f15dbdbc8d4c9157b not found: ID does not exist" containerID="4ad1fc2afd0165a3b1dbbc7cfe2eb3ac3c64ce577cbccb4f15dbdbc8d4c9157b" Jul 02 12:52:13.371853 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:13.371753 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ad1fc2afd0165a3b1dbbc7cfe2eb3ac3c64ce577cbccb4f15dbdbc8d4c9157b"} err="failed to get container status \"4ad1fc2afd0165a3b1dbbc7cfe2eb3ac3c64ce577cbccb4f15dbdbc8d4c9157b\": rpc error: code = NotFound desc = could not find container \"4ad1fc2afd0165a3b1dbbc7cfe2eb3ac3c64ce577cbccb4f15dbdbc8d4c9157b\": container with ID starting with 4ad1fc2afd0165a3b1dbbc7cfe2eb3ac3c64ce577cbccb4f15dbdbc8d4c9157b not found: ID does not exist" Jul 02 12:52:13.381042 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:13.381014 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-75b89-6449db88c5-qt9lc"] Jul 02 12:52:13.386746 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:13.386725 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-75b89-6449db88c5-qt9lc"] Jul 02 12:52:14.574930 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:14.574887 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a689b081-9855-4c37-a268-7bfa6c95ce35" path="/var/lib/kubelet/pods/a689b081-9855-4c37-a268-7bfa6c95ce35/volumes" Jul 02 12:52:22.689412 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:22.689376 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd"] Jul 02 12:52:22.689845 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:22.689682 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd" podUID="eda568ff-555c-4dec-b550-7b68621524b4" containerName="kserve-container" containerID="cri-o://95d309578158d5aefde01fa2ebd8a1d1a515e7b0850e4a11219089bd482c6202" gracePeriod=30 Jul 02 12:52:22.689845 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:22.689736 2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd" podUID="eda568ff-555c-4dec-b550-7b68621524b4" containerName="kube-rbac-proxy" containerID="cri-o://e1976e194f58e147f13e76c4efa43d6148649c1849ac9c481211f1a91ff7fd9e" gracePeriod=30 Jul 02 12:52:22.906282 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:22.906235 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd" podUID="eda568ff-555c-4dec-b550-7b68621524b4" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.36:8643/healthz\": dial tcp 10.132.0.36:8643: connect: connection refused" Jul 02 12:52:23.416476 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:23.416441 2582 generic.go:356] "Generic (PLEG): container finished" podID="eda568ff-555c-4dec-b550-7b68621524b4" containerID="e1976e194f58e147f13e76c4efa43d6148649c1849ac9c481211f1a91ff7fd9e" exitCode=2 Jul 02 12:52:23.416681 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:23.416514 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd" event={"ID":"eda568ff-555c-4dec-b550-7b68621524b4","Type":"ContainerDied","Data":"e1976e194f58e147f13e76c4efa43d6148649c1849ac9c481211f1a91ff7fd9e"} Jul 02 12:52:27.345133 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:27.345112 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd" Jul 02 12:52:27.436665 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:27.436615 2582 generic.go:356] "Generic (PLEG): container finished" podID="eda568ff-555c-4dec-b550-7b68621524b4" containerID="95d309578158d5aefde01fa2ebd8a1d1a515e7b0850e4a11219089bd482c6202" exitCode=0 Jul 02 12:52:27.436861 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:27.436684 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd" event={"ID":"eda568ff-555c-4dec-b550-7b68621524b4","Type":"ContainerDied","Data":"95d309578158d5aefde01fa2ebd8a1d1a515e7b0850e4a11219089bd482c6202"} Jul 02 12:52:27.436861 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:27.436704 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd" Jul 02 12:52:27.436861 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:27.436793 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd" event={"ID":"eda568ff-555c-4dec-b550-7b68621524b4","Type":"ContainerDied","Data":"fc39e4e6cf1476abc51642c1c2f5377ba03ebb5be3f59d58df507c1813039344"} Jul 02 12:52:27.436861 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:27.436836 2582 scope.go:117] "RemoveContainer" containerID="e1976e194f58e147f13e76c4efa43d6148649c1849ac9c481211f1a91ff7fd9e" Jul 02 12:52:27.444872 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:27.444855 2582 scope.go:117] "RemoveContainer" containerID="95d309578158d5aefde01fa2ebd8a1d1a515e7b0850e4a11219089bd482c6202" Jul 02 12:52:27.452327 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:27.452309 2582 scope.go:117] "RemoveContainer" containerID="4e6fb8554f029be9bc8f6cf8ffe61edc781df5b2b7b8970cf1050a469eb69fb7" Jul 02 12:52:27.459686 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:27.459671 2582 scope.go:117] "RemoveContainer" containerID="e1976e194f58e147f13e76c4efa43d6148649c1849ac9c481211f1a91ff7fd9e" Jul 02 12:52:27.459914 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:52:27.459897 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1976e194f58e147f13e76c4efa43d6148649c1849ac9c481211f1a91ff7fd9e\": container with ID starting with e1976e194f58e147f13e76c4efa43d6148649c1849ac9c481211f1a91ff7fd9e not found: ID does not exist" containerID="e1976e194f58e147f13e76c4efa43d6148649c1849ac9c481211f1a91ff7fd9e" Jul 02 12:52:27.459966 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:27.459923 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1976e194f58e147f13e76c4efa43d6148649c1849ac9c481211f1a91ff7fd9e"} err="failed to get container status \"e1976e194f58e147f13e76c4efa43d6148649c1849ac9c481211f1a91ff7fd9e\": rpc error: code = NotFound desc = could not find container \"e1976e194f58e147f13e76c4efa43d6148649c1849ac9c481211f1a91ff7fd9e\": container with ID starting with e1976e194f58e147f13e76c4efa43d6148649c1849ac9c481211f1a91ff7fd9e not found: ID does not exist" Jul 02 12:52:27.459966 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:27.459939 2582 scope.go:117] "RemoveContainer" containerID="95d309578158d5aefde01fa2ebd8a1d1a515e7b0850e4a11219089bd482c6202" Jul 02 12:52:27.460150 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:52:27.460136 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95d309578158d5aefde01fa2ebd8a1d1a515e7b0850e4a11219089bd482c6202\": container with ID starting with 95d309578158d5aefde01fa2ebd8a1d1a515e7b0850e4a11219089bd482c6202 not found: ID does not exist" containerID="95d309578158d5aefde01fa2ebd8a1d1a515e7b0850e4a11219089bd482c6202" Jul 02 12:52:27.460186 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:27.460156 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95d309578158d5aefde01fa2ebd8a1d1a515e7b0850e4a11219089bd482c6202"} err="failed to get container status \"95d309578158d5aefde01fa2ebd8a1d1a515e7b0850e4a11219089bd482c6202\": rpc error: code = NotFound desc = could not find container \"95d309578158d5aefde01fa2ebd8a1d1a515e7b0850e4a11219089bd482c6202\": container with ID starting with 95d309578158d5aefde01fa2ebd8a1d1a515e7b0850e4a11219089bd482c6202 not found: ID does not exist" Jul 02 12:52:27.460186 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:27.460168 2582 scope.go:117] "RemoveContainer" containerID="4e6fb8554f029be9bc8f6cf8ffe61edc781df5b2b7b8970cf1050a469eb69fb7" Jul 02 12:52:27.460385 ip-10-0-140-7 kubenswrapper[2582]: E0702 12:52:27.460370 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e6fb8554f029be9bc8f6cf8ffe61edc781df5b2b7b8970cf1050a469eb69fb7\": container with ID starting with 4e6fb8554f029be9bc8f6cf8ffe61edc781df5b2b7b8970cf1050a469eb69fb7 not found: ID does not exist" containerID="4e6fb8554f029be9bc8f6cf8ffe61edc781df5b2b7b8970cf1050a469eb69fb7" Jul 02 12:52:27.460426 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:27.460388 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e6fb8554f029be9bc8f6cf8ffe61edc781df5b2b7b8970cf1050a469eb69fb7"} err="failed to get container status \"4e6fb8554f029be9bc8f6cf8ffe61edc781df5b2b7b8970cf1050a469eb69fb7\": rpc error: code = NotFound desc = could not find container \"4e6fb8554f029be9bc8f6cf8ffe61edc781df5b2b7b8970cf1050a469eb69fb7\": container with ID starting with 4e6fb8554f029be9bc8f6cf8ffe61edc781df5b2b7b8970cf1050a469eb69fb7 not found: ID does not exist" Jul 02 12:52:27.474493 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:27.474474 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/eda568ff-555c-4dec-b550-7b68621524b4-proxy-tls\") pod \"eda568ff-555c-4dec-b550-7b68621524b4\" (UID: \"eda568ff-555c-4dec-b550-7b68621524b4\") " Jul 02 12:52:27.474569 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:27.474527 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/eda568ff-555c-4dec-b550-7b68621524b4-kserve-provision-location\") pod \"eda568ff-555c-4dec-b550-7b68621524b4\" (UID: \"eda568ff-555c-4dec-b550-7b68621524b4\") " Jul 02 12:52:27.474609 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:27.474565 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xxgj\" (UniqueName: \"kubernetes.io/projected/eda568ff-555c-4dec-b550-7b68621524b4-kube-api-access-6xxgj\") pod \"eda568ff-555c-4dec-b550-7b68621524b4\" (UID: \"eda568ff-555c-4dec-b550-7b68621524b4\") " Jul 02 12:52:27.474672 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:27.474623 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/eda568ff-555c-4dec-b550-7b68621524b4-cabundle-cert\") pod \"eda568ff-555c-4dec-b550-7b68621524b4\" (UID: \"eda568ff-555c-4dec-b550-7b68621524b4\") " Jul 02 12:52:27.474828 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:27.474807 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/eda568ff-555c-4dec-b550-7b68621524b4-kube-rbac-proxy-sar-config\") pod \"eda568ff-555c-4dec-b550-7b68621524b4\" (UID: \"eda568ff-555c-4dec-b550-7b68621524b4\") " Jul 02 12:52:27.474971 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:27.474935 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eda568ff-555c-4dec-b550-7b68621524b4-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "eda568ff-555c-4dec-b550-7b68621524b4" (UID: "eda568ff-555c-4dec-b550-7b68621524b4"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 12:52:27.474971 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:27.474950 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eda568ff-555c-4dec-b550-7b68621524b4-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "eda568ff-555c-4dec-b550-7b68621524b4" (UID: "eda568ff-555c-4dec-b550-7b68621524b4"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 12:52:27.475154 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:27.475134 2582 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/eda568ff-555c-4dec-b550-7b68621524b4-kserve-provision-location\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:52:27.475272 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:27.475160 2582 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/eda568ff-555c-4dec-b550-7b68621524b4-cabundle-cert\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:52:27.475272 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:27.475133 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eda568ff-555c-4dec-b550-7b68621524b4-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "eda568ff-555c-4dec-b550-7b68621524b4" (UID: "eda568ff-555c-4dec-b550-7b68621524b4"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 12:52:27.476562 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:27.476528 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eda568ff-555c-4dec-b550-7b68621524b4-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "eda568ff-555c-4dec-b550-7b68621524b4" (UID: "eda568ff-555c-4dec-b550-7b68621524b4"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 12:52:27.476637 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:27.476621 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eda568ff-555c-4dec-b550-7b68621524b4-kube-api-access-6xxgj" (OuterVolumeSpecName: "kube-api-access-6xxgj") pod "eda568ff-555c-4dec-b550-7b68621524b4" (UID: "eda568ff-555c-4dec-b550-7b68621524b4"). InnerVolumeSpecName "kube-api-access-6xxgj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 12:52:27.576337 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:27.576303 2582 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/eda568ff-555c-4dec-b550-7b68621524b4-kube-rbac-proxy-sar-config\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:52:27.576337 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:27.576331 2582 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/eda568ff-555c-4dec-b550-7b68621524b4-proxy-tls\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:52:27.576337 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:27.576340 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xxgj\" (UniqueName: \"kubernetes.io/projected/eda568ff-555c-4dec-b550-7b68621524b4-kube-api-access-6xxgj\") on node \"ip-10-0-140-7.ec2.internal\" DevicePath \"\"" Jul 02 12:52:27.760499 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:27.760471 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd"] Jul 02 12:52:27.764728 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:27.764703 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6774b6c5fc-9h4kd"] Jul 02 12:52:28.575022 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:52:28.574990 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eda568ff-555c-4dec-b550-7b68621524b4" path="/var/lib/kubelet/pods/eda568ff-555c-4dec-b550-7b68621524b4/volumes" Jul 02 12:53:38.567493 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:53:38.567412 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-sqd4q_95b6074d-8908-400e-85c7-c2d989e4b2d3/console-operator/1.log" Jul 02 12:53:38.568286 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:53:38.568265 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-sqd4q_95b6074d-8908-400e-85c7-c2d989e4b2d3/console-operator/1.log" Jul 02 12:53:38.571187 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:53:38.571166 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfrv8_45891c6f-888b-490a-907f-1f58e3947b8a/ovn-acl-logging/0.log" Jul 02 12:53:38.576219 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:53:38.576190 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfrv8_45891c6f-888b-490a-907f-1f58e3947b8a/ovn-acl-logging/0.log" Jul 02 12:58:38.606516 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:58:38.606487 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-sqd4q_95b6074d-8908-400e-85c7-c2d989e4b2d3/console-operator/1.log" Jul 02 12:58:38.608514 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:58:38.608492 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-sqd4q_95b6074d-8908-400e-85c7-c2d989e4b2d3/console-operator/1.log" Jul 02 12:58:38.609540 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:58:38.609522 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfrv8_45891c6f-888b-490a-907f-1f58e3947b8a/ovn-acl-logging/0.log" Jul 02 12:58:38.611196 ip-10-0-140-7 kubenswrapper[2582]: I0702 12:58:38.611179 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfrv8_45891c6f-888b-490a-907f-1f58e3947b8a/ovn-acl-logging/0.log" Jul 02 13:03:38.635988 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:03:38.635950 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-sqd4q_95b6074d-8908-400e-85c7-c2d989e4b2d3/console-operator/1.log" Jul 02 13:03:38.638597 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:03:38.638575 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfrv8_45891c6f-888b-490a-907f-1f58e3947b8a/ovn-acl-logging/0.log" Jul 02 13:03:38.639243 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:03:38.639225 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-sqd4q_95b6074d-8908-400e-85c7-c2d989e4b2d3/console-operator/1.log" Jul 02 13:03:38.641854 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:03:38.641834 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfrv8_45891c6f-888b-490a-907f-1f58e3947b8a/ovn-acl-logging/0.log" Jul 02 13:08:38.664861 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:08:38.664822 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-sqd4q_95b6074d-8908-400e-85c7-c2d989e4b2d3/console-operator/1.log" Jul 02 13:08:38.667701 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:08:38.667680 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfrv8_45891c6f-888b-490a-907f-1f58e3947b8a/ovn-acl-logging/0.log" Jul 02 13:08:38.670008 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:08:38.669990 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-sqd4q_95b6074d-8908-400e-85c7-c2d989e4b2d3/console-operator/1.log" Jul 02 13:08:38.672737 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:08:38.672717 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfrv8_45891c6f-888b-490a-907f-1f58e3947b8a/ovn-acl-logging/0.log" Jul 02 13:13:38.700758 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:13:38.700731 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-sqd4q_95b6074d-8908-400e-85c7-c2d989e4b2d3/console-operator/1.log" Jul 02 13:13:38.703605 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:13:38.703578 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfrv8_45891c6f-888b-490a-907f-1f58e3947b8a/ovn-acl-logging/0.log" Jul 02 13:13:38.705979 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:13:38.705955 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-sqd4q_95b6074d-8908-400e-85c7-c2d989e4b2d3/console-operator/1.log" Jul 02 13:13:38.708638 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:13:38.708616 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfrv8_45891c6f-888b-490a-907f-1f58e3947b8a/ovn-acl-logging/0.log" Jul 02 13:18:38.728899 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:18:38.728869 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-sqd4q_95b6074d-8908-400e-85c7-c2d989e4b2d3/console-operator/1.log" Jul 02 13:18:38.731587 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:18:38.731570 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfrv8_45891c6f-888b-490a-907f-1f58e3947b8a/ovn-acl-logging/0.log" Jul 02 13:18:38.736535 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:18:38.736505 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-sqd4q_95b6074d-8908-400e-85c7-c2d989e4b2d3/console-operator/1.log" Jul 02 13:18:38.739612 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:18:38.739594 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfrv8_45891c6f-888b-490a-907f-1f58e3947b8a/ovn-acl-logging/0.log" Jul 02 13:23:38.758442 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:23:38.758337 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-sqd4q_95b6074d-8908-400e-85c7-c2d989e4b2d3/console-operator/1.log" Jul 02 13:23:38.762576 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:23:38.761100 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfrv8_45891c6f-888b-490a-907f-1f58e3947b8a/ovn-acl-logging/0.log" Jul 02 13:23:38.767361 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:23:38.767342 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-sqd4q_95b6074d-8908-400e-85c7-c2d989e4b2d3/console-operator/1.log" Jul 02 13:23:38.769929 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:23:38.769915 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfrv8_45891c6f-888b-490a-907f-1f58e3947b8a/ovn-acl-logging/0.log" Jul 02 13:28:38.788938 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:28:38.788829 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-sqd4q_95b6074d-8908-400e-85c7-c2d989e4b2d3/console-operator/1.log" Jul 02 13:28:38.792800 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:28:38.791752 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfrv8_45891c6f-888b-490a-907f-1f58e3947b8a/ovn-acl-logging/0.log" Jul 02 13:28:38.798525 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:28:38.798506 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-sqd4q_95b6074d-8908-400e-85c7-c2d989e4b2d3/console-operator/1.log" Jul 02 13:28:38.801079 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:28:38.801061 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfrv8_45891c6f-888b-490a-907f-1f58e3947b8a/ovn-acl-logging/0.log" Jul 02 13:30:24.604201 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:24.604166 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-b7x9v_c7bdeed2-7b53-450b-a2e9-e3ae689e9c85/global-pull-secret-syncer/0.log" Jul 02 13:30:24.805553 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:24.805521 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-wsp6w_e3c36384-fc8b-4a2e-905a-bef30b2be7c6/konnectivity-agent/0.log" Jul 02 13:30:24.881636 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:24.881551 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-7.ec2.internal_bd91ebf43e810155cc24f7e478ff9f41/haproxy/0.log" Jul 02 13:30:28.859009 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:28.858985 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_870c5db4-143e-4020-b8fa-8117b8ebce9a/alertmanager/0.log" Jul 02 13:30:28.885936 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:28.885915 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_870c5db4-143e-4020-b8fa-8117b8ebce9a/config-reloader/0.log" Jul 02 13:30:28.923664 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:28.923614 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_870c5db4-143e-4020-b8fa-8117b8ebce9a/kube-rbac-proxy-web/0.log" Jul 02 13:30:28.949234 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:28.949203 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_870c5db4-143e-4020-b8fa-8117b8ebce9a/kube-rbac-proxy/0.log" Jul 02 13:30:28.972022 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:28.971982 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_870c5db4-143e-4020-b8fa-8117b8ebce9a/kube-rbac-proxy-metric/0.log" Jul 02 13:30:28.998336 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:28.998313 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_870c5db4-143e-4020-b8fa-8117b8ebce9a/prom-label-proxy/0.log" Jul 02 13:30:29.023756 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:29.023725 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_870c5db4-143e-4020-b8fa-8117b8ebce9a/init-config-reloader/0.log" Jul 02 13:30:29.084557 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:29.084524 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-vhmpk_4f639cf9-152c-4a8c-be48-309c48631998/cluster-monitoring-operator/0.log" Jul 02 13:30:29.113849 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:29.113767 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-t2dr7_0d03d9c6-9e8f-4f1c-9460-9b96184b8ca5/kube-state-metrics/0.log" Jul 02 13:30:29.135901 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:29.135877 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-t2dr7_0d03d9c6-9e8f-4f1c-9460-9b96184b8ca5/kube-rbac-proxy-main/0.log" Jul 02 13:30:29.161156 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:29.161127 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-t2dr7_0d03d9c6-9e8f-4f1c-9460-9b96184b8ca5/kube-rbac-proxy-self/0.log" Jul 02 13:30:29.205007 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:29.204978 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-69656f596c-zwchc_50683ab3-1453-4276-8d7a-3b3a7499a918/metrics-server/0.log" Jul 02 13:30:29.437477 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:29.437452 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tplzj_f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a/node-exporter/0.log" Jul 02 13:30:29.470882 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:29.470846 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tplzj_f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a/kube-rbac-proxy/0.log" Jul 02 13:30:29.496582 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:29.496558 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tplzj_f88cb30b-7df4-4d4f-8b9a-ee754bad0c8a/init-textfile/0.log" Jul 02 13:30:29.890385 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:29.890300 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-696b9f5dcf-gh4xn_b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9/telemeter-client/0.log" Jul 02 13:30:29.911024 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:29.910992 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-696b9f5dcf-gh4xn_b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9/reload/0.log" Jul 02 13:30:29.931366 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:29.931340 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-696b9f5dcf-gh4xn_b2b1a084-f4ec-4aa5-ba50-0cb7ae34d0c9/kube-rbac-proxy/0.log" Jul 02 13:30:31.426198 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:31.426170 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cdb5968b9-slfq4_1a5ab597-6c02-4d90-9656-a10f19699fbb/networking-console-plugin/0.log" Jul 02 13:30:31.932776 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:31.932729 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-sqd4q_95b6074d-8908-400e-85c7-c2d989e4b2d3/console-operator/1.log" Jul 02 13:30:31.940987 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:31.940966 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-sqd4q_95b6074d-8908-400e-85c7-c2d989e4b2d3/console-operator/2.log" Jul 02 13:30:32.357994 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:32.357909 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-748f6586df-djc9c_1da7e513-5148-4a89-b453-87be9028b0cc/console/0.log" Jul 02 13:30:32.960636 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:32.960577 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-69d9f679db-5djd8_21ca6365-0380-4964-ad2c-6760f70ade05/volume-data-source-validator/0.log" Jul 02 13:30:33.107362 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:33.107328 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-74fjg/perf-node-gather-daemonset-x4vmf"] Jul 02 13:30:33.107703 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:33.107690 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a689b081-9855-4c37-a268-7bfa6c95ce35" containerName="switch-graph-75b89" Jul 02 13:30:33.107703 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:33.107704 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a689b081-9855-4c37-a268-7bfa6c95ce35" containerName="switch-graph-75b89" Jul 02 13:30:33.107803 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:33.107722 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eda568ff-555c-4dec-b550-7b68621524b4" containerName="kserve-container" Jul 02 13:30:33.107803 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:33.107728 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="eda568ff-555c-4dec-b550-7b68621524b4" containerName="kserve-container" Jul 02 13:30:33.107803 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:33.107741 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eda568ff-555c-4dec-b550-7b68621524b4" containerName="kube-rbac-proxy" Jul 02 13:30:33.107803 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:33.107747 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="eda568ff-555c-4dec-b550-7b68621524b4" containerName="kube-rbac-proxy" Jul 02 13:30:33.107803 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:33.107759 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eda568ff-555c-4dec-b550-7b68621524b4" containerName="storage-initializer" Jul 02 13:30:33.107803 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:33.107766 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="eda568ff-555c-4dec-b550-7b68621524b4" containerName="storage-initializer" Jul 02 13:30:33.108070 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:33.107834 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="eda568ff-555c-4dec-b550-7b68621524b4" containerName="kube-rbac-proxy" Jul 02 13:30:33.108070 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:33.107844 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="eda568ff-555c-4dec-b550-7b68621524b4" containerName="kserve-container" Jul 02 13:30:33.108070 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:33.107851 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a689b081-9855-4c37-a268-7bfa6c95ce35" containerName="switch-graph-75b89" Jul 02 13:30:33.110906 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:33.110886 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-74fjg/perf-node-gather-daemonset-x4vmf" Jul 02 13:30:33.113137 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:33.113113 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-74fjg\"/\"default-dockercfg-djlrx\"" Jul 02 13:30:33.116677 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:33.116636 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-74fjg\"/\"kube-root-ca.crt\"" Jul 02 13:30:33.116989 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:33.116694 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-74fjg\"/\"openshift-service-ca.crt\"" Jul 02 13:30:33.117988 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:33.117570 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-74fjg/perf-node-gather-daemonset-x4vmf"] Jul 02 13:30:33.187250 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:33.187218 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6819494b-006a-44ef-94f3-42ae3a965daa-proc\") pod \"perf-node-gather-daemonset-x4vmf\" (UID: \"6819494b-006a-44ef-94f3-42ae3a965daa\") " pod="openshift-must-gather-74fjg/perf-node-gather-daemonset-x4vmf" Jul 02 13:30:33.187250 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:33.187261 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rn5r\" (UniqueName: \"kubernetes.io/projected/6819494b-006a-44ef-94f3-42ae3a965daa-kube-api-access-6rn5r\") pod \"perf-node-gather-daemonset-x4vmf\" (UID: \"6819494b-006a-44ef-94f3-42ae3a965daa\") " pod="openshift-must-gather-74fjg/perf-node-gather-daemonset-x4vmf" Jul 02 13:30:33.187532 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:33.187386 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6819494b-006a-44ef-94f3-42ae3a965daa-podres\") pod \"perf-node-gather-daemonset-x4vmf\" (UID: \"6819494b-006a-44ef-94f3-42ae3a965daa\") " pod="openshift-must-gather-74fjg/perf-node-gather-daemonset-x4vmf" Jul 02 13:30:33.187532 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:33.187428 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6819494b-006a-44ef-94f3-42ae3a965daa-lib-modules\") pod \"perf-node-gather-daemonset-x4vmf\" (UID: \"6819494b-006a-44ef-94f3-42ae3a965daa\") " pod="openshift-must-gather-74fjg/perf-node-gather-daemonset-x4vmf" Jul 02 13:30:33.187532 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:33.187459 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6819494b-006a-44ef-94f3-42ae3a965daa-sys\") pod \"perf-node-gather-daemonset-x4vmf\" (UID: \"6819494b-006a-44ef-94f3-42ae3a965daa\") " pod="openshift-must-gather-74fjg/perf-node-gather-daemonset-x4vmf" Jul 02 13:30:33.288105 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:33.288000 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6819494b-006a-44ef-94f3-42ae3a965daa-proc\") pod \"perf-node-gather-daemonset-x4vmf\" (UID: \"6819494b-006a-44ef-94f3-42ae3a965daa\") " pod="openshift-must-gather-74fjg/perf-node-gather-daemonset-x4vmf" Jul 02 13:30:33.288105 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:33.288042 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rn5r\" (UniqueName: \"kubernetes.io/projected/6819494b-006a-44ef-94f3-42ae3a965daa-kube-api-access-6rn5r\") pod \"perf-node-gather-daemonset-x4vmf\" (UID: \"6819494b-006a-44ef-94f3-42ae3a965daa\") " pod="openshift-must-gather-74fjg/perf-node-gather-daemonset-x4vmf" Jul 02 13:30:33.288353 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:33.288132 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6819494b-006a-44ef-94f3-42ae3a965daa-podres\") pod \"perf-node-gather-daemonset-x4vmf\" (UID: \"6819494b-006a-44ef-94f3-42ae3a965daa\") " pod="openshift-must-gather-74fjg/perf-node-gather-daemonset-x4vmf" Jul 02 13:30:33.288353 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:33.288149 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6819494b-006a-44ef-94f3-42ae3a965daa-proc\") pod \"perf-node-gather-daemonset-x4vmf\" (UID: \"6819494b-006a-44ef-94f3-42ae3a965daa\") " pod="openshift-must-gather-74fjg/perf-node-gather-daemonset-x4vmf" Jul 02 13:30:33.288353 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:33.288172 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6819494b-006a-44ef-94f3-42ae3a965daa-lib-modules\") pod \"perf-node-gather-daemonset-x4vmf\" (UID: \"6819494b-006a-44ef-94f3-42ae3a965daa\") " pod="openshift-must-gather-74fjg/perf-node-gather-daemonset-x4vmf" Jul 02 13:30:33.288353 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:33.288229 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6819494b-006a-44ef-94f3-42ae3a965daa-sys\") pod \"perf-node-gather-daemonset-x4vmf\" (UID: \"6819494b-006a-44ef-94f3-42ae3a965daa\") " pod="openshift-must-gather-74fjg/perf-node-gather-daemonset-x4vmf" Jul 02 13:30:33.288353 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:33.288309 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6819494b-006a-44ef-94f3-42ae3a965daa-podres\") pod \"perf-node-gather-daemonset-x4vmf\" (UID: \"6819494b-006a-44ef-94f3-42ae3a965daa\") " pod="openshift-must-gather-74fjg/perf-node-gather-daemonset-x4vmf" Jul 02 13:30:33.288353 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:33.288317 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6819494b-006a-44ef-94f3-42ae3a965daa-sys\") pod \"perf-node-gather-daemonset-x4vmf\" (UID: \"6819494b-006a-44ef-94f3-42ae3a965daa\") " pod="openshift-must-gather-74fjg/perf-node-gather-daemonset-x4vmf" Jul 02 13:30:33.288353 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:33.288310 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6819494b-006a-44ef-94f3-42ae3a965daa-lib-modules\") pod \"perf-node-gather-daemonset-x4vmf\" (UID: \"6819494b-006a-44ef-94f3-42ae3a965daa\") " pod="openshift-must-gather-74fjg/perf-node-gather-daemonset-x4vmf" Jul 02 13:30:33.295967 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:33.295938 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rn5r\" (UniqueName: \"kubernetes.io/projected/6819494b-006a-44ef-94f3-42ae3a965daa-kube-api-access-6rn5r\") pod \"perf-node-gather-daemonset-x4vmf\" (UID: \"6819494b-006a-44ef-94f3-42ae3a965daa\") " pod="openshift-must-gather-74fjg/perf-node-gather-daemonset-x4vmf" Jul 02 13:30:33.421820 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:33.421784 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-74fjg/perf-node-gather-daemonset-x4vmf" Jul 02 13:30:33.555880 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:33.555804 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-74fjg/perf-node-gather-daemonset-x4vmf"] Jul 02 13:30:33.559940 ip-10-0-140-7 kubenswrapper[2582]: W0702 13:30:33.559908 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6819494b_006a_44ef_94f3_42ae3a965daa.slice/crio-d188b09927592976d79760979849ba95be885a9b9d6596851c3e7ab0a9ac7a04 WatchSource:0}: Error finding container d188b09927592976d79760979849ba95be885a9b9d6596851c3e7ab0a9ac7a04: Status 404 returned error can't find the container with id d188b09927592976d79760979849ba95be885a9b9d6596851c3e7ab0a9ac7a04 Jul 02 13:30:33.952091 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:33.952061 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pv76q_436af359-0eff-4feb-a272-a74fedb5a0a1/dns/0.log" Jul 02 13:30:33.957095 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:33.957071 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-74fjg/perf-node-gather-daemonset-x4vmf" event={"ID":"6819494b-006a-44ef-94f3-42ae3a965daa","Type":"ContainerStarted","Data":"d1fa07251909b61825e9dfcecd70a2957a3d7379cb2d1350d533e651c5ac6daf"} Jul 02 13:30:33.957238 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:33.957157 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-74fjg/perf-node-gather-daemonset-x4vmf" event={"ID":"6819494b-006a-44ef-94f3-42ae3a965daa","Type":"ContainerStarted","Data":"d188b09927592976d79760979849ba95be885a9b9d6596851c3e7ab0a9ac7a04"} Jul 02 13:30:33.957238 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:33.957226 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-74fjg/perf-node-gather-daemonset-x4vmf" Jul 02 13:30:33.971767 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:33.971718 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-74fjg/perf-node-gather-daemonset-x4vmf" podStartSLOduration=0.971702839 podStartE2EDuration="971.702839ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:30:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:30:33.971050799 +0000 UTC m=+3115.871314452" watchObservedRunningTime="2026-07-02 13:30:33.971702839 +0000 UTC m=+3115.871966490" Jul 02 13:30:33.973018 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:33.972997 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pv76q_436af359-0eff-4feb-a272-a74fedb5a0a1/kube-rbac-proxy/0.log" Jul 02 13:30:34.089906 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:34.089877 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hbp5q_f3416a26-326a-4325-b9c1-dcd3d38c27c4/dns-node-resolver/0.log" Jul 02 13:30:34.624890 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:34.624864 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-r4xmq_bd5bf081-bf94-44f1-99a9-9565fc764886/node-ca/0.log" Jul 02 13:30:35.586239 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:35.586213 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54fcb7b75-zz9dh_e0e3103b-711d-4a9d-b5cc-0a911b218f12/router/0.log" Jul 02 13:30:35.912283 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:35.912202 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6hfbr_4c33d294-3dc2-4951-8a0e-59212bfc2ca6/serve-healthcheck-canary/0.log" Jul 02 13:30:36.292572 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:36.292482 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-fv6k7_a26b3699-7f1b-41b6-8451-0fe9c95aa096/insights-operator/0.log" Jul 02 13:30:36.293161 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:36.293143 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-fv6k7_a26b3699-7f1b-41b6-8451-0fe9c95aa096/insights-operator/1.log" Jul 02 13:30:36.377842 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:36.377813 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fnj9w_88cd4454-9208-4cda-bb1f-c45f44c0d107/kube-rbac-proxy/0.log" Jul 02 13:30:36.395555 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:36.395534 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fnj9w_88cd4454-9208-4cda-bb1f-c45f44c0d107/exporter/0.log" Jul 02 13:30:36.415361 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:36.415328 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fnj9w_88cd4454-9208-4cda-bb1f-c45f44c0d107/extractor/0.log" Jul 02 13:30:38.606856 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:38.606827 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-67d95fdc48-wlx4q_19cf590e-d443-45a4-99e7-6fc7d0a98aae/manager/0.log" Jul 02 13:30:38.626259 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:38.626223 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-fd65d7d6-44hmj_a16f5d9f-f38d-451c-9b72-c3533b6ae0d1/server/0.log" Jul 02 13:30:38.784873 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:38.784842 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_odh-model-controller-84b54b7f97-sjw88_3d581ca6-8a62-4597-84ab-11c0d48a26e9/manager/0.log" Jul 02 13:30:39.971664 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:39.971619 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-74fjg/perf-node-gather-daemonset-x4vmf" Jul 02 13:30:43.070107 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:43.070068 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-2s7pm_a21ecc40-b3d7-452d-9341-1658114a945c/kube-storage-version-migrator-operator/0.log" Jul 02 13:30:43.072645 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:43.072622 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-2s7pm_a21ecc40-b3d7-452d-9341-1658114a945c/kube-storage-version-migrator-operator/1.log" Jul 02 13:30:44.128111 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:44.128035 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2kcwd_69dad1af-5279-40e3-9676-662e8392842f/kube-multus-additional-cni-plugins/0.log" Jul 02 13:30:44.155629 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:44.155602 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2kcwd_69dad1af-5279-40e3-9676-662e8392842f/egress-router-binary-copy/0.log" Jul 02 13:30:44.180648 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:44.180624 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2kcwd_69dad1af-5279-40e3-9676-662e8392842f/cni-plugins/0.log" Jul 02 13:30:44.211454 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:44.211430 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2kcwd_69dad1af-5279-40e3-9676-662e8392842f/bond-cni-plugin/0.log" Jul 02 13:30:44.233885 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:44.233860 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2kcwd_69dad1af-5279-40e3-9676-662e8392842f/routeoverride-cni/0.log" Jul 02 13:30:44.266193 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:44.266163 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2kcwd_69dad1af-5279-40e3-9676-662e8392842f/whereabouts-cni-bincopy/0.log" Jul 02 13:30:44.292725 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:44.292696 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2kcwd_69dad1af-5279-40e3-9676-662e8392842f/whereabouts-cni/0.log" Jul 02 13:30:44.721376 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:44.721351 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-vhrlk_4cfd72de-67d1-41ae-9946-a0c526b08910/kube-multus/0.log" Jul 02 13:30:44.742277 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:44.742245 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bxzt9_d3ed604e-9278-4403-b407-8f5aa8122793/network-metrics-daemon/0.log" Jul 02 13:30:44.757705 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:44.757675 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bxzt9_d3ed604e-9278-4403-b407-8f5aa8122793/kube-rbac-proxy/0.log" Jul 02 13:30:46.210965 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:46.210940 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfrv8_45891c6f-888b-490a-907f-1f58e3947b8a/ovn-controller/0.log" Jul 02 13:30:46.236101 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:46.236071 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfrv8_45891c6f-888b-490a-907f-1f58e3947b8a/ovn-acl-logging/0.log" Jul 02 13:30:46.236264 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:46.236197 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfrv8_45891c6f-888b-490a-907f-1f58e3947b8a/ovn-acl-logging/1.log" Jul 02 13:30:46.262351 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:46.262330 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfrv8_45891c6f-888b-490a-907f-1f58e3947b8a/kube-rbac-proxy-node/0.log" Jul 02 13:30:46.285510 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:46.285482 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfrv8_45891c6f-888b-490a-907f-1f58e3947b8a/kube-rbac-proxy-ovn-metrics/0.log" Jul 02 13:30:46.302854 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:46.302831 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfrv8_45891c6f-888b-490a-907f-1f58e3947b8a/northd/0.log" Jul 02 13:30:46.324385 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:46.324362 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfrv8_45891c6f-888b-490a-907f-1f58e3947b8a/nbdb/0.log" Jul 02 13:30:46.346796 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:46.346766 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfrv8_45891c6f-888b-490a-907f-1f58e3947b8a/sbdb/0.log" Jul 02 13:30:46.410553 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:46.410525 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfrv8_45891c6f-888b-490a-907f-1f58e3947b8a/ovnkube-controller/0.log" Jul 02 13:30:47.690174 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:47.690149 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-56499946bc-b5xqj_97692f4f-de73-44c7-a10e-c87b4163131f/check-endpoints/0.log" Jul 02 13:30:47.761752 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:47.761727 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-zxj89_b151e533-cc30-4cea-bfa8-7fc75567a995/network-check-target-container/0.log" Jul 02 13:30:48.696286 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:48.696253 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-rssjt_48562a93-2235-4d95-bada-b1639f40db42/iptables-alerter/0.log" Jul 02 13:30:49.378370 ip-10-0-140-7 kubenswrapper[2582]: I0702 13:30:49.378334 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-zpkl8_5314ba0b-ba05-4cf4-bffe-54e925b98467/tuned/0.log"